How is ROCm support for RX 7700 XT? I'm thinking of buying it for Stable Diffusion and other similar projects, like RVC, etc.

[linuxtroubleshooting]

How is ROCm support for RX 7700 XT? I'm thinking of buying it for Stable Diffusion and other similar projects, like RVC, etc.

[ChuloIva]

Also interested in this, been searching everywhere couldn't find anything. Looking to run local LLMs

[james-banks]

It's not too bad, but you have to be prepared to use Linux and play around in the terminal to get things set up properly. Like the 7700, my 7800 XT isn't "officially" supported by ROCm but it works.

The other alternatives if you want to use windows include ONNX and DirectML, but personally I've been using ZLUDA (a CUDA translation layer that uses AMD's HIP SKD) on windows for the last week and it's been awesome. With SD1.5 at 512x512 on my RX 7800 XT I get about 8 it/s on SD.Next and closer to 20 it/s when using the command line version.

[yuuto-fur]

hey @james-banks can you link to something that explains more on how to make the 7700xt work with ROCm

[james-banks]

@Yuu-to-kun Sure, this guide on the AMD website should give you everything you need: https://rocm.docs.amd.com/projects/radeon/en/latest/docs/install/install-radeon.html

This gives guidance for the ROCm specific PyTorch version install: https://rocm.docs.amd.com/projects/radeon/en/latest/docs/install/install-pytorch.html

Only other note is that you need to update the environment variable export HSA_OVERRIDE_GFX_VERSION=11.0.0 to make it think you have a compatible (ie RX7900 XT) card. Then you can just install SD from GitHub and it should work.

There's a slightly old but still relevant full guide here, just update the numbers to the latest versions (i.e use the Pytorch install command given on the second link above instead, otherwise you'll install an old version): https://www.reddit.com/r/StableDiffusion/comments/10zfnlj/novice_guide_how_to_fully_setup_linux_to_run/

[ChuloIva]

I've found this

https://www.reddit.com/r/LocalLLaMA/comments/170tghx/guide_installing_rocmhip_for_llamacpp_on_linux/?rdt=38080&onetap_auto=true&one_tap=true

did a fresh install of Ubuntu 22.04.4LTS (was on 23.10)

and it worked for me. Didn't even had to do some workarounds that were mentioned, like the error for:
sudo apt install rocm-dev

[yuuto-fur]

Very much appreciated @james-banks, the export did the trick as well as the amd instructions for pytorch. Since i use arch i didn't have to install the amdgpu-install since we have an arch repository for that. For anyone else that happens on this comment, i use arch and have an 7700xt and all i had to do was follow the official instructions from the stable-diffusion-web-ui amd installation and instead of installing pytorch and pytorch vision from the repos mentioned just use the ones that amd officially provides. And before any installation make sure to do the export mentioned above.

[pereira-rafael]

Im already have one rx 7700xt but i havert sucess to use ROCm =/