Running LLAMA-3 8B and 70B Model with ROCm on Windows feat. Radeon RX 6900XT GPU
Вставка
- Опубліковано 8 вер 2024
- Learn how to unleash the full potential of your Radeon RX 6900XT GPU on Windows by running the LLAMA-3 8B and 70B model with ROCm. Join us as we delve into the intricacies of GPU acceleration and explore the power of ROCm for deep learning tasks. Whether you're a seasoned developer or an enthusiast eager to optimize your machine learning workflow, this tutorial provides valuable insights and step-by-step guidance. Dive into the world of cutting-edge technology and elevate your AI projects today!
Works fine on 6750xt.
Hi from Turkey. Nice video
Thank you!!!
Big kiss for you my friend, you help me, im so great for found you
Hummm.. so when are you gong to upgrade to a Mi50?
:D May be never
Does anyone know of a way to make an RX 580 run with ROCm on Windows? Yes, it's old, but it would be better than using the processor to play with A.I. and there are plenty of RX580s out there.
same issue here
The 6650xt tells me that no compatible graphics card has been found :(
Koboldcpp rocm works, rx6600 over Here, 8BQ6 works perfect, 25t/s
Mine is RX 6600XT, does it work for it?
Hi, RX 6600xt is different architecture with Navi 1032. As I know, rocm supports Navi 1030 with is Rx 6800 and Rx 6900. I don’t have access for Rx 6600 but you can try it by yourself.
@@TechJotters24 I tried it with my rx 6700xt and it worked fine.
@@awesometm845great!!!
@@awesometm845 you installed hipsdk on a 6700xt?
@@awesometm845 bro i installed hip sdk on my 6700xt but amd rocm noit showing up on lm studio, it shows opencl
Does this work on a 7700XT?
yes. I would use the llama3 8b but in ollama for windows or linux.
@@pingvinmandwhy ollama instead of LM studio?
@@MX-op7nf because you can do so much more, you can load your own rag. You can use open web UI so it is 100% like chatGPT.
Think it will work on this beast of a system with 2 rx 6900 xt gpus?
ua-cam.com/users/shortsLvsGWDUH3HE?si=b66UUCF5gCE71Qk-