Running Ollama on Any Older AMD GPU | Easy Setup for RX 5500 XT, 5700 XT & More!

[@ahmeditax1710]

i hope you live happy life. you and your family. youre a life saver man. i search everywhere and didnt find this

[@d_c_y_1]

I'm really glad that my guide helped you 😄 Stay tuned for more videos like this 😃

[@ballahalls.o7]

Thanks bro, it worked for me.

[@d_c_y_1]

I'm glad that it worked for you! Stay tuned by subscribing the channel!

[@idontneedname2529]

i got the rx5700 and it doesnt work i did the same stuff as you

[@d_c_y_1]

What's the os version? And what's the python version?

[@idontneedname2529]

@@d_c_y_1 os version, python version ? im using the newest windows 10 version and when i type python -V i get error, however when i do python only i can open the python compiler.

[@idontneedname2529]

@@d_c_y_1 im using the newest windows 10 version. When i do python -V i get something like install it on the microsoft store. However when i do python only the python compiler. i installed python and i get now python -V 3.13.1

[@unpatitoRU]

Followed the tutorial/repo and also didnt work... until i got it working by replacing the rocm dll which is like two parent folders from the tutorial given path "c:\user\\\\path", there is a ~400mb rocm file and the 'moded' version is like ~200Mb. Pretty weird trick but it worked for me. +: Rename the ~400Mb file as backup if something goes wrong

[@lklunchking1674]

do I need to still add the libraries if I am using RX 7900 xtx as I am getting an error when i try to run the model

[@d_c_y_1]

This shouldn't be an issue for your gpu. Have you installed ROCM package?

[@makaanchow]

我也用5700xt 帮了大忙

[@d_c_y_1]

I'm glad that it worked for you! Stay tuned by subscribing the channel! 我很高興它對你有用！請訂閱頻道，敬請關注！

[@aayushshah459]

didn't work for me, i am using gtx 1650 and windows operating system

[@d_c_y_1]

The tutorial is solely for AMD gpu. If you're using Nvidia, its pretty easy and you'll have to do nothing other than downloading pre made zip. github.com/AUTOMATIC1111/stable-diffusion-webui/wiki/Install-and-Run-on-NVidia-GPUs

[@unpatitoRU]

While it works on windows, it seems that Linux(open???) is a nightmare Now i feel in a simulation .-.

[@d_c_y_1]

I've got it working on linux too... Have you tried setting it up?

[@unpatitoRU]

@@d_c_y_1 Not at all, installed ollama and added the environment variables but got stuck at this point and still running on cpu i cann't find any useful post about 5700xt + ollama + linux, i appreciate any help 🙏🙏

[@EliteTalentAgencyEEU]

Didn't work

[@d_c_y_1]

What's your gpu? And os?

[@EliteTalentAgencyEEU]

@@d_c_y_1 Windows Rx5500 Xt I tried both methods

[@johncrisgonzales1164]

@@d_c_y_1 same im using windows and rx5700xt

[@d_c_y_1]

Mine is the same. Should work. What's the python version?

[@d_c_y_1]

Haven't tested on 5700 xt but should work. What is your python version?

[@honeybadger3756]

При установке rocm.gfx1031.for.hip.sdk.6.2.4.littlewu.s.logic.7z появляется ошибка. Я устанавливал на 6750 gre 12 gb. После команды run загружается полностью память видеокарты, но когда пишешь вопрос в консоль, то появляется эта ошибка: Error: POST predict: Post "127.0.0.1:54190/completion": read tcp 127.0.0.1:54199->127.0.0.1:54190: wsarecv: An existing connection was forcibly closed by the remote host. Попробовал остальные версии 1010-1011-1012, 1032, 1034-1035 на них ошибки нет, но видеокарта не загружается, только процессор.

[@d_c_y_1]

Sorry, can you please write in English?

[@honeybadger3756]

@@d_c_y_1 hello, When installing rocm.gfx1031.for.hip.sdk.6.2.4.littlewu.s.logic.7z, an error appears. I installed the drivers for 6750 gre 12 GB. After running ollama, the video card memory is fully loaded, but when you write a question in the console, this error appears: Error: POST predict: Post "127.0.0.1:54190/completion": read tcp 127.0.0.1:54199->127.0.0.1:54190: wsarecv: An existing connection was forcibly closed by the remote host. I tried other versions from your site: 1010-1011-1012, 1032, 1034-1035, there are no errors on them, but the video card does not load, only the processor.