Four Ways to Check if Ollama is Using Your GPU or CPU

[@zandanshah]

Thanks, keep the good work going.

[@TigerTriangleTech]

Thanks, will do!

[@igoriane93]

In my specific case (7900XT) it tries to locate ROCm0, as Iam using windows my computer freezes.

[@TigerTriangleTech]

The AMD 7900 XT is supported by Ollama "out of the box". No need to use the modified version. But you might also want to make sure your OS and drivers are up to date.

[@vmeow9895]

why after a while, the response_token/s gradually decreases? i use rx 6600xt

[@TigerTriangleTech]

Hello and thanks for watching. I'm not sure, but in a chat situation, I would think it could be because it is storing previous prompts in memory in order to "remember" the previous conversations. How much it keeps could depend on the context window of the model. I have not tested this but that's my best guess. Someone else may have a better answer.

[@vmeow9895]

@@TigerTriangleTech Thanks for your reply to my question, Hope you can solve it later😁