Using Ollama to Run Local LLMs on the Steam Deck

[@DaveParr]

2:54 love the honesty of hitting the bug and keeping it in the video ❤

[@IanWootten]

Thanks Dave. Thought it was important to show that if you do go ahead and install stuff, it's going to potentially get wiped out with SteamOS updates.

[@MyFriendDev]

did you try if phi3:mini model runs faster? (as you show it seems run faster than my notebook) but did you check if it is running over gpu or cpu? (here on notebook it is running on cpu)

[@internetcarson]

I just read your article on running the brew package manager on the Deck!

[@CFedits62]

Cool

[@ystrem7446]

Does it run on CPU or GPU ? Thx

[@IanWootten]

Hi there, I mentioned toward the end, but yeah it's running on the CPU.

[@yuuleeyianmaiser2900]

@@IanWootten I've also experimented with it and unfortunately wasn't able to get it running on the GPU. If you're successful, I'd be very interested in the results.

[@jairsonk.7458]

@@yuuleeyianmaiser2900 Im doing this as well, and unfortunately as well ... ...

[@space7panda]

$ sudo steamos-readonly disable