Good finding, I didn't know this one, but I've been testing Open WebUI
@dllsmartphone32142 ай бұрын
nah bro. i stick with ollama and as UI open web ui, librechat, lobechat and others are so much better like this...
@g-nice_pimp2 ай бұрын
I have been using localai and up till know i have been able to connect my home assistant and nextcloud to my localai instance. The only thing i need to do is speed up the inference using my laptop gpu. Do you have any tips to speed up the inference ?