Local LLM with Ollama, LLAMA3 and LM Studio // Private AI Server

[@kenmurphy4259]

Thanks Brandon, nice review of what’s out there for local LLMs

[@SteheveRodriguez]

Its great idea, thanks Brandon. I will test on my homelab.

[@romayojr]

this is awesome and can’t wait to try it. is there a mobile app for open webui?

[@jjaard]

I suspect technically it can easily run via any browser

[@kderectorful]

I am accessing the openai server via a Mac, and my guess is that the netsh command is about your windows workstation you are accessing the server. Is there a similar command that would need to be run, or if I do this on my Linux server via Firefox, will I still have the same issue. I cannot seem to get the ollama3:latest installed for openweb. Any insight would be greatly appreciated as this was the most concise video I have seen on the topic.

[@mjes911]

How many concurrent users can this support for business cases?

[@trucpham9772]

How to run ollama3 in macos, i want public localhost to use nextchatgpt , can you share command this solution

[@fermatdad]

Thank you for the helpful tutorial.

[@LibyaAi]

Nobody explained how to install ollama and run it in properite way ، it should be step's ، is docker important to install before ollama? I tried to install ollama alone and it doesn't installed completely!! I don't know why

[@kironlau]

1. you should mention what is your os 2. read the official documentation 3. if you run on win, just download the exe/msi file, install with one click(and click yes...)

[@SyamsQbattar]

Is LMStudio better than Ollama?

[@camsand6109]

no, but its a good option

[@SyamsQbattar]

@@camsand6109 then, Ollama is better?

[@TheTricou]

so this "guide" is missing some key things like how to change the ip for wsl then how to run ollama like a service. even in his written guide is not telling on how to do this.

[@thiesenf]

GPT4ALL is another good locally running chat interface... it can run On both the CPU but also on the GPU using Vulkan...

[@nobody-P]

😮I'm gonna try this now

[@klovvin]

This would be better content if done by an AI

[@thiesenf]

Atleast we got the usually extremely boring stock videos as B rolls... *sigh*...