How to Run Local AI Models - in 5 minutes

[@danielhabibio]

This is the first tech tutorial I've ever seen that was recorded in the woods!

[@DiogoNeves]

@@danielhabibio thanks! The coming videos should also have an outdoor twist too 😉 hopefully gets more people in the flow and woods are just awesome. P.s. I promise I’m not building a bunker in the woods to hide from our AI overlords 😉

[@NickWinters]

Mine too!

[@DiogoNeves]

@@NickWinters thanks I appreciate the comment There’s another one coming, on Llamafiles (I’m feeling bad it’s taking so long but coming) and I’m also going to start doing Lives soon. Subscribe if you’re interested 😊 Have a great day

[@luciferovonnachtosphere]

Finally, I found a well-made, no-frills, guide to installing local LLMs!

[@DiogoNeves]

@@luciferovonnachtosphere thanks 🙏 I really appreciate

[@yorkie4k]

I've been using LM Studio as it just works. Super easy to build plugins with the server as well to get functionalities that aren't in the app.

[@DiogoNeves]

@@yorkie4k totally! I’m now also looking into Llamafiles and SQLite-vec. Both really cool too, but LM Studio is still the simplest and most accessible I know Do you use LM Studio just for the chatbot? Or are you building something with it? Would love to learn more 😉

[@yorkie4k]

@@DiogoNeves I've built my own RAG app for it. If you're in the LM Studio discord you'll see my post on it.

[@aca95aks]

I'm much preferring LM Studio than GPT4All - thanks for the tutorial :)

[@DiogoNeves]

@@aca95aks thanks 🙏 yes, I really like the simplicity and interface of LM Studio. Have you tried any of the other alternatives like Ollama?

[@boqoll]

U need a supercomputer for this. The regular m.2 mac, can’t handle this. Way too slow…

[@DiogoNeves]

It needs a fair bit of memory, I’m running on an M1 Air with 16GB Which models have you tried? Start with a smaller one. How much memory do you have? Soon I am going to show a lighter approach that although slow, runs on a raspberry pi