AI Unleashed: Install and Use Local LLMs with Ollama - ChatGPT on Steroids! (FREE)

[@乾淨核能]

hardware requirement?

[@m4saurabh]

Nvidia H100

[@乾淨核能]

@@m4saurabh seriously? that's not for everyone T_T

[@LinuxTex]

For Phi 3.8b, 8 gb ram. No gpu needed. For llama 3.1 7b, 16 gb ram. Most consumer GPUs will suffice. H100 not necessary.😉

[@乾淨核能]

@@LinuxTex thakn you!

[@go0ot]

Do more local llm installs videos

[@nothingbutanime4975]

Do make a video regarding ai generated images local models

[@LinuxTex]

Definitely bro👍

[@obertscloud]

thanks how do I get modules that are no censored ?

[@MrNorthNJ]

I have an old file/media server which I am planning on rebuilding as a future project. Would I be able to run this on that server and still access it with other computers on my network or would it just be available on the server itself?

[@LinuxTex]

That's a great idea actually. You could make it accessible on other devices on your network as ollama suppots that.

[@MrNorthNJ]

@@LinuxTex Thanks!

[@shubhamshandilya6160]

How to make api calls to these offline llm. For used in projects

[@MuhammadMuaazAnsari-l1b]

0:39 The Holy Trinity 😂😂🤣

[@nehalmushfiq141]

okay thats someting good and appreciatable content

[@LinuxTex]

Thanks Nehal. 👍

[@kennethwillis8339]

How can I have my local LLM work with my files?

[@LinuxTex]

Sir you need to setup RAG for that. In the MSTY app that I've linked in the description below, you can create knowledge bases easily by just dragging and dropping files. Then you can interact with them using your local llms.

[@atharavapawar3272]

which linux is perfect for my samsung NP300E5Z 4 RAM , Intel Core i5-2450M Processor , plz reply

[@caststeal]

Go with mx linux. Xfce desktop environment

[@decipher365]

Yes we need much more such videos

[@Soth0w76]

I already use ollama on my Galaxy A54 with Kali Nethunter

[@nageswaraopatha5445]

Do more videos like this❤ good apps

[@LinuxTex]

Will do. Thanks for the comment👍

[@Mr_Ravee]

Quality content dude..👍 got a sub👆👍

[@MarimoBakaa]

Helpful video!

[@LinuxTex]

Thank you Syed👍

[@janetmartha3261]

Useful information 💯 ,,🔥🔥🔥🔥🔥

[@LinuxTex]

Thank you👍

[@rohankshetrimayum1049]

Wow

[@gamalieltonatiuh1924]

😮👍