From OpenAI to Open Source in 5 Minutes Tutorial (LM Studio + Python)

[@BudoReflex]

Love the pace you present at. No filla.

[@realAIDOPE]

Man, you always go THE deepest with your AI insights and videos. Kudos, bro! Always #AIDOPE 🍪

[@MilhanIqbal]

Beautifully explained. Thanks a bunch

[@MarcoZaro]

Hi very interesting indeed, one question what are the requirements to run the model? I’m asking because my goal will be to use flowiseai hosted locally , then host a vector database like supabase, ingest our technical document and create a chatbot for our needs completely local. At the moment I’m using OpenAI ChatGPT api but I want to do it completely offline for privacy reason

[@ollydix]

Lol I'm doing the same

[@vbywrde]

Very good information, and well presented. Thank you!

[@kawsarahmad]

Brilliant as always!

[@kollinashcraft]

This was so incredibly helpful... thank you!

[@harithummaluru3343]

amazing content. greatly appreciated

[@oliverli9630]

Sam Altman: "How dare you!"

[@Shari_Tejp]

Does this mean i can run this Llm on my local desktop computer at home, and be able to access it from my laptop online? Sorry if it’s a dumb question im new to this

[@yes4me]

Can we download the python code?

[@benoitheroux6839]

I'd like to know why you choose the older version (v2.2.1) instead of the newest one, the 2.6 ? the size of the dolphin-2.6-mistral-7b.Q5_K_M.gguf is almost the same ?

[@MrUpgradable]

Legend, thanks for sharing this

[@abenjamin13]

Always appreciate the overview, thank you.

[@MythicMemorie]

i cant open the Model's python file. Notepad says file is too large. What do i do??

[@bobsmith-hv1kb]

Is there a link to the script?

[@VassilisPerantzakis]

Just a question. What is your hardware configuration for running the local models?

[@arpitkumar4525]

What are the minimum system requirements to run models locally?

[@noumaniftikhar5184]

Love that...a mage from Warcraft teaching AI

[@DarrenTarmey]

were can i get this code and do i have to load it into visual studio

[@Ghrenig]

Excellent - what is your hardware setup?

[@JeeteshSurana]

Can you please provide the test3.py file?

[@JungUndStabil]

Hey, is my Mac mini m2 strong enough to use opensource ki?

[@Yomi4D]

Thank you.

[@3xOGsavage]

well thanks to you i got a new way to use local ai model as a API. never knew this was possible too. can you make more such videos?

[@Shari_Tejp]

Does this mean i can run this Llm on my local desktop computer at home, and be able to access it from my laptop online? Sorry if it’s a dumb question im new to this

[@saeedasgaritehrani]

Tnx, very helpful! Are you ENTP? 🤔

[@husamui]

How would you deploy this to use via api?

[@uighkgui]

i got a 1080ti and for some reason i can't get it run on my GPU.. is my GPU too old??

[@legendaryman4336]

do you do this so you can get the fully uncensored output? I tried asking it iffy stuff and it gave me a nope in LM Studio. Same model

[@AberrantArt]

Did you try it on the uncensored model he describes at the end?

[@RamazKadgaev]

Are there models on LMStudio that can do image recognition like GPT4?

[@kate-pt2ny]

llava

[@RamazKadgaev]

You are right, there is llava model, but I dont see LMStidio ui option to add photo in chat mode. May be there is python option?

[@akdisrael]

woooow thanks for this im free with chatgpt

[@user---------]

Dont clear understand, isn't it possible to just download models from HF and use them locally? Why is LM studio local server need?

[@KhajaMD143]

Yes very much possible to do without lm studio, but what lm studio brings to the table is one UI for all that you do in different terminal windows otherwise. It becomes very messy, with the terminals running, then you want to change some configurations, you want to jump from one model to another etc.,

[@SirTunkur]

Fungerar AMD gpu's?

[@abhipatil4844]

awesome

[@palashjyotiborah9888]

You are Late for the party 🥳

[@serenditymuse]

Cool and very useful. . But I would appreciate videos on how to do this without being beholden to some company and its apparently closed source product. Government crackdowns are coming and I want as much of my toolchain on my own hardware and in my control as possible beforehand.

[@watchdog163]

Can you explain a little bit more about what you mean by government crackdowns? Are you talking about the copyright issues with OpenAI and big industries like Hollywood and Newspapers suing them and potentially having them raided by FBI, CIA or some other corrupt agency?

[@legendaryman4336]

Yup me too I downloaded that shit as much as I could to my local drives. 500GB+ so far... Gimme!! I wouldn't be surprised if they removed uncensored models from the web. Actually they will 100%, because it's a security threat to them. Prepare for the end folks be smart lol

[@AberrantArt]

Are you saying lm studio is the issue? Just curious to understand what you mean.

[@mackroscopik]

​@@AberrantArtyes it is not open-source

[@randallblake1213]

My understanding is that Jan AI is an open source alternative to LM Studio but there are not many tutorials on how to use the local inference server.

[@funprog]

Very Very slow though

[@ohaleceiffel]

Ugh still too involved for non techies like me. Cant someone just package all this up in an executable? I mean that’s the whole f-ing point of ai isn’t it? So we don’t have to bother with command line BS. Pfft!

[@alx8439]

Step number one - to download some proprietary shit... Not interested