Thank you so much for taking the time to create this.

After the launch of llama 3.2 1B & 3B, this video should Skyrocket so Ollama

thanks Matt ! Is there any list of all env variables with description for each in the Ollama docs ?

Ha, ha, ha. We understand how KZbin works. We either pay for YT Premium or we watch ads and you get paid based on views. You don’t need to announce it is FREE at the beginning of your video. (Thanks for the content, though😊)

What does "K_L/M/S" etc mean for quantized models? Why are L larger than M for same quantization?

I'm subscribed with all notifications turned on but I didn't get this one for some reason... ☹

Thanks Matt for your videos. Please are you able to do one with instruction for installing LLama 3.2 11B. It will be very helpful for many people but no pressure.

YES YES environment variables, the first time i need it for obsidian copilot. it was chat gpt and claude and discord teach me about this, I'm really sure this video is undoubtedly needed by many ollama user

tks 👍

today llama3.2 3b have use tools :) saying... ;)

"With this Mac code, I understand that ollama pull model downloads it again if it's updated, and if it's not updated, it doesn't download it again? Because I don't see any fetch in the code, and ChatGPT made me think otherwise, I don't know."

thanks! :)

you rock! Thank you!

Most excellent vid sir! Can you expamd on this by showing how to make RAG perform faster at 25 tokens per second at least, with several GB or 1000's of md files uplloaded to it please?

The "staring at my soul ending" is the besto route possible in a visual novel like this one. 🖤

Can Llama AI tell me how to cheat in video games ? Cuh google ai wont. Also, can llama AI draw photos ?

Ok so we just make the middle of the document spacer text and then leave the real info at the atart and end... 😅 16:11

is it possible to get an graphical ui ?

I'd LOVE the more integrated JSON mode that OpenAI has. I know you can put it ollama in JSON mode, but that's more of a hint that isn't always followed. It would be a GAME CHANGER! From OpenAIs announcements in August 6th: "We are introducing Structured Outputs in the API-model outputs now reliably adhere to developer-supplied JSON Schemas."

yoo so far as i understand , ollama is not an application right? or is there a way to get it like that i am new to this

I love what you have been sharing on this channel. As a developer I really enjoy the content like in this video which is not just a tutorial on a tool but knowledge that is deeper. Also less code and more control, yes please !

Would love to see further deep dive on this including hybrid keyword/semantic search and reranker for large datasets applied with an LLM via Ollama. Thanks for the great tutorial as always!

Exactly what I was looking for! THANK YOU!

Hate the rip off price of the internal drives in mbp. I did manage to convince myself it was a better investment though by pricing up the alternative costs of an equivalent google drive over its lifetime. When you max it out to 4tb its about 1200usd. The closest the ai just came up with is 10tb with google drive which is 49.99 a month. Based on the fact i have had this for about 5 years now that would have cost 2500usd. I had a better comparison before but chatgpt cant search its own conversation history and I cannot find it right now. So when i get the next upgrade, which i think will be the m4, i will pay their price and convince myself its ok using maths magic. 😅 And then i keep it all safe from dropping or being stolen with backblaze.

Informative as always. Heh. I was just listening, not watching and after the goodbye I heard your water bottle. Remembering to hydrate can be hard, so thanks for the reminder.

How to make truly random events? Just hook it up to a lava lamp! Google it. Lava lamps are actually being used to keep the internet secure. 😆 Basically there is a wall of lamps and a webcam pointing at it, and the fluctuations are used as the values for the random numbers.

good video, my wish is that in install, i can select folder for ollama models, because in one pc i have few space in c: jaja And one ask, what tool for ocr you recommand for windows? thanks :) sorry for my english, im spanosh ;)

They need to add ollama stop to the python API. Could really use me some ollama.stop action in my applications.

I have an issue timestamp 8:17 (I am on Windows 11 using the docker terminal) When I use the ollama_host=0.0.0.0:11434 docker run -d --gpus=all -v ollama:/root/.ollama -p 11434:11434 --name ollama ollama/ollama I get an error: The term 'ollama_host=0.0.0.0:11434' is not recognized as the name of a cmdlet, function, script file, or operable program. Check the spelling of the name, or if a path was incl uded, verify that the path is correct and try again. Any idea what went wrong?

Wow thanks Matt! Looking forward to the tutorials!

Video Suggestion: Table-Augmented Generation (TAG). TAG is a unified and general-purpose paradigm for answering natural language questions over databases.

❤❤❤❤❤❤❤❤❤ great

🎉🎉🎉🎉 Reader-LM is Slow, it needs temperature 0 to work fine.

Can you please show how to make Pixtral available for Ollama? Thank you

Great tutorial. Can you do a non-mac version of this? I see things like qlora but I have no idea even where to start.

He said that fine-tuning is only for dealing with how the model responds but it's also for increasing domain expertise as far as I know

Thank you Matt for this,

ollama stop finally!!! 😅 i no longer have to keep restarting ollama 😅😂

I have a question because you collaborated with the Ollama project. Because Ollama is not compatible with more low-income models like AMD and models like Rx 580 or Rx 6600, while the LMStudio project is.

no more systemctl restart ollama

the long awkward pause at the end always gets me

I am training the Pixtral model to further enhance creating interfaces. I downloaded it from a server that usually has these. I can say it is pretty good for OCR and screenshots to correct errors, or read scanned books.. Coupling this with Claude Dev or Engineer, super powers the whole process of building real complex apps... Thanks Mistral!

It is just missing a fine-tuning command with a large custom dataset.

PIXTRAL?

Would you regard the NER models as cases of fine-tuned models?

what do you think about Ollama or other ways of running LLMs such as 8b models on smartphones?

I'm new here, but I saw this content is really informative and I like that you're very knowledgeable so I subscribed

My issue is that I need model loaded always, and I can’t find an obvious way of keeping it in memory for longer then 4 minutes:)

I would be interested in using other inference engines with ollama but the documentation I've found doesn't have enough detail

Prompt caching and more support for vision models would be great...in any case nice update! Thanks