Python Advanced AI Agent Tutorial - LlamaIndex, Ollama and Multi-LLM!

[@257.4MHz]

You are one of the best explainers ever. Out of 50 years listening to thousands of people trying to explain thousands of things. Also, it's raining and thundering outside and I'm creating this monster, I feel like Dr. Frankenstein

[@justcars2454]

50 years of listening, and learning, iam sure you have great knowlege

[@Davichius]

Best comment ever 👌 😅

[@aga1nstall0dds]

Uve been studying ai for 50 years ?!?

[@rembautimes8808]

Agree been watching a lot of Tim videos 😂

[@AlexKraken]

If you keep getting timeout errors and happen to be using a somewhat lackluster computer like me, changing `request_timeout` in these lines llm = Ollama(model="mistral", request_timeout=3600.0) ... code_llm = Ollama(model="codellama", request_timeout=3600.0) to a larger number (3600.0 is 1 hour, but it usually takes only 10 minutes) helped me out. Thanks for the tutorial!

[@ricardopata8846]

thanks mate!

[@jeenathkumar3291]

thanks @alexkraken

[@feirahisham4033]

thank you for your comment! this really helps me! I've been stuck for few hours! thanks!!!

[@CodingWithStella]

thank you so much.

[@bajerra9517]

I wanted to express my gratitude for the Python Advanced AI Agent Tutorial - LlamaIndex, Ollama and Multi-LLM! This tutorial has been incredibly helpful in my journey to learn and apply advanced AI techniques in my projects. The clear explanations and step-by-step examples have made it easy for me to understand and implement these powerful tools. Thank you for sharing your knowledge and expertise!

[@DonG-1949]

This is clearly a bot-written comment, but why? What's their endgame? So many bots with puzzling intentions

[@samliske1482]

You are by far my favorite tech educator on this platform. Feels like you fill in every gap left by my curriculum and inspire me to go further with my own projects. Thanks for everything!

[@xero5159]

Thanks to you, now I can create an agent with Ollama and LlamaIndex. I have been working on this topic for a month. Very headache. Now, it is solved. Thank you very much.

[@joe_hoeller_chicago]

I like Tim. Tim explains the important things concisely without diving into rabbit holes. Tim gets straight to the point without loud obnoxious music using code. Tim is an expert. Be like Tim.

[@briancoalson]

Some helpful things when going through this: - Your Python version needs to be

[@mikewebb3855]

For me, once installed xcode, rerun installing the package and was able to get llama_cp_python wheel to install. Thanks for this note, helped make sense of the error message.

[@dearadulthoodhopeicantrust6155]

Yup. I encountered this on windows. On my Visual studio I used the ctrl + shift + p opens a search bar. I searched for interpreter and then I was able to access previous versions of python in different environments, I selected Conda environment and opened a new Terminal. I checked python --version and then the selected python version was up.

[@seanbergman8927]

Excellent demo! I liked seeing it built in vs code with loops, unlike many demos that are in Jupyter notebooks and can’t run this way. Regarding more demos like this…Yes!! Most definitely could learn a lot from more and more advanced LlamaIndex agent demos. Would be great to see a demo that uses their chat agent and maintain chat state for follow-up questions. Even more advanced and awesome would be an example where the agent will ask a follow up question if it needs more information to complete a task.

[@valesanchez6336]

I have never found anyone that explains code and concepts as well as you. Thank you for everything you do, it really means a lot♥♥

[@ft4jemc]

Great video. Would really like to see methods that didn't involve reaching out to the cloud but keeping everything local.

[@ChadHuffman]

Amazing as always, Tim. Thanks for spending the time to walk through this great set of tools. I'm looking forward to trying this out with data tables and PDF articles on parsing these particular data sets to see what comes out the other side. If you want to take this in a different direction, I'd love to see how you would take PDFs on how different parts of a system work and their troubleshooting methodology and then throw functional data at the LLM with errors you might see. I suspect (like other paid LLMs) it could draw some solid conclusions. Cheers!

[@techgiantt]

Just used your code with llama 3, and made the code generator a function tool, and it was fvcking awesome. Thanks for sharing👍🏻

[@Batselot]

I was really looking forward to learn this. Thanks for the video

[@davidtindell950]

Thank You for this very informative video. I really like the capabilities of 'LlamaIndex' with PDF's. I used it to process several of my own medium-size PDF's and it was very quick and correct. It would be great to have another vid on how to save and reuse the VectorStore for queries against PDF's already processed. To me this is more important even than the code generation.

[@_HodBuri_]

Error 404 not found - local host - api - chat [FIX] If anyone else gets an error like that when trying to run the llamacode agent, just run the llamacode llm in terminal to download it, as it did not download it automatically for me at least as he said around 29:11 So similar to what he showed at the start with Mistral: ollama run mistral. You can run this in a new terminal to download codellama: ollama run codellama

[@aishwarypatil8708]

thanks alot !!!!

[@firasarfaoui2739]

i love this community ... thanks alot

[@jishh7]

@TechWithTim This should be pinned :D

[@umutsonmez5214]

you are my hero bro . Thiss problem so f*cking disgusting.Than you my honey

[@sahinomeerr]

some heroes don't wear cape

[@martin-xq7te]

Great work TIM you hit it on the head ,what put people of is downloading. Putting into a requirements file is a great idea

[@garybpt]

This was fascinating, I'm definitely going to be giving it a whirl! I'd love to learn how something like this could be adapted to write articles using information from our own files.

[@ravi1341975]

wow this is absolutely mind blowing ,thanks Tim.

[@jorgitozor]

This is very clear and very instructive, so much valuable information! Thanks for your work

[@Ayush-_-007]

11:20 If your ollama command doesn't work like mine you can try reinstalling then restarting. If not then try manually add it to path.

[@siddharthp9216]

The way you explain is really good and I understood it , you code line by line others just copy paste and donot explain what the code is doing but you explained everything really good content ALso can you bring more tutorial using mutlti agent in crew ai using this multi local llm model thing coz the open ai key is very expensive and all the other channel use that none does it in the local llm

[@shopvictor]

im 16yo and this is the best video tutorial on llm agent!

[@Ayush-_-007]

you still want people to say...oouuu he is only 16 wow he has potentia.....shit

[@siddharthp9216]

I really loved the video please keep making videos like this

[@beautybarconn]

No idea what’s going on but I love falling asleep to these videos 😊

[@trk1139]

Your explanation is quite effective. Could you let me know when the next video is scheduled for release on similar topic?

[@equious8413]

"If I fix these up." My god, Tim. You know that won't scale.

[@JRis44]

Dang seems im stuck with a 404 message @ 31:57. Anyone else have that issue? Or have a fix for it possibly? Maybe the dependencies need an update already?

[@tomasemilio]

Bro your videos are gold.

[@vaughanjackson2262]

Great vid.. only issue is the fact that the parsing is done externally. For RAG's ingesting sensitive data this would be a major issue.

[@debeerpaul]

Yeah that's probably why its a free service. They take your clients sensitive info and train their own A.I. Not good.

[@nour.mokrani]

Thanks for this tutorial and your way of explaining, I've been looking for this , Can you also make a vid on how to build enterprise grade generative ai with Nemo Nvidia that would be so interesting, thanks again

[@imramugh]

Thank you for this video... it was really informative.

[@bigbena23]

What if I don't my data to be manipulated in the cloud? Is there an alternative for LlamaParser that can be ran locally?

[@AaronGayah-dr8lu]

This was brilliant, thank you.

[@CoderX92-mc5hv]

Hi Tim, Great tutorial. I wanted to ask l have been using having trouble when l use .query, I have been using models like mistral-instruct, mixtral, even llama.3.2-instruct. But l am having error that they are not Conversational models

[@camaycama7479]

Awesome video, man thx a big bunch!

[@sethngetich4144]

I keep getting errors when trying to install the dependencies from requirements.txt

[@I2ealTuber]

Make sure you have the correct version of python

[@AndrewH.Agbezin]

or better since I prefer he pip install them manually

[@sahinomeerr]

It is probably because of your python version. I had the same errors. It requires python version below 3.12. I prefer using 3.11.9

[@zmazadi]

You are truly amazing in explaining concepts. it is like you have fully understood it yourself that is why you can explain them really well. I am trying to get the autocomplete of VS code to work on Mac but nothing works. which extension are you using?

[@mohanvenkataraman648]

Great video tutorial or walk-thru. It would be nice to determine minimum configuration required to run. I tried the example on a Xeon 4 core Ubuntu laptop , 16GB with a NVIDIA Corporation GM107GLM [Quadro M2000M] / Mesa Intel® HD . Sometimes it gave a bunch of errors and I had to do cold restart. Also, the only difference in an Ollama versus non-Ollama version should be the instantiation of the LLM and embedding model. Am I right?

[@avxqt001]

I can't install packages of llama-index in my Windows system. Also, the 'guidance' package is showing an error

[@maximelhuillier8964]

did u find the error ?

[@kumaronchat]

I am using Python 3.11.6 and in my Windows OS I installed C++ developer tools options. but getting this error "Building wheels for collected packages: guidance, llama-cpp-python Building wheel for guidance (pyproject.toml) ... error error: subprocess-exited-with-error" Shall I proceed with this?

[@song1749]

Awesome 👍

[@nikhilv6732]

can anyone reply to me wt pre requisites to learn for this??

[@hamsehassan7304]

everytime i try to install the requirements.txt files, it only downloads some of the content but then i get this error message: Requires-Python >=3.8.1, im runnning this on a mac with python version 3.12.3 and I can't seem to download the older version of python.

[@KEVALKANKRECHA]

Great❣

[@ben3ng933]

This is awesome.

[@samwamae6498]

Awesome 💯

[@themax2go]

neat! but why not multi-agent dev team that evaluates (qa) and reiterates on code that fails qa?

[@ricardokullock2535]

The guys at llmware have some fone-tuned models for RAG and some for function calling (outputing structured data). Could be interesting to try out with this.

[@Pushedrabbit699-lk6cr]

Could you also do a video on infinite world generation using chunks for RPG type pygame games?

[@seanh1591]

Tim - thanks for the wonderful video. Very well done sir!! Is there an alternative to LlamaParse to keep the parsing local?

[@stevenheymans]

pymupdf

[@mustafa.atamer]

Llamaparser do that unlocal, it cause that it can not be used for enterprise. Is there any way to do this fully local?

[@RolandDewonou]

it seems multiple elements in the requirements.txt doc require different versions of python and other libraries. Could you clarify what versions what what is needed in order for this to work?

[@blissfulDew]

Thanks for this!! Unfortunately I can't run it on my laptop, it takes forever and the AI seems confused. I guess it needs powerful machine...

[@ChathurangaBW]

just awesome !

[@vedantbande5682]

how to know the requirements.txt dependencies we required (it is a large list)

[@rajansikarwar3500]

when im using llama.31 my llm response gets stuck in a loop of action observation action observation. what to do?

[@m.waqas27]

This is the limitation of llama3.1 and all llamas. Once we pass on tools it always ready to call tools even the query don't need it.

[@LourdesMarín-b5h]

Why did I need to downgrade python 3.12 to 11 to be able to run requirements.txt which some dependencies were calling to use a version less than 3.12 but I see you are using python 3 with no errors?

[@tomgreen8246]

Guessing you are using Windows? Sometimes you need a different library / adapted library for Windows. It's easier to follow someone who's a Windows developer, but once you get used to the nuances, it's pretty simple. Or you can just use a WSL2 Ubuntu project, or Docker, and it all works fine.

[@camaycama7479]

Does the mistral large will be available ? I'm wondering if the LLM availability will be up to date or there's other step to do.

[@ghazalrafique4012]

I can't move past this error "No module named 'llama_index.llms.ollama'". I have tried to uninstall and install llama_index and I have also downgraded python version. Did anyone else run into this?

[@anishkoirala8532]

Anyone here??? to help? I am also stucked at the same point

[@ghazalrafique4012]

​@@anishkoirala8532 You may need to "pip install langchain_ollama", if you don't have it.

[@mayerxc]

What are your MacBook Pro specs? I'm looking for a new computer to run llm locally.

[@techgiantt]

Buy a workstation with very good Nvidia gpu, so u can use cuda. If u still want to go for a MacBook Pro, get the M2 with 32gb or 64gb ram. I’m using a MacBook m1 16” 16gb ram and I can only run llms with 7 - 13b without crashing it

[@TechWithTim]

I have an M2 Max

[@GiustinoEsposito98]

Have you ever thought about using colab as a remote webserver with local llm such as llama3 and calling it from your pc to get predictions? I have your same problem and was thinking about solving like this

[@iamderrickfoo]

My mbp pro m1 8gb is hanging while running the llm locally. Any alternatives that we can learn to build without killing my mbp?

[@robertwclayton6962]

Great video tutorial! Thanks 🙌 (liked and subscribed, lol) A bit of a "noob" developer here, so vids like this really help. I know it's a lot to ask, but.... I was wondering if you might consider showing us how to build a more modular app, where we have separate `.py` files to ingest and embed our docs, then another to create and/or add embeddings to a vector DB (like Chroma), then another for querying the DB. Would this be possible? It would be nice to know how to have data from one Python file feed data to another, while also minimizing redundancy (e.g., IF `chroma_db` already exists, the `query.py` file will know to load the db and query with LlamaIndex accordingly) Even better if you can show us how make our `query_engine` remember users' prior prompts (during a single session). Super BONUS POINTS if you can show us how to then feed the `query.py` data into a front-end interface for an interactive chat with a nice UI. Phew! That was a lot 😂

[@danyloustymenko7465]

What's the latency of models running locally?

[@mredmister3014]

Good video but do you have a complete ai agent with your own data without the coding formatting? This is the closest tutorial I’ve found to do on premise ai agent implementation that I can understand. Thanks!

[@AndyPandy-ni1io]

what am i doing wrong cause when I run it does not work no matter what I try

[@adilzahir9921]

Can i use that to make ai agent that can call customers and interact with them and take notes of what's happens ? Thank's

[@Czarlsen]

Is there much difference between result_type = "Markdown" and result_type = "text"?

[@257.4MHz]

Well, I can't get it to work. It gives 404 on /api/chat

[@omkarkakade3438]

I am getting the same error

[@mrarm4x]

you are probably getting this error because you are missing the codellama model, run ollama pull codellama and it should fix it

[@kodiak809]

so ollama is run locally in your machine? can i make it cloud based by applying it into my backend?

[@nikta456]

Please create a video about production-ready AI agents!

[@anandvishwakarma933]

Hey can you shared the system configuration need to run this application ?

[@billturner2112]

I liked this. Out of curiosity, why venv rather than Conda?

[@henrylam4934]

Thanks for the tutorial. Is there any alternate to LlamaParse that allows me to run the application completely local?

[@purvislewies3118]

yes man...this what i want to do and more...

[@antqqer]

How to do same thing for .csv data, someone plz help

[@WismutHansen]

You obviously went to the Matthew Berman School of I'll revoke this API Key before publishing this video!

[@willlywillly]

Another great tutorial... Thank You! How do I get in touch with you Tim for consultant?

[@TechWithTim]

Send an email to the email listed on my about page on youtube

[@jay.ogayon]

what keyboard are you using? 😊

[@technobabble77]

I'm getting the following when I run the prompt: Error occured, retry #1: timed out Error occured, retry #2: timed out Error occured, retry #3: timed out Unable to process request, try again... What is this timing out on?

[@coconut_bliss5539]

Your Agent is unable to reach your Ollama server. It's repeatedly trying to query your Ollama server's API on localhost, then those requests are timing out. Check if your Ollama LLM is initializing correctly. Also make sure your Agent constructor contains the correct LLM argument.

[@TballaJones]

Do you have a VPN like NordVPN running? Sometimes that can't mess up local servers

[@adithyav6877]

change the request_timeout to a bigger value, like 3600.0

[@Ayush-_-007]

Guys if there is some kind of problem downloading the modules with different versions you can remove the specified versions then try installing again.... this is for slakers like me create a python program ti delete the version text which is after == (ask chatgpt if you can't)

[@Darkvader9427]

can i do the same using langchain

[@Ari-pq4db]

Nice ❤

[@PANDURANG99]

multiple pdf at a time and pdf contains drawing, how to make

[@ofeksh]

Hi Tim! GREAT JOB on pretty much everything! BUT, i have a problem im running on windows with pycharm and it shows me an error when installing the requirements, because its pycharm, i have 2 options for installing the requirements, one from within pycharm and one from the terminal FIRST ERROR (when i install through pycharm) in both options im seeing an error (similar one, but not exactly the same) can you please help me with it?

[@diegoromo4819]

you can check which python version you have installed.

[@ofeksh]

@@diegoromo4819hey, thank you for your response, which version should i have? i can't find it in the video.

[@neilpayne8244]

@@ofeksh 3.11

[@ofeksh]

@@neilpayne8244 shit, that's my version...

[@DomenicoDiFina]

Is it possible to create an agent using other languages?

[@nikta456]

Problems ? # make sure the LLM is listening `pip install llama-index qdrant_client torch transformers` `pip install llama-index-llms-ollama` # didn`t download codellama `ollama pull codellama` # timeout error set request_timeout to 500.

[@kayoutube690]

New subscriber here!!!

[@radheyakhade9853]

Can anyone tell me what basic things should one know before going into this video ??

[@SashoSuper]

Nice one

[@kevalkankrecha5778]

It's Great but how can we manage chat history. =

[@adilzahir9921]

What the minimum laptop to run this model ? Thank's

[@samohtGTO]

you need a good gpu to run like litrarly any llm

[@notaras1985]

How do we know that Meta hasn't corrupted the ollama model with spyware or other malicious code?

[@meeFaizul]

❤❤❤❤❤❤

[@ases4320]

But this is not completely "local" since you need an api key, no?

[@matteominellono]

These APIs are used within the same environment or system, enabling different software components or applications to communicate with each other locally without the need to go through a network. This is common in software libraries, operating systems, or applications where different modules or plugins need to interact. Local APIs are accessed directly by the program without the latency or the overhead associated with network communications.

[@JNET_Reloaded]

nice

[@joshuaarinaitwe8351]

Hey tim. Great video. I have been watching your videos for some time, though i was definitely young then. I need some guidance. Am 17, i want to do ai and machine learning course. Somebody advise me.

[@Marven2]

Can you make a series

[@Pythonist_01]

I did one using Llama2.

[@giovannip.6473]

are you sharing it somewhere?

[@amruts4640]

Can you please do a video about making a gui in python

[@unflappableunflappable1248]

круто

[@dolapoadefisayomioluwole1341]

First to comment today 😂