Introduction to LlamaIndex with Python (2024)

[@alejandro_ao]

🔥Join the AI Engineer Bootcamp: Hey there.. The second edition of the AI Engineering Cohort is starting soon. - Learn with step-by-step lessons and exercises - Join a community of like-minded and amazing people - I'll be there to personally answer all your questions 🤓 - The spots are limited since I'll be directly interacting with you You can join the waitlist now 👉 course.alejandro-ao.com/ Cheers!

[@LookNumber9]

Yes. More on LlamaIndex please. I so appreciate your clear and thoughtful tutorials. Beautifully done!

[@alejandro_ao]

i appreciate it! absolutely 💪

[@eric-theodore-cartman6151]

Yes please make a whole series, especially the application based on usecases. ​@@alejandro_ao

[@rembautimes8808]

Excellent tutorial watched this video,over several days. Thanks so much for explaining this platform 😊

[@olextech]

Thank you for your effort. This is by far the most structured and easy to understand introduction into LlamaIndex / RAG topic.

[@alejandro_ao]

really appreciate it! i'm glad it was helpful :)

[@Waseem-f7n]

yes please continue with LLam index tutorials. appreciate that

[@changed217]

Thank you so much man, just yesterday I was struggling with the same thing, there is no recent content on llamaindex, everything is outdated. This is a live-saver, please continue this series.

[@alejandro_ao]

you can count on that

[@IdPreferNot1]

LLamaindex looks like a survivor. Would love to see some of the advanced new features in your coming tutorials.

[@alejandro_ao]

totally agree. i am sure they will be shaping the AI app sphere for a long time

[@davidtindell950]

Works Very Well and very low cost (in pennies per PDF). Further savings by 'Persisting the Index' ... Thank You Yet Again! I own you a whole pot of coffee ! 😄

[@adil385]

Been looking at this for a few weeks and this is the perfect start for anyone wanting to understand RAG and llama index. Fantastic video :)

[@ai-touch9]

the moment you say good morning, I feel like I woke up on a flight with pilot announcement, Good stuff btw.

[@janwillemaltink2216]

always eager to start building things after watching one of your videos. You really have a talent for explaining things super clear and easy .

[@megamind452]

I was searching about llamaindex yesterday on your KZbin channel

[@alejandro_ao]

we're in sync 😎

[@BrandonFoltz]

Excellent as usual! And useful as usual. Thanks and stay cool. 😎

[@alejandro_ao]

thank you brandon! always a pleasure to see you around!

[@thomasthemaker]

Awesomely information-dense. Thanks man

[@Muzeemkhankamaal]

Really nice and to the point tutorial.. Thank you.

[@alejandro_ao]

thank **you**

[@rochedavid1643]

Merci beaucoup pour ce contenu de qualité (comme toutes tes vidéos), vivement la suite ! (j'espère que tu aborderas la création de RAG basé sur des agents)

[@tlyoon]

Am considering using llamaindex for my ai application project after viewing your wonderfully done video, which is straightforward, simple and absolutely understandable. I am expecting a follow-up video by you on how to deploy llamaindex online for a realistic entrepreneur setting.

[@sunitjoshi3573]

Nice & articulate. Thanks for putting this out.

[@alejandro_ao]

I appreciate it :) expect many more to come

[@iacondiego]

Good video, I have seen few videos that explain this topic well, greetings from Chile

[@somerset006]

Thanks for the up-to-date video on Llama Index! It would have been helpful to explicitly mention the deltas from half a few months back.

[@haiderkhalilpk]

Very precise and much much useful!

[@alejandro_ao]

hey there, thanks! glad to see you around!

[@CaptainBri-ro4lp]

Great tutorial!!

[@RakshithML-vo1tr]

Bro literally you are doing such a useful thing please do more videos its very helpful lots of love from student community ❤️

[@PauloRogeriopauloaraxa]

Excelente explicação como sempre. Parabéns.👏👏👏

[@ziggyybr]

It helped me a lot! Thanks for the video

[@alejandro_ao]

no worries!

[@DevidasBhobe]

U r doing better job than llamaindex vp who reads from a paper in videos

[@samuelsztabholz2419]

Très bonne présentation. Merci

[@alejandro_ao]

je t'en prie !

[@sarveshsawant7232]

This is perfect

[@alejandro_ao]

you are

[@trealwilliams1563]

Thank You✊🏾💎

[@alejandro_ao]

😌 no problem

[@user-wr4yl7tx3w]

i like to learn llamaindex but i wonder if i will just be spreading myself too thin by trying to master both langchain and llamaindex. do you have any advice?

[@empfehlbar]

Hi Alexjandro! This introduction is really good! Which is the next video in this series about Llamaindex? (I saw you have a lot of interesting videos)

[@alejandro_ao]

the one coming next week is about data loading :)

[@Jay-wx6jt]

Their recent documents are really really good

[@alejandro_ao]

they are awesome indeed

[@SamiUllah-xv8ft]

Awesome content as usual

[@alejandro_ao]

hey sami 🙌

[@KumR]

@@alejandro_ao 🎉

[@limjuroy7078]

Interesting~

[@akshaymenon5088]

Can this setup be implemented within a protected infrastructure? I have sensitive data that I don't want to leave my network

[@AlexCasimirF]

Love your videos!!! Great content here again. One question: in 30:20 where the index gets created locally, what do the subfolders look like? "image_vector_store", "graph_store"... - does this mean the dataloaders would also split a PDF in plain text, graphs, images and then store the respectivbe embeddings in separate folders? Tried it on my own PDFs but could not make much sense of the index files unfortunately...

[@nyceyes]

Their documentation is lacking, so thank you for this. Question: In your code editor, I noticed the hover-over text: "start coding or generate with AI". What code generator service and/or plugin are you using, if you don't mind me asking? 😊 (E.g. GitHub Copilot, etc). Thank you. Edit: Ah, it's probably whatever CoLab offers. I was too focused on the LlamaIndex talk to notice the IDE was CoLab. LoL

[@gazorbpazorbian]

Great video! Keep em coming! Quick question. When you load documents can it get the documents recursively inside data? Like if there are more folders inside folders? Is there any limit to loading documents? Any aditional advice on the loading documents? What if a document has many pages and it has a footer and a header with repetitive content? Could that affect negatively the retrieval?

[@Pingu_astrocat21]

Alejandro Thank you for the clear introduction to LlamaIndex. Instead of using OpenAI API , how can we use a model from hugging face?

[@alejandro_ao]

definitely, coming up!

[@Pingu_astrocat21]

@@alejandro_ao thank you! waiting :)

[@SonGoku-pc7jl]

thanks

[@alejandro_ao]

thank *you*!

[@jacobsmith7877]

Looking forward to Agentic RAG system build with function calling and etc

[@rmjjanssen2645]

Great video. So if I understand correctly, the code example only shows the parsing into documents. So no nodes, embedding/vectorising and persistent storage in a vector DB? Any observations on weak/ strengths in comparison with langchain? The parts upto vector db and the parts from user upto vector DB

[@alainherreman3685]

Merci !

[@alejandro_ao]

Merci Alain !!

[@GP-qs6cq]

can i setup llamIndex on my own server? i dont want to use api or don't want to send data to other's server

[@_wallykhalid]

Really interested to see a fully open source version of this with hugginface embeddings and models.

[@alejandro_ao]

coming up!! sorry been super busy with the cohort 😅

[@encianhoratiu5301]

Can you make a video where you discuss how you can test a RAG?

[@GabrielVilladiegoOchoa-nt1xc]

Excelente

[@alejandro_ao]

hola amigo 🙌

[@J.jocker]

what 's the different between (llamaindex for chatbot creation) and (langchain +streamlit ...for pdf bot(the video you did last time) which of them is more suitable if I want to create a chatbot for a company

[@alejandro_ao]

there is a bit of overlap between the two. but you really can't go wrong with either of them. they are both very reliable and have a great community. it seems to me that llamaindex is focusing a lot more on the data ingestion side and langchain is going more for them overall orchestration of the components. at least for now. the good news is that you can use both :) most of the paradigms are compatible, so you can take advantage of the strengths of each one. in the meantime, i recommend you focus on one of the two and then start implementing features from the other one as needed. you will soon get the core concepts and be able to choose which one is better suited fr a specific project 👍

[@yaseenal-wesabi5964]

Should we pay for the openai api key? And How

[@acharafranklyn5167]

Welldone boss i almost thought you stole it from Krish Naik but your adding the lamaparse made the difference

[@alejandro_ao]

thanks mate! i'm pretty sure both of us took it from the official docs, tbh 😅 but yeah, i wanted to give a more wholesome presentation of all their offer, not only the open-source part :)

[@CaiqueBikeBJJ]

Do you already have a video how to use Llama-Index with local llama3 instead of ChatGPT? Thanks!

[@alejandro_ao]

Not yet, but coming up next week!

[@AMR2442]

I’m waiting for the local install video.

[@KumR]

Hey AO.. Looks like the default LLM is being used which is Da Vinci. Can we upgrade to GPT4o?

[@alejandro_ao]

hello there, absolutely. for this particular example, you can just add the model param to the query engine: ```python from llama_index.core import VectorStoreIndex, SimpleDirectoryReader from llama_index.llms.openai import OpenAI documents = SimpleDirectoryReader("data").load_data() index = VectorStoreIndex.from_documents(documents) query_engine = index.as_query_engine(llm=OpenAI(model="gpt-4o-mini")) response = query_engine.query("What is the bootcamp about?") print(response) ``` btw, i am pretty sure that the default model that llamaindex uses with openai is gpt-3.5-turbo. look: github.com/run-llama/llama_index/blob/41643a65bc89cfdb3eb0c11b4f8cb256b02aa21c/llama-index-integrations/llms/llama-index-llms-openai/llama_index/llms/openai/base.py#L78

[@alejandro_ao]

i feel like this shirt makes it look like i'm at the beach

[@SamiUllah-xv8ft]

it looks cool

[@alejandro_ao]

😎

[@sylap]

looking great bro!

[@VR-fh4im]

You should become a professor it will benefit thousands of students in your country. Well taught.

[@alejandro_ao]

i hope to do that one day! thank you, it means a lot!

[@sam-uw3gf]

can do langchain tutotrial with open source I was searching and got none in case any please give me the link

[@TriconDigital]

hoping for video #2

[@alejandro_ao]

finally here, sorry lots of work!!

[@AbdulaiJalaldin]

please can you make a tutorial on langgraph

[@alejandro_ao]

coming up!

[@adityahpatel]

It is vague at this point - 12:50 "nodes are interconnected creating a network of knowledge". This is very old technique. Obviously embeddings of chunks semantically close to each other will fall in the same area in embedding space. So they are interconnected..How is this any different from chroma db or ANY xyz other vector database in the world? What is different here!

[@Rits1804-l4r]

brother please make a video on RAG (by using the llama index), I have done it already if you need I can send you, so you can save your time for research, Please explain it in your language , please use open source model instead open ai

[@romanemul1]

LlamaIndex is a commercial product, with pricing based on usage... Ok bye. Thanks for a video anyway.

[@faturismee]

so? wdym?