Build a PDF Document Question Answering LLM System With Langchain,Cassandra,Astra DB,Vector Database

I'll show you how to build a powerful Query PDF Question Answering System application. We're combining the forces of Apache Cassandra, DataStax's Astra DB as a vector database, LangChain, Streamlit, Python and the incredible GPT-4 to create a game-changing solution.
▶ Link to the code :colab.research.google.com/dri...
▶ To create the cassandra db signup in the datastax platform:https: dtsx.io/4adwXRK Use your business email address and get from $1000- $3000 in free credits and consulting with your subscription.
Link in bio: dtsx.io/4adwXRK

[@krishnaik06]

Today marks my 5th year anniversary of uploading videos related to Data Science and AI in my yourube channel.I have definitely learnt a lot and I hope I was able to add values in others life. Looking to continue this work till jab tak hai jaan 😀 Lets keep the likes target to 1000 on this occasion :)😊

[@hari-415]

you deserve a lot more sir❤

[@squadgang1678]

Congratulations 🎉 appreciated sir

[@AshuChhabra3]

Many congratulations Krish...keep up the good work 👏👏

[@madhugarg7499]

Getting error: 'OpenAI' object has no attribute 'embed_query' - After executing the "astra_vector_store = Cassandra(....". Can you please tell how to fix this ?

[@krishnansankaranarayanan1969]

It is helpful for my capstone. Thanks

[@CW-dt2xk]

Next Level, Thank You!

[@infobarbosa]

Awesome content! Congrats!!!

[@krishj8011]

Awesome Tutorial...

[@2771237]

Thanks Alot for Video dear :)

[@vaishnaviumesh8590]

Hi Krish, love all your videos..Can you make a video on whisper and Distil whisper and how to use them in a project please?

[@datadumpp]

Just amazing

[@samuelnikhade5612]

Sir can you please create a video with FAISS index. Thank you for this video this is amazing information

[@CrusadeVoyager]

Nice Krish, Your Next Vid will be based on Indian AI Model, OLA has released Krutrim - feb 24 ;) . Glory to Bharat ❤

[@AI__Spectrum]

Good work man

[@gaurangabhuyan3760]

What if i ask to this model "tell me something about this pdf/ a summary of it", how will it do the similarity search as it requires information from all the chunks?

[@izainonline]

Sir Like the size is very huge like in tbs to use Cassandra dB. 2nd open ai embedding is not free if we use hugging face embediing

[@NoDoglapan]

hi there can you let me know what change I need to make to the code if i want to use multiple pdfs as my data ? thanks in advance!

[@out-of-sight]

Hi, can we use different embeddings for this project? I don't want to use OpenAI. I want to use open source one.

[@dipankardandapat5495]

Sir in pdf if some image and graph present how to store it , and how to ask question based on graph or image ?

[@RamaChandran-fc3hp]

Sir is it similar to pine cone vector database?

[@priyanshupandey3148]

Does it handle images and tables as well?

[@umeshkumarasamy6608]

@ exactly 14:40 you have imported something called Concatenate from typing_extensions library (which I think is now deprecated) but I don't see the imported function/Object used anywhere in the code. Can you explain the rationale as to why the import was done? Am I missing something here?

[@sunilkumarpradhan.4376]

I am facing issues with rate limit exceeded even after putting new API key of open ai , how can I fix this ? Also does pdf size matter in this ?

[@user-gu5fz3vn7t]

is it ok to use your code for personal, education and or commercial application?

[@rishiraj2548]

🙏🙂👍💯

[@umeshkumarasamy6608]

Also I have another doubt. Why are the similarity search results returning the same results twice. Does that mean there are duplicate entries in the vector database? If so how do you avoid such duplication.

[@afannouni1837]

Hi what version of python did you use

[@manujmehrotra2771]

What is the software that is being used here to draw and elaborate.

[@NotesandPens-ro9wx]

Sir why you contenate raw_text with content variable ? I didnt get it

[@chanchalsahu5023]

What is the purpose of giving a provider while generating the DB

[@user-fo7vm9px8f]

It give me the details from outside of the pdf also. How can I restrict this with only PDF?

[@BhuvanWebOsmo]

Can we use gemini embedding for this project? (Cause it's free)

[@Balajinicky]

hi, Krish what if the pdf has graph, images and scanned copies how to embed them and push into the VectorDB. It will be full fledged project idea. why are you not using milvus which actually works well

[@namanagarwal6549]

this is a major problem while extracting data from pdf or docx file

[@VinodKumar-ku7yi]

Thanks Krish for sharing this video. Is it possible to do query with multiple PDF. in our case we have pool of Resumes in PDF format and HR wants to query using LLM and they want to get the relevant CV. Suggest if you have any idea.

[@krishnaik06]

Yes it is possible

[@Pubba_]

@@krishnaik06Can you tell me what are the changes we need to do if we do query with multiple documents?

[@akashramdham7704]

I'm also working on a same task but till now I haven't found anything interesting

[@shraddhamishra5642]

yess please tell me also..

[@user-sz2mi4bk4l]

Hey dude can I get ur twitter or telegram i have lot of doubts related to this field I guess ur the genius to answer those !

[@madhugarg7499]

Hi All..Anyone is facing the error: 'OpenAI' object has no attribute 'embed_query' - After executing the "astra_vector_store = Cassandra(....". please tell how to fix this ?

[@aniruddhajoshi4055]

can someone plz help me.. 1. in just last lecture, we had used Pinecone for embeddings, and now casendraa and all that .. Why? what is the diff? 2. In order to read pdf, why can't we use the same approach : def read_doc(directory): file_loader = pyPDFDirectoryLoader(directory) documents = file_loader.load() return documents Beacause this code also goes with the same approach: read data -> divide into chunks -> embeddings

[@darshandodamani6682]

I am learning Machine Learning I have bunch of PDFs . Can I use this tutorial to create a pdf question answering. I also need that the pdf has sall short cuts notes mentioned. I want to use the pdfs and get the detailed information once I ask the question to it. Is it possible sir?

[@charanya5209]

i am planning on doing it. Have you done with it? If so guide me

[@darshandodamani6682]

@@charanya5209 I tried it but couldn't complete full. I think it couldn't be done without the GPT free trail. We have to buy the token.

[@charanya5209]

@@darshandodamani6682 That's ok. Thank you

[@NerdNetArcade]

Hi Sir, I am getting this error - "InvalidRequest: Error from server: code=2200 [Invalid query] message="Unknown keyspace articles" But i am using the Keyspace as None only, Please help me astra_vector_store = Cassandra( embedding=embedding, table_name="qa_mini_demo", session=None, keyspace=None, )

[@mananmaini6968]

i am getting the same issue ...any tips to resolve that?

[@bablusingh-ij1sw]

can you create a video without using the OpenAI

[@lalitjoshi6528]

Error i encountered is token limit is 4169 and you are using 4925 token in your prompt and 200 in question. So how to fix that or how to modify that code for larger text files of 2mb

[@krishnaik06]

U need to change the into multiple documents chunks and then send

[@liquid_pro2344]

how can i find openAI_API_KEY

[@ashoksamrat8486]

I want to design a ATS system so that I can filter the resumes based on job description. Suppose there are 10000 resume of candidates and I want to get Top 50 or 100 resume that can be best suited for job description. input:- 10000 resumes in pdf format. Output: Top 50/100 resume that best suited for job description. How can I achieve this using LLM and Streamlit for UI?

[@madhugarg7499]

@krishnaik06 - Please take some time to answer your KZbin videos, at least for the recent & new technology videos.

[@kanagadavid931]

why so many probably ?

[@bossmanish2879]

😂😂😂

[@shraddhamishra5642]

sir can we used for pdf folder which include atleast 50+pdf so how we do for this??? please sir tell this ..

[@Balajinicky]

Yes, you put them in s3 bucket call them directly and process it. It will work

[@squadgang1678]

This is RAG right?

[@krishnaik06]

Yes

[@HrisavBhowmick]

pls do a video where we wont use any API key

[@krishnaik06]

Use llama2 its an open source model

[@user-mj7xr5nf7b]

In above video is LLM model is responsible to interact with Cassandra DB and get the output for desired query ? Also, do we need to train the LLMs model with the pdf data or it just integrate with DB and give us desired output? Please explain about Promote templates in above videos where I can use it ? Thank you in advance.

[@esotericwanderer6473]

Great content, just one suggestion, stop using "probably" word in every single sentence unnecessarily, it is just irritating and distracting. otherwise great video, learnt a lot. keep going Thank you

[@Nikhil-dp2mw]

yellow

[@enough200]

Can you stop using the word "it will probably do this"? It will or it will not.why probably , basicall

[@nnajijuliet5024]

You are m@d Create your channel and use what you want