LLM Project | End to End Gen AI Project Using LangChain, Google Palm In Ed-Tech Industry

[@codebasics]

Check out our premium machine learning course with 2 Industry projects: codebasics.io/courses/machine-learning-for-data-science-beginners-to-advanced

[@aarjukumar6831]

A doubt - How does the llm get to define the input variables i.e. context and question without being explicitly mentioned by user? We nowhere mentioned that the context should be the vectordb and question should be the user query. Any help would be appreciated! PROMPT = PromptTemplate( template=prompt_template, input_variables=["context", "question"] )

[@kalkarlengebhai]

same doubt

[@_sarthaks1768]

Hey there Dhaval Sir ! Just finished creating this project, Following along and It was really amazing ! Got to learn a lot in the process. Had some issues with installations and versions at some steps, But solving them helped me learn more. Thank you very much 🙏

[@codebasics]

Great 👍

[@DARK-fs3rz]

Can you please elaborate on what issues you faced at time of installations and versions as when I installed all the packages of the requirements.txt it gives this import error : ImportError: Could not import google-generativeai python package. Please install it with `pip install google-generativeai`. Code : from langchain.llms import GooglePalm api_key = "my api key" llm = GooglePalm(google_api_key=api_key,temperature=0.8) I had installed google-generativeai but it still gives this error

[@amuralikrishna22]

@@DARK-fs3rzI am getting error when I try to load it data=loader.load() error: 'utf-8' codec can't decode byte 0x92 in position 1197: invalid start byte.How to fix it?

[@codebasics]

Excellent 💯

[@aloktiwari4604]

@@amuralikrishna22 Open the csv file, you will find some special characters in prompts. Remove them and try again.

[@gauravkungwani]

at 19:12 you are using "docs" but it is "data" there, how it is working ?

[@kishore961]

I used docs and got the same behaviour. I pondered for a while and just moved on. :)

[@cyberking405]

@@kishore961 , im facing lot of issues with packages used in this project. could you please help me out. its been 3 days since im facing this issue. i have tried in both vsocde and pycharm. please help me out

[@PrathameshShete-ik2xo]

I am very excited when I watch video and title. It's full fill all the needs. And I have a request to you can you add to read pdf which are present in the website that also read and gave answer regarding that . See most of college of University update there notification panel only like they upload pdf. And if we use this it's only scrape the text data present on the website can it also scrape the pdf and creat knowledge base using all the data present on websit. And if it's done there next big hurdle is some are only upload image so can our ai will read that data like if some students of college got placed they not updated the placement page rather than put banner on the homepage. But overall love your content all the time❤❤

[@kishore83]

This is a great learning. Trying out with the samples but does not seem to be working. Facing errors while compiling with Python 3.12. Any suggestions?

[@DevShahin-zm8ni]

In the first part of project before asking the LLM model a question, you compare user query with csv, my question is it concept of RAG?

[@chinnibngrm272]

Yes .... Waiting a lottt😍...... Sir in previous Rocky Bot... When I am using the urls which was provided by you...The data from urls is not fetching...( The docs where Empty) But when I tried with other urls i am able to run without any error... Could you please give me a solution why it is happening... Please sirrrr

[@codebasics]

It can be that it has issues browsing those urls. You can try it again to see it works. Or we need to debug it further to check what the issue is. For me it was working ok without any problems.

[@chinnibngrm272]

@@codebasics Yes sir.... There is issue while browsing the urls.... As you said I have tried multiple times.... More than 20 times... But still not working for the urls you provided... Please help me to slove sir.... I wish I will get proper solution from you.... Soo that i can put this project in my resume.. Because by seeing your videos I have learned all the things related to Langchain+ llms... (Built small small applications to get practical knowledge) ...But not able show them as end to end project... I thought this rockybot application is very good application to showcase in my resume... Please help me sirr

[@amuralikrishna22]

​@@chinnibngrm272hello in this question answering project I am getting error when I try to load it data=loader.load() error: 'utf-8' codec can't decode byte 0x92 in position 1197: invalid start byte.How to fix it?

[@anandmaurya9629]

same problem.@@amuralikrishna22

[@NishantKumar-dw5er]

How well it works for Tabular data having columns from SQL DB. Should we use SQlAgent or Vector DB can work. We aren't getting good result from SQLAgent

[@MehrabEvanC94]

Hi, i am struggling about Out of context. how to minimize the percentage of out of context response?

[@chinnaiahkotadi4702]

Thank you sir . This vedio will very very useful to students. Moreover it is inspiring to those are settling as data scientist

[@codebasics]

You are most welcome

[@harshseth427]

@@codebasics SIR UDATE DISCORD LINK

[@rishitha3506]

Please can you make a video on RAG implementation

[@superrelaxation508]

thanks Dhaval sir for another cool end to end project but I think we are missing one thing is that the Deployment part

[@lalitagarwal9155]

Sir please create this project as per new syntax of langchain, I am getting stuck while converting it into newer version.

[@ParthivShah]

Thank You So Much dhaval sir. Love from Gujarat ❣

[@abc123-uk8uv]

Raise NotImplementedError( NotImplementedError: Need to determine which default deprecation schedule to use. within ?? minor releases....plsss help me to solve these...after 36.13

[@gabbaSL]

Hi did you resolved the error ? i am having the same issue.

[@ayush07310]

​@@gabbaSLwere you able to solve whole project?

[@gabbaSL]

@@ayush07310 yes

[@ayush07310]

​@@gabbaSLsorry to ask you again were you able to complete the project ? Since it's been 6 months I'm worrying whether I can start and finish this project without any outdated stuff

[@vishwmewada4007]

Very Nice video Dhavalbhai. I have question what are the privacy related risks connected to using this approach. Any data breach or anything like that ?

[@gagan5801]

Thank you very very much.I can't explain how important this video was for me.

[@younessaznag470]

thank you bro you re a reference in this domain, might allah guide you and help you .

[@AI_Expert_007]

Thanks for the great and very very simple explanation of whole process. The method you explain the concept is extraordinary. Just super !!!

[@kashifahmad9880]

Retrying langchain.llms.google_palm.generate_with_retry.._generate_with_retry in 60.0 seconds as it raised NotFound: 404 Requested entity was not found.. gettning this in logs when i am generating answer.

[@amiralioghli8622]

Hi, sir. Since you are working with sequential data, may I kindly suggest that you consider creating a video tutorial on implementing Transformers for time series data? This tutorial could cover topics such as forecasting, classification, or anomaly detection. It's not necessary to cover all of them; just one would be sufficient.

[@abc-code6]

❤❤❤❤q

[@chinnaiahkotadi4702]

We are expecting blockchain technology and TinyML course also sir

[@rahulvenkatesan8394]

Sir how to integrate it to React.js ??

[@kalkarlengebhai]

In prompt template there are two variables context and question. When you are using chain("do you have js course"). Is retriever the context? How will it know which is question and which is context?

[@JJChen-bt4be]

Hi, महान लोग, I am wondering how you evaluate your model performance

[@AbdulHadi-hl3el]

Sir we are encountering ImportError: Dependencies for InstructorEmbedding not found. Please tell how to resolve it . Can we get a list of all depedencies so we do not have to install them one by one . I have already downloaded the files in requirment.txt

[@lulumartinez8441]

Hello Dhaval, great tutorial as usual ! I have a, probably silly, question (sorry about that). I saw that even after the 'Instruction' prompt has been specified to indicate to the model that if not relevant documents have been retrieved it must answer 'I don't know'... there are some retrieved source documents anyway, why is that? It is clear that model is not using them as a context for its answer, how can he knows that it must not use them? There is some similarity threshold behind? Thanks ! :)

[@ahmadazhar5432]

why don't you save the chain like you did with vector db? and use that model. Im suffering from re running it, as in colab i had gpu, on my machine I don't, plus on colab there are libraries which make configuration easy. if you can please share a tutorial managing like that it'll be great

[@AlonAvramson]

I wish to better understand the issue of context and question prompt_template = """Given the following context and a question, generate an answer based on this context only. In the answer try to provide as much text as possible from "response" section in the source document context without making much changes. If the answer is not found in the context, kindly state "I don't know." Don't try to make up an answer. CONTEXT: {context} QUESTION: {question}""" PROMPT = PromptTemplate( template=prompt_template, input_variables=["context", "question"]

[@suhaskishore1615]

sir, you are awesome! I wish we we had projects like this during undergrad.

[@abbasghori2002]

Sir please make more project videos with open source hugging face model and more focoused towards fine tuning

[@singarajah-nj4qc]

sir, is there any better way to create a conversational chatbot for a huge database using langchain. I am encountering issues with the payload limit.

[@AnirjitDattaRoy]

Anyone doing this Project now or has done recently , I need some help actually , Firstly , llm ( ..Prompt..) and InstructEmbeedding these two syntax didnt work , so used HuugingFace embeddings instead , and secondly : I have succesfully completed until the Document chunk retreival step following this code (also created the chain) , But at the last step when With those chunks , it will interact with the LLM , I have tried many times but the Chain("...Question...) syntax is showing error , I have also tried with chain({'query':'question'}) , that also is not working , so stuck at the last stage , anyone may help?

[@kashifahmad9880]

Hi my project was doing well but from few day it is showing Retrying langchain.lIms.google_palm.generate_with_retry.. _generate_with_retry in 60.0 seconds as it raised NotFound: 404 Requested entity was not found.. getting this in logs when i am generating answer.

[@jasmineding4515]

Using chain.invoke("")

[@RadhakrishnanBL]

Great content, thank you and appreciate your effort. Shall we take the same approach to fine tune a LLM to generate python code ?

[@sandhiyas352]

if i have csv and excel file consist numerical and categorical now i want to get output in llm even for numerical also how to do it ? i need ur help to start this

[@Raaj_ML]

Why are we not splitting the document content in to chunks, in these examples ?

[@Animesh_AD]

Sir, Good morning. The way you teach the concepts are phenomenal . Love you from bottom of my heart. Do this kind of video more in coming days. I know that majority just go by the fancy thumbnail but this kind of video need too much effort. Thank You again!

[@AbdulHadi-hl3el]

How can we integrate it to a working website??.....Has anyone tried it??

[@MehreenMunsif]

what's the difference between query and retrieve? because both are returning the same result

[@m.bashar4309]

Plz bring more langchain projecta

[@codebasics]

Yes. One more project will be published next week. It will be in retail domain

[@Rohit-ju8kp]

I have tried to fix this code. It is giving error while running this code.

[@yeongnamtan]

how does the system associate answers with prompts if you only load and embed the prompt column ?

[@unitecq4014]

Sir can u make videos on how to predict future results with past data in basketball or even football I am trying to create a basketball prediction which predicts the result at any point of time of the match

[@ankitkumar-ve1bg]

Hi Sir , I stay in Bangalore and I had applied at AtliQ ....Sir can we meet?

[@QUniversity]

Hi, can you also cover end to end Autonomous AI agent creation and deployment. There is plenty of material online but almost no one covers the topic comprehensively enough.

[@yogeshindulkar320]

why can't we use streamlit in jupyterlab why we need pycharm code editor

[@rohitmore3637]

Sir I am having an error while retrieving question's answer. The error says list index out of range.

[@sairampolishetty3211]

@dhavalpatel,can we say this as rag chatbot which uses source url for context from vector database?

[@codebasics]

Yes

[@farheenfatima9414]

I have a question. Is it not necessary to clean the data after loading it?

[@terrykeiran4582]

where the new question is going to add ? is there any performance matrices to check?

[@Jackeychan-ve8sg]

Best country to land a job as a data analyst ??????? Tell sir🤚

[@Jackeychan-ve8sg]

Best country to land a job as a data analyst ??????? Tell sir🤚

[@Jackeychan-ve8sg]

Best country to land a job as a data analyst ??????? Tell sir🤚

[@Jackeychan-ve8sg]

Best country to land a job as a data analyst ??????? Tell sir🤚

[@Jackeychan-ve8sg]

Best country to land a job as a data analyst ??????? Tell sir🤚

[@sriharshap1971]

sir i am getting credentials error while running just the poem line itself !!!. can any one help me

[@yash-seth]

were you able to get a solution for this?

[@Jackeychan-ve8sg]

Best country to land a job as a data analyst ??????? Tell sir🤚

[@Jackeychan-ve8sg]

Best country to land a job as a data analyst ??????? Tell sir🤚

[@sonyannem]

Thank you for providing such a valuable videos, In your free time could you please make a video on Concept Normalization .

[@atharvadhokte6272]

@ codebasics sir I am facing issue while installing faiss cpu, can anyone please help

[@kashifahmad9880]

Same here have solve this error?

[@AmitMishra-j2k]

Dear sir how to download all model and embedding concept in my local server and how can run the all process without internet connection.

[@AmitMishra-j2k]

Hello... guys if any buddy have know so please tell me..

[@maly7422]

Thank u sir!! Plz make a 6 month roadmap for a fresher data engineer with free resources its a request..

[@Jackeychan-ve8sg]

Best country to land a job as a data analyst ??????? Tell sir🤚

[@mainuddinali9561]

❤❤❤

[@SatyendraJaiswalsattu]

getting error for line embeddings = HuggingFaceInstructEmbeddings( query_instruction="Represent the query for retrieval: " ) ImportError: Dependencies for InstructorEmbedding not found. any help??

[@gauravbisht3683]

i am also getting the same error .please let me know if aapka theek ho gaya hai yeh error toh

[@random_guy_7]

use a different embedding like embeddings = HugginngFaceEmbeddings() this could be seen on the langchain embeddings like he mentioned

[@anandsahu6767]

You have to do pip install instructor and then pip install sentence-transformer==2.2.2 don't use the latest sentence-transformer

[@solomanvarghese6481]

ImportError: Dependencies for InstructorEmbedding not found. This error shows even if I installed all libraries

[@AbdulHadi-hl3el]

same problem with me , please update if you have found a solution.

[@anandsahu6767]

You have to use pip install instructor and then pip instan sentence-transformer==2.2.2 these are the dependency for instructor embeddings

[@akbarboghani1]

Thank you for sharing such informative session

[@codebasics]

Glad it was helpful!

[@NANDITHAN-f7i]

18:46 the whole cell is not working😢

[@yashrami2531]

yes bro, same.. been stuck there from last 3 hours. If you have found the soln, please share

[@AbdulHadi-hl3el]

Same bro....please update if you found a solution.

[@kashifahmad9880]

Bro have you solved this??

[@aravintht3004]

Why there is no textsplitters/chunks used here ?

[@AzizulhakimRashed-mr8dl]

Is it possible to do it on colab?

[@anandsahu6767]

Hey folks 👋 , i have just created this project using updates dependencies and models. Since the video a bit old and there is countinous changes in the libraries we have to change the code a bit if any one want any help you can reply me on this

[@aryanthakur0009]

Hi can u help me

[@anandsahu6767]

@@aryanthakur0009 yes tell me

[@kashifahmad9880]

Hi i getting error now my project is not working Retrying langchain.lIms.google_palm.generate_with_retry._generate_with_retry in 60.0 seconds as it raised NotFound: 404 Requested entity was not found.. getting this in logs when i am generating answer.

[@jasmineding4515]

Hi! Do you have any repo that can share? Have questions on all the dependencies.

[@anandsahu6767]

@@aryanthakur0009 yes tell me what's the issue

[@saisimranpatro8164]

how to get the OpenAI api key when the existing key has expired , any help or suggestions?

[@wckd6726]

Simply generate a new key no!?

[@akashkamble4684]

I've been looking for a detailed guide on LLM projects, and this video delivers exactly what I needed. Kudos to the presenter.

[@ayush07310]

Hey were you able to complete the project ? Since it's been 6 months I'm worrying whether I can start and finish this project without any outdated stuff

[@praveenkumar-wb4wc]

Hi Dhaval, When we can expect AI+ML course in code basis

[@codebasics]

I am building math/statistics course right now once that is launched, next one is AI+ML. It will take few months though.

[@Sangeekarikalan]

When can I call myself a data scientist or a machine learning engineer. What all courses in your playlist will help me reach that tag name

[@codebasics]

in youtube search "codebasics data science roadmap" watch that video to know what all you need to learn

[@showmethemoney824]

why vector FAISS db from_document for documents parameter is Docs instead of data from loader.load() in the notebook? I think it's typo but may be Im wrong

[@awangsuryawan7320]

Up

[@cyberking405]

sir, im facing lot of issues with packages used in this project. could you please help me out. its been 3 days since im facing this issue. i have tried in both vsocde and pycharm. please help me out

[@cyberking405]

sir, im facing lot of issues with packages used in this project. could you please help me out. its been 3 days since im facing this issue. i have tried in both vsocde and pycharm. please help me out

[@AbdulHadi-hl3el]

same here...please update if you have found a solution.

[@kashifahmad9880]

Have you solved?

[@AbdulHadi-hl3el]

@@kashifahmad9880 yes , make the project in a new virtual environment then install all the packages required , i have used google palm embeddings instead of hugging face instructor embeddedings and some other packages...

[@AbdulHadi-hl3el]

@@kashifahmad9880 yes , make the project in a new virtual environment then install all the packages required , i have used google palm embeddings instead of hugging face instructor embeddedings and some other packages...

[@muhammednishad6003]

Is vector database same as embedding matrux?

[@sidindian1982]

Excellent Sir ... Truly mean it 😍😍😍😍

[@AlonAvramson]

Thank you! this is a great video!

[@MrRobot-mb6rq]

Amazing content. Loved it 💥

[@dn9416]

Not Audi

[@souravbarua3991]

This tutorial video helps me to complete my project 'chat with local pdf file'. Thank you 🙏.

[@codebasics]

So glad it resonated with you! 😊

[@vijaybhargavkarnati9926]

Hey I have a question, so can we use a Word document instead of a CSV file and make the QA application by following the same.

[@cyberking405]

sir, im facing lot of issues with packages used in this project. could you please help me out. its been 3 days since im facing this issue. i have tried in both vsocde and pycharm. please help me out

[@eyekathir]

Waiting to hear from you

[@GM-rw5fl]

Maza a gya

[@flaviobrienza6081]

When I try to access to MakerSuite it says "Restricted Access". Why?

[@codebasics]

did you login using your google account? Anyone with a google account should be able to access this.

[@flaviobrienza6081]

@@codebasics yes, still got restrictions

[@flaviobrienza6081]

@@codebasics got why, in Italy the API is not available

[@md.mahadehasan737]

I was facing the same problem in Finland. Tried with VPN and it works.

[@flaviobrienza6081]

@@md.mahadehasan737 yes, in EU is not available

[@farhanafridi8694]

Thank you for this

[@Gurur_shots]

Love you sir ❤

[@gabbaSL]

Does any one tried this recently and ran without any errors?

[@Pranava_ai]

I tired but Google api key error

[@shashankshetk]

Awesome explanation

[@NehaSingh-fb8kj]

Great content

[@swadeepsudini9353]

Thank you!

[@piyushshukla238]

is it related to data analysis???

[@codebasics]

No. This is related to data science, machine learning, Gen AI

[@defikanth]

waiting...

[@DH0809]

yes

[@VikasAgarwal-o5c]

@Codebasics- Error Message - line 154, in __init__ raise ImportError("Dependencies for InstructorEmbedding not found.") from e ImportError: Dependencies for InstructorEmbedding not found. . Can you pls help me to fix this issue?

[@meowgu9132]

yes I got the same error too how do we fix this

[@meowgu9132]

installed the required dependencies but still get it

[@ttvgolive3436]

i was getting this error too bro and i used gpt4all instead of instructembedding , its working fine for me

[@meowgu9132]

unfortunately gpt4all failed for me too@@ttvgolive3436

[@meowgu9132]

not sure if its becoz mine is m1 Mac or sth..

[@samasrinivasreddy961]

great work

[@abhishekghosh9523]

Did you face any issue's while embedding? Please do reply

[@samasrinivasreddy961]

@@abhishekghosh9523 No ,i have not faced any issue ...suppose if you face any issue you can use other embedding techniques like hugging face "sentence-transformers / all-mpnet-base-v2" or "sentence-transformers / all-MiniLM-L6-v2" other transformers to embedding

[@abhishekghosh9523]

@@samasrinivasreddy961 Hey thanks for the reply! But already sorted the issue. Presently facing some dependencies issues while trying to run it on vscode, with huggingfaceinstructorembedding. Have you faced something similar?

[@ayush07310]

​@@abhishekghosh9523 hey have you finished the whole project ?