LLM Project | End to end LLM project Using Langchain, Google Palm in Retail Industry

Build End-to-End LLM project for a retail domain (t-shirts selling store). We will use SQL Database chain in Langchain along with a few shot learning to build a question and answer system that can talk to MySQL database and generate answers.
Code: github.com/codebasics/langcha...
Langchain, LLM playlist: • LangChain Tutorials Pl...
Here is the tech stack for this project,
* UI: Streamlit
* LLM: Google Palm LLM model
* Embeddings: Hugging Face
* Framework: Langchain
⭐️ Timestamps ⭐️
00:00 Introduction
00:29 Project Requirements
03:17 Technical Architecture
06:45 Google Palm API key set up
08:17 MySQL Database Setup
10:40 Simple SQL DatabaseChain in Langchain
25:45 Few Shot Learning
41:49 Streamlit UI
Do you want to learn technology from me? Check codebasics.io/?... for my affordable video courses.
Need help building software or data analytics/AI solutions? My company www.atliq.com/ can help. Click on the Contact button on that website.
🎥 Codebasics Hindi channel: / @codebasicshindi
#️⃣ Social Media #️⃣
🧑‍🤝‍🧑 Discord for Community Support: / discord
📸 Codebasics' Instagram: / codebasicshub
📝 Codebasics' Linkedin : / codebasics
------
📝 Dhaval's Linkedin : / dhavalsays
📝 Hem's Linkedin: / hemvad
📽️ Hem's Instagram for daily tips: / hemvadivel
📸 Dhaval's Personal Instagram: / dhavalsays
🔗 Patreon: www.patreon.com/codebasics?fa...

[@mdmusaddique_cse7458]

Thank you uploading such detailed project videos. Learining newer tech like langchain becomes easier with such tutorials.

[@user-qm9gu2me4w]

I am watching videos on Generative AI from last 7-8 days and this one is so easy to understand. Thanks

[@SandeepKumar-rj3te]

This is one of the best tutorial I watched so far, it is comprehensive with perfect example. feeling lucky after going though this.

[@rajv4509]

You really are a fantastic teacher! Thank you for the time and effort that you have put in to create this outstanding video.

[@aruneshuma]

Its such an amazing video. You explained such a complex topic in a simple language and the demo alongside nailed it. !! Hats off to you!

[@arri5812]

Thank you sir, I took this project as base for my major project in college and it got selected , you helped me in my majors thanks sir thanks alot.

[@sardorabdirayimov]

Your body language is excellent, folk! That makes the topic to understand easily!

[@lakshmir9946]

Amazing tutorial. really helpful. Thanks Dhaval Patel sir.

[@kotresht1804]

Thanks for the video. Concepts and flow explaination is really nice. Its taking some time to digest all of this.

[@umeshtiwari9249]

Thanks you Sir. you make really best videos with clear concepts. please make more projects it will really help

[@umeshtiwari800]

U always explain very easily😊

[@parth.mandaliya]

I binged on the playlist, how come this does not have millions of views?

[@smeetkathiria1182]

Excellent video Dhaval Sir. 👌👏🏻👏🏻

[@henilshah.]

My sincere thanks to you for making such an insightful video, sir It would be great if you could make a video on how to create a custom LLM model. Currently, we are using another company's LLM, so I want to create a new one and publish it to the public or Huggingface. love from Gujarat

[@drogokhal3058]

Dear sir, thank you very much for great tutorial! Keep it going on!

[@dasigiraghu640]

hats off , took me a while to understand fewshotprompttemplate

[@abdulqadar9580]

Amazing project

[@maroofabdullah9031]

GREAT project!!!!!!!! Waiting for more LangChain Projects

[@codebasics]

please check a playlist link in the video description (I have 3 end to end projects already on LLM in education sector, finance and this one is on retail)

[@ikennanwosu3261]

This seems like a really good video, I'll be watching this later today. Wondering if you have a project where Databricks is used as data source?

[@harsh2014]

Thanks for this tutorial !

[@karthiksundaram544]

Nice teaching ❤

[@Breaking_Bold]

Excellent !!! Can you make a video on (1) How to deploy custom LLM applications to Production (2) How to Evaluate LLM models

[@samimbsnl]

For Big Database again inform queries by Prompt(like train LLM again) is huge job . May other way like Fine Tuning Model on Specific domain or Retrain it.

[@2dapoint424]

This is goldmine of information!!

[@loading757]

What if we change database every day like we insert or delete? This will work?

[@2dapoint424]

@@loading757Why will you change DB everyday?

[@loading757]

@@2dapoint424 i mean if we alter, insert delete or make changes in db?

[@sesesmith4783]

@@2dapoint424 😂😂😂😂

[@panhtran8384]

Thank you 💯❤

[@fantasyxpress7966]

How humble dhaval sir who keeps us motivated

[@codebasics]

Thank you, Happy Learning.

[@loading757]

​@@codebasicsbut sir if we need answers of multiple coloumn what will we do? And database changes everyday, is it incorporate with our model?

[@danielgroth6998]

Amazing video💪

[@senthiljun1987]

Well explained

[@KanupriyaDhiman]

Very nice use case! Quick question though, we don't we create a dashboard out of this DBMS?

[@trendyjewellery1987]

Superb

[@SurendraKumar-ci3vt]

Hi Dhaval Please make a video on How to Evaluate LLM models? Which metrics need to use?

[@vishalsaichindepalli2798]

Thank you for this video! I was wondering if there is a way to do this with Gemini 1.5 Flash or Gemini 1.5 Pro

[@FutureAIUpdates]

Great video Dhaval❤

[@codebasics]

Glad you liked it!

[@user-rl2px8uq1n]

How can I do it if I have elastic search instead of mysql database?

[@pankajvats421]

Can we use langchain in corporates. I mean using API access key may be not secure to use in corporate industries because of data security

[@user-jy2tu4qb2p]

Hey, Great Video ... How can we do this for Question Answering LLM Task.

[@priyaranjan2094]

Can I perform the same with MongoDB (No SQL) too? Does langchain support that @codebasics?

[@gauravfamily2209]

Hi, how I will decide that which GPT version will suitable for my project as below code? Please send any guideline/rule regarding this. Thank you. chatllm=ChatOpenAI(openai_api_key=os.environ["OPEN_API_KEY"],temperature=0.6,model='gpt-3.5-turbo')

[@akrsrivastava]

Is this free slot prompting scalable in production environments? There can be so many tables, do many different kinds of possible queries. We can not keep asking queries to prompts. Also these few shots examples would need to be part of the LLM context will be costly.

[@gudiatoka]

Great 🎉

[@codebasics]

Thank you !

[@jagdishmudaliyar1645]

sir how to give table and column name description to llm since most of the time the names are assigned based on domain knowledge so how to give custom description

[@saitarak1824]

I'm facing an issue with sentence-transformer. Even after installation when it comes to HuggingFaceEmbeddings, it is throwing error install no module named torch._c and also says to install sentence-transformers. Python, torch versions are matching though.

[@koushikroy8668]

Hi , this video was super helpful for my work but can we retieve the SQL query without running it, actually I want only the SQL Query. I tried with logger but failed. Any good idea would help a lot.

[@ThemanB1997]

Is it possible to use hugging face llm model api key too

[@rahneshin752]

❤❤❤

[@siddheshphapale95]

can we ask context based response? eg : Q1 . "how many XS size thsirt are there?" ans 50, Q2. "and S size?" LLM will understand the context of Q2 which is 'SiZE'

[@tharunps8048]

I have a doubt. Will this send my Database contents/schema along with API request to LLMs for queries I ask ?

[@sainukala9]

how to print associated SQL query for the question in streamlit?

[@maroofabdullah9031]

Can we access MongoDB as well?, becoz i could not find docs related to MongoDB.

[@user-to9zl4xm5v]

hi sir, while doing langchain i found that model is passing unwanted quotes to the db. Can you suggest any solution to rectify this problem?

[@nemsingh6035]

Please make a video on prompt engineering

[@gudiatoka]

Please make a video from database to deployment...❤

[@sidindian1982]

i am getting error .. while importing file from .SQL (mySQL ) to MS SQL SERVER

[@user-xf8ki4jp5g]

I am trying to join the list but i am getting error like this "sequence item 3: expected str instance, dict found" how can i solve this error please help me to comeout from this

[@Maneesha352]

I have no science background in my school level and i completed my post graduation.is it eassy to shift data science filed.. If i can learn data science certificate programm.. If data science short term course are available in data science filed

[@rakeshkumarrout2629]

can you make a video on finetuning llm for cyber security.

[@NRAnalytics]

which google-generativeai version have you got installed? i am getting tons of errors due to version mismatch...

[@aryanraina1932]

Same here bro

[@bookcentralpakistan2497]

I've been facing a problem where I'm not been able to connect local host. Please help if anyone can.

[@saiprakashreddy8590]

In production answers might change every day, it will be not possible to change answers every day right? And what about if I need data in table format, It will only answer in one single word, if we need data of 2 or more columns, so what would be the approach for it?

[@loading757]

Same doubt

[@altanbagana98]

what if the quantity of t-shirt decreases which means someone buys after some time passed, do we need to change few_shots list's values and rerun the whole process? or llm figure out by its own?

[@loading757]

Exactly my doubt

[@loading757]

You did this project?

[@vms7597]

I'm able to run it on jupyter notebook but pycharm throws this error for the wrapper: validation error for SQLDatabaseChain database instance of SQLDatabase expected (type=type_error.arbitrary_type; expected_arbitrary_type=SQLDatabase)

[@user-du4kl4by3y]

i got this error too, if you find a solution can you tell me how you managed? thank you in advance

[@shreyasreedhar1225]

Could you resolve the error?

[@shashiraj6093]

Hi sir good afternoon

[@codeshivam_3434]

Hii sir, 2nd year cse student sir, certification ka bhi workshop rakhiye if possible please

[@honprarules]

How do we add memory to this?

[@MyWorkoutDiary11]

Another superb video. Can we build "End to End LLM Project Using Langchain, OpenAI in Finance Domain" which you shown 1 month ago with Google PaLM? I am asking because as you said google PaLM is free. So those who doesn't have OPENAI paid account then they can practice it. If possible then please make a video on it. Thanks in advance

[@codebasics]

Hey yes for that finance project you can use Google palm instead of open ai. you can get it done with few lines of code change. I am not sure if I will have that to make a separate video on that. consider this as an exercise for yourself 😃

[@MyWorkoutDiary11]

@@codebasics Thank You very much for your kind support. You are a real gem of this industry. You are putting your great effort for India's bright future.

[@DheerajJ-tl6cl]

Did you figured it how to use Google PaLM instead of OpenAI

[@DheerajJ-tl6cl]

I have been working on it for a long time but getting error at embedding

[@sidindian1982]

​@@codebasicssir can this be connected sql server db?? .. I am using quite long

[@bhaskarmarepalli2448]

How to use Gemini?

[@technova430]

Sir you are using a GPT api key internally how they work and what is providing in the code when you use the chain function then you are not going to encode query. And you pass LLM = LLM means what??

[@johannanderson848]

Bro you got a long way to go

[@technova430]

@@johannanderson848 means

[@pragneshsolanki8243]

Which python version is used in this project & Why? There are new version available like 3.10, 3.11, 3.12

[@memesthatifoundonreddit6432]

use 3.11 or 3.10 dont go for 3.12

[@pragneshsolanki8243]

Thanks @@memesthatifoundonreddit6432

[@veeru18]

I am getting issue with langchain libraries , pls advice python version and import lib versions -- Thanks

[@loading757]

Dont trust this guy. You will stuck on midway 😢😢

[@mukilanru]

Can we use HuggingFace InferenceClient?

[@Sy06274]

Obviously

[@siddharthrane2430]

Does this project include any paid Suprciptions for keys?

[@codebasics]

No

[@sriharshap1971]

I am getting error at the starting stage itself while using the google palm

[@sidindian1982]

Activate your api key

[@shivanshusoni4445]

Error of this line :--to_vectorize = [" ".join(example.values()) for example in few_shots] This is the error :---------------------------------------------------------------------------- TypeError Traceback (most recent call last) Cell In[31], line 1 ----> 1 to_vectorize = [" ".join(example.values()) for example in few_shots] Cell In[31], line 1 ----> 1 to_vectorize = [" ".join(example.values()) for example in few_shots] TypeError: sequence item 3: expected str instance, dict found If I change above line with this to_vectorize = [{" ".join(str(value) for value in example.values() if isinstance(value, str))} for example in few_shots] this is working fine but in next line vectorstore = Chroma.from_texts(to_vectorize, embeddings, metadatas=few_shots) it is giving me this error 86 texts = list(map(lambda x: x.replace(" ", " "), texts)) 87 if self.multi_process: 88 pool = self.client.start_multi_process_pool() AttributeError: 'set' object has no attribute 'replace'

[@user-ge4lm5qj3k]

Feel bad for Lauki Lal

[@user-cb8jk9se7s]

31:53 Facing error at vectorstore = Chroma.from_texts(to_vectorize, embeddings, metadatas=few_shots) ValueError: Expected EmbeddingFunction.__call__ to have the following signature: odict_keys(['self', 'input']), got odict_keys(['self', 'args', 'kwargs'])

[@rohaanmanzoor3268]

pip install chromadb==0.4.15

[@rajeshayyagari1944]

​@@rohaanmanzoor3268even after installation am also facing the same error

[@nandanab525]

still getting same error. did u fix it?