Chat with MySQL Database using GPT-4 and Mistral AI | Python GUI App

Build a Natural Language SQL Chatbot with GPT-4 and Mistral AI: A Complete Tutorial
This is a tutorial on building a natural language SQL chatbot using GPT-4 and Mistral. This chatbot isn't just any chatbot; it's designed to communicate with a SQL database in natural language.
In this detailed video, we cover everything from setting up your development environment to integrating OpenAI's powerful GPT-4 model for generating SQL queries based on natural language input. Whether you're a beginner or an experienced developer, you'll find valuable insights into developing applications that interact with Large Language Models.
--------------------
LINKS
🐱 GitHub repository: github.com/alejandro-ao/chat-...
❤️ Buy me a coffee... or a beer (thanks): link.alejandro-ao.com/l83gNq
💬 Join the Discord Help Server: link.alejandro-ao.com/HrFKZn
✉️ Get the Newsletter: link.alejandro-ao.com/AIIguB
📌 Post with Notebook and explanation of the MySQL Chain: alejandro-ao.com/chat-with-my...
--------------------
Key Highlights:
- Creating the Chat Interface: Learn how to set up a user-friendly chat interface that allows users to ask questions in natural language.
- SQL Query Generation: Discover how to utilize GPT-4 to generate SQL queries from natural language questions.
- Database Interaction: Get hands-on experience connecting to a SQL database, running generated queries, and interpreting the results.
- Enhancing User Experience: Explore how to implement conversational memory for follow-up questions, making your chatbot smarter and more intuitive.
- Tech Stack Deep Dive: Dive deep into the technologies used, including Python, Streamlit for the frontend, LangChain for integrating language models, and SQL Alchemy for database management.
By the end of this tutorial, you'll have a fully functional SQL chatbot that can interpret natural language queries, generate corresponding SQL queries, and fetch and interpret results from a music store database. This project is not just a fantastic addition to your portfolio but also a solid foundation for developing advanced AI-driven applications.
Whether you're aiming to impress potential employers, showcase innovative projects to your clients, or simply share your creations with friends, this tutorial equips you with the skills and knowledge needed to stand out in the tech world.
Don't forget to like, share, and subscribe for more tutorials on the latest software technologies. Join our Discord server for community updates and discussions on the fascinating world of Large Language Models. Let's embark on this journey together and unlock the full potential of AI in application development!
🚀 Timestamps:
0:00 Introduction
2:21 Setting Up the Project
5:39 Build the GUI
11:10 Integrating the Database
17:49 SQL Chain Diagram
20:28 Make chat interactive
27:09 Create SQL Chain
38:43 Create Full Chain
50:05 Runnables
53:45 Add Mistral AI Model and Test
59:53 Conclusion
#SQLChatbot #GPT4Tutorial #AIProgramming #SoftwareDevelopment #PythonTutorial #OpenAI #Streamlit #LangChain #SQLAlchemy #TechTutorial

[@jim02377]

I just made it through the entire tutorial. As usual you attention to the details is awesome. Now I want to try to agent version and see the difference!

[@aristoz1986]

Great!! I will try it out this week!! Keep on going with the good stuff🎉

[@alejandro_ao]

Thanks!! Let me know how it goes!

[@muhammadqasim6524]

Congratulations on your Diploma. 🎊 Enjoying your videos.

[@BrandonFoltz]

Oh yea! More to learn this weekend! Cool to see all of these technologies merging and synergizing. Keep up the great work!

[@alejandro_ao]

Thank you Brandon! Always a pleasure to see you here!

[@adityabhagwat6965]

Great content! Appreciate you sharing. Excited to give it a go!

[@matiasparouy]

Thanks Alejandro for sharing! excellent video! 👏

[@alejandro_ao]

thank you man :)

[@vinayakmane7569]

I am loving your work bro . dont stop . keep making such unique projects

[@alejandro_ao]

thank you! there is much more coming up :)

[@mlg4035]

Congratulations on your diploma!! Great video!

[@alejandro_ao]

thank you!

[@hakeemowais9845]

Great .... Will try to implement this week 🎉🎉🎉🎉

[@alejandro_ao]

let me know how that goes

[@lookingaround1586]

Thanks @alejandro_ao. Could you make a video on implementing graphs/charts alongside the NL response? Congrats on your diploma!

[@shashankkumardubey6260]

Great project. As a beginner this project can help me to learn better. Do make some more unique projects . Keep doing great work.

[@alejandro_ao]

thank you mate, i will!

[@AmirShafiq]

Good stuff and great explanation

[@alejandro_ao]

thank you sir 🫡

[@ilsms]

Thanks for sharing ! The best video

[@alejandro_ao]

it's my pleasure!

[@babas5990]

Congrats on earning your diploma.!!! Thank you for your excellent video tutorials.

[@alejandro_ao]

thank you!!

[@openyard]

Thank you. Another video with great content.

[@alejandro_ao]

thank you!

[@charleslee8318]

So cooooool! You are hero. Talented

[@alejandro_ao]

glad this was useful! keep it up!!

[@scollin10]

Love your walkthroughs! I’m using your method and approach to chat with a MySQL database of resumes. The eventual goal would be to build up the database of both resumes and job descriptions and have my team of recruiters be able to prompt it to optimize efficiency.

[@alejandro_ao]

hey there, that's an awesome idea! just remember that, for a real application, you should not use the `root` user of your mysql database. create a new user that only has READ privileges. you wouldn't want your LLM to accidentally write anything into your database or delete some data!

[@scollin10]

@@alejandro_ao I use a .env for now just as good practice but it is all local as I’m encountering some issues. I would love to pick your brain and chat over coffee or a consultation session if that’s cool.

[@scollin10]

@@alejandro_ao Thanks for the tip on using root! I would like to pick your brain and seek your help on my app. I'll shoot you an email.

[@kingfunny4821]

Thank you for your wonderful efforts and excellent explanation Please, I would like to ask you whether it has been explained how to make a conversation with files without using the Internet, that is, it is only local

[@RaushanKumar-ut2ke]

Hey alejandro. Do we have any method to connect multiple schema for database chatting

[@djaz7347]

Hi Alejandro , is possibile to connect a DB2 database through jdbc?

[@bobcravens]

I’ve been enjoying your channel. I wonder at what temperature there is a probability of the LLM dropping tables from your DB ;-)

[@alejandro_ao]

oh yeah, absolutely, please DO NOT use this with a mysql user that has write privileges

[@JuanPalacios]

excelente informacion!!!!

[@alejandro_ao]

gracias!

[@redo22011]

Thxs for sharing, its a great work!!! can you add similar example for amazon bedrock Claude 3

Thx Alejandro , great stuff like always .. crystal clear 😎. I changed your code a bit to use it with a postgre database, works like a charm !✊❤‍🔥

[@alejandro_ao]

that's so cool! which adapter did you use to connect? psycopg2?

@@alejandro_ao yes this one

I started to push the prompts a little further (formatting, tone, etc...) it's a really good base to work with. Thanks again for this starter kit 🙏💪

@@alejandro_ao did you ever try with a mongodb?

[@alejandro_ao]

@ so glad to hear this!

[@NasserTabook]

Great tutorial, Thank you for the hard work

[@alejandro_ao]

thank you, i appreciate it!!

[@ritishajaiswal9918]

Hey Alejandro, Thanks a bunch for the helpful video. Could you make another one where you show us how to use a model we've downloaded locally (Can be a quantized one)?. Also, it'd be awesome if you could include Vertica database as the DB in the process. You don't have to go through the whole process again, just maybe explain how to connect to the database using the local model. I've heard there are models like SQL-coder-7b that are designed for translating plain English into queries. It'd be really helpful if you could check out a few of these models and share your thoughts on which one would work best in this kind of situation. My organization is pretty cautious about sending sensitive data to LLM model APIs, so it's important for us to be able to do this kind of thing locally without relying on APIs. Looking forward to the next video. Thanks again for all your helpful content!

[@laurarusu1989]

Hi, I did this with llama3-7b. Actually the code is the same one from the video. First, you install the local model. in my case I installed llama3-7b by running in Terminal 'ollama pull codellama:7b' then I run 'Ollama run code llama:7b' (you can go to the llama site and see the actual command) then when I set the llm I used 'from langchain_community.chat_models import ChatOllama llm = ChatOllama(model="codellama:7b")' . everything else should be the same. Langchain supports many different llms, you could see the documentation and check if the llm you're interested in is available and use the corresponding module. I hope this helps you :)

[@TheAbanik]

Amazing video as usual, very helpful. Could you explain why you decided to use GPT 4 instead of 3.5 Turbo ? Is GPT 4 better in crafting the sql queries based on natural language ? Also can you try creating a video based on langchain agent to showcase a use case where user asks a question, the response can be either in a document/pdf or from a database and agent needs to figure out the correct way to respond.

[@alejandro_ao]

hey there, sure. i used gpt-4 because i needed its 128k token context window to be sure that it could ingest the entire database schema. but actually, when the schema could fit in GPT-3's context window, i found that it actually worked better. i will be doing videos on agents very soon!

[@yugeshkaran7547]

Thanks for the video bro . Now I have built and hosted the similar chatbot on streamlit cloud community, but I have encountered an error with connecting with MySQL database. I have crossed my database server but still i haven't resolved it. Could please guide me what the issue might be??

[@RahulM-lm6qg]

please make video for this usecase only using open source LLM models

[@akshaysangwan2172]

The code you taught works properly for small queries but fails to write complex queries and provides incorrect information. Can you help? I'm using ChatGPT-3

[@victorchrist9899]

Congratulations on your diploma

[@alejandro_ao]

thanks!!

[@blackpanther3005]

Hello, good day, excellent video, sorry, how much VRAM did you use for the project?

[@alejandro_ao]

hey there, all the completions of this app are done in remote servers, through the providers' APIs so they are the ones dealing with all the processing power. you could run this in an old raspberry pi tbh 😎

[@Jtheshooter]

Congrats on the diploma sir 🎓

[@alejandro_ao]

thank you sir 🫡

[@RaushanKumar-ut2ke]

All the methods I saw is to use single schema but I didn't find any workaround for connecting multiple schema for database chatting

[@VoltVandal]

congrats !

[@alejandro_ao]

thanks!

[@user-ce2sg2dp4n]

Hello, great tutorial as always. I am completely new to this, so after running the code and changing a few things I keep getting this error "AttributeError: st.session_state has no attribute "db"" and I do not know how to solve it.

[@SatyendraJaiswalsattu]

Nice tutorial, please make one video - how to entract with my excel sheet data

[@alejandro_ao]

great idea!

[@aadilgani5528]

Congratulations on getting your diploma, can you please make a video On Chat with SAS (clinical data .bat files) database using open-source LLM.

[@alejandro_ao]

I have never used sas, but a senior technical architect there implemented an agent that interacts with sas data. Maybe this can be useful to you: www.linkedin.com/posts/bogdanteleuca_how-to-create-your-custom-langchain-agent-activity-7161603166952734720-jqRo/

[@tapanpati9452]

cool,bro i have a scenario to create a chatbot using 36,000 pdfs ,do you have any idea,but rag is not giving accurate answer.

[@AIWALABRO]

I love this video! can I put it into my resume? In the end, you said that in real life we do things by "agents" instead of "chains". here we did it with "chains". 1) so for the production-ready how we approach it are we used chain or agents? 2) can you make a video by using agents?

[@alejandro_ao]

hey there, absolutely! feel free to add this to your cv :) 1) i would test both. the only difference is that an agent would probably be better at processing your query. it would be able to check the result from the mysql database and reformulate its sql query if the result does not answer the user's (your) question. best would be to test both and see which one performs better! 2) coming up!

[@AIWALABRO]

@@alejandro_ao thanks for your response! eagerly waiting for the agents video in mysql, we can say mysql part-3.

[@JoEl-jx7dm]

Hey i have issue hosting on streamlit cloud, could ya try?

[@thangarajerode7971]

Could you please create the video about how to deploy the steamlit app into langserve?

[@1sanak]

Grats on the diploma! Can I use the same method to connect to a MSSQL DB?

[@alejandro_ao]

thanks!! i heard some guys from the channel were trying to do this. i haven't tested myself. but look, apparently you can pass in a driver just like we did here with mysql, but for MSSQL: docs.sqlalchemy.org/en/20/dialects/mssql.html#module-sqlalchemy.dialects.mssql.pyodbc

[@fozantalat4509]

Can you create this app tutorial using agent instead of chains, that would be really awesome.

[@alejandro_ao]

i will probably do something like this using CrewAI

[@udaynj]

Does this mean that OpenAI and/or Langchain have access to your database schemas and also the data generated? That could be a huge security risk for most companies.

[@Ganitham-GenAI]

Will the test results and the data be exposed to LLM or only meta data

[@alejandro_ao]

yes, all data goes through the LLM. if privacy is your concern, you can load an open source model locally, such as llama3

[@niyetheg]

I need your help, I followed all the steps and I am at the last part where I ask questions and get feedbacks but I keep getting this error validation error even though I have included the API KEY. for ChatGroq __root__ Did not find groq_api_key, please add an environment variable `GROQ_API_KEY` which contains it, or pass `groq_api_key` as a named parameter. Please what can I do?

[@gianni4302]

print under it to see if its accessing the Groq qpi key, or just input the key and see if it works. if it does its an issue with the parth to your .env. make sure to 'load_dotenv()' at the start instead that may help

[@manikandanr1242]

If we ask questions from out from db example user enter hi what will be it response

[@alejandro_ao]

hopefully the overall chain would be able to get that you were actually just saying "hi". but in order for your program to decide whether or not to call the database depending on the user question, you might need to create an agent or a bit more sophisticated chain

[@nguyenduyta7136]

Thanks god for having cool man

[@alejandro_ao]

thank YOU!

[@SoyCharlayCafe]

I love you!!!

[@alejandro_ao]

i love you more!

[@crepusculoooo]

Next video with agents!!

[@alejandro_ao]

yes sir

[@saibaldasgupta1]

Is this code can be use for postgresql?

[@vincentfernandez7145]

You need to use psycopg2-binary instead of my-sql-connector

[@tofani-pintudo]

Yes, you just need to change the db config.

[@stanTrX]

Thanks but traditional forms to pull data from db's would be probably more efficient.

[@user-bb6hp8hn2f]

Hello, greetings and congratulations on obtaining your diploma. Once again, I would like to ask you a question. I may need to analyze MySQL data. The first step is to execute sql_chain and run SQL statements, and the second step is to add an analysis chain. The problem I encountered is: when I add self-awareness knowledge to prompt words, and when I ask self-awareness questions, two chains need to participate at the same time. How can I control the first chain not to execute or have any other way to only run one chain, which may make the program more powerful. Let me give an example: User: hello! AI: hello, can I help you? When I asked this, he didn't need to execute SQL statements, but now he still does. So there are the issues mentioned above. I hope you can understand my language, because I am Chinese and this question was translated through translation software. I do not know English. Wishing you again.

[@alejandro_ao]

Hey there. If you want something more interactive, that is able to respond to other questions and not only those strictly related to generating a SQL query, you should probably implement an agent. LangChai makes it very straightforward to implement agents: python.langchain.com/docs/modules/agents/. You can also use CrewAI to create a team of agents: docs.crewai.com/ I hope this helps!

[@user-bb6hp8hn2f]

@@alejandro_ao Thank you very much. I have benefited a lot from watching your latest video.

[@stanTrX]

How those code tips are popping in vs code? Does anyone knows?

[@alejandro_ao]

hey there, that's github copilot. saves a lot of time :)

[@tapanpati9452]

Can you please make a video how to use langsmith?

[@alejandro_ao]

definitely, i'm working on it!

[@kaleshashaik5959]

Can we do this using offline LLM model?

[@alejandro_ao]

absolutely, just initialize your LLM using ollama instead of openai or groq

[@trideepsaha2594]

This is what we have been waiting for a time, No words only 🎈🤩..We must all do our homework. Special thanks for groqcloud.Congratulation on your Diploma AO.

[@alejandro_ao]

thank you!! very glad to hear this was useful! let me know what else you would like to see!

[@trideepsaha2594]

@@alejandro_aoFrom this side anything u want to teach. #AI #RAG #LangChain #FineTune

[@utk1000]

bro your langchain pdf reader with API code is outdated. it doesn't work Ive been stuck for a couple days

[@zeelthumar]

Langchain is updating their docs rapidly 😢

[@utk1000]

@@zeelthumar youre right

[@galdakaMusic]

Is posible all on local mode?

[@alejandro_ao]

of course, in this video i am using a local mysql database. if you refer to a local model, yes. you can use ollama instead of openai or mistral.

[@syedhashir5014]

can i build the same with MongoDB?

[@alejandro_ao]

of course! but you would need another type of chain. i'll make a video about this soon

[@syedhashir5014]

@@alejandro_ao plzz do

[@nguyenduythai4585]

i want it to print the message that the question is not related to the db. Help me ?

[@alejandro_ao]

hey there, maybe you can add to the final prompt that "if the context does not contain the answer to the question, please say that the information could not be retrieved from the database", or something like that!

[@nguyenduythai4585]

@@alejandro_ao you can help me with code...

[@nguyenduythai4585]

@@alejandro_ao can you help me with code

[@nguyenduythai4585]

@@alejandro_ao you can write code here.

[@gianni4302]

Great tutorial, but i keep running into error 400 due to token counts. Any real world schema alone will bump up to almost 10k tokens. anyone found a workaround? A tutorial on this would be lifesaving!

[@VibhuSharma]

I am running into the same issue, always getting exceeded token limit error. Were you able to figure out any workaround?

[@Namita212]

Can anyone tell where will I get keys mentioned in env file

[@alejandro_ao]

hey there. if you want to use openai’s models, you have to create an account at platform.openai.com. Their models are paid for but they are the best, plus each query is like 2 cents and i think they are still giving away a few dollars for first time signups. if you want to use mistral (for free), just go to groq.com and create an account. You can now create an API key in their portal and use it like in the video. make sure to use the same variable names as in my .env file

[@Namita212]

Hey thanks n congrats on ur diploma. The first two I have got, where do I get langchain api key.

[@adelinadonisa]

At 9:50 how did that SQL database chat page opened 😢? Maybe I am stupid but I can't figure it out if you run the code or not 😂

[@alejandro_ao]

hey there, that’s a good question. what i opened there is not actually part of the app. i just opened the command line of my computer and showed that i have a mysql server running locally ;)

[@adelinadonisa]

@@alejandro_ao Thank you!

[@akhil2729]

Has anyone managed to work with postgresql?

[@marvinmarkham8405]

dont talk to the mic so close but great vid

[@alejandro_ao]

sorry bout that! :s

[@Namita212]

Please tell where i get langchain api key,sorry to bother again

[@alejandro_ao]

no bother at all. you don’t actually need that to run this app. the api key you see there is to use Langsmith (the logging platform where i showed the steps of the chain and the intermediate results). you can run the whole app without it. but if you want to check the logs of each step of your chain, you can get it here: www.langchain.com/langsmith

[@Namita212]

Thanks for explaining. U r awesome guy.❤

[@lAutoDidacte]

Hello Alejandro and thx for the vidéo. I'm having an error with this "from langchain_community.utilities import SQLDatabase". it says "Import "langchain_community.utilities" could not be resolved". Also, i have this error for this "from langchain_groq import ChatGroq" "Import "langchain_groq" could not be resolved". Any solution plz ? thx.

[@alejandro_ao]

hey there. it seems like you don't have the packages installed. did you run `pip install langchain-community langchain-groq` ? be sure that you have your conda environment activated when running this!

[@lAutoDidacte]

@@alejandro_ao hi. Yes i have all the packages. I just restarted vs code and all the errors gone. Know it’s ok 👍. Thank you for the video and for the answer 🙏.