Use AI to chat with a relational SQL database with natural language!

Demo app: github.com/alex-wolf-ps/chat-...
Intro to Azure OpenAI
• Learn Azure OpenAI - G...
My other AI videos:
Use AI to chat with a NoSQL database: • Use AI to chat with a ...
Learn to code a simple AI powered app: • Learn Azure OpenAI - B...
Learn to use AI to chat with your document data: • Learn Azure OpenAI - C...
Learn Azure OpenAI fundamentals: • Learn Azure OpenAI - G...
Learn how to authenticate to Azure OpenAI the RIGHT way: • Authenticate to Azure ...
In this video we'll explore how to use the powerful OpenAI gpt-4 model to search your SQL Database using natural language. GPT-4 excels at understanding natural language, and can even understand database schemas and produces code and SQL queries of its own. We'll explore a working demo, the app architecture and the code necessary to get this working.
00:00 Intro
01:09 App demo
05:53 Architecture
07:12 Database setup
09:17 AI service setup
10:57 Explore the app code
20:13 Search service concepts

[@alexthecodewolf]

The demo app is now available here: github.com/alex-wolf-ps/chat-sql-data-demo Sorry for the delays!

[@MarvinMarkhamBurgos]

Is it possible to run this on my mac m3? How can I get it up on my localhost once I have the Azure DB and the Azure OpenAI service up?

[@dipteshbose]

Awesome. Thanks

[@Jake-td8nm]

AI has so much coverage, and 99% of it is either "here's a photorealistic image that has 13.5 fingers" or even worse the generic "You should be terrified because AI is coming!" both of which hold no value, provide no context, and don't show any use case that's valuable to 95% of individuals, and 100% of enterprise. Conversely, this video shows an actual coherent use of AI that could blow up and be super valuable - actually improving the productivity of people using it. Bravo!

[@alexthecodewolf]

Thanks, I try to showcase real world demos instead of just flashy but useless concepts

[@pwakabi]

Excellent piece

[@sindhupillai1354]

Good starting point for the people who are exploring more with Gen AI. Thanks for sharing valuable real time use-case. I am in 'Subscribed'. Hurray! waiting for more such use cases.

[@511Burak]

Hi thank you for sharing. Is there a way to get the sample code?

[@alexclark6777]

Remember Microsoft English Query? Pepperidge Farm Remembers...

[@lshagh6045]

That was very useful and professional. Thank you indeed and thanks for sharing 👍

[@alexthecodewolf]

Thanks I appreciate it!

[@ShaharNardiaAllOverTheNet]

thank you very much wolf🙏 exactly what I am coding right now for my customer

[@alexthecodewolf]

Thank you so much, generous!

[@bengroseclose1795]

Your a helpful cheerful youtuber :D

[@twenty4marc306]

Hi, do you have a public demo?

[@andrewherrick879]

hi this is pretty cool. is your code available open source? i checked your GH but didn't see it. thanks!

[@mouradaissani8957]

very good, thank you 🐺

[@alexthecodewolf]

Glad you enjoyed it

[@mouradaissani8957]

BTW ; 11:00 warning , ur openaikey is exposed ;) @@alexthecodewolf

[@liammcmullen4497]

Thanks

[@alexthecodewolf]

Thanks so much for your support! It means a lot.

[@sajjadmussani]

very informative. can you please share the code of your Razor app?

[@rubberuk]

Excellent video! Have you got a link to source code? thank you.

[@sinamohammadpourinaeim1058]

Hi Code Wolf Thanks for your useful video, Is there any offline AI Service to use the same thing in our local machine or our own sever?

[@alexthecodewolf]

Hey, thanks for watching. There are definitely local AI models, but I haven't worked with them enough to recommend any sort of solution for this. Would probably be a good topic to research for another video :)

[@applepeel1662]

Hey! Please share the source code! This is honestly really cool

[@jyothirmaimachavaram4307]

Hello, Could you please let me know where can I get the source code for it?

[@Joly0]

Is it possible to have a version, that works without azure? So using the normal openai api with a key and maybe other llm providers such as ollama?

[@alexthecodewolf]

I actually just made a video about this using Ollama, hah. It shows this same setup at the end using codellama kzbin.info/www/bejne/Z2iaootsotWsg8k The concepts in this video should work with any model that is skilled at text to code (such as code llama) and a SQL database of some sort. You'll have to experiment with different models and prompts to see which works best.

[@TellaTrix]

Wowo ! No more developer required to binding data and complex query.

[@alexthecodewolf]

Yeah one of my favorite things about this is it can help devs as much as analysts because it can write your sql queries for you....to some extent :)

[@aeromeme]

Hi, could be possible to have database definition in azure storage file so that way we aboid large prompt, or is there any other solution.

[@alexthecodewolf]

Hey, good question, this is something I'm also looking into myself - how to only have to send the schema once and be able to update and maintain that schema in an active context. So far I haven't found a solution I'm happy with yet but I'll respond here again if I do. The models are getting better at deconstructing large inputs all the time, but I understand from a cost perspective its not desirable.

[@ShaharNardiaAllOverTheNet]

@@alexthecodewolf I tried using the assistant for that - sent him all the scheme in JSON files but it sucks 😔

[@feelzzgaming6306]

Hi @alexthecodewolf ! Thanks for the video. I have two questions: Is there a way to use OpenAI with and SQL database, without using the Azure OpenAI Service? It is currently only for people and companies who have requested special access. So Im wondering if there is a workout where I can use the OpenAI's API directly towards my own Azure SQL Database, and not have to rely on the OpenAI service on Azure? Number 2: Do you have the source code anywhere? Hope you will reply ASAP as im currently working on a project that has come to a halt.. Thank you very much! :D

[@alexthecodewolf]

Hey, thanks for watching. You should be able to use the regular OpenAI service (non Azure) with this exact same approach, there might just be some slight differences in the code and authentication. I'm not sure how pricing differs between them. Currently this code is part of a separate project I'm working on that I adjusted for this demo, so at this point I can't distribute the source code to for a few reasons, sorry!

[@feelzzgaming6306]

@@alexthecodewolf any idea what the code for that approach would Look like? Spent all day today, but to no avail.. also, thanks for the response!!

[@alexthecodewolf]

Due to the requests here I'm working on getting the source code available for this, it was tied to a project I couldn't release but am working that out.

[@mukshobhit]

Thanks, did you get chance to get repo?

[@user-wt5uy9pn5e]

Thank you Alex, looking forward to learn how to do it

[@alexthecodewolf]

@@mukshobhit It's available now, thanks.

[@alexthecodewolf]

It's available now, thanks.

[@user-wt5uy9pn5e]

@@alexthecodewolf Thank you Alex, grateful for making it available

[@mohan007ish]

Can we use GPT-35-Turbo instead of GPT 4?

[@alexthecodewolf]

You can certainly try using GPT-35-turbo, but GPT-4 included major improvements to understanding and responding with structural content. However it'd be interesting to see how well 35-turbo does in comparison, I didn't actually try that myself.

[@polly28-9]

Thanks a lot! How about huge database? We send the whole schema with the initial prompt which costs a lot? How to solve this problem with huge database?

[@alexthecodewolf]

This can be tricky - I'd recommend this solution for small to medium size databases, I have some other content coming for larger database solutions. However, theoretically this solution can also work with large databases if the table structure is consistent/standardized. You'd probably need to use one of the large GPT models though, such as the 32k GPT-4, which accept higher volumes of tokens. I've been trying to figure out if there's a way to have the AI Model "store" or remember the initial schema prompt, but I haven't been able to find an ideal solution for that.

[@polly28-9]

@@alexthecodewolf Thanks a lot! Please, if you find some ways to have the AI model "store" or remember the initial schema, make such a video or write to me. I'm looking forward to it. Thank you!😀

[@hirenshekhda3567]

Hello sir can you please source code for education purposes? Its working universe database?

[@goodtimeforever2035]

Hey @alexthecodewolf - Can you able do the same video using AWS ?

[@alexthecodewolf]

Hey, this should work using any powerful large language model and SQL based database, did you have a specific scenario in mind?

[@THEDTSMAN]

What happens if someone says “delete all the data” ?

[@alexthecodewolf]

That's a really valid concern, you'd want to make sure the app is running as a user that only has read permissions.

[@Baraka-yl2dp]

Code Wolf, can you please share your source code?

[@alexanderkamenev5529]

GIT REPO IF YOU DONT MIND PLEASE