ChatGPT API in Python

Exploring the ChatGPT (GPT3.5) API from OpenAI and building some simple chat applications with it.
Github code: github.com/Sentdex/ChatGPT-AP...
Neural Networks from Scratch book: nnfs.io
Channel membership: / @sentdex
Discord: / discord
Reddit: / sentdex
Support the content: pythonprogramming.net/support...
Twitter: / sentdex
Instagram: / sentdex
Facebook: / pythonprogramming.net
Twitch: / sentdex
Contents:
0:00 - Why use the ChatGPT API
2:10 - How to query the ChatGPT API
7:45 - History and dynamic input w/ ChatGPT API
15:30 - Comining everything so far
18:25 - Building a Gradio chat application with ChatGPT

[@isaacandrewdixon]

I have always loved that you don't edit out errors and mistakes, and show us your process of trying to understand them.

[@kenchang3456]

I always love that he laughs at his mistakes.

[@satya.antonio]

I agree! That's very valuable. To see how intelligent people go through analyzing a problem and looking for a solution. And it also gives time for us to think along the video.

[@krzysiek6293]

This is a beginning for numerous of startups

[@CodingWithLewis]

I love how simple the API is! We really are in the gold rush of AI based applications.

[@nickwinn]

We are indeed, it's exciting and scary. I'm writing my first chatgpt app that will troll scammers on craigslist.

[@tomb.8375]

@@nickwinn simple but it would have been nice if they managed the history?

[@fordtify]

I started watching your videos in 2017 in college. Thanks to you and specifically your pygame series I'm a mid level SWE

[@awesomefeldmanfamily]

Amazing!!! Thank you!!! I was always waiting for this!! I have notifications set for your channel but I never get any notifications, also I didn't even see any of your videos for the past year on my feed or anything

[@real_Emmanuel]

Your awesome. Keep making simple videos like this! I just subscribed because of how simple this was.

[@nikitaserov33]

Greatest guy on the internet, always loved the way you follow your passion and work not on just some classical stuff but playing with whatever is interesting for you If you’ll ever want to work on AI-aided chemistry/medicine - our Chemistry and Artificial Intelligence lab in ITMO university is fully open for you 🥰 Continue making great stuff 👍

[@YashPachchigar69]

Always loved your tutorials videos

[@riveradam]

I was about to write "you don't need an API key" but then I did a sanity check. I thought I was using `gpt-3.5-turbo` API for free, but what's actually true is ... if OPENAI_API_KEY is in your environment variables, then `import openai` will automatically find that key and use it. I'd previously set the env var for testing `text-davinci-003` (GPT-3) AND I'd included `openai.api_key = os.getenv('OPENAI_API_KEY')` in my code, but when I tested `gpt-3.5-turbo` for the first time I forgot the second line and then when it worked I assumed they'd removed the need for a key. Great video! Thanks!

[@caioflores4918]

Nice job, man. Regards from Brazil!

[@nickpalladinos]

Great work! The API is extremely easy to use, and I was able to create a small hack (little-reasoner) that combines the power of ChatGPT and the Z3 theorem prover.

[@GiantsOnTheHorizon]

Total side note but I wanted to tell you how amazing your Neural Networks from Scratch book is. Ive started down a few roads with NNs and I normally prefer video but you have really made it so clear and so much fun to learn. Congratulations on creating the perfect technology book!

[@sentdex]

Awesome to hear this! Thank you!

[@adilmajeed8439]

Please share the book name

[@kweekkikker]

​@@sentdexI am a painter, and like all you do, even the mind blowing 1st hand errors you can't hold your laugh about, I rofl than 2, everything. Simply because u rite

[@yellowboat8773]

I’ve been a sub of your for years, funny thing is I am not a programmer, or even remotely work in the field you produce videos on. I just love watching your curiosity take you around the j Ferber and take your time to teach others. Well done mate

[@kweekkikker]

So true❤

[@nuclear_AI]

The longer between this video and your next one, the more excited I get.😂😂

[@pookiehd]

Perfect timing, I was just about to use it in my next project.

[@kensai7]

Tons of wisdom, as always. We thank you! 🤓

[@tanmaydash2108]

Always loved your work .thank u for ur inspiration.m deep fan of urs.

[@javiers2133]

awesome video as always thank you very much, I hope you have a great day!

[@naidol]

Bro. This is a great tutorial. Most other people are just publishing some nonsense gpt-api stuff. You are bit of a whacko (compliment) but i 😍 your speed of tutoring. You did not waste our time by going back to check on AI reply about which moon it was sizing. Great stuff dude.

[@msaeed5961]

Best channel to learn python.

[@I33nc3]

I have already done and deploy a ChatGPT "proxy" via web and an API for mobile apps. It works great, I'm here for the assistant history part. :) Can't wait to see that because for now, I'm truncating the history down to 500 tokens, which is working pretty good for me.

[@I33nc3]

Unfortunately I did not get the answer from this vid. I can't wait for the next one. :) Using user+assistant role instead of system role is a very clever idea. :) thanks! Btw, if you have any chance to get Whisper API working on Android that would be awesome. I could not find any good solutions to that. Uploading mp3 to the server is not an option 😃

[@raomuhammadsharjeel8029]

Who has been waiting for this for a long time now?

[@davidwu3247]

thank you so much for this brotha. real lifesaver

[@schlechtestergtaspielerdek3851]

Amazing! I am building a cocktail maschine with this. I recognise voice with speech to text, feed it into the API. Like "I want a martini please", I will feed in with the custom add on to convert the cocktail to a json with a given format, my cocktail machine can use and make a cocktail with. :)

[@samahirrao]

A big thanks from an Indian. Amazing stuff you post. God bless you.

[@patricksweetman3285]

Great video, thanks.

[@funkahontas]

In my experience, the system role is really useful for things like restraining the bot as to what it can do , and also to give it some background information like how it would like to be called or what tasks it can perform. So when the user asks :" what can you do for me ?" The chatbot can answer what the system says it will be able to do or what it's main purpose is , and the personality you want the bot to have. The system message may be something like "You are a language translation helping bot, you cannot talk about anything else, your name is Bob and you are a stern but calm teacher."

[@kweekkikker]

I smell spam . I Red this 1 twice already

[@Brickkzz]

Back to tutorials! Hell yeah!

[@davidobembe5302]

I just love your videos ♥️

[@generichuman_]

System is where I define the persona of the bot, any special instructions, and most importantly, where I dump any additional information that will be useful to the bot. Text retrieved using semantic search, summarized chat logs from previous conversations etc.

[@Jlane31]

Great video, thanks for posting it. Can you try editing the first prompt and have it say what is the circumference of Earth's moon? My guess is the script could reference the message history but since there are so many moons it wasn't sure you meant Earth's. Anywho, good content!

[@jfjesus1980]

Although they say that the assistant role is needed in order for ChatGPT remember the previous responses, from my experience, it only works if you also define a system role.

[@OZtwo]

Been meaning to get around to it, but really would like to setup ChatGPT so that it can talk with itself on two different systems just to see what happens. :)

[@user-cy2on3gc3k]

Thank you so much for sharing 💚💚💚💚

[@edellenburg78]

I used the api to make a chat bot for my discord community, but they used it too much, and I could not afford to keep it going, but man having a group chat with AI is crazy.

[@mytechnotalent]

ahh yeah this one it is cheap to use and this is a great example thank you!

[@sptoo123]

It's quite interesting. I try to make it a role with the "spell" : "You are a well-trained AI multi-task language translator. When I input non-Chinese sentences, you should output Chinese translation sentences. While I input Chinese sentences, you should output Vietnamese. You only need to ouput the translation result, no need other words or explanation. If you understand, say OK." It succeed in the first, but with more sentences input, it confused, even I input a chinese sentence, it return a chinese sentence "translation" (which is the same words because no need to translate) but not a vietnamese one. I'm not sure why but it just can't understand or forget the tasks when I input like 5~6 non-chinese sentences and some chinese sentences.

[@111wizo]

Great vid but was just wondering what the rate limit on gpt-3.5-turbo is since I couldn't find any solid documentation online and wanted to know it since I plan on mostly using it for my own recreational use which will involve quite a bit of requests being sent? Currently still on the free plan but I want to confirm this before going paid.

[@AbhishekKumar-se2ub]

I was wondering when you will upload such video

[@caspercby]

Love your python setup in V.S. for openAI !! Do you have a video tutorial on it? Thanks!

[@sanattaori6209]

Thank you

[@goonie79]

Is Azure's generative AI solutions the only option to both fine-tune and build guardrails for niche chatbots? It seems to be the only option to feed custom indexes in a GUI so that the chatbot is bespoken for specialized use cases.

[@abilovestotrade]

Which extension in VS Code helps with the completion of syntax like that ?

[@UncleEngineer]

Wow, Thank you

[@dansu1503]

Thanks for the great content, sentdex! If I understand the process correctly, every time the user adds a message, we need to extend message_history and pass the entire message_history to ChatGPT is that right? My concern is that the cost for giving N responses would scale on the order of N^2 (if all future messages require the full history). Although I cannot think of any other way to use ChatGPT currently--unless there is some "delta" api call that can pass in new messages and load past tokens for free? I think this is a rather big barrier to "indie" developers adding ChatGPT to certain applications--wonder if you have any thoughts on this!

[@anthoniG]

Yeah I'd like to know this as well. I can see it getting out of hand and just swallowing tokens.

[@michaelfekadu6116]

15:23 Since the initial question never said “Earth’s moon” the AI had to infer that’s what you meant. It is technically true that if you had referenced the “Earth’s moon” in some prior conversation then the history of that prior conversation would not be given to the AI. The AI can access chat history, but only the current chat history.

[@monstercameron]

@20:19 isnt that type of prompt what they give as an example in the docs for system prompts?

[@alexgts1234]

I love how you took one of the previous top comments (previous video) into consideration to "live" code again, like "back then" when your channel was small.

[@thefigmaster3519]

In my experience, its difficult to restrain GPT. For example if you make a request to it that future messages should conform to some format but you later ask it to stop that, it will stop. No matter how ademant you are that it should not violate a rule in a message, this can be overruled in a future message. Thoughts?

[@trentleslie2888]

You are a nerd's nerd, and I love it.

[@nisargbhavsar25]

Which intellisense are you using in VS Code?

[@tomb.8375]

Thanks for your video. I am wondering, how much will it cost as we keep sending the message history? My question is really: if we keep the history building between messages, will our cost increase because we keep submitting the history ?

[@Riitabobita]

Hi, I want to learn about data analysis. I don't know anything about it, but I'm interested in starting something new. I was looking into starting the data analysis course on Coursera, but just wanted to see if I should take another route before doing that. What would you recommend? Thanks in advance!

[@jalladcom-sq1wk]

You are amazing .. thanxxxxxxxxx

[@xntumrfo9ivrnwf]

lol I'm following along but I didn't get this fluke with the "which moon is this in reference to" question - worked fine for me

[@borisdominguez9089]

Man, I love you.

[@houssem009]

What os are you using? And was that a bash terminal? Looks more like zsh terminal, would love to see a video about your setup

[@HubbiNashrullahM]

It looks like Ubuntu

[@markp2381]

You could explore building something with Langchain

[@xbox9092]

amazing !

[@rudrakshcodes]

What font family are you using for the vs code?

[@Veptis]

how do you feel about using a terminal within vscode?

[@alroygama6166]

Which vs code plugin are u using to get those code suggestions?

[@metaltech3944]

Wouldn't having to send message history every time you want a predication get very expensive token wise?

[@robbyriverside]

It makes perfect sense. It is not a bug. GPT has no idea what moon you are refering to. It just knows what people have said about the moon and if they didn't clarify what moon, then it has no idea. In fact, it never has any idea. It is a stocastic parrot.

[@Ironmechanic-ct2yw]

This API is crazy.

[@edgarbernal-martinez4698]

question. to remove the user's input from the textbox in Gradio. Do you need to use "with gr.Blocks () as demo? i noticed I was using 'gr.interface': demo = gr.Interface(( fn=CustomChatGPT, inputs=input_textbox, outputs=output_textbox, title="" ) )

[@tielessin]

I wonder where the conversations would end up if you have another ChatGPT model play the role of the user

[@JoeTinnySpace]

Black holes my friend

[@Primarycolours-]

@@brandonbahret5632 it still need user's prompt in it to answer any questions, in short: it doesn't change a thing about how it interacts with the user.

[@brandonbahret5632]

@@Primarycolours- what? No, you can totally have chatgpt interview an instance of itself. Its just like asking GPT-3 to generate a transcript and not providing any stop codes.

[@konstantinrebrov675]

What is the VS Code extension that you use for interactive Python?

[@pd2437]

It would be great if you could make a series on Transformer models!!!

[@real_Emmanuel]

How would I customize the page where you are asking questions. For example, if you wanted to turn the textbox green and chatbot box red?

[@akoslaszlo974]

thx. the video! how can I publish it to public? so not run only locally?

[@wobbler8473]

What extension is it that autocompletes the code? Thanks

[@DigitalSamTV]

hi, how do u set if the api uses gpt3.5 or gpt 4 ? there is no setting when you generate the key as far as I can see... please help. cheers

[@DMan6285]

What extension are you using for auto complete, co-pilot?

[@DMan6285]

Nevermind. You answered it in the video. ;-)

[@mohamedelbahichi876]

hi I have a question please. How can I activate the autocomplete that you are using

[@harvey.28]

How can I use this and create my own using my own answers for the bot? Thanks~

[@miscellaneous9932]

Is there a limit to how long the message history could be?

[@serafinalcantara5520]

12:44 maybe it did not catch the message history. It probably answered from the data it was trained on.

[@Manivelarino]

they gotta come out with a self-hosted version. Not having to send all the data to openai to get a prediction would be a game changer.

[@israelRaizer]

First we need to figure out a way to make these models smaller, currently you need a very beefy computer to run them at any reasonable speed

[@metaltech3944]

actually they do have one: kzbin.info/www/bejne/qHjWn56hr7tlldE

[@mbonuchinedu2420]

Yeah, sometimes they depreciate it on purpose. Thanks sentdex.

[@HG77K]

Thought on NeRF / Luma labs AI

[@ChaiTimeDataScience]

Me: Sad, having a rough day.... Laptop: "What is going on everybody..." and I'm happy again!

[@moe3551]

Are you gonna be continuing the nnfs series? :(

[@sentdex]

Yes

[@Dkingprime]

Hi, sendtex. Python or JavaScript for backend, which would you recommend? I can't decide between them

[@development3383]

That's entirely dependent on you (and your team) and your project. Most of the website stuff I do is fairly simple so I just use nodeJS but if I were to write more complex endpoints I'd use django (python) or springboot (java). If you know one of those languages already, go with that. otherwise chose one of them and learn it

[@HellboyMob]

man this world is getting good

[@eaudesolero5631]

so what is the difference between these LLM's (gpt3/4, Alpaca, etc), what was AlphaFold/ESM/2, and the types of systems that were used to create efficient biologically similar structures like frames for vehicles or furniture? And Alpha Tensor? Wolfram Alpha? what other types of AI/ML systems are there? some are trying to do things as good as humans, some are doing things we can not do. how are these different things coded? what are the ideas these are based upon? how can they be merged? can each be used to improve the others? what are evoformers vs transformers? and what other things are there?

[@Raffsy]

What theme is he using?

[@davidfonseca87]

Sentdex using Copilot?? 😯 I remember when he used IDLE

[@sentdex]

I have been a mega fan of copilot since release tbh.

[@davidfonseca87]

@@sentdex I have found rubberduck on VSCode, which has been updated with the latest changes on the API, I really it, I would guess rubberduck has more options I may need to try more copilot to see its uniqueness

[@extrememike]

15:20 I was using the website free version yesterday and ran in to a similar problem. I requested an output based on information I had provided previously (above) and it said it could not refer to my previous messages. Maybe is something they temp discontinued to increase speed.

[@Lolguyj]

You probably went past the token limit

[@jonclement]

Lets' not forget that other planets in our solar system have named moons -- ours is actually named, "the moon" -- hopefully that doesn't send the AI into an infinite loop

[@mittamoa]

Luna ?

[@fdanisndsa]

Why do I keep getting the error that AttributeError: module 'openai' has no attribute 'ChatCompletion'?

[@gamedark4765]

you use wich linux???

[@antoniosalzano6235]

you said that the API itself isn't going to manage your history for you, so how might we do that?just start with some sort of message history variable for now to keep it simple, but we might use a database or some other storage method. Can you explain how we can do that using a database for example?

[@funkahontas]

one way to do this would be to store each message along with its associated metadata (such as sender, timestamp, etc.) in a database table. Then, when generating responses using the ChatGPT API, you could query the database for relevant messages and use them to provide context for the API.

[@antoniosalzano6235]

@@funkahontas ok I got it, but how can you relate the content ID with the answer. For example: if I say to the AI, my name is "X". The AI says "Hi X, nice to meet you". I store this two entries in the DB. But then? I have to do function that will scan the entire DB in order to search something "my name is: ..." and take the context?

[@kai_one6218]

1:41 whats the downside to using jupyter notebook?? ;-;

[@varghapayandeh3024]

Why do I get "module 'openai' has no attribute "ChatCompletion"!?

[@willhasnofriends]

Couldn't even get past the first run. "openai.error.InvalidRequestError: The model `gpt-3.5-turbo0302` does not exist"

[@iamtowbee]

Great work. How do you get the code to autocomplete?

[@sentdex]

Github copilot

[@mccleod6235]

Github Copilot.

[@himalkunwar9]

can AI replace ml/Ai engineers?

[@user-fx8tz6vs6u]

price?

[@re-heritage]

finally