GPT function calling in a nutshell

GPT function calling is super useful! But it can be a bit tricky to understand at first. In this video I go through what it is and how you can use it in practice, using simple drawings and practical examples in Javascript.

[@jakegearhart]

This was an excellent tutorial, I hadn't even thought about using functions to force a structured output but it makes perfect sense.

[@henrikkniberg]

Yeah it took me a while to realize that too!

This is a really smart way to give the AI arbitrary additional abilities without running into all kinds of security, rate limit, runtime etc. limits. You're basically allowing it to run specific things remotely on your computer.

[@Ariadne-c6n]

What an excellent tutorial! The maps are really visible and clear！❤❤

[@JuanDebrecen]

I'm not coder. Will never be probably. Yet I not only enjoyed this awesome tutorial, but actually understood it (at least most of the concept itself :P ) Thanks!

[@micheldev7941]

Excellent! This is the best concept overview with 2 real world use cases I came across with. To the point , clear and usable. Thank you

[@yanikkendler]

its so weird to see you upload a super interesting video randomly every few months lol

[@henrikkniberg]

That’s pretty much the story of my youtube channel. Random interesting stuff every few months :)

Quality over quantity!

[@PoojaSingh-fd5ng]

Hi Mr. Henrik, Thank you for digging up the GPT documentation and sharing your insights. This is super great. I’m thinking to explore this capability further with #DSPy. Is it possible for you to share your notebook in the the description. Appreciate your help! With regards, yogi

[@caiyongji]

Yes

[@No.ThatPrettyGirl]

lol and I just happened to stumble upon his channel today for the first time - actually, I stumbled upon his more recent and comprehensive video titled “Generative AI in a Nutshell.”😊

[@alexsandergutierrezgoncalves]

This is very cool, there are many possibilities for creations

[@lehuy7306]

I'm 8 months late but this is still incredibly helpful. Thanks!

[@alfredpeter2404]

I'm 8 months and 4 days late, and I totally agree with you!

[@dklearning2247]

I’m 8 months and 8 and 8 days late, but indeed it very good

[@jeffnelson4054]

Nice work, Henrik. I think your career pivot with GAI is inspiring. Thank you!

[@JoeGlines-Automator]

Excellent tutorial! Very well organized and clear! Your diagrams, explaining what is happening, really helped me understand the goals! Great job!

[@ralfgustav982]

How did I only learn about this today. This is insanely cool.

[@HazemAzim]

perhaps the best tutorial on the mysterious and ill-explained OpenAI function calling. Thank you

[@ts757arse]

Agreed. I've wanted to use these and found it very difficult to understand. It's really a very clever merging of the contextual "intelligence" or an LLM and the rigid structure and application of programming. I think the difficulty in understanding for me came from that clash.

[@jpbeaudry8878]

The image at 1:40 alone can replace reams of docs. Well done.

[@JOHNSMITH-ve3rq]

You are good. Really clear presentation. Thanks.

[@VitaminVS]

Big fan of of your presentation skills ❤

[@Code.J]

Great stuff! Thanks for sharing. I learned a lot from the way you explained it :D

[@RohitSharma-to7yy]

Great tutorial. Easy to follow and very intuitive. Thanks a lot

[@salesgurupro]

This is amazing. Thanks for sharing. The whiteboard really helps visualize and understand things far more easily :)

[@GregDolan]

Great tutorial, I'd really enjoy more of these 🙏

[@anazi]

Subscribed 🎉🎉🎉 Best one who explained GPT functions

[@yassinebelmamoun9727]

I'd gladly pay for more content like this! Your explanations are elegant, simple, smart, and easy to grasp. Thanks for sharing - looking forward to seeing more!

[@Our__Earth]

Henrik what tool are you using here for the drawing and communication? Very nicely done.

[@dariusdbbowser6329]

This is excellent and exactly what I was looking for. A way to run a function using GPT, but my implementation will be server-side and the function will call code from a blockchain and return that data ti GPT. I was looking for a solution that wouldn't involve me having to use Python.

[@honestiguana]

Thank you very much, I finally understood what functions do and how they work. One more sub!

[@henrikkniberg]

Glad to help :)

[@user-wr4yl7tx3w]

best explanation so far

[@UgurMahirOzkaya]

Sir this video is great! thanks for sharing knowledge. have a great day

[@eternalevanescence]

Neat

[@imnbsp]

I had kinda understood function calling up to some point but this cleared up a few more things for me and I can see a lot farther away now 😂 Thanks 👍

[@servicesfromistanbul]

You are the best

[@WenRolland]

Great tutorial, thanks!

[@czyngishan]

Henirk, it's a great tutorial. Hope more will come ;)

[@lamacap]

Thanks! This video was super useful.

[@anazi]

I just wish you shared the code. Its easier to follow along and go back to it. But really thank you for the great video and useful content.

[@nick8292]

Really good. Thank you.

[@ryangross6886]

How do I like this video twice!?!?

[@jonnysaxon]

Very new to this but how did the gpt know which were the largest 3 cities when reporting on the weather?

[@ilichpadilla2448]

Great video 👌

[@nathandesign98]

Very clear tutorial, thank you. Is the example code shared?

[@xiaomiwu4734]

Learn a lot, thanks!

[@SuikaGameplay]

Great vid! Which tool did you use to create the schema? I tried some web tools and the schema didnt look quite the same as your examples. Not sure how crucial that is.

[@7509whynotresist]

loved the way you explain and articulate

[@moeinhasani8718]

great video, just one suggestion it would b nice if you share a link to the code so afterwards we can have a look at it.

[@TennisFedable]

This is so cool - how do you make these animated diagrams?

[@bingolio]

Excellent

[@marka5215]

That was very helpful. Thank you. I take it that the setLanguages() funciton is specific to OpenAI/GPT4... is that right? If so, how would you approach this with local models?

[@grossteilfahrer]

So, we will write the function "google search " and let it loop for a while to allow the model to learn whatever it needs and boom, we're out of the sandbox?

[@honestiguana]

Makes sense, but you'd have a lot of trouble parsing all the results to feed them to ChatGPT until it thinks it has enough information.

[@grossteilfahrer]

@@honestiguana Hard but likely not impossible. What if we use Chatgpt itself to parse the results with some clever trick?

[@AIonRails]

ChatGPT bing search is working in same way. They just bing your request, grab X first pages, put it in context trying to answer your question using data there know and bing provided in context.

[@AIonRails]

@@honestiguana I think, we didn't need to provide all results, search engines is good enough. Just grab first 50 pages by your request and put it to context. Most complex task is to exclude information we need, and GPT can do it

[@ilanlee3025]

Great video thank you. Subscribed

[@federicoramos]

Thank you!

[@leesmith5420]

Is there any way to specify a few functions that OpenAI can use? For example, I want to create a quiz and have 3 formats that a question can be. 1. multi-choice with 4 possible answers 2. yes/no with 2 possible answers. 3. simple question with an input for the answer I want to allow OpenAI to choose which type of function to use but always use a function (so that we always get a structured response).

[@voyageruk2002]

GPT can now browse the internet, how does this change the use of function calling? Can we ask it to browse the web using the API?

[@yaasirkhalid]

In the video you said there are tools to generate the function spec? can you suggest some, or I can ask ChatGPT to generate the spec for me. Again, really helpful tutorial and use cases

[@henrikkniberg]

I usually ask gpt to generate it.

[@xspydazx]

in a nutshell !! >>>> How s function calling ACTUALLY working!!! >>>> its using jupiter notebooks! executing a single cell ... so open interpreter etc is using these jupyter notebook clinet to create your funciton executor wrapper! ... the rest is instrutor(slower) and response parsing....

[@ekkamailax]

Is this deterministic and reliable? Can you rely on GPT to always call the correct function, pass the correct parameters, and interpret the function results accurately? If not, how is it possible to build a customer facing application with these risks? Appreciate your insight.

[@gingerdude1010]

Hello Henrik, great tutorial! I added a function for a 5-day weather forecast too. However, I'm encountering issues when querying high and low temperatures for the next day. The responses often contain errors, it looks at incorrect dates or temperature readings. I've tried both GPT-4 and GPT-4-0125-preview, but the issue persists. I suspect the complexity of the JSON from OpenWeatherMap might be overwhelming for the AI to parse accurately. My next step might be to pre-process the data, simplifying it and including the high and low temperatures. I had hoped GPT-4 would handle such data more capably. Any suggestions or insights on this?

[@gingerdude1010]

For anyone curious, I used chatgpt to simplify the data representation returned back from openweathermap, as it stood it was too complex for even gpt4 to reliably parse. Making a simpler representation with clearly labelled fields fixed this. I also preprocessed data calculating max and min temps.

[@AlexandreCastanet]

Thanks

[@SogMosee]

What is reflection and how can it be used in the way you suggested?

[@amasonofnewreno1060]

funnily for the 2 cities weather problem, you could just call getWeather with 2 cities, right? without the loop

[@cmcdonough2]

This is wild.

[@xiaomiwu4734]

Suggest to provide corresponding reference codes to learn better. Thanks!

[@henrikkniberg]

Good tip. Thanks! Will do so next time.

[@caiyongji]

Anyone knows what’s the whiteboard author using

[@allpal3077]

What app do you use to create those cartoon graphics?

[@MikeRhodesIdeas]

@henrikkniberg would you consider sharing the code for this? I kinda mostly get it.. but now need to play with it to really grok it. also you're one of the few people I've seen doing this in JS & not python. As a non-dev this is great, as I can (sort of) read JS & with gpt4 and copilot I've been able to create some useful stuff.. python though still eludes me! thanks in advance.

[@AutoMato-AI-Content]

Curious, its been almost a year now, does anyone use gpt function calling?

[@alexgordon951]

Not another weather function

[@debashishbramha]

Great Henrik, Can you recomend some Book about "Prompt Engineering" ?I have given this request to you in Linkedin.Rgds,Brahma from India.

[@luisfernandopinto5632]

Very good video, but the free chat GPT 3.5 don't know about the existence of the openAI package, he just give code using the Rest methods to the API :(, the source code could save some time

[@honestiguana]

If you're still not a paying customer, you're not serious about coding with ChatGPT, and might be missing a lot of interesting features.

Omg 😳

[@villson3960]

Neat

[@JuanMorales-bv7qr]

Neat

[@user-se4ij]

Neat

[@johandaun874]

Neat