OpenAI ChatGPT Realtime API: End of Human Customer Support?

Real-Time Chat GPT API: Build Your Own AI Assistant! 🤖🎙️
In this video, we dive deep into Chat GPT's new real-time API, exploring its capabilities and showing you how to integrate it into your applications. Perfect for beginners and experienced developers alike!
🔑 Key Points:
Real-time conversation capabilities
Function calling for external data (e.g., weather)
Memory storage functionality
Multiple voice options
Easy integration with existing applications
🔗 Links:
Patreon: patreon.com/MervinPraison
Ko-fi: ko-fi.com/mervinpraison
Discord: discord.gg/nNZu5gGT59
Twitter / X : mervinpraison
GPU for 50% of it's cost: bit.ly/mervin-praison Coupon: MervinPraison (A6000, A5000)
🛠️ Tools & Resources:
platform.openai.com
GitHub Repo: github.com/openai/openai-realtime-console
Node.js and npm
👨‍💻 Tutorial Steps:
Clone the GitHub repository
Navigate to the project folder
Install dependencies (npm install)
Start the application (npm start)
Add your OpenAI API key
Connect and start interacting!
🔧 Customization:
Modify console.page.tsx to add your own tools and functionalities
Adjust settings like threshold, prefix, and silence duration
🎓 Learn More:
Function calling explained
Weather and memory tool implementations
React component breakdown
💡 Pro Tip: This real-time API can revolutionize customer service applications!
👍 Like, Subscribe, and hit the Bell icon to stay updated on the latest in AI technology!
🔗 Useful Links:
OpenAI Platform: platform.openai.com
Node.js: nodejs.org
🕒 Timestamps:
0:00 - Introduction
0:35 - Overview of real-time API features
1:16 - Exploring platform.openai.com interface
2:28 - Setting up the project locally
3:25 - Connecting to the API and testing
4:55 - Code walkthrough of console page.TSX
6:32 - Explanation of weather and memory tools
7:05 - Final demonstration of API capabilities
7:34 - Conclusion
#ChatGPT #RealTimeAPI #AIAssistant #OpenAI #TechTutorial
Questions? Comments? Let us know below! 👇

[@kristianlavigne8270]

Will go 90% down in price with 12-18 months… competition coming shortly 😉

[@ajith007-ytb]

Thanks for the video. That was very helpful!

[@valdecircarvalho]

Why did you stopped with THIS IS AMAZING? This is your signature :)

[@thejcedeno]

API calls are expensive, this wont scale. It almost makes me want to release my engine as oss

[@AI_Escaped]

Yup. They fucked up on pricing, no one is going to pay this unless they have deep pockets

[@parth-club]

If cost comes down 2 OOMs it's gg

[@lawrencium_Lr103]

wow, love how you get things going right on release

[@Megamil]

I tried to use it on my machine, but it said `Upgrade Required`. Can only subscribers test it?

[@fantasticshorts167]

Hey! I have use the function calling in this real time api for calendar bookking but I am struggling with how to send the response of the function back to API for TTS. Can you please help me with that?

[@fourlokouva]

Another great video, thanks for demonstrating this!

[@DialogoAi]

awsomee :D!!!. Is it possible with this setup to change the voice, where can it be done in which file

[@greendsnow]

Toooooo expensive.

[@isaiah.dasilva]

For consumers yeah… for businesses not at all

[@greendsnow]

@@isaiah.dasilva many non westerners would be so happy to work for $18/hour, the asking price for realtime API.

[@ChristopherFoster-McBride]

Play with it now as the cost will reduce soon

[@ahmadzaimhilmi]

This could be combined with Meta's rayban. Unfortunately openai voice assistant is prohibitively expensive at this time.

[@AamirFarooq]

Brother my English is not Good, I like to learn new thing in AI, if you can upload Urdu or Hindi audio track it will more helpful me to understand concept

[@anubisai]

U can use AI to convert the transcript. Thenbuse AI to make the TTS....

[@d.d.z.]

How much did it cost to do this?

[@rselvarajanMBA]

One hour of this costs more than a day's salary for BPO employees in India - the world's back office !😮

[@SajjadAli-je8oq]

Yes but we should wait for open source which will come very soon 😅

[@Jeganbaskaran]

How come your prefix is missing in your video!!! வாழ்க வளமுடன் !!!

[@vikaskyatannawar8417]

No idea who will use it. The rates are too high for customer care. In the company wants to use AI to save money not increase it.

[@luisgustavosantini6843]

Awesome!

[@yashshinde8185]

Can you make a video replicating this kind of using local llms

[@AI_Escaped]

Local llms can't do this, not at this level anyway.

[@income-ai]

it's impossible! How didn’t you say "This is amazing" 🤨

[@xXWillyxWonkaXx]

Sorry but i fail to understand, whats the difference between this and how we usually access ChatGPT Voice normally? Is it just the function calling feature thats new?

[@MervinPraison]

Chatgpt voice can be used only on chatgpt app. This can be used in any application and also in any website

[@user-uk9ls]

Nice demo. but almost nobody would like to to pay for this, except the gov't.

[@adamchan4403]

So fun to play with it 😃

[@60pluscrazy]

🎉

[@MikaelAkopyan]

Very very expensive (

[@John-il4mp]

Salaray of someone is 90% more expensive how can you say it is expensive 😂😂😂

[@AI_Escaped]

Just trying to figure out how this works and the dev process would be very expensive, that is the problem.

[@fabriziocasula]

interesting but it is expensive... no?

[@InAMinute-ws3yv]

Yes

[@John-il4mp]

It not expensive when you think you have to pay 50k a years for someone doing this it will not even cost 5k at the end of the years for.phone call so you save 90% i don't understand people say it cost to much 😂😂😂

[@fabriziocasula]

@@John-il4mp true

[@fabriziocasula]

@@John-il4mp 100%

[@John-il4mp]

It cost 14.40$ per hours thats not expensive lol when you can match a crm and take call and book appointments where you guys live at😂😂😂 and at 14.40$ an hour it work the 60 minute none stop lol so thats lots of talking.

[@AI_Escaped]

It's 18/hr from what I've heard from multiple reliable sources. And that's not the problem, the costs of learning and dev of this would be very expensive. Once up and running, sure it's relatively cheap.

[@John-il4mp]

@AI_Escaped it's not $18 an hour, and it's not even $14.40. I gave you the worst-case scenario. Audio input costs $0.006 per minute, and audio output costs $0.24 per minute. So yeah, if you multiply the $0.24 by 60, it comes to $14.40, but that's just for audio output. You can't have both input and output running 60 minutes each when you talk, so it's actually way less than $14.40 in reality. Go check OpenAI’s pricing for yourself-it's all right there.