BIG UPDATE: AI Agent Now Calls And Book Appointments - OpenAI Realtime API

[@CatrickSwayze99]

so heres what im thinking: if we get to the point of ai agents talking to each other on phone calls to book appointments why not just automate this process textbased via chat. this seems completely unnessesary and a waste of computing power/resources. also, does no one see any ethical concerns about this when we call real people via ai agents without letting them know they talk to ai?

[@lancejones4636]

It's called the Turing test. ;-)

[@ioanslavu3991]

it's the same for drivers of self-driving cars, until everything is based on ai as a standard we have to go trough this

[@sphereron]

We need laws to make it mandatory to disclose if it's generated voice. Otherwise, phone calls will be pointless

[@CatrickSwayze99]

@@sphereron i agree. no one wants to be on the phone not knowing if they actually talk to a human and im a little bit disappointed hes not even considering or mentioning it.

[@MrErick1160]

Very good point

[@micbab-vg2mu]

Great! I haven’t used the Real API yet due to the cost, but the quality is so high that I might give it a try. :)

[@lanceguilin]

100% there will be more AI agent used at us from the business side as opposed to the other way around.

[@jana171]

Been using the pydantic structured output for a while now, even longer than the native support from OpenAI... it is THE only way i can get LLM's to not just throw garbage after me every like 50% of the time 😀 It's a real gamechanger in this field if anywhere, and it seems a must for agentic AI imho.

[@martinkling3266]

Great video! Btw how much was the cost this time?

[@mikew2883]

This is awesome! I'm a paid member but don't see the updated code on this. I only see the original code that was added 2 weeks ago.

[@Brkcln]

This is so nice. No need other api etc. finally. Thank you

[@AristideFumagalli]

Hopefully it doesn't get used by scammers to scam old people. Was thinking of pranking my grandma but I can see how this can be misused. Although I wouldn't want to have this censored either.

[@andygray9429]

How much did it cost per call on average?

[@dlaytonj2]

Good video. I see the improvisation in the conversation as the other side of hallucinations -- if you don't have the answer make something up. In your examples,, that improvisation worked out well. I wonder how long it would take before those improvisations get you into trouble. 😀 Also, I wonder if the human that is on the line asked whether they.were talking to an AI or a human whether or not, whether or not the AI would lie and simply resspond that they were the persona you supplied to it. On another note, I spoke to an AI voice agent and have to say that i prefer the AI agent experience. First, the voice was clear without an accent. of any kind, but more importantly I got through to an agent immediately -- no longer waiting in a queue for the next available agent.

[@industrialpunk1088]

Love these trial calling vids - very interesting results. The humans do seem to realise that something is strange with the current voices, but its probably hard to tell when they deal with the public everyday. I would guess that the future will be personal AI interacting with company AI - you ask an AI on your phone to accomplish a task and it will do this by calling other AI installed at a company. Maybe an end of human receptionists?

[@henno6207]

So awesome! More agents!

[@asi_karel]

Perfect job. Perfect content!

[@wawoai]

Kris please share the code with the members!

[@spnoetzel]

Where can I get the Repo? Can't find it on the open GH.

[@JeeteshSurana]

very good keep it up

[@Blooper1980]

How do you make the actual calls?

[@mapledev9335]

Is there an open source alternative that can do this locally?

[@MrWuzey]

No, there is nothing like GPT--4o that can be convincing on the voice part. We would have to use TTS and open source TTS just can't do that.

[@gianpaj]

There's a typo in your thumbnail. It's improvement 😅

[@stephenterry6372]

I subscribed yesterday, but I have had no reply to my request to access Github, and the Discord channel is DEAD !

[@desmond-hawkins]

This is impressive for sure, but I can't imagine what work is going to be like in a few years for people who pick up the phone to register appointments. I wouldn't be surprised if most of them hated the idea to speak to an AI. We'll see! It will most likely happen.

[@3thinking]

Most of the people who answer the phones themselves will be replaced by AI.

[@MrErick1160]

Hey man, coild you make a full tutorial to transform this into a WhatsApp agent? Would be amazing 😍

[@leabenero3417]

I've tried telling it to speak very very fast, but still the voice is slow.

[@automguru]

i didn't hear anything.

[@19kickboxer68]

The receptionist sounded like AI. I saw an immediate failing where the receptionist had already said the name of the company then the Ai asked it again.

[@lancejones4636]

Is it a failing? Or human-like? Have you ever answered the phones to interact with customers? 😂

[@mybrokerisonline]

I have a buyer, client for your system.

[@x01e03]

Robocalls are illegal in US, otherwise super cool demo.

[@emanuelec2704]

Illegal based on what?

[@x01e03]

@@emanuelec2704 Just google "F.C.C. Bans A.I.-Generated Robocalls" from Feb/2024

[@x01e03]

@@emanuelec2704 FCC banned them in February 2024.

[@lancejones4636]

This would not be classified as a robocall. It's not a pre-recorded message... nor would it need to make more than 2-3 calls (beyond Kris' test).

[@x01e03]

​@@lancejones4636 www.fcc.gov/document/fcc-makes-ai-generated-voices-robocalls-illegal I think it classifies as using AI generated voices in robocalls. I think how robocalls are defined is a computer program making a call.

[@3thinking]

People can use this (with voice cloning) to call the boss to phone in sick 😆

[@khariclemens]

I’m a member of your paying subscribers. I’m having a bit of difficulty getting this Realtime API boilerplate setup. Can you give us an example using nodeJS instead of Python? Many thanks in advance.

[@MrErick1160]

Goddamn bro wtf, it sounds more natural then me 😂

[@Jacekkk-qb1zd]

👍

[@rajak7410]

I have made this a week ago

[@rajak7410]

I am a freelancer and available to do projects on generative ai.

[@SimonNgai-d3u]

It's fucking scary lol. We live in a time where we can build AI to talk to real humans. lol

[@beardordie5308]

I also think that it is a bit rude to the human to fail to mention that the conversation is with an AI. This is just how I feel at the moment, and that may change over time.

[@Immersiverse]

It’s very rude; since they are trying to act kind and it doesn’t even matter.

[@lancejones4636]

@@Immersiverse You do know what happens if you're rude to an AI, right? RIGHT??

[@MudroZvon]

I require you to provide a disclaimer that you are not an artificial intelligence before posting comments

[@beardordie5308]

If you didn't, I think you should call back yourself and let them know that was an AI call test.

[@oaklyfoundation]

I agree

[@ginofellino69]

Dude, get over it

[@extremelylucky999]

You used to tell on people in school when you were a kid right?

[@deter3]

this ai voice appointment checking has no real application value to my knowledge . google has showed the similar usage almost 7-8 years ago . if everybody are using this , then some internet company will make a database and api then .

[@Booleanzero]

If you keep using products from companies I need to pay for in every idea you just sound like a cute commercial and I will block you. Open source. Or you're a waist of our time.