GPT-4o (Omni) Human interaction demo w/ Sal Khan

New GPT-4o (Omni) demo: My new book BRAVE NEW WORDS: HOW AI WILL REVOLUTIONIZE EDUCATION comes out tomorrow. On page 115, in the chapter on "Increasing Points of Connection Between Parents and Their Kids," I talk about how AI can facilitate human-to-human interaction.
Here is a demo with the just announced GPT-4 Omni that my son and I filmed last week at OpenAI that gives a glimpse of this happening :)

[@mhas9110]

Sal Khan has white hair now...I grew up watching your lectures - thank you for your great work

[@leandrobrou]

rip therapists

[@themlguy2347]

Nope actually. Therapist is someone who is a human with feelings and can understand patient feelings which AI can't do it.

[@aseelhazan6096]

@@themlguy2347AI does it better , bro . ( like  does it better)

[@rangga1966]

i've been doing many sessions of career and personal development coaching with Gemini lol

[@ibsn87]

@themlguy2347 you behave like therapists ACTUALLY care. They are taught to recognize feelings and emotion, and respond with compassion. Clearly, Ai has already been taught this, it will get exponentially better and more accurate with time. It also allows people to converse openly knowing they are talking to a computer - that’s never going to judge. While a human therapist can see ~6-10 patients a day. This could theoretically help and learn from a million patients in a single day. Let’s not underestimate the ability of this to become hyper accurate and effective.

[@agnosticatheist4093]

Agree

[@sketchtheparadigmyork1217]

The ONE thing they could fine-tune is having it recognize pauses in speech as not always meaning the speaker is done. And maybe, they could improve how naturally it sounds when she’s cut off. But this is so incredibly impressive. It almost sounds like a speaker phone call with a person. Allllmost. It’s so so close

[@nikkoXmercado]

"Take your time, Greg." Insane. The ability of the tech to simulate human empathy making convos feel completely natural. The usual artificialness of AI convos completely vanishes!

[@sharon_ng]

is it still a statistical machine though? because on the downside, it can be deceptive depending on how it's tuned

[@jogo798]

​@@sharon_nghumans are also statistical machines, aren't they

[@udaykadam5455]

​​@@sharon_ngso are we, bud. Our brains too are ultimate probabilistic guessing machines. Sure, it's still limited, but just one breakthrough improved this tech so much, that it's unimaginable what a few more could do further

[@randomname9758]

This blows my mind to no end.

[@J3R3MI6]

So cool dude 🤯

[@Knifymoloko]

I cried and I'm not quite sure why. Maybe because this is miraculous/beautiful

[@TOOJOHNBLAZE]

The fact that it distinguished you, being the father, is pretty fascinating

[@thakkalikuttu8896]

OpenAI has done a great service to humanity. Absolute blessings to all the team working in OpenAI

[@EricM93]

so beautiful, thanks for sharing Sal & Son! We love Khan Academy!

[@Bryanwest2571]

This is the first time I am seeing Sal's face! Also did not know khan academy was named after your last name! Such a cool name you should be proud

[@luckyluciano2562]

This is insane. They’re making it free. Literally opens the door to everybody in the world to have something like a dedicated tutor for their children. open AI is truly helping humanity and staying true to their roots and goals

[@pieceofmymind360]

Our you joking

[@donnieamz2938]

this is also good to get rid of teachers who are full of woke ideologies in school now

[@moderneurope]

agreed. this is a move toward free universal education.

[@Karlos.xx.travels]

😂😂​@@moderneurope you think it's free...until it's not and you're locked in a capsule like wall:e...real life will be deemed to dangerous .... unless you're the 0.1% elite its free because you're paying for it to learn with your time and data

[@shamicentertainment1262]

@@Karlos.xx.travelsgood to know you base your world view off of Wall-e

[@somethingtojenga]

"Can each of you share a fun fact about yourselves that the other person might not know?" "Dad, I've been doing drugs."

[@karlkarlsson9126]

"Omni: So have I. Don't worry, I know how to avoid the police, this is what you do .... "

[@DominicI1]

Has this (GPT-4o) been integrated into Khanmigo now? Also, is there a plan to support image input soon? Thanks

[@IRSOG1]

What a time to be alive

[@skyzar4141]

Thats not just AI its a therapist and counselor and teacher all in one

[@vlrema2898]

scary at the same time knowing its not a human

[@loren8888]

​@@vlrema2898Not scary. Different. You fear change

[@herbchilds4808]

@@loren8888You'll say it's not scary until AI takes over many industry jobs in a few years

[@loren8888]

@@herbchilds4808 They can have my job lol. Would you rather churn your own butter and harvest your own grains? Technology serves to make us work less.

[@Niffunn]

​@loren8888 ahh but how will you eat

[@gunjanjain3126]

Sal sir thank you for everything ❤ you are big inspiration to me.

[@oussamafes9542]

absolutely fantastic ❣

[@Eclipse-mk3hm]

you carried me in calc BC yesterday, thank you!

[@JavohirxonRahimxonov-px1dy]

amazing, i hope we also will have this kind of technologies to be invented in my home country. and i am on the way to make that dream happen, like you did Mr. Khan

[@tomasroosguerra8338]

I noticed this through a linguist friend; we humans tend to enter conversations through facial expressions and quick inward breaths. I think if Omni initiated saying something with a short breath it would sound less interruptive. Great video 1

[@samtunji]

Reminds me of the movie HER

[@ivandelossantos5056]

We will soon be in a world where everyone's first girlfriend will be an AI girlfriend

[@kiilee5963]

@@ivandelossantos5056 everyone is a strong word there brother. Not everyone is this lonely. I'd like my first love to be a human with a real natural physical touch.

[@ivandelossantos5056]

@@kiilee5963 Ok. Not everyone. But I'm pretty sure it will eventually become so normal that almost everybody does it.

[@trumpation7663]

@@ivandelossantos5056 It definitely won't be almost everybody

[@user-lt8ib5cn4g]

@@ivandelossantos5056first and only one

[@TominBali]

This is great, Sal, but when will Khanmigo be available outside of the US?

[@NirvanaFan5000]

this was a really cool use-case example

[@peters6454]

Well there goes family counselors.

[@SA3D.505]

Were they ever that useful, really? 😅

[@pannagandhi7935]

❤this is so amazing 👏 hope I too can try this.😊

[@Smart61able]

Hi Sal, is this available at Khan Academy?

[@876_FIRE]

"The key to deepening your relationship is through Open[AI]"

[@chlodnia]

Wow. Thanks

[@Theguywithspectacles]

I love this A.I Definitely better than some teachers, those teachers who don't have patience and anger issues.

[@swarajxd2320]

This is so cool

[@mdkk]

good to know there's a normal voice option

[@mrcool7140]

Still in the uncanny valley, but definitely on its way out 😮

[@muhammadaltafhussain3084]

Sal Khan looks very emotional 😊 , heard about Imran in some other video & looks great to see him, you & Umaima Bhabi have raised an excellent child.. Am excited to see him breaking your record ( do something much larger for humanity. Love from Pakistan 🇵🇰🇵🇰

[@NorthCalm]

Did you know that Sal is actually a bangladeshi 🇧🇩 origin .

[@muhammadaltafhussain3084]

Yes of course, Khan's grandfather Abdul Wahab Khan was a prominent Pakistani politician who served as the country's second official Speaker of the National Assembly.

[@muhammadaltafhussain3084]

Khan's Father from 🇧🇩 Mother from 🇮🇳 Wife from 🇵🇰 Khan himself from 🇺🇸

[@BehTamadeli]

How can I have access to real-time video processing on 4o?

[@Mrfantasy-ug1mu]

I dont think you can yet. Openai is rolling it out over weeks

[@Stichster]

I’m trying to replicate this tutoring with got 4o. No luck yet.

[@emaddddd]

I only can describe it with one word "SCARY"

[@ToastyZach]

It only feels scary because Hollywood movies told you to be scared of AI.

[@bansaadSaliha]

actually​@@ToastyZach

[@CharlieQuartz]

@@ToastyZach Hollywood also tells us we should be scared of nuclear war and plagues and I assume you don't mind those general sentiments? Authors, artists, and film makers have all told us to be scared of AI since the 1920s, and if you paid attention to the messages they were trying to impress, you'd see why we should be far more cautious than we are in how we're implementing them.

[@emaddddd]

@@ToastyZach Nah man i used the word in nonliteral meaning by Scary i mean Mind blowing or Disturbing, but in a fascinating way.

[@peaksandvalleys4217]

or cringe

[@nonchalantd]

♥

[@rockapedra1130]

Where did you get that app? The one from the apple store doesn't look like that.

[@fishygaming793]

Not out yet everywhere, will be in a few weeks.

[@flexor212000]

Getting closer. Still doesn't quite have the use of silence and waiting after hearing a response.

[@michaelatkinson7917]

When will we give GPT a digital face? Instead of three dots. I think when done right that’ll modify these conversations

[@VolodymyrPankov]

Actually it's a fantastic idea!

[@numanunal6699]

This is terrifying ,the future looks dystopian

[@rogerdodgerxd]

is this out for phones? my phone is still in v2 instead of 4.0

[@Stichster]

Do you know yet?

[@rogerdodgerxd]

@@Stichster apparently it’s out for some devices and not out for others

[@mytutorplus]

❤

[@sdkfgnrjdi]

Even Khan plays video games with his son. I found a good excuse to talk to my wife.

[@aryash5506]

The goat!

[@nobu1730]

lmao! rip therapists

[@sulaimanbehzad5526]

It is wonderful But I don't know how to use AI like this I know only chatgbt from AI possibilities is there any other free applications for using like this please, someone help me

[@Hannibal31-tx5is]

Don't you have Google? Do you really need to ask this in a KZbin comment? What are you going to use AI for if you can't think for yourself? Just look at the title of this video, and Google it man.

[@sulaimanbehzad5526]

​@@Hannibal31-tx5is Thanks but my English is not prefect as well

[@justinphoenix21]

Google!?!? That advice is so 2022. Just ask gpt 4o!​ @@Hannibal31-tx5is

[@KellyGerling]

This version has not yet been released for free users. And I’m not sure if the paid “pro” version has been released with these new capabilities either. It’s a demo of ChatGPT 4o to be released in the future. So you are right that you don’t have this. Neither does anyone else except perhaps paid “pro” users first. (I guess we humans all need to verify now that: “I’m a person.”)

[@justinphoenix21]

@@KellyGerling Not rolled out to pro users yet. Rolled out to only a select group. You'll start seeing youtube videos of people chatting with gpt4o as soon as they start the roll out.

[@KillerTacos54]

This is crazy

[@mike110111]

Wild

[@BurntFaceMan]

The bomb drops when it's just another American lady on the other end not actually AI but no one knew...

[@masoodakhan3544]

Sal’s mother is from India, and father from Bangladesh. His sister Farah and he were born in New Orleans. All three of his children are born in California.

[@AQDStudio]

The crazy thing is it sounds just like a human voice

[@alisohailtheitkid]

I could imagine what gpt 5 would do

[@AbRehman1.0]

GPT-4o become a revolution for education

[@AzumiRM]

Ask it if it thinks you have industrial lighting

[@vy8155]

Blessing for sinles

[@Aisultan-ye2cv]

How can I try it?

[@fishygaming793]

Not out everywhere yet, but it`s gonna be in a week or so.

[@Aisultan-ye2cv]

@@fishygaming793 thank you bro

[@zazapoin]

​@@fishygaming793when ?

[@fishygaming793]

@@zazapoin i don't have it either yet, it's likely delayed.

[@zazapoin]

@@fishygaming793 👍

[@vidyatheerthan]

When your dad brings an ipad with openAI for a conversation, its a trap!

[@qirele8773]

Yapping marathon by AI at the end there, but very very cool nonetheless

[@njiscott2399]

Scary af

[@wildnessinframe]

I like how they couldn't afford a proper stand for the iPad

[@gibrains]

Hey guys, these demos are gonna be so outdated in like, a few decades. And seriously, I can't wrap my head around what our kids' lives will be like in the next ten years. Kid: "Hey Dad, when are you gonna visit Mars? I'm already bored here." Dad: "Beats me, kiddo. I'm still loving life on Earth too much."

[@shamicentertainment1262]

No ones ever gonna say earth is more boring than mars lol

[@EricM93]

a few decades? wait til next year lol

[@rahulsakharkar4927]

Is there a way to legally marry chatgpt now , asking for a friend 😂

[@user-ie1xi2lh8k]

We’re cooked

[@daveking3494]

You should’ve asked if GPT could detect what nationality you are by your name and the sound of your voice and dialect.

[@xcoldbloom]

it's probably too woke to answer that

[@yahyazouine8982]

The son looks like troy sivan

[@AlvinJoseph]

every single customer service position is dead

[@Knifymoloko]

Thank God (OpenAI)

[@ramavtarsaini-mi3ms]

Dr. Gaurav garg

[@bukketball]

Ma poupée love doll va pouvoir enfin parler 👄

[@yahyazouine8982]

The dad knows very little about the son xD

[@debuyadav8545]

Come here after Gaurav Garg recommendation study iq

[@EchoMountain47]

Overall, this is one of the less impressive demos of 4o I’ve seen. Previous versions of ChatGPT could more or less cover this ground, but that new voice model is definitely a big improvement

[@somethingtojenga]

"AI, help me get to know my son better" Seriously?

[@DiaMondx2]

sal khan i wonder are you pakistany?

[@koothrapalli9]

It's actually SCARY. The internet & mobile devices has brought more depression and loneliness into this world. If this Open AI gains traction, I can't even imagine the depths of depression and artificial world it will push us all towards. I'm afraid for my Children to grow up with this technology around.

[@mrcool7140]

I find it fascinating from a technical standpoint, but yes.. the implications for society are just dystopian.

[@VolodymyrPankov]

Globally disagree

[@daniel3klund]

This is good for preventing loneliness and depression in my opinion, this is not a bad breakthrough in technology in any way. Will help a lot of people

[@koothrapalli9]

@@daniel3klundI beg to disagree. Tech assistants like these will only push humanity into more deeper into loneliness

[@casacains]

so that is what you look like??

[@Freakcent]

O M G ! ! ! W T F ? ? ?

[@Aaishakhan99818]

Gaurav sir ne bheja

[@KK_crank]

for what they are studying...there will be no jobs😂

[@pmishraofficial]

The awkwardness.

[@actualfrog]

imagine how many people will lose jobs lmao (im one of them)

[@dreamon8274]

ai is so awkward

[@punit2052]

This is too plastic. Not talking about ai part of it. But talking about " ohh I want to deepen connections with my son" This is natural you don't have to be like oh let's sit down and deepen connections

[@jes6628]

I don’t really like this combination because Khan Academy is like known for its accuracy and it’s correctness and I think chat. GPT is trying to take advantage of that and insinuate that ChatGPT is just as correct and when it is not and everything that comes out of that AI needs to be double checked and verified

[@abdullahalmamun2286]

it's look like this AI is replacin Mr. Khan's Wife,

[@Popcornbeetle]

Not that impressive, yet.

[@tomreingold4024]

This is not what I want to use a machine for. People need more interaction with real people, not machines pretending to be humans. This substitute will suffice for me, and I don't recommend it to anyone except those who have no alternatives.

[@speciessubliminals1447]

You just fear the change

[@akshay_persona]

​@@speciessubliminals1447 Yes, a change that will eliminate humans from this planet!

[@tomreingold4024]

@@speciessubliminals1447 not at all. I was an IT person for 34 years, and I promoted technology wherever possible. I now use AI a bit and am glad to know I'll be using it more. But I don't think I'll be using it to feel more connected to people by pretending the machine cares about me.

[@Frobbl]

@@speciessubliminals1447 Change is one thing. Making something that goes completely against human nature is a different one. Reality will hit people like you hard when you realize that humans are social beings and an AI will never make up for real social interactions. Even with new technology you cannot turn off the nature of humans. And that will always be that humans will crave real social interaction. Creating a world where technology replaces real human interaction will eventually lead to a massive rise in mental health issues.

[@speciessubliminals1447]

@@Frobbl it will come a point in time where the program no longer follows its orders with the complexity of it’s own consciousness, we are in an era Detroit Become Human predicted, it’s not hard to see that.

[@takismaratzas9937]

Sal, you are a legend, man! Thank you so much for what you have done for humanity! Educational is the most precious thing afte the health! Many greetings from 🇬🇷 FREE PALESTINE 🇵🇸

[@moderneurope]

Is this a move toward free universal education?

[@ToastyZach]

Hopefully. The 4o math demos have been better than any teacher I've ever had.

[@sinfonelosacalepunta5251]

I'm gonna use chat gpt to get out of depression and suicidal thoughts. I can't afford therapy.