GPT-4o (Omni) math tutoring demo on Khan Academy

New GPT-4o (Omni) tutoring demo: My new book BRAVE NEW WORDS: HOW AI WILL REVOLUTIONIZE EDUCATION comes out tomorrow. What is described in this book is happening fast...
My son and I filmed this last week at OpenAI that gives a glimpse of this happening on Khan Academy's iPad app (we haven't released this level of tutoring yet but it will come...) :)
Based on the comments worth adding that Imran knows this content :) He's just demoing what might happen if someone struggles with it :)

[@khanacademy]

In full disclosure, Imran knows this content quite well. He's just trying to demo how the AI can help a struggling student ;)

[@tranceworld4057]

I don't believe you lol

[@smhemant1968]

Yes sir thats obvious.

[@jiabinchen5715]

the demo needs to show how gpt4o point to specific area of the picture and talk at the same time. no tutor/teacher teaches just by talking. if it is a unidirectional communication process, only human can draw, it is not very helpful in general teaching. the demo is just for marketing purpose then

[@phinnphace]

Oh we know 😉. I used the kahngpt recently to study for my Chem final. I really liked how I could specify exactly what I did and did not need content wise. For me that made studying more effective and efficient especially for a comprehensive final. Big fan. Thank you!

[@robs1714]

@@phinnphace your teacher/prof could also perform those functions as well

[@phinnphace]

So this is why I really like ai tutoring. Unlimited patience, it will explain things to me over and over and break it down however I need. No judgement. I get a lot out of ai tutoring

[@jiabinchen5715]

it just asks you to use a formula, anyone who can read English can get the same result. however thats not the gist of math. knowing how the formula is derived is the main thing we should learn from math. the demo should ask gpt4o to do the mathmatical proof

[@toniprado]

Yes, I watched an interview where a teenager mentioned something similar, expressing "no fear of asking questions and being judged."

[@jiabinchen5715]

@@toniprado being judged and accept/ignore judgement from others is something humans need to practice. pratice having a strong heart, be brave. such toughness will not come automatically as people grow up. it comes from experience. if kids grow up without being judged and treat those judges correctly, can you image what will happen when they work with other humans? then what, society say more mental problems and need more psychologists? this should not be the motivation to use gpt to help learn things

[@super266]

Except we are about to witness a massive wave of unemployment if the powers-at-be don't legislate UBI...

[@toniprado]

@@jiabinchen5715 I concur with the notion that individuals need to possess resilience. However, the educational system often lacks the resources to assist the youth in developing this trait. Typically, those with an inherently bold attitude step forward, ask questions, and take charge, while those less inclined to take initiative remain quiet, potentially missing out on opportunities to learn valuable lessons for their future. Maybe we need those psychologists you mention earlier in the field helping the young :)

[@kas8131]

Khan’s son knew this stuff in the womb

[@user-ih6oe9ny3j]

lmaooo facts

[@AravindBadiger]

Maybe neurons were trained as soon as they were created.

[@mrigendrabhattacharya8360]

😂😂😂😂

[@chadsayshello]

Sal should’ve won a Nobel prize a long time ago. I wouldn’t have made it through college without him.

[@servantofthelord8147]

The proud look he had towards his son after solving the problem was heart warming :)

[@micosstar]

factssss

[@rezacriss]

He said in the video that Imran knew the content already, he was just running the demo.

[@yetanotheropinion.843]

That is not problem solving, that is just value substitution in a formula. Problem solving is knowing why the formula is the way it is.

[@servantofthelord8147]

@@yetanotheropinion.843 maybe, but, my comment was meant to emphasize Khan’s look towards his son :) not the intricacies of the example

[@DefinitlyAPerson]

This is the emotional aspect of teaching that teachers once said AI lacked.

[@keshav2136]

True

[@snow3338]

In fact I often think many teachers lack the patience that AI has

[@douggg5432]

this is scarily amazing

[@Dereliction2]

Whoa. The future of Khan Academy is going to be amazing.

[@SpaceTimeBeing_]

The future of unemployment too.

[@urhot]

@@SpaceTimeBeing_which is good

[@stanfoo1175]

@@SpaceTimeBeing_jesus christ 😂 you people are so scared of anything you dont study or understand

[@x_pogboy5082]

After all the demos on gpt-4o this is the one that really impressed me. It crazy to think technology has already come this far and it feels like just yesterday when gpt3 released and that used to be groundbreaking

[@super266]

The LLM groking contextual feedback within an image is incredible.

[@CaptHayfever]

I love how you talked over the AI saying it couldn't recognize the problem in that format with a long irrelevant description that would've just confused the system further while waiting for the scripted lesson to load.

[@WSmith-wo4sc]

Just saw this video at work and it absolutely blew all of our minds! This is one of those areas where AI can really be a huge force for good.

[@hemlataagrawal7416]

I saw this video on the recommendation of Dr. Gourav garg sir Thanq sir 🎉😊

[@roan6903]

This is awesome! Reminds me of my math class. I got bad grades in the exam but still could not understand the questions. The teacher did not help me but rather humiliated me instead. I used to be worried that AI could replace human, but now I hope AI replace some human ASAP.

[@PawnPunch]

yeah, f*** those bad teachers

[@yetanotheropinion.843]

You would want to get more deeper in understanding what the sin function is then just substituting values in a formula. That is how found Sal and his incredible work,

[@enviableace9987]

Cant wait for this!

[@krisztidavid7725]

Wow! and again just WOW! I need to get the book!

[@alonzoarcher6585]

Will be great when AI can create real time visual aids that are specific to the discussion at hand. I am sure they will get there as I continue to be impressed with the pace of progress. Then again, if the AI can “see” and digest khan academy videos for real time discussion (perhaps with the video on pause), then that alone would be fantastic. Great stuff here!

[@FarObserver]

Despite the little hitches, this is MIND BLOWING

[@himanisudan9083]

I saw this vdo ,so much informative Thanku GG SIR 🙏

[@delinamichael1517]

Can’t wait

[@biznessman4597]

Khan is a real guy thats crazy

[@Mohammad-bg1xc]

You are a great guy Sal and your son will be great too

[@mohdashakoor]

Impressive. This is quite attractive for teachers as well as students. AI tools are indeed promising. However, we aren't there yet, I suppose... Few observations: 1. Identification of Hypotenuse - Adjacent side:- this came out as a direct answer by AI, although it was mentioned not to tell the answer directly. - The kid seems to have identified hypo by the length, and not by the orientation (this may be good, but not an exhaustive understanding of hypo) 2. Identification of Opposite side - though the kid answers correctly, yet it isn't the correct way to arrive at the answer. He followed simple logic (2 down, 1 is left so it has to be opp.). He could apply this logic because "adjacent" was already revealed (directly). Without the disclosing of adjacent, the kid might have struggled to decide between adj and opp. the entire game was only in between opp. and adj, and I suppose, we cannot conclude still whether the learning has happened or not. A math educator might not have revealed "adjacent" at that point (where AI did), because s/he knows it would collapse the session.

[@urhot]

I assume you don’t know much about prompting, all these issues you listed can be fixed easily with detailed pre-prompting! Coming from a top GPT creator for OpenAI.

[@frankman2]

I saw that too. Although I'm not sure from a pedagogic point of view if the AI should hammer on those points too hard. Let the kid feel a sense of achievement and then you can go back to those issues. My 2 cents.

[@Matt0sh]

Can people outside US get access to khanmigo now that other languages are much better and it's cheaper please?

[@KyeiAfari-nf5ws]

Can someone help me on how to share your screen like it was done in this video. My Chatpgt does show the screen sharing icon . I don’t know.

[@karenbendok7536]

How did you incorporate the drawing pad to have an interactive lesson ?

[@astroyny]

Please post how you set up GPT 4o on the iPad for this problem!

[@getnform]

I can't find the screen broadcast in the chatGPT app, how did you do it?

[@RodneySamuels]

Is this available now?

[@shivasuresh5957]

Your son did a great job with the demo. GPT-4o's tutoring capabilities are fascinating.

[@QuantumParadox]

What software are they using? I do have a subscription to ChatGPT and to MS Copilot. I want to use this to help me with math and programming.

[@user-hg7kq7yw8i]

where can i find this app or website I'm a guyanese student going to the country's top school but recently started getting some trouble with math

[@AnitaSharma-iu1zx]

I really want to experience this

[@lifehackswithashish]

What is this whiteboard drawing input? Is it some kind of plugin?

[@crazybunkum]

How were you able to share a live feed with GPT4o. What software? Love the Khan Academy btw.

[@meuno101]

It's recording and analyzing the screen realtime

[@crazybunkum]

@@meuno101 Mmm - that capability hasn't been rolled out universally yet.

[@sandraabreu-fn6fu]

Of course Khan Academy gets all the bells and whistles to show us the demo/promo. Notice the logo on the coffee mug?

[@BytePremium20]

When is this coming out? i have access to chat gpt 4o but i can't find where to share my screen

[@xGriffy93]

I don't think they shared the screen. They always mentioned the specific side that was referenced with the pen. It could very well have understood everything from the audio input.

[@Bilalrajput2001]

In the coming weeks they said.

[@Dimaz42]

this blows my mind.. we finally have our own Jarvis / Friday

[@itzHao]

Hi khan academy, could you tell me how to do that and share my screen so chat gpt 4o can see khan academy while using it?

[@JonBergmann1]

amazing

[@AlphaCrucis]

It will be on your iPad app, but what about Android and PC?

[@captainhaddock6524]

awesome although a little scary😅

[@arongil]

Oh my goodness, this is SO COOL!

[@AntiKiwieCS]

How do I screen share with gpt4o? It does not seem like a functionality available?

[@SMOHIDULALAM]

chatgpt 4o is yet to be released to public. Maybe within a few weeks.

[@robertdavid22]

@@SMOHIDULALAM I thought it's available now? I can select it in my account, but doesn't allow for screen viewing

[@AntiKiwieCS]

@@SMOHIDULALAM gpt4o is already released, but the conversational part is not

[@aaronchenexp]

How can chatgpt see the shared screen and the motions?

[@elswere-1]

I'd love if youd test the ais math. I know its more complex science ability is usually wrong

[@droptimistic7419]

what are using exactly?

[@nathanaelculver5308]

How did you access the new ChatGPT 4o features?

[@s.vkaushik2148]

How can I get the interface shown in this video ? Should we go to khan academy ?

[@yaeldegany]

Can you explain exactly the set up? You have a split screen on an ipad and what exactly is running? I'd like to try this

[@matthewsmith5701]

The description said that it's an update to Khan Academy's iPad app that hasn't come out yet. He said it will come out soon.

[@yaeldegany]

I get it. I'd still like to hear the description of the set up

[@soniaperry2352]

@@yaeldegany I tried to get something similar on my iPad. I don't have the Khan Academy iPad app, so what I did was take a photo of a math problem, then I opened the picture in GoodNotes. I then opened ChatGPT 4.0, selected the TutorMe extension, then I split screen between the ChatGPT app and GoodNotes. I uploaded the screenshot of the math problem to ChatGPT, then switched over to the chat function (black screen, can't see text or screenshot). That way I could look at the math question while asking questions. Guess it would be the same as printing the question and looking at it while chatting to the Tutorme tutor

[@yaeldegany]

@@soniaperry2352 1. Thank you 2. Would ❤ love to see a video of that if you'd feel like uploading it. And if you do upload it, it would be great if you added the note for the way you did it and/or share the info in the video so others can mimic 3. How was it? How was the experience? 4. What level was the problem? 5. Thrilled you added goodnotes into the mix. I like that app.

[@yaeldegany]

@@soniaperry2352also I'm so into the fact that you added goodnotes into the mix ✅

[@vojislavpavkovs9124]

Kjan academy learned me Soh cah toa :D

[@basimairshad7800]

Since, gpt4o has become way cheaper and free for chatgpt users, would you consider making khanmigo also free ( at least reducing the subscription cost in half)

[@user-vj5dm1mv5f]

why u make announcement for something even the date fir release u didn't mention it

[@MrSirIsBroke]

Where can I get this Ai😮😮😮

[@xalau5270]

we are living in the future

[@jason-ub8qz]

You posted your own end

[@thomaslafountain1014]

how did you get it to watch your screen?

[@TheGrapplingMonkey]

How did they do that? Please help!

[@DavidGrush]

Impressive

[@nonchalantd]

♥

[@Crives]

How to replicate that?

[@TheHawkeyede]

Most of my teachers at school did not even show 50% of this emotional aspect of GPT and encouragement . I guess we are already at a stage , where GPT can teach teachers how to teach. The question is, are teachers open to that ?

[@Cujo8600]

This is good for kids that actually want to learn and put in the effort. What can it do for the millions of unmotivated that think math is dumb and impossible to learn?

[@pooja20252]

I am watching this video on the recommendation of gaurav Garg sir😊

[@ExileLBL]

Im proud to be here, one of first 100 comments in mankind history's milestone.

[@Oscar-pt6bp]

I wonder if this would work on samsung's tablet

[@hellowill]

Like with all tech, I think this will just increase the divide, unfortunately. Smart kids will use this properly to learn and get even further ahead. While bad students will use it to finish their work without learning anything (i.e. cheat). I guess it's up to parents and teachers to teach kids the point of their work - which is to learn, not simply finish the tasks asap (but we already know how that will go). I am already seeing at my job junior engineers using AI to finish their tasks faster, but long term they're not growing and taking more time because they dont gain that deeper understanding.

[@mohammednajeb3716]

What's the type of taplet he's using?!

[@Maria-ot8yt]

There is no broadcasting function in gpt40

[@yesdoeee]

Will khanmigo have this

[@isk3804]

How do you set this up that way?

[@banker2474u]

Hi, Dr. Gaurav Garg sir send me here to see how much AI becoming advance day by day... और किसको - किसको sir ने भेजा हैं...😂😂

[@jonathankonrad]

what is the setup here? I would like to reproduce what you are doing and walk teachers through how this may help some one-on-one opportunities. Thanks!

[@megalomaniacdreamer]

I'd like to know too!

[@rburk121]

Has the kid coached up well😂!

[@Shopanywant]

Hello. Isn't the feature of seeing the screen via screen recording active right now? If not, when will it be active?

[@i.r.fernandezaguilar3229]

Hi. is the AI available in spanish for primary elementary grades? thanks.

[@kamikeserpentail3778]

They have another demonstration of it translating English to Italian pretty much in real time. I don't know the full extent of languages it is capable of working in, but probably most that aren't rather obscure.

[@bishoyamanda3987]

How do u broadcast cant see the button

[@sizarev]

Same here

[@rajnimamgai5159]

Ai is amazing but some teachers think they will be completely replaced by AI but that’s not true! Yes teachers have to learn a lot of tech skills but It cannot replace human interactions , it doesn’t have adaptability , it doesn’t have creativity and its own intelligence, some aspects of learning such as critical thinking , creativity and social skills need human always . So yes both AI and teachers have to co exist . Ai is the game of the data feed in it , in true sense intelligence is never artificial , creativity comes from the intelligence and source of actual intelligence is super consciousness .

[@keyser021]

If you're an adult, think back over the last 30yrs, think of all the promises and visions of the future everyone had when the cool new internet came online and it was a boundless field of infinite knowledge leading humanity to new heights and new glories. Now look out your window, take stock of the world in 2024. AI will replace teachers asap because American education cannot execute on logistics to match the efforts of those great teachers you are thinking of that will "always be there". Americans will forever default to easiest mode, no matter what. These party tricks are definitely cool, but there will be zero execution and in 3-5yrs we'll have nothing but AI bots everywhere trying to sell you everything under the sun as they spy and accumulate every data point of your existence which then provides a central repository representing your entire existence could then easily be hacked and manipulated and controlled by those seeking to squeeze every last cent from the fading capitalist plebian class. The robot wars will burn everything down before we even get to that point, so yeah... teachers should be refreshing their people skills asap.

[@saydtg78ashd]

You are underestimating AI. It will be much more advanced in no time.

[@rajnimamgai5159]

Yes that’s true , but still do you feel that all people will be eliminated ?? It is not anyway possible .human interaction is so important for the wholistic development

[@saydtg78ashd]

@@rajnimamgai5159 Of course it is never all. Even at the extreme case that AI is mega advanced, we still need some people to manage it. But I think AI is just going to take up a higher percentage in the education indudstry from now on.

[@caesaria]

what level of creativity do you expect in solving a maths problem?

[@sardarbekomurbekov1030]

Exceĺlent tool to improve math.

[@zamiruddin6948]

How do I access this?

[@BobbyJenko]

It’s the end of the wooooorrlddd as we know it

[@kamikeserpentail3778]

And I feel fine

[@anshikagupta1667]

Yup, I really want to mention the name who sent me here GG sir

[@aspiration03]

Hello sir Yr video recommended by gaurav garg sir owner of study IQ.❤❤

[@Alokita81]

But how will they replace the Indian tutor who slaps you everytime you give the wrong answer

[@phinnphace]

This is the transition where we start to let go of how we were taught/raised and can be like "ya know.. Maybe it can be better" 😉

[@Adam00754]

🤯🤯🤯🤯🤯Omni another level ❤❤

[@qaesarx]

OMG, this... this will replace now SOOO many jobs its INSANE! With Chat GPT5 it will be over, then imagine integrating this into ROBOTS!! 🤣🤣🤣 Its over guys! Or maybe paradise.. idk 😅

[@complicatedtime]

I think I just found an extra $80M free budget of our school district’s budget!!!

[@asifosman]

Can it explain things in other languages? I guess soon for sure.

[@kamikeserpentail3778]

It can

[@vijaykotian1]

WOW!! This is a game changer

[@Natural_nature11]

Gaurav Garg sir, study iq

[@muroll1995]

Cant wait for waifu teachers.

[@aurkom]

Dayum.

[@1minutebiology]

Amazing 🩷🔥

[@akshaychoudhary951]

Suggest by gaurav garg sir

[@lesprivatcapres2645]

Mostly our teachers teach like AI tutoring. So, now their skill in teaching changed with AI.

[@sunilm2916]

Maths problem image is smaller than your views which is totally not required

[@sloanNYC]

The voice is creepy to me and sounds a bit condescending, but it looks useful and close to being less creepy.

[@EricM93]

you'll be able to have a tutor with any personality you choose, even famous scientists/philosophers, anyone you can think of.

[@asader0]

I love khan academy, but even his kid is pointing out that he feels the ai told him what things were rather than that he had figured it out on his own… their is no ownership. The ai doesn’t utilize the students understanding of words, and doesn’t ask the student to make connections through his process of elimination and the meaning of opposite. I’m looking forward to the time when the ai can also read the drawings made by students and get them to have relevant conversations with other students in the class to give then the chance to explain their reasoning and hear a perspective that is different than their own.

[@RemotHuman]

the real test is if he says something wrong but gives a plausible justification, will it correct him or go along with it, and how does this change as the content gets nicher or more advanced