Realtime Translation with GPT-4o

Say hello to GPT-4o, our new flagship model which can reason across audio, vision, and text in real time.
Learn more here: www.openai.com/index/hello-gp...

[@mooreel]

How many startups were just bankrupted?

[@ShpanMan]

Startups? My man the entire economy is going down(well way up actually, but people will lose jobs in the interim period).

[@jayd00k]

Several 😆

[@user-hy5oo3vf5c]

Answer: yes

[@onapersonalnote7045]

The whole translation and interpretation industry is sweating right now, and has been for a long time. The only thing stopping them getting wiped out is that you cannot hold AI accountable.

[@RainMan52]

The reminding call center husk just evaporated

[@carlyoukilleditbeats]

You guys are changing the path of humanity in real time 😅

[@homefreedome217]

Exactly!

[@ldkevin2]

4th industrial revolution baby!

[@paelnever]

I don't know Rick, that voice in Spanish sounds really bad

[@dakantsa1712]

😅😅😅😅😅🗿🗿🗿🗿🗿🗿💀💀💀💀💀

[@Blaze6108]

@@ldkevin2 I strongly doubt automatic fabrication and advanced fertilizers will come from a chatbot. It's good technology, but not an industrial revolution.

[@bluesoffthecharts]

It's over for google translator

[@TheeBrainer]

And translators as well

[@-mk_]

If your live translation fits within the daily limit of allotted tokens

[@s.veteranramboalpha6762]

Google iz a shiiit in translation

[@Kaienhere]

I'm not sure about it because you can do the exact same thing in Google translator already, no AI involved. The voices here are better though

[@bradleybell9581]

@@Kaienhere Not quite to the same capability. I've used Google translate in clinic and every now and then I have to hit the microphone button to keep the conversation going. It's not efficient at all when I'm looking at their eyes with the slit lamp and then I have to move all the equipment to go tap the microphone button. Also, if you say the wrong words or want to change what you said, you have to wait for it to finish speaking. And on top of that, it's really not that great of a translator. This is way better and I'm relieved I can finally freaking communicate with the patients.

[@captainobvious1415]

No wonder Apple closed the deal with OpenAI yesterday. Sam must’ve showed them a demo and Apple new they couldn’t compete lmao

[@klirmio21]

what deal? can you give a link?

[@hayden3865]

​@@klirmio21 Siri will be ChatGPT in the future.

[@djbombba]

Ong 😆 WWDC about to 🔥

[@katto1937]

@@hayden3865 Not surprised, it's basically the perfect use for this. It's what Apple envisioned but could never make

[@1997Banane]

@@djbombba That deal wont effect this years WWDC. Probably next year at the earliest.

[@cxplorerv3]

Wow! What a great time to be alive! This will be useful on my travels.

[@pisky5067]

There are two types of people: 1) people who see AI and say "Wow, what an amazing tech, I'm so lucky to be alive now!" 2) people who see AI and say "Wow, this is very scary, AI will doom us all!"

[@reachthezora1912]

​@@pisky5067none are wrong hahaha

[@MiguelAngel-kw7pl]

@@reachthezora1912 Haha this!!

[@Arcticfox7]

Perfect for communicating with my future wife in Kazakhstan who speaks zero English, and me zero Kazakhstani

[@lyds6382]

@@pisky5067 unfortunately they are both right. Do utopian view would be that AI and automation can take over dangerous, boring or repetitive tasks and basically start doing the work that is necessary for survival for us, us freeing up humans for better pursuits, such as creating and personal connection and the sorts of things that technology won’t ever be able to do. Unfortunately, that would require some sort of universal basic income possibly funded through taxes on automation or something of that sort, and that won’t happen until things are dire. We have structured society in such a way that we are woefully unprepared for such a massive shift.

[@jk_lol9266]

this may seem like a really uncomfortable interaction for normal humans, but this is an accurate depiction of tech bros interacting.

[@CLSGL]

Talking through a device is the only way to get them to converse 💀

[@generichuman_]

I love how people make fun of awkward tech bros, while they use all the technology made by tech bros. Tell me Mr. social butterfly, how would you interact with a person who spoke a different language than you. Does your super awesome social skills allow you to overcome language barriers?

[@CLSGL]

@@generichuman_ relax there, knight in shining armor. It’s a joke. I’m in software and even we joke about our introversion all the time.

[@jk_lol9266]

@@generichuman_ ask chatgpt to explain the joke cuz u clearly don't get it

[@banny123456]

​@@generichuman_ you learn the language and you can freely speaking to each other.

[@PalantirVisionOfficial]

OpenAI shocked the world today - great product release!

[@Cainny]

You copy and pasted this on every single video, purely for likes. Do you even mean it? 💀

[@techfun123]

@@Cainny I hate it when people do that. But.. they did indeed shock the world. again.

[@financeguru234]

I was not mentally prepared for this.

[@georgemorenstein]

For what?

[@Arcticfox7]

It's OK, you're only human. Lol! Humans, lol

[@catinjar9460]

I wasn’t either

[@techfun123]

Vastly better than anything I've seen.

[@shmookins]

Yes, finally! This is actually something useful. Thank you. I saw a demo from Google doing live translations years ago, but I have no idea what happened to it. Also, we need to translate text and audio files as well so that anybody could access any knowledge they want regardless of language barriers.

[@moviecuts9487]

Hi Openai, remember me...we used to be friends.

[@theincarn8842]

New num, who dis

[@terrafray]

As Interovert, I can imagine myself have more confidence to learn a new language in a more convenient and responsive way, can't wait, it looks so good. 🔥

[@SirusStarTV]

more covfefe

[@mohammadiaa]

Focus on English for now.

[@terrafray]

@@mohammadiaa Thankfully, I don't have to resort to artificially inflating my own comments or posts. My contributions can stand on their own merits without needing to give myself an insincere thumbs up or upvote. Self-promotion of that kind comes across as insecure and desperate for validation. I'd rather let the quality of my words and ideas speak for themselves and be judged authentically by others. A little self-confidence goes a long way - no need to pat yourself on the back artificially.

[@terrafray]

@@mohammadiaa 2 minute reply with 1 like, yeah, of course.

[@dralchemy8459]

Angry​@@terrafray

[@botmsj]

So you're telling me my 10 years of painfully learning a second language have amounted to a hill of beans?

[@imaginationpictures]

You don't learn a second language to necessary be a translator, you want to talk face to face to other people not by using a phone, and u also want to engage with them, so no, it's worth it learning a second language.

[@pinupkulture2231]

Or as ChatGPT-4o would say, “Una colina de frijoles” 🫘

[@SirusStarTV]

Consider you have gpt model of that second language implanted into your brain

[@nicholastoo858]

If there’s no data or battery.

[@jaredf6205]

No because google translate has already been able to do this exact thing for years now, no matter which language you talk in, it will instantly read it out loud in the other. It even shows the translation on the screen as you talk. It also responds at the same speed. It’s going to be more accurate since it’s programmed to be a translator and this is not.

[@daniilsanders2257]

Lets gooo OpenAi!

[@MementoMori_2070]

This will definitely be useful, while lost in a different country and needing directions

[@dice268926]

UFC Post Fight interviews going to go A LOT FASTER 😂

[@AgentZero777]

Ahah I was thinking the same thing. 😂

[@EliasRoy]

lol 😂

[@Roantanoto]

this is beyond amazing, it's almost unbelievable that AI is progressing this quickly

[@MuchoMate]

How come english voice sounds so natural and spanish so crazy ridiculous 😂 Definitely some improvement still needed there

[@jaredf6205]

It’s designed to speak all languages with a slight American accent.

[@user-on6uf6om7s]

It sounds like a Spanish lisp so definitely Spanish from Spain but also kind of American.

[@montonmonton8791]

Definitely, the way it speaks Spanish is much less natural and fluid. Also, the guy is clearly speaking Spanish from Spain, but ChatGPT is translating with a pretty strong Mexican accent.

[@tylermd89]

I have to try communicating with non-English speaking japanese people at work every single day. This just made my job 80% less frustrating.

[@MauricioUbach]

Need that OpenAI coffee mug in my life

[@AhmedIbrahim-uf6ft]

Now that’s the beginning of a new era.

[@paranoidhumanoid]

ChatGPT can understand all known different varieties of Spanish without having to indicate it as you would in Google Translate.

[@Gesh7]

This is amazing. If this Feature is someday available offline its gonna be crazy.

[@adredy]

Nothing works offline sorry 2024 this is to big

[@user-kl8vr8io3b]

Вот это действительно полезно...👍👍👍

[@helloworldcsofficial]

This is great. Upgrading now.

[@giovannisantos8429]

Let's Gooo OpenAI 🚀🚀

[@AITheBests]

So excited!

[@morpheus7422]

So Morpheus here again 🎉🎉🎉

[@panzerofthelake4460]

balls

[@bemci1975]

Damn, the future is here.

[@masoudmokhtari3904]

I love how you were struggling to rotate the camera the whole time 😂 It was kind of weird that the table was detected as a stylish person with a leather jacket.

[@sameersharma99]

What camera?

[@dugong659]

insane

[@Andrewe1]

Hopefully we get an anger translator like Luther... would come in handy.

[@santiagoc93]

It will be useful when you have to prepare for an interview. Just upload the resume and ask Chatgpt to practice with questions.

[@bluemarkyu6123]

連通上帝的巴別塔被OpenAI重建了！？💯

[@stargazer8465]

Incredible

[@roteschwert]

Gemini feels like GPT 2 compared to this, and they're the most direct competitor

[@Jay-bc7kh]

Gemini is far better than GBPT when it comes to factual things ie. Anything STEM related.

[@Carman999]

Very useful for traveling to countries you don't know the language, but I think real time translators and interpreters are still needed because conversations depends a lot of the context, and sometimes you don't need to translate literally all the information to the other person to understand the message. Anyway, nice tool

[@AmericoVespucioo]

I think the AI is capable of interpreting slang. If not, it will learn anyway and eventually 😄

[@bradyali8696]

Amazing!

[@kimurakaido285]

thank y for realizing "Her"🎉

[@wah866sky7]

If I am studying a degree of translation in university, whether need to drop it tomorrow?

[@yak-machining]

Don't worry you are still useful when electricity goes out

[@amanshekhar7200]

​@@yak-machiningbro😂😂

[@homefreedome217]

​@@yak-machining savage😂😂😂

[@pepsico815]

@@yak-machining People will say that and turn around and call Bitcoin a scam lmao

[@mark9294]

Yes

[@fishzebra]

Awesome, I just used it with a plumber at my home to translate between Finnish and English. Thank you so much, great timing in releasing this.

[@Hiroth86]

I can't wait to have this app

[@user-qc8uy2cb8o]

Наконец-то инопланетные технологии нашли применение в жизни обычных людей!

[@joshuaedwards3522]

I hope this can be available for everyone, not a pay to use

[@joakalfajoor]

In a future gpt4 free, gpt5 no

[@DREIKVENONW]

Where are they getting their money from ? U can't expect people to accomplish such a thing for free. Do you work for free just to help people?

[@infntegaming]

This will be very useful to Roger from American dad

[@kevmahon]

This is amazing, but only if there isn't any background noise. Great for one on one meetings in a quiet room, but this will not work well outside of that.

[@lawrencelawsen6824]

omg incredible :0

[@GregBecker]

I wonder when it will approximate the voice as well (ie translate a masculine voice with deep AI voice)...

[@moose6781]

I would love to see if this new model with the vision can translate ASL to English.

[@dthompsonza]

Its a 'translator' when its written text, its an "interpretor" when its spoken language

[@MisionJapon]

Thank you for the video. I am currently living in Osaka, Japan and I am very interested in Instant Translation with AI models. However, what I understand by "Instant Translation" is not: "I say a sentence - The model translates it after a few seconds and I can hear it - I say another sentence - The model translates it after a few seconds and I can hear it..." What I understand by Instant Translation is: "You are talking in Japanese and, while you are talking in Japanese (with a delay of a few senconds), I listen your speech in Spanish. No matter how long it is the speech. May be the Japanese speech is 10 minutes long and I can begin to listen to it after 5 seconds in Spanish and will end 5 seconds after finishing in Japanese". Basically it is like having a interpreteur by your side who doesn't have to wait until the end of the speech to begin translating. That way, the conversation gets more fluid. I know this is not an easy task, as there are SOV and SVO languages. However, I think that Seamless m4t model is able to take this into account aswell. Do you think is it possible to implement such a thing with this model?

[@user-ub6sw6jt8r]

少なくともスマホ一台だと自分の話している声で、AIの声が聞こえなくなりそう

[@MisionJapon]

@@user-ub6sw6jt8r はい。スマホ2台以上です。

[@CarlosEnriqueAmaro]

Hi OpenAI, first off, thank you. Thank you for continuously providing not only Opened Sourced ChatGPT for more technically inclined individuals to continue in the research and development and enabling such an upgraded GPT-4o for users to fully grasp AI’s rapid expansion and evolution in the industry. With that said, thanks again for the extended free prompts for testing such features. As mentioned within a WIRED article recently published, “Just know that you’re rate-limited to fewer prompts per hour than paid users, so be thoughtful about the questions you pose to the chatbot or you’ll quickly burn through your allotment of prompts.” Kudos. I can’t wait to be able to pick and choose between consented personality voices of individuals partnering with OpenAI for a more personalized “voice” of preference when interacting with GPT and enabling its latests search and translation features.

[@preder4520]

I'm so glad I decided to switch career paths from translation to finance. This will put a lot of people out of jobs

[@generichuman_]

you think finance is safe? ... Interesting

[@chebudedandee1627]

Amazing

[@ndu-sx3ns]

if you are seeing this from the future, just know that I will be the first person to edge to ASMR of chatgbt when it releases.

[@georgemorenstein]

The rippling in the water, would seem to indicate that a feeding frenzy of some sort is underway and things might start to get, what was that heathen's 'theory' called again. I remember the theory was eponymously titled. Ahhhh, now I get it. "It" being exactly just what, I'm not so sure about."

[@TheHarleyEvans]

Wait for this to be incorporated into game lobbies and chatrooms (discord, zoom, skype etc.)

[@akosizrake]

Duo is sweating rn

[@hurobiont1054]

This is like that scene from Demolition Man, where Phoenix translates from English to Spanish in real-time. :D

[@YTjanitor]

It switched from European Spanish to Latin American Spanish based on the guy’s lack of a lisp. That was good.

[@montonmonton8791]

ChatGPT is translating in Mexican Spanish even though he is clearly speaking Spanish from Spain.

[@Ayutarda]

can someone explain how exactly you download this for your phone and use it like they are here.

[@BornToVlog]

how to get 4.O?

[@eeskaatt]

my key takeaway is that it can easily recognize fast paced type languages like spanish. dang.

[@laurenz1337_]

I hope they can get rid of this robotic voice crack side-tone with the next update, otherwise all this stuff is super impressive

[@-jg9pi]

I'd be curious to see how well this works as a private language teacher. I could see myself use this for hours trying to learn and practice a language. My worry is it not pronouncing words correctly or it not being able to switch between english and another language mid sentence

[@nikeneon3188]

Well thank got I've got my 2nd education. I think I could be a teacher for about 2 more years... definitely need to get 3rd education ASAP

[@aguzman222]

Uh to get the right amount of intonation in Spanish is real crazy / people talk about job lost - but imaging having an universal translator at all times

[@knux5796]

damn thats pretty impressive/cool no ones gonna have to learn a language lol! that being said the spanish one does sound slightly robotic compared to the english one

[@CARnalRides]

Duo is sooo cooked, another netflix might happen, but to them 😂

[@andreimade3261]

This is amazing, now learning a second language will be a choice, not an obligation, thanks

[@lapaloma80]

I tried this with the current voice model and it forgets to translate after a short time and starts responding directly to what is being said. Has anyone else experienced this? I'm wondering if it will work better with the new voice mode. The demos always show only very short conversations.

[@harshitnanda9290]

nah this crazy..the future is about to go crazy

[@Mt-BNN]

im guessign the app used is a prototype ive been unable to find it anywhere even for sale

[@asbestosflake5749]

When will this be available? I upgraded to this and it says it doesn’t support this function 🤔

[@PaulS-nq4cm]

Is this available now? Or is this coming soon...? If available now. Please share how the spoken interaction is initiated.

[@Jason-33W]

Soon they will have translation automatic where you can talk to someone on the phone and it will instantly translate to you and vice versa. We'll have the real-life Star Trek voice interpreter. In fact, it's already here.

[@AcidDotDrop]

Ther should be some way to set it as a default to not have to go trough the "tranlsate x to y and y to x" everytime you pull it out

[@pedrojosedasilvarodrigues7510]

Is that on outside the US?

[@Dmindtalk]

How many Nigerian kings we are having now with this one 👑

[@Soooooooooooonicable]

There are still plenty of words and sayings that don't have direct translations. I wonder how this would handle those situations. Also, what if someone is speaking sarcastically? Will it convey that to the other person?

[@imperson7005]

It can summarize what they're saying, it doesn't have to directly translate it, it depends on the context. Just pretend you're talking to a human in regard to it's ability to understand sarcasm.

[@aaronjiang8964]

It will collect data and improve itself

[@kitkottin]

its not a word to word translation. the AI understands the context and translates based on that.

[@PhantomAyz]

break a leg! -> buena suerte! (good luck!)

[@weisserbaer]

When will it be available?

[@bluesoffthecharts]

Today

[@HeinrichRuzenberg]

As OpenAI said, in the next weeks for plus users

[@fikazr6474]

the monthly subscription is annoying.why we can't buy the app at once !!

[@soichirokawagoe440]

Is this released already?

[@sskohli79]

Can’t see it in the App Store

[@dumarEsquire]

When will This be released?

[@jamesho9875]

Hi, very interesting but which app I can use to achieve what you showed in this video. I've downloaded official ChatGPT app but not able to succeed to what you did in this video

[@Joel.Tapia90]

Para cuándo estarán disponibles esas funciones que muestran en su demo donde puede hablar y hacer video llamada con el robot

[@VoodooD0g]

You guys already showed that in the live stream..

[@Arancione3000]

Whet it exit for Italy and Europe?

[@andrew-ld1jg]

When it will be on my phone?

[@merterarslan4414]

When we can use it?

[@Sir-loin86]

Has anyone actually got access to this voice chat version yet? I have access to gpt4o but my voice chat version seems exactly as before.

[@rdee8652]

Suddenly my mobile interface looks like desktop version of ChatGPT, which is to say, not at all interactive. Instead of the orb, there's a text entry field. But it worked before. Now it doesn't. I wonder waht gives.

[@PhonkAttack4DX]

Is this free to use?

[@kreativechaos7606]

Waiting for the upgrade when it can help with trading.

[@voyagetravel1840]

Dam ik alot of companies are shaking right now. OpenAI is really changing the game

[@jasonapplebaum9871]

Is this already usable or not yet?

[@NotTylerTheCreator]

Drake finna cook with this 😂

[@kanwarmuhammadareeb1335]

Why cant i use this feature in aus?

[@omegaRST]

It has a thick accent in spanish but impressive nonetheless