Live-caption glasses let deaf people read conversations using augmented reality

Subscribe to our KZbin channel for free here:
sc.mp/subscribe-youtube
These smart glasses show real-time subtitles of conversations, which could be useful to deaf people. The XRAI Glass software turns speech into text, which is then displayed on the inside of the lenses.
Support us:
subscribe.scmp.com
Follow us on:
Website: www.scmp.com
Facebook: / scmp
Twitter: / scmpnews
Instagram: / scmpnews
Linkedin: / south-china-morning-post
#scmp #Technology #Virtualrealityandaugmentedreality(VRandAR)

[@NdreTtoJ]

Imagine having this to help communicate with ppl across different languages. Really support the project

[@n1ppe]

Well it's very hard to translate speech in real time to another language because words and sentences are structured differently in different languages so it would have to listen to the whole sentence or multiple sentences before it could actually accurately translate it, and there could still easily be akward mistakes. It could work somewhat on languages that are related to each other

[@MultiverseRaidenWarriors]

Their accent is rly...

[@Drop_The_Mic]

I don't really see the need for paying $400 for this glasses. Guys, our phones can already do that. just open the translator app and choose conversation. and it will subtitle all the conversation automatically. I do not see any need for these glasses...

[@miriamceraman4932]

@@n1ppe true - plus, there's all these little intricacies to languages, like metaphors and idioms, which would be quite difficult to translate

[@marcbayarea1980]

@@Drop_The_Mic $400 is very inexpensive for these glasses. Deaf people already use phones to communicate with people, and it's very cumbersome and inefficient. Plus, you always need to have your head in your phone, which isn't so favorable.

[@liveitlarge68]

Science and technology never ceases to amaze me. The joy and happiness it can bring to people is just priceless.

[@peacepham7838]

But all this project need fossil oil, and many activities are protesting to get rid of it.

[@psisis7423]

Yes but it could be dangerous relying on private companies on this. If they lose the budget to maintain them, they could get abandoned and break down. 400usd is really cheap.

[@MitchellFeldman]

Hi, I’m Mitchell one of the founders of XRAI Glass 😎. Thank you for liking our video 🙏 This is the most profound and rewarding initiative I’ve ever been involved with. There is nothing better than empowering people to enjoy a richer and more inclusive life. Myself and all the XRAI team are extremely humbled and proud. 😍

[@ibuprofen0001]

That’s amazing

[@crazycricket39]

Thank you and bless you for bringing these to all that need them. I cannot express how much these would help me. When do you anticipate them being available in the US? Also, are they designed to be worn over regular glasses? Where can I follow you to know when they're available?

[@1darkironman1]

I'm deaf and have thought this up years ago. I'm impressed that it did happen. I bet it uses auto-caption so it won't be 100% effective, maybe 80%?

[@L4zyasz]

glad to hear that. oh wait... shouldn't have said that

[@durururururururu]

On the go Speech to text is really hard, and its something only Google has managed to do effectively, even then it lags behind sometimes. i'm skeptical of this product

[@MAHESH-qe8cv]

@@L4zyasz 💀

[@bobbobbo5278]

@@durururururururu true. It especially made me consider being in loud or crowded environments too

[@cyberbard]

more like thirty percent.

[@lickyd1942]

We did it boys. Now we can finally have subtitles irl

[@Renosen]

go to Japan with eng sub💀

[@haizalizwan3787]

Otaku detected.

[@adhninzul4388]

Yes!!!

[@jinsatoshi8424]

@@Renosen 🤣🤣🤣🤣🤣

[@RespectOthers1]

Love how technology is embracing everyone with varying abilities.

[@supremegreaser2399]

Old technology.

[@danscarfe1]

@@supremegreaser2399 put to a new use 🙂

[@-beee-]

It’s usually preferable to say “disabled people” or “people with disabilities” 🙌💯✨

[@crabjunie]

more than anything, this is really just a groundbreaking moment for the deaf and hard of hearing community. it’s still at its starting point, of course, but as research on the subject becomes more intensive and technology continues to evolve, so will the efficacy and accessibility of these glasses. i’m so happy in behalf of inclusivity for all!

[@youngmasterzhi]

It’s like having video game subtitles in your very own life’s story!

[@honesty_-no9he]

You are a really cultured cinema aficionado I see.

[@kirkmarcuz635]

this tech is really a blessing to the world

[@clumsydude1398]

This is one of the coolest pieces of technology I've seen in a while.

[@luci4087]

does it matter how clearly the person speaks for the subtitles to be correct? i’ve had issues with some speech to text apps because of some health related speech issues. edit: 0:15 her speech is pretty clear and easy to understand. i’m talking about speech that is not as clear, slurred to varying degrees, etc.

[@someblaqguy]

Some software's actually learn your speech habits over time and adjusts to them accordingly. I've learned over the years that speech to text softwares aren't all created equal. Since this device's entire existence and credibility is banking solely on that one feature then I would hope that it would be among the best there is.

[@justinpark2946]

@@someblaqguy but your speech doesn't matter, it's other people's

[@someblaqguy]

@@justinpark2946 point of bringing that up is that it can possibly identify others and create a voice profile for frequent speakers.

[@danscarfe1]

The clearer you speak, the better the transcription naturally, but it's designed to work with normal, not perfect, speaking.

[@warcraftarenas8770]

Did you not see the Co-founder (who is deaf) talking to the other deaf woman? You can tell she lost her hearing later in life thats why her 'accent' has changed, and the software seemed to pick it up with ease.

[@prathyushadasari5832]

The joy and happiness I felt with this invention..even though I don't personally know anyone who is hearing impaired, is tremendous. Donno why. I guess with everything going on in this world now a days , bad news one after the other... This video brought a feeling that I almost haven't had in a long time.

[@joshuamcnab8986]

Lovely. This is what we should be using our human intelligence for.

[@sokapradipta8599]

Imagine being alone at night and your glasses say "twin girls laughing menacingly"

[@Okk681]

Oh noo not the Netflix captions 😭

[@RayMak]

It's like having captions in real life

[@hiddenaccount5699]

Bro u are everywhere

[@Murad_Ramadan]

fr

[@rikakosimp4483]

Finally subtitles invented in real life

[@crystallation4249]

Or even a dialog in real life

[@xephyre6955]

This could also be useful for non-deaf people if translation becomes more effective in the future.

[@ruthannklos9649]

This is going to make life so much easier for alot of people.

[@ximec.r.2643]

Next step, universal translator all across the world

[@VictorCostaCaldas]

This is great because it can also help deaf people learn/train how to talk, apart of giving them “hearing” capabilities

[@danscarfe1]

It's a scenario we hadn't thought of but works perfectly!

[@Smiley957]

How? 🤔

[@ruthjohnson1001]

That's gonna massive help with meetings I had involved with struggle to turn head to see who speak. I hate meetings with big groups but see this new subtitles glasses just what I need and not turn head too much. Excellent!!

[@randomjank]

Finally. I can see the subtitles when I go to Japan.

[@Check-inz]

Imagine someone who doesn’t speaks perfect/fluent ” English “ wrong subtitle, it might cause emotional damage. Lol 😂

[@jellonbillona1548]

Did you watch the full video?

[@Dev-sc9ze]

@@jellonbillona1548 seems he is not

[@seventail]

This is the best glasses coming out of tech yet

[@ariffinhr8426]

I like it when we human invent something that helps other people. This made my day.

[@suicideshy451]

I have a deaf roommate and he can't read lips very well. I think this could help with a lot of the violence he gets in the streets with hearing people. Overall I still think of the many deaf people who are discriminated with work finding it impossible to buy one.

[@_Just_Another_Guy]

Now create another version of this but for translating conversations in real-time. Sort of like subtitles for videos, except real-time subtitles.

[@jimurrata6785]

Google Glass did this a decade ago. Alphabet released a new version of translation lenses back in May.

[@Kazushiryu]

This will also means another efficient way to communicate and overcome that language barrier. New & improved translator incomin soon.

[@mikeguerrero7416]

This is so amazing, this is kind of technology that the world needs.

[@Dev-sc9ze]

The glass is called Nreal Air and selling in Japan and UK right now. Hopefully it can be sold in more countries.

[@greego5952]

Yeah it needs to come to the USA especially. The USA has a very large deaf community because of the lack of government funding for hearing technologies especially cochlear implants. But all countries should have this technology offered.

[@Dev-sc9ze]

@@greego5952 i think some develop companies should pay attention on this , it is big market and government may give some allowances on this

[@Maria_Lourdes]

Inventor deserves a noble prize for this.

[@danscarfe1]

I'm sure there are more worthy people than me 🙂

[@blulaguna18]

this is the best invention i have ever seen. lets make this happen to break the language barrier now.

[@kraftthisile9113]

My mother in law can read lips like a pro. And from far distances too. I don't think she would like this, she's proud of who she is. But I would love to surprise her with this.

[@robbert6393]

She's definitely ex-spy

[@arshediamedia314]

Thats wonderful. I applaud anyone who thought of and innovated this.

[@ayuu.]

Finally! Been always wanting to see such subtitle glasses since I was young. Will be so awesome if they can get transcript downloaded too!

[@aaa-my5xy]

i feel like this technology could have been released years ago. we've had speech to text technology for over a decade now and the google glass was made in 2013.

[@ADeeSHUPA]

uP

[@annatsukiya]

Maybe copyrights patent prevent it to be release to the public. Remember when Microsoft was first invented the window system, no can replicate because they have hold 20 years of copyrights legal. After that over, Apple can come up with their own OS.

[@danscarfe1]

We needed the right glasses. Google glass the original was ahead of its time!

[@darkmatter3112]

Cant wait until more features are added in. Sounds promising to me as someone born with Auditory Processing Disorder

[@kme]

I have APD too, but I'm also deaf (go figure). I need this like... yesterday, kinda thing. It would seriously help people like us, definitely. Will have to look into this.

[@jgrkennis]

Now THAT deserves a Nobel Price !

[@sarahlee8271]

It's not just science and technology that we applaud here but the beautiful heart of a person. Thank you!

[@sparklenive189]

This glasses feels Like a surreal moment I literally had goosebumps 😍

[@Zhyrim]

If funded enough, it’ll be wireless and be able to translate multiple languages

[@danscarfe1]

We need better batteries first! Qualcomm are working on wireless glasses though. Hopefully we should have some in the coming year or so.

[@Whynotcreate]

Absolutely amazing when we use technology like this

[@TechnicalSupport3758]

" why can't we subtitle the world?" 💕

[@YeahIsaidWhatISaid]

"Subtitle the world" Genius!

[@tfozo]

This is a breakthrough

[@yuuzhkingdom7025]

This guy is gonna be rich, imagine the broader use of translating one language into another

[@Gnekdjidkdbbdd]

This is the kind of the technology the world needs in order to improve the humanity ..Not robots plzz 🙏🏼!!

[@Lser03]

Awwww this is honestly so heart touching

[@heidannazakami6288]

A spectacular innovation. Im not referring the invention, but the massive production of this thing is a very well welcomed by our society.

[@rafaelperalta1676]

Projects like these are true blessings. It will help a lot of people.

[@knowledgetoshare4061]

Finally we can read subtitle when going to Japan

[@lindayusof]

What an inspiration..very innovative and creative and will help millions..thank u sir and grandpa too

[@astronerds1079]

Thanks for the people who developed this amazing tech !

[@nazrulikmal95]

Anime people going to Japan like "Finally, subtitles!"

[@lilithyolanda9851]

This is a great invention, I hope their able to polish the speech so it can be subtitle more accurately.

[@abirhossen9063]

Finally something that can help Askarov to understand what his coach is saying during the round breaks.

[@Maria-ed3jo]

Technology is just amazing! Super happy for those who can use these glasses.

[@tfozo]

Technology constantly shaping the way we live

[@OtakumaENY99]

Need this for the nail salon gossip😂👍🏼

[@hhakyt]

Revolutionary, in time there would be a subtle design, no different from a spectacle, less bulky, and comfortable, and it would have all these in it, along with AR.

[@professordingdong3892]

Hold on a Second... Why dont We Subtitles The World ? Amazing Quotes 👏🏻👏🏻👏🏻👏🏻

[@grandpawnapkins7429]

A piece of utter brilliance

[@jabbertwardy]

This is awesome! They had something like this in the 80s TV reboot of Mission Impossible. Great to see such a helpful application of a once fictional idea.

[@linkelvez6709]

I can finally go to japan and read subtitles

[@katunyuz1319]

i hope this is better than *youtube auto caption*

[@empyie666]

This is insanely cool!!!

[@isolate9920]

Finally with these i can now see the subtitles when i visit to japan... For some reason subtitles are disabled there

[@atifazeem1702]

we don't need wars.... we need these type of technologies to help each other out. Why do we fight? just to satisfy our ego?

[@Sllee93]

I feel so much joy from this video! 😀

[@alfred6180]

This will be really helpful today and next generation. Great job

[@Obliviateglitch]

Wow real life subtitles amazing!

[@ICYHope]

THE FUTURE IS EVOLVING THIS IS ONLY THE BEGINNING AHHHH

[@redvanderbilt289]

Simple but excellent invention!

[@maxxrr7389]

Her: My eyes are up here Me: Sorry I'm reading your subtitles

[@clementinephokela7631]

Beautiful! Absolutely beautiful 🥲

[@ah.3487]

lowkey need this as I have hard time understanding what the words are being said

[@kinnai8334]

Finally, I can now go to Japan with subtitles on!

[@peggyvogt3215]

Amazing use of technology!

[@Kopie0830]

Amazing. This is what the world needs. Now, we need like a 80 dollar version of this.

[@derpedfox]

This can also be used for live translation when abroad

[@xraiglass]

Exactly! We are excited to take these traveling as we add more languages! 🌍

[@yanwilyamk.p.664]

So basically now we have Subtitles in real life huh? Nice & Wholesome.. 🙃 Still waiting a Camera-like Technology but for Smell (Smells Recorder Devices) tho...

[@foreignname9292]

I think this kind of glasses can also be used to translate languages so two different persons with two different native languages can communicate and understand each other. What do you guys think?

[@danscarfe1]

I think watch this space 😉

[@mr_whyy]

Ok guys they did it, they've just solved deafness !!!!

[@jeremyhall2727]

This is a blessing

[@DABUNGINATOR]

It'll be harder for the app to work in noisy crowded areas. Also, speech to text isn't perfect, & the app relies on your phone's mic quality. Not to mention, the glasses don't exactly display conversations in real time. You still gotta wait for the app to process all the words & then display them. That's not to say this product is useless; it's still responsive enough to be quite helpful, but it's certainly not foolproof. Still, this is a nice step toward a better future.

[@xraiglass]

Thank you for sharing and absolutely! We've been working hard to make this platform usable in various situations as we enhance our features. It uses a technology called Beam Forming, which effectively places a wall around you and the speaker so as to not pick up the conversation around you especially when our built in noise cancellation is enabled. However, we recommend using audio mic options dependent on your environment e.g. in a boardroom, or in a noisy bar.

[@K7TZ]

Finally. I can go to Japan with subtitles

[@helenhibberd-brown7971]

This is so cool, such a simple idea that can change so many peoples lives 😎

[@radsnake_playsrobloxreboot7056]

THIS IS ECONOMICAL BREAKTHROUGH

[@RvLicious69]

finally someone made irl subtitles. japan here i come!

[@Alazsel]

Amazing inventors!

[@eld7476]

When you realise you can have subtitles when you go to Japan

[@LucatieI]

This was always my passionate idea of graduation project but I couldn’t have enough support to do it

[@abmong]

One step closer to a universal translator.

[@blaazerr]

Finally now i can go to japan and experience real life anime

[@chris_day_]

Finally I can go to Japan with subtitles

[@maugn4471]

Well done Team Human! Fantastic concept! Please gift them, make people happy!

[@Prerna3d]

"subtitle the world" awesome.

[@Nezuko_was_here]

That's so cool, love how society is advancing the right way :))

[@xTasyDotes]

this is really helpful for also borndeaf people, they can practice alone on how they speak WOW! grats technology, u did it again!

[@pristein6098]

Mission impossible: this message will self destruct in five second...

[@thekaraokelady5182]

Dude, gotta get these for brother. Hes so bad at listening he literally said he wishes life had subtitles for people 🤣🤣 no we do.