Demo: The magic of AI neural TTS and holograms at Microsoft Inspire 2019

What if neither distance nor language mattered? What if technology could help you be anywhere you need to be and speak any language? Using AI technology and holographic experiences this is possible, and it is revolutionary.
Audio Description Version: • Demo: The magic of AI ...
Subscribe to Microsoft on KZbin here: aka.ms/SubscribeToKZbin
Follow us on social:
LinkedIn: / microsoft
Twitter: / microsoft
Facebook: / microsoft
Instagram: / microsoft
For more about Microsoft, our technology, and our mission, visit aka.ms/microsoftstories
#Microsoft #MSInspire #HoloLens2

[@dvorakpetr]

And yet, some of my Word documents still have a bug where list bullets are rendered as black squares...

[@davidnguyen9065]

That's not Microsoft Word, that's your laptop and Word settings lol

[@scarlettchopra8255]

Omg dude😂

[@silentgrove7670]

Lol

[@imford]

@@davidnguyen9065 it wouldnt be a problem if there wasnt a bug making that happen

[@oceanpotion5599]

So I can virtually spawn people I dont like and punch their holograms? Sign me up

[@8xrry]

Hell yeah

[@xbrakx]

Worse, you can splice together holograms and take incriminating photos.

[@nutanhattewar5873]

Noice

[@MikeToob]

Even better! Virtually spawn people you like! :)

[@ctrl2k]

The Black Mirror reality just got closer

[@AhmadDarwiche]

Amazing technology ... but let's not forget this might have a really serious security impact !

[@nonsomokwuah]

At this point, every new tech is a security risk

[@jean-lucpicard581]

7 months later this comment changed in perception drastically xD

[@emmanueloluga9770]

@@jean-lucpicard581 WHAT DO YOU MEAN

[@jean-lucpicard581]

@@emmanueloluga9770 I DONT KNOW ANYMORE I WAS STONED XDDD

[@user-px5un6po4v]

can you explain it please

[@olugbemirosodeinde5275]

Learning and mastering a language or languages will always be of very great value. Language is a fundamental tool of all learning - its acquisition or the transmission of learning. The real value of this technology is the opportunity and mechanism for the rapid and extensive dissemination/exchange of information in multiple languages and places - all at once! But it cannot obviate the requirement for properly calibrated nuance in self-expression, debate and negotiation....in politics, social interaction or business. Many countries, including USA, still organise Spelling Bees (Competitions) for school children despite the availability of spelling- and grammar-checking software...for good reasons! In short, the old statement remains true regarding computers..."Garbage in, garbage out". Meanwhile, how FAITHFULLY does the hologram generate and synchronise the hand gesticulations and facial expressions with the what is being said across languages and cultures? In summary, these technologies are very welcome and are to be celebrated. But they cannot replace learning and hard work.

[@kabikabikhadgi6348]

As a young man in 70 ties anything based on AI films were sci-fi Disney Star Wars, Marvel/DC super hero films, The Predator, Men In Black International, Terminator Dark Fate and Ghostbusters 2016 etc etc. I saw “Demon seed”, I think around 1978, can’t remember. I was so young then and came out smiling, bushed it off straight away saying this will never happen in my life time. I knew and I had seen videos about Japan coming up with and it was going to unveil something to do with “Hologram” for 2020 Olympics. Well, here is the new reality, AI is no more sci-fi anymore. Demon Seed (Trailer) kzbin.info/www/bejne/fmeyYoGIqJKMq7c

[@andregustavo2086]

I guess it's only a matter of time until machines to be able to do this too

[@SheriJenningsYELLOWWALLPAPER]

the sound is such an experience and so nice to see this technology off of the shop floor

[@nftglobal]

For the first minute I thought she might be a hologram

[@thrchannel5250]

Well... I'm Japanese but I would say the way she (hologram of her) speaks Japanese is not “perfect”. Yet still sounds pretty good as we can understand it normally

[@SohamDas78]

This is amazing. Saw this technology live in Microsoft Ready and its spectacular ❤️

[@bestbuy3514]

wow, Amazing Demo, the magic of al neural TTS and holograms at microsoft inspire, thank you

[@imkir4n]

Woww this is why I wanna explore and study AI Along with my cs

[@resieri]

What a great time to be here!

[@xuedonghuang]

Azure Speech and HoloLens 2 coming together so amazing well

[@maheshm5463]

Dr H Now one understands AVATAR concept of Hinduism

[@cristianerices4609]

I was in first year of english-japanese translation. I think I will quit.

[@forgivingisdivine]

LOL , just do it, future is here, imagine book of Acts , Chapter 2:1-11, has the same feeling

[@scarlettohara85]

🤓 Stop.learning just enjoy life these things will do everything now for us

[@samiraakhavan575]

why exactly?

[@SuperBhavanishankar]

@@scarlettohara85 wht do you mean by stop learning

[@adco]

Haha

[@sukhwantsinghthaper]

Great. But in the hologram the sweater didn't have the thread hanging below.

[@MuhammadAsif-im5su]

Great catch 😆😂😅

[@snehadominic3422]

She had already told that it's not realtime. They've captured this dress prior to this speech.

[@sukhwantsinghthaper]

@@snehadominic3422 Ok. I missed on that

[@malika_begum]

Yes I too observed that

[@daamirbassanas70]

@@sukhwantsinghthaper no mate your right she even says so after the demonstration at 3:20 what you just seen now was my life sized replica my hologram rendered in in real time right now so you are right.

[@crazyincars]

It will be definitely needed in India for election campaigns 😅😅 remembering campaigns in Tamil Nadu and Kerala

[@haleiwahi27]

I once thought a mobile phone in a car was fake because it didn't have a cord attached to it. This can only become more realistic in time.

[@user-sb4wd5tf5r]

感動しました。もうここまで進んでるなんて

[@HouseFairyDIY]

This will end in tears.

[@bamboostinger]

> I will be in love with mine. > Next target: A Doll with AI

[@KrishnaKumar-ud8nt]

So beautiful and tech improved

[@QuixoticPenguin]

Oh wow that’s trippy. I can not wait until there is a consumer version released that isn’t 5000$ and we will soon all walk around with one of these as a new type of phone. As a vr and ar enthusiast it’s looking great

[@ks9545]

u happy bout da metaverse ?

[@QuixoticPenguin]

@@ks9545 So far not really. We shall see where it goes

[@ferhau]

Amazing this! I remembered the move from manual calculation to electronic one. It is important to be able to do mathematical calc by yourself but in fast daily life is difficult to keep doing manually and remain competitive. Learning languages will probably always be a plus but I believe this technology and forthcoming improvements will break communication barriers.

[@elcapadocio]

Just so amazing!

[@roopeshreddy5978]

Lot of concerns on this one. Firstly the voice tones didn't match at all in this video and it was clear two different voices of what the author spoke and what the hologram spoke. Secondly the animation was having lip sync too, which I am keen to know how does the hologram do so so neatly. It looks like an animation created by recording the person in a studio exactly and if that's the case and the hologram cannot speak automatically with lip sync it won't be that great an experience. Anyways one of the knave ideas everyone gets surrounding mixed reality, but good to see it's implementation on progress.

[@RobinVarghese11]

Ofcourse, she's speaking in English. The AI/hologram is translating her English to Japanese. Lips will not be in sync

[@roopeshreddy5978]

@@RobinVarghese11 just enable captions and check the lip sync. The hologram has very high lip sync with English. My point was more on how is this achieved. Is it possible to achieve it without creating studio animation. It was not on not having lip sync with Japanese.

[@fauzee]

Very impressive! Last time this sort of thing we call ghost...and it is more on imagination...but now we can really create ghost!

[@vitr0n]

This is the game changer technology introduced by MS. It will change the perspective for monitors. Please make it available for public sooner and inexpensive. Thank you MS, For developing such tech.

[@8xrry]

Well, from the sounds of what it can do, I'm sure Microsoft is planning on making it expensive. But we never know do we.

[@nelsonsimoesjunior2523]

I am a really Microsoft's fan and this show how powerfull its tecnology is. Amazing

[@harmeetsethi9121]

amazing evolution. Outstanding.

[@onevisionary6124]

This is how the image of the beast will be🤭

[@andrewtheking3188]

Oohhhhh snappp that fire

[@ra-jb9wn]

ここまでできるのすごいと思う

[@devoso2156]

Just glad to see this "star trek" technology happening in my last years of this life. I have great faith in humans and we have gone ahead in leaps and bounds. Within 100yrs there will be no need for phones as a form of communication,it will be somehow more neural,Don't be scared of A.I. but embrace it. Human Machine Interface is our next step of Evolution.The future will be even more amazing and much more to come. Bye..

[@James-vk5ov]

*Yo dawg it's rewind time*

[@kitgary]

Microsoft still has the best technology in the world!!! Hey Google and Apple, where are you?

[@MusicDecomposer]

Somebody call Captain Disillusion!

[@RKV1700]

True

[@allsides5626]

I was looking for this comment

[@413felixortiz8]

Awesome NiCeLy dOnE🎉👏👏👏👏👏👏👏💖🚀

[@lewistrangmar4530]

Be great if these excellent engineers and scientists who developed this, worked on something important like space exploration and colonisation.

[@chrischauhan1649]

Future is here at Microsoft!!

[@anonsandifer507]

The next frontier in video game story and gameplay. Next Gen for Yu-gi-oh and other card game!

[@stwatertown]

I believe the VR/AI technology is able to deliver nearly real-time (simultaneous) interpreting in foreigner language now, and might do better job than a blood-flesh trained professional (linguistics expert/bilingual-interpreter).

[@ajsky1066]

The ramifications of this technology on porn will "blow" everyone away!

[@belalhossensumon1173]

Fentastic excited toncolige next life , love i♥️♥️♥️♥️♥️♥️

[@gustavorosa3d]

Is there a Microsoft Service that I can use (I would certainly pay for that) that translate my voice with my intonation from Portuguese to English like in the video? If there is, where can I get/access it?

[@aylinj3232]

It's amazing!... The future is here💎 But where is the board of real area and virtual area? It sounds dangerous!

[@silentgrove7670]

Is the next step to remove the person from the start of the experience ? A script, an image created by ... someone ... something ? Then the reality of it all is even further removed. Connect it to GPT-x and what do we have ?

[@richseidel6597]

This is as significant as the apple computer saying "hello" for the first time!

[@justincphilip]

Woah! That's insane!

[@JeffOnsrud]

Nice combination of technologies, but I would have liked to see them add one more in there that re-rendered the mouth to match the native Japanese tones like the "deep fakes".

[@8xrry]

It's just the start in my opinion. I'm sure they'll have further improvements near the future.

[@zenzeleluckymtshali8433]

@@8xrry IF THE HOLOGRAM WAS A DIRECTOR OF A COMPANY IN MICROSOFT BUISNESS MEETING BUT A HOLGRAM IN THE MEETING..YES RULES ITS HUMAN EVEN IF ITS A HOLLOGRAM CARRYING CASH..DID THE HOLGRAM DONATE FRIENDLY TALK ETC IN ECONOMIST ASSIST

[@8xrry]

@@zenzeleluckymtshali8433 bruh, 3yrs ago 💀

[@clementtan1981]

This may fool an AI expert but not a physicist. This is projected on screen rather than hologram (she mentioned it). It is not physically possible to produce an effective hologram in open space. p.s. Light will need a medium to *reflect* (shine and bounce back from screen, mist, smoke, etc) or *refract* (absorbed and re-emit at atomic level) which is not possible in open space.

[@RobinVarghese11]

Hi Clement, You need to wear holo lens to see the hologram. The hologram shown here is what she's seeing in her holo lens.

[@clemayk]

@@RobinVarghese11 So what did the audience see actually??

[@RobinVarghese11]

@@clemayk Audience were looking at the normal screen but POV of her vision. There's was an adaptor which projects whatever she's seeing to a screen. They're explaining that in the beginning.

[@WonderingAimlessly]

@@RobinVarghese11 I call Bs. It was showing a 3rd perspective. She was behind it not in front.

[@SDFRiver]

@@WonderingAimlessly The camera that was recording is also equipped with the adapter. It's as if the camera person is also wearing a Hololens 2 and is seeing the exact same thing she's seeing.

[@seansmith4440]

If it was a hologram I would be impressed but it's not. It's just AR. Been out for a while. A true hologram you wouldn't need the glasses.

[@raybush4149]

I was thinking the same thing. This is unimpressive compared to what I was expecting.

[@cccdy6375]

Well said I knew my gut was telling me something was up.

[@gameman5804]

It won’t be long until we get to that level of tech.

[@abyjoy4843]

I think u should develop that and I don't think u can 😂.

[@duudleDreamz]

Microsoft rocks. The mixed reality/translation/same voice/hologram combo is a winner. Where do I sign on.

[@yosepupithani5441]

is there any demo done in real-time? atleast a small one?

[@TV-tz5xx]

Great~~~

[@JoeNyutu]

mind blowing

[@danielarochadias8071]

Amazing 😉

[@whitecloakandhalo]

I would've love it if she was actually in another space and having her speech and key notes delivered, while the Holo transmission did a "realtime" projection with translation on the stage.

[@anabeatrizucv]

The future is here indeed

[@m.i.8751]

I Love This Presentation! I request that please come out some of event at Tokyo DisneyLand’s Attractions, it supposed to be this is it I hope so, we will do like by ourself experiences and a lot of fun. Peaceful ;)) May faith be the guiding Light of our life

[@m.i.8751]

I am just reminder, what a sensational presentations! Alhamdulillah

[@ke1tacts]

Amazing！

[@gtjintothefuture1048]

Amazing, The Future

[@luckydog570]

Sounds like they can do anything now even bring in the end times

[@johnjones393]

Image of the Beast.

[@spaceasteroid6528]

This is the coolest thing ever

[@nagesh007]

Awesome

[@dava4444]

the lips should sync with the voice in translate.. but overall +1.. this is the future of AR.

[@sudarshankj]

Why does the stage look so graphical?

[@amirbukan]

the stage is also a screen

[@ilikechopin8112]

Why does she need to wear the goggles why the hologram talked???

[@oyaa.k.5570]

ILikeChopin because it is not a hologram it is only AR thats why she needs those

[@rasu84]

I don't want to be that guy but the hologram did not sound even remotely like her.

[@MichaelSmith-wv5hy]

You don't sound like you when you come out of speakers.

[@12XFactor]

imo its a question of time for the developers and a question of training for the AI.

[@filmerd]

Needs data.

[@procaztinator]

this is damm amazing

[@thamizhansudip6644]

It's really awesome

[@vinodvankayala7911]

Wow this is amazing.....

[@chatmallow3972]

Amazing for what? Manipulate people?

[@storytimeproduction8052]

Things are happening... looking forward for the X-Men era...

[@neta562]

ID 2020 mark of the beast Baal

[@ravikumar-vr6zm]

awesome

[@alexalegre6487]

Impresionante

[@janitgaming608]

superb i want to go in this line only

[@jamesambrosini2026]

Image of the Beast!

[@pamelabrown4410]

Unbelievable !

[@AL-lv4xt]

Indeed the future is here!

[@nostringsattached952]

That would be cool if there where a interactive hologram companion

[@umarovmuhammadsolih618]

Now it is real ! You can be in two places at the same time

[@rvknjhs8027]

thanos :- its time to visit earth

[@Irfanrabbani]

Love Microsoft, proud to make difference and empower every individual to be more productive.

[@SpaceMog]

Soo cool!

[@Morenob1]

MS: the future is here Corona: hold my bear!

[@abacus749]

This technology needs to be regulated. It is a weapon. What is Havana Syndrome with Frey Sound effects?

[@AL-lv4xt]

Would you please remind me what year are we in??😱OMG

[@maythesciencebewithyou]

I don't know man, most people make me believe that we are stuck in the 50s, many others make me feel like we are still in the middle ages, and then we get to see people like this make you feel like we are jumping ahead to the 22nd century.

[@divyajoshi1429]

superb presentation. I am pursuing my masters in AI. Hope I can be a part of the Microsoft AI team too and soon. All Excited!!!

[@lionheart051droid]

How does the image show up in real life?

[@niryado]

Where can i buy one :)))

[@healthymedia8101]

Wow!

[@vvpartizan2462]

arigato 👍🤙👌🏼💥😉

[@yummytatersubliminals9651]

In a few years holograms will be so advanced that it will be like the emh from star trek

[@user-qs4kf8bu5k]

놀라운 홀로그램

[@talalwasif4823]

Wow...really appreciated👏👏👏👏

[@ledieuexist2856]

Alograme is amazing idea to intgerate with machine like ships and phone and tv and transport especaily to see what is from far distance and in drones you will change videod to alograme film

[@mmganesh6087]

can the audience see the " hologram body" without goggles ? this is confusing. why is the lady wearing the glasses... cant she see her hologram ?

[@adannaya1]

Same question I'm asking. I'm kinda confused too

[@shelarmama4673]

Yes. Its confusing. No explanation.

[@Visishta]

Then how are we seeing?

[@gayanwickramasinghe662]

I doubt that the audience is real - obviously they won't see the hologram - wonder why they are clapping.

[@kishoreahmed]

How hologram too have same dress😉

[@kctoh2008]

Wait a minute. I got so many forwards of this video that I have to ask a question. Those of you into VR may have a response. Is Microsoft trying to say that it had managed to inject the 3D opaque hologram of this speaker onto the stage where the speaker is in real time? From the clue that she had to wear VR gear I figure that Microsoft is trying to say that we are looking at the same 2D video of the stage she sees in the VR headset. Any comments?

[@user-ny7lz3pc8s]

Oh, first of all, it's Augmented Reality (AR). Difference, it "combines" the REAL floor and chair you see by your eyes. VR are ALL virtual. It projects into the HoloLens 2 of that woman. Then how all the audiences see what she sees? They use another way (or camera) to let what she sees, displays on the monitors that all audiences can see ON the *monitors*. What all audiences can see DIRECTLY on the stage, of course empty. (Only her real body, no hologram with naked eyes by Microsoft. Yet.).

[@Skandar0007]

🛑Tip: This is CGI people You can’t see the hologram objects without the glasses.

[@johnsmith4650]

Skandar no shit Sherlock

[@sharpuslf]

Contact lenses...just like the Astronots use.

[@user-bk5sr9wc9o]

The future is coming.

[@ljprep6250]

At least the hologram isn't YELLING. (pretty cool, actually.) While the Japanese may not have been perfect, the lip-DISsync was perfect, just like Gojira movies from the '70s!