The most realistic video calls ever | Project Starline Prototype

Google introduced Project Starline in 2021, a new technology project that uses breakthrough 3D communication advancements to help people feel like they’re together - even when they’re hundreds of miles apart.
Today, we are excited to announce the latest version of our prototype - which is now smaller and more practical for everyday use thanks to advancements in AI/ML.
See it in action and hear directly from our partners at Salesforce and T-mobile on how Project Starline is helping them build more personal connections through the distance.
For a quick recap of Google I/O, check out this video:
• Google I/O '23 in unde...
Dive into the world of Google. See how we’re pushing the boundaries of generative AI, developing cutting-edge technology & using our platform to help communities globally. Subscribe to stay up to date with our mission: www.youtube.com/@Google/?sub_...
Subscribe to our Channel: / google
Tweet with us on X: / google
Follow us on Instagram: / google
Join us on Facebook: / google

[@seazonegranec]

Really excited to have my boss at home, I really want to see more of him

[@karasira2696]

🤣🤣🤣

[@Rick-ng3lr]

Yes

[@apo617]

You win the internet

[@pp-1954]

😂😂

[@melomaniac_93]

Epic 😂

[@theturtledave]

This would be so fantastic to implement with Assisted Living Facilities, Nursing Homes and Memory Care facilities. My mother is in memory care and I don't get to see her as often as I'd like, and her family and friends from around the country would like to have a conversation with her as well. FaceTime and other similar services just don't cut it. I guess the problem is that the each person needs this setup (or access to a station) in order for it to work effectively.

[@stevedubois8529]

DITTO !!!

[@user-vo4th1ph7i]

GB

[@mohad46]

Looking forward this technology, it's like 1985 predection of future.

[@maximuspro-gamer1500]

exactly

[@MacGuffin1]

It's a lot like the 1984 prediction too !

[@LouisRusso2005]

Beam me up Scotty !😎

[@mkjvd]

Look like communicating a police officer with culprit😂

[@d11ita]

McFly, you’re fired!

[@immeatom]

This feels like one more step closer to holograms. First a window with a 3D-model. Then, moving on to projecting that 3D model to some place.

[@VaibhavShete]

First let them release a video showing this screen from two cameras simultaneously. Then I will believe anything like that is even possible..

[@jackfrosterton2530]

@@VaibhavShete try to keep up with what's going on in ai right now. All kinds of things are becoming possible, this is really not among the more impressive of them, imo

[@rodbartruff7823]

I could use this for my long-distance relationship.

[@arindamchugh649]

they could use you as a PM

[@carriethemarrie]

But you can't touch your partner

[@AFMCarlos]

Kkkkkkkkk o cara webnamora

[@Klesh]

Cool idea and a step in the right direction, I guess. At least it isn't awkward dizzying VR meta nonsense.

[@Liefx]

This doesn't replace VR

[@theonlythingihavetosayis9333]

There is nothing wrong with vr

[@MK8MasterJunjie]

How the hell do you have more subscribers than me?

[@fedvvvv]

I've been using the Meta Portal for the last 4 years to contact family abroad. In such a globalized world we need tech like this to remain close to our loved ones when far away. I'll be getting this for sure in the future.

[@atomic3628]

This is incredible! What futuristic tech. Truly a product we all dreamed of when we were younger

[@xDeadlyWarriorX]

Why do I feel like most comments here give a little sarcasm vibe... 🥲

[@johnwisdomtv]

you must've had some F'd up dreams mate xD

[@Tlll123]

dreamed of when reading 1984😂

[@mariuxxxx1]

you have shitty dreams then mate

[@aliasgur3342]

You dreamt of being able to converse with a digitally generated simulated image of an actual person!

[@Mr_Battlefield]

This would help me communicate with my wife and her family in Indonesia and I'm here in the United States. I keep praying our Visa gets approved soon. I love and miss my wife so much.

[@hcblue]

I want this for home use. Being able to see my best friend and her family like they're literally in the room with me. I care less about being able to see my boss in 3D.

[@deificGashsaucer]

Cam girls be racking up sales

[@JRay2113]

Lmaoooo

[@cube2fox]

Typical Melkor.

[@MrPtheMan]

True. Best innovation for Google for cam girls

[@avnish_s]

Ok, so here's the starline, I thought I would never hear about it, INCREDIBLE WORK!

[@gblandrr]

The sex industry will LOVE this

[@MannyRamirez310]

I just feel like they'll kill it at the end.

[@sharkwarrior1993]

I feel like these guys always get the market wrong, application in business is surely valuable but the application of this in your personal life can become invaluable. Seeing your loved ones like this would be amazing.

[@autofocus4556]

There’s nothing like getting fired in 3D.

[@hocuspocus6681]

Thanks for clarifying their pronouns in 3D

[@Pandash1]

As great as this technology is, because of the amount of hardware needed, and the cost of the hardware, this is going to be just another Google project that gets canceled due to low adoption. Love how Google is still paying the engineers and inspiring other companies

[@mnomadvfx]

It's not even at the early adopter phase yet. Light field display and camera tech are still cost prohibitive and will likely require a hardware revolution like flat panel TFT LCDs gave over CRT displays in order to make them affordable with less physical depth. Metamaterial optics might be the answer to that, but that is another thing that is still largely in the lab and not integrated in any consumer facing tech at the moment.

[@warrenjoseph76]

Maybe the return of 3D TV’s? Touchscreens were around a long long time before they became ubiquitous and more useful

[@whaleinatormusic9527]

The next stadia!

[@HowP88]

Having just moved from the UK to Australia, I hope this technology catches on and becomes affordable soon!

[@jackmiddleton2080]

Nice to see google is innovating something.

[@zadolbashka]

Бузумная технология! Это просто великолепно!

[@bozhidarkostov]

Congratulations to all of us we can touch product like this after a while… I remember the first Tetris :) what an era.

[@michalptaszynski]

A meeting between only two people who sit precisely in front of each other is a situation that almost never happens. And if it does, the room is never a blank wall.

[@goontoro9145]

Wonderful, creatives, and innovative. Definitely looking forward to seeing it grow and get used.

[@josephfischer3789]

AI can create an avatar of yourself so you wont even need to attend the meetings

[@mariuxxxx1]

it will be dead sooner than later nobody needs that read this message in couple years if you still lhere xD

[@murderbunnies]

Can't wait to see it get shelved like every other project.

[@noli-timere-crede-tantum]

But this one will look much better on the shelf - it'll look like it's right there in your house!

[@muen1842]

with this, VR, and telehaptics, long distance gets a couple steps easier

[@margiegreene-moss6888]

I’m impressed. As a senior person I hope this better view of reality and closeness gives us a better understanding of our uniqueness yet sameness. No matter our visual we MUST all understand we all need the same. food, water, covering and love.

[@AG_before]

The AI we dreamed about back in the day. 💯 I work from home. I'd pay good money for this.

[@Zero11_ss]

Why though? You can just get a big tv and do a video call for basically the same level of interaction.

[@AG_before]

@@Zero11_ss I have a pretty large monitor. I guess from the video it seems like the other person is more in '3D' (perception through many cameras and depth maps maybe). At least that's what I see and understand. Eventually... Holograms! 🙂 👍

[@Zero11_ss]

@@AG_before personally it makes near zero difference to me and wouldnt be something i would pay for. Just wanted to ask since the things i wouldn't pay for never seem to align with what others would pay for

[@bloglima]

It's a TV in front of me but using a modern name. Cool!

[@MasDouc]

It's all fun and games until the CG depicition of your grandma glitches and suddenly stands up in the T pose

[@purushottamparakh5165]

I got so excited by this that I applied for the job of software engineer for project starline😊 I hope I can get an interview call😊

[@donm1612]

This may be too expensive for many but all the tech involved can become cheaper and can be step-wise implemented to enhance what people already do rather than asking people to do something completely different.

[@JeanHuguesRobert]

DIY, some AI required. 1) capture Bob & Alice key points 2) send to other party 3) generate image using remote key points (high compression) and local key points (for view angle adjustment) As a side effect of step 1 a local neural network gets trained. Bob & Alice exchanges their models when the call starts. Works best when rendering respects the true size of the other party. Can go "full size" if tall enough, for example using a projector on a big screen. I patented this some years ago, called it "magic mirror" because of the superposition of the local face onto the remote one to add a light mirror effect, like when looking thru a window and seeing yourself a little bit.

[@danielebonatto8378]

See my comment too :) same kind of technology developed ;) but not based on your patent at all, we transfer multiview data in atlasses instead

[@sayenathn3664]

Star Wars-style meeting coming alive, but better!! this is going to be awesome.

[@MarshallRichards]

It's like how the ViewScreen operates in Star Trek. Nice

[@luxeave]

waiting for the same technology being used for windows cheaply where I can see ocean or desert at my choosing.

[@rytfrommars]

nice one... really ground breaking...

[@justafidemyself]

Finally something futuristic. Face it, we've all been waiting to see when we were actually gonna get close to Back To The Future 2.

[@KidFictionOfficial]

Great! More genuinely interesting tech that will never actually happen. Thanks Google!

[@vikasanandame]

so I don't need to look at the camera in the future? amazing!

[@RedKanto]

wow! this is ground breaking!

[@malongfan840]

Bing will never be able to hold Google's jock strap.. Google will always be the King of Internet search and advertisement.

[@saasjunction]

We also need Google Glass! 🙌

[@carlosfreire8249]

Can’t wait to talk to my boss as I’m inside a puppet theater booth.

[@icyliciousblue]

Next project: Starline XXX Edition!

[@lordhamlet1185]

😂😂😂 Oh god...

[@el_projects]

I'm a fan of google tech since early days. But after Daydream VR and Stadia, I've learned to keep my hopes down. I can see Google killing this project around 2 years after release.

[@samyg123]

I could see this being useful for larger international companies. Not only to hold more effective virtual calls but also to interview prospective candidates from afar.

[@saibhavan7267]

Google you did good but vertical display takes this tech sell faster(use AR to get virtual dress)

[@nOx1D3]

damn i cant wait to put 30 cameras straight in my face while i'm sitting a box and my boss is yelling at me in 3d AI technology

[@maelstrom2313]

Let's face it, like every medium mankind has ever invented, its primary use case in the long run will be adult entertainment.

[@deepakismyname]

I wish this is affordable and be available in many countries to connect family/friends thousands of miles away

[@RealShaktimaan]

It won't even be available anywhere

[@futureforeveryone4687]

Hopefully kilometres away too.

[@rijanbahadurpradhan3017]

I can't even handle my coworkers being in the same suburb as me and you're talking about bringing them home like in my OWN HOME

[@mahirfoysal8759]

This looks so cool!

[@VaibhavShete]

how does it get resolved for two eyes? Or are the screens in this video aware of the filming camera's angle and rendering specially for it? (In which case the actual person in front of the screen is just seeing a 2D image with random-looking distortions)

[@jessyanie]

i need this for teaching online!

[@fr4120]

Thanks to Google now my boss can slam me in 3D. Gonna miss the old 2D ones.

[@Seven-of-Nine]

I could use this for my long distance relationship with Dragonborn

[@ziron5385]

Dovakhiin

[@user-rf6ly2tq9f]

this + holo = the dream in almost all scifi movies , like iron man and like

[@hitman1365]

Like my Teams/WebEx meetings, I would turn off my cam on Starline calls too

[@cytroyd]

It will allow us to see the barcode behind your head.

[@kingof9x]

Open source!!! Thats just icing on the cake

[@berkkkay]

Başarılar İrem 😊😊

[@Taolude]

Will optimize the camgirl experience for sure!

[@SamiCoopers]

Single camera + AI flat to 3D + stereoscopic effect via viewer eye tracking = all devices

[@franklinoladipo2343]

This is very interesting. Where can I see and learn more about this project and even follow up on it. Like a website or something. Thanks!

[@AnjanAwasthi]

Try Google, maybe?

[@paulchatel2215]

Thanks you David He/Him and Melanie She/Her!

[@CrusadeVoyager]

Nice breakthrough in holographic tech❤

[@c10_c10]

Yay🎉 another video about technology and work. Just we want. 😅

[@FredPauling]

I really want to try this.

[@hemanthsivakesh6250]

Actually we have AR(vr) where meeting can be easily conducted for shorter period

[@kolos4650]

Can't wait for the colab between Google and PH

[@Ana05702]

It came out in A New Hope ages ago

[@rytfrommars]

Starline is not handy to be set up in every home. But it could be set up and used as Public Call Booths for people really living far from home. Really.. GOOGLE WE LOVE YOU. Also for Bard, Thanks 😅for bringing it to India.. I was waiting for so long and tired of chatgpt.. bard is lot better

[@apo617]

Better bring your own windex and paper towels. Those booths are gonna get sticky

[@stevedubois8529]

"OOGLE WE LOVE YOU ",..... me : DITTO !!

[@asyapolyak589]

So, do I understand correct that the current online meetings do not work because people do not treat them as real ones? Is that why we need starline?

[@apo617]

Correct. If you don’t have starline, then you don’t have to show up to your meetings.

[@alisanan9090]

Now video calls will be more intimidating for introverts.

[@thebishopelect]

Ah beautiful, lets further the technology gap, between those that can afford it and those that cannot.

[@uniworkhorse]

Freaking magiiicccc I hope in the future we look back at this as super obtuse and clunky. This is nuts tho, I think I'd try throwing something at the other person ngl

[@kitkarson4226]

This is great!!

[@dungeonsofkards]

EXCITED ABOUT WHAT X VIDEOS WILL DO WITH THIS TECH

[@arjay2002ph]

movies will never be the same if this tech will be used

[@deltonlomatai2309]

They should make a 3d desktop monitor out of it. Imagine what it could do for gaming or presentations. No more vr glasses. Or movies jaws 3d.

[@nightthemoon8481]

Asus pro art 3d:

[@peteyburgers]

With having family overseas, I'm really looking forward to this.

[@yayeng8161]

द😢😢😢😢😅 इइइ 0:36 0:36

[@kuakilyissombroguwi]

Let's perfect and miniaturize this tech in the 2020s, Google. It's too cool to let it become vaporware because finance.

[@newsverse-ir6rc]

Google wants to make remote interactions feel just as personal and natural as being face-to-face. So whether you're catching up with your bestie or closing a big deal, Project Starline's got your back. It uses some pretty nifty 3D communication tech to make it feel like you're in the same room as the person you're chatting with.

[@Buttaknife]

Not gonna lie. That's pretty cool.

[@shatadru01]

Wondering how this would work for a meeting with more than 2 people

[@sachinkoparde2052]

I re-checked the upload date to make sure it was not uploaded on April 1st

[@akhil8048]

Can't wait for pixel 20 to do this...

[@edandersen]

The PR for this "3D Teleconferencing" is probably because Apple will announce a similar thing with the Reality Pro / VR headset.

[@KenniOdelheim]

Another amazing product we will never see, bc Google! 🤷‍♂️

[@HiFiInsider]

google is dreaming that people want to be seen on a large screen and that people have good lighting for the cameras. 😂

[@bookofmystery9670]

Nah this isn't for normal people. This is for corporate. Companies will buy this and to conduct board meetings, town hall meetings and lot more .

[@user-yq5gp7tr6e]

woww. amazine

[@Mcthindi]

Well this better than those boxes on eyes

[@mohannadhashim801]

Google feels. ❤

[@SimonSaysJohnsen]

I live as an expat in Brazil, however my family is from Denmark. Looking forward to visiting them more often. Thanks to the amazing team at Google! 🤗

[@heavyflavor4159]

the/this video looks interesting

[@AleCardenasRealtor]

Put your developers to work on an airdrop alternative that works between android and windows

[@linkdk59]

Wait, so is this an illusion of 3D? Is it a lenticular screen? Or is it tracking your eyes, and rearranges the viewing angle accordingly? If so, how does the camera capture different angles while the call is in progress? I'm just super curious about that 3D screen

[@DavidGoodman]

It's probably a lenticular screen + eye tracking together. You need some way of being able to direct a different image to each eye, which lenticular displays solve, but if you want to make the effect work when your head is moving around then you need either a lot of viewports (computationally expensive to render) or eye tracking. I'm pretty sure the camera "capturing different angles" is what they're announcing they're using AI for here. My guess is it's something like a NeRF-like model that takes the images from the real cameras as input and the user's eye positions and synthesizes new images based on that.

[@DavidGoodman]

I haven't seen anyone else building 3D video calling like Starline, but other 3D displays like Leia and Acer SpatialLabs labs do exist

[@zgidwitz]

Wonder what the bandwidth requirements are going to be to replicate this experience. International data calls are still unstable much of the time. Can’t imagine how this could be a smooth experience at this point.

[@NYYstateofmind]

Probably not that much. It's the computation and software that makes this happen

[@marcozirino3621]

how will it prevent the person on the other end from having their likeness duplicated by an AI?

[@apo617]

Just want we all wanted… more meetings.

[@tekmepikcha6830]

Hey #Google - please make sure that the finished Project Starline product reaches the #ISS !

[@Mr_ToR]

google is such a good company. all comments are ai.

[@frustasistumbleguys4900]

Excited, when it release?

[@jlf_]

Another amazing project that’ll never see the light of day.