The technology that’s replacing the green screen

[@Vox]

We just launched our official online store! Get your Vox tees, hoodies, hats - and exclusive Vox Atlas, Earworm, and Missing Chapter stickers - all in one place at www.vox.com/shop

[@prestonak]

7 likes, that’s not normal it should be at 8

[@hadley20]

@@prestonak i made it 8 you’re welcome :)

[@into_the_void]

Whyy

[@into_the_void]

@GEORGE FLOYD ok buddy... That's enough meth for today..

[@hadley20]

@GEORGE FLOYD how high are you?

[@alishanmao]

That explains why everything looks so real, but green screen still is the basics for many small studios

[@jglinks3670]

With this technology in the next decade, there will be a large, say "largest" warehouse made up of the brain, now filming is improved,

[@darthdeezy]

And better visual referencing only strengthens the performance capabilities of the actors. I love this.

[@KillahMate]

An entire cottage industry is almost certainly going to be built up around this tech. Why _ever_ build your own Volume unless you're an actual huge Hollywood blockbuster? If you're a small movie or a TV production, you're going to use tech like this sparingly for a few impactful scenes. So you rent out a prebuilt Volume for a couple days - some backlot in LA where a specialized production company's set up a soundstage with all the tech already configured and online, with in-house technicians running the Volume that can help your crew hit the ground running in a matter of hours. Just like VFX houses but in reverse. You don't keep people on your payroll to do the rendering, you've got a supervisor to keep track of all the VFX and then you contract it out when principal photography's done. Same with this - you have either an AD or some dedicated position keep track of Volume shoots, and people in preproduction to plan them out basically like location shooting, except it's also studio shooting and also you build the location like a set, but virtually. A lot of it naturally falls within different already existing departments and isn't too different from shooting on a rented location. If you're a small studio, the one _big_ difference is that any production that uses this will probably _need_ a previs department, because for most productions the previs department will probably take on the actual construction of the virtual sets. And I bet there'll be a hundred small companies springing up to offer previs+virtual set construction as a turnkey solution.

[@outerlands3382]

nasa will continue to use greenscreen if it saves some cash

[@akunog2708]

@@outerlands3382 "nasa will continue to use greenscreen if it saves some cash" nice, a space denier. Original.

[@nickzardiashvili624]

I teach VFX and it's baffling to me that something that has a pivotal role in the biggest films today has so little exposure outside the industry. Thank you very much for bringing more attention to it! Edit: I realized I was not very clear in what I meant. I didn't mean that this tool in particular has little exposure. It's a very new tool and it can only work in a very specific setting, so that's understandable. I meant VFX as a whole needs more exposure.

[@PHlophe]

Nick, its because green and blue are still reliable and are fully integrated in all pipelines. this will take time to settle slowly. its the shiny new thing and the lads at one of the VFX houses I am familiar with are really chuffed to have tried it.

[@David_Duckylove225]

Woah

[@KaloyanVasilevUK]

It's unfortunate that they didn't even mention once in the video, that the technology they use was actually Unreal Engine 4 ... The whole set is a real time scene camera capture from Unreal and instantly displayed on the LEDs. The real world camera is tracked down and directs the camera in the engine - making it accurate and realistic immediately.

[@nickzardiashvili624]

@@PHlophe Yeah, of course, that's exactly what I tell my students :D I meant overall about the VFX.

[@nickzardiashvili624]

@@KaloyanVasilevUK Yep, I'm right with you! They should have mentioned it. I was never really that interested in video games, so I've never learned UE and now it seems I have to do it anyway :D

[@CAPTAIN_CLOCK]

It's also great for the actors, because instead of having to imagine for instance, "a big scary explosion in a mile's radius" they can actually _see it,_ which makes their acting more convincing.

[@seanc9520]

Reminds me of that prank done with a LG big screen replacing the windows. Think it can still be found on KZbin.

[@enarboldifunto]

@hasith mayanga Are you saying that as is a bad thing? Because is not. Better tools that make the job easier always equals better products, or in this case better performances. To have better performances, in general, is a good thing, not a bad thing.

[@enarboldifunto]

@@werdsfanklf68 No rant, just love.

[@Emiliapocalypse]

Didn’t the guy who play Gandalf break down into tears once due to this?because he didn’t become an actor to be doing it all on a green screen and act at a tennis ball on a stick? I think I read that somewhere.

[@Bob-zg8lm]

Or just make a real explosion

[@seanriley1603]

I think the Mandalorian was filmed 100% indoors, which meant they never had a weather delay, no waiting for the perfect sunset or any lighting issues. The actors and crew probably liked working in air conditioning too. Mando’s costume didn’t look comfortable.

[@zhankazest]

(ive never actually watched the mandolalorian so just a warning) i think i did read/watch or something that there were a _few_ scenes that were shot outside but im not fully sure

[@HowardYing1]

Even if you're filming indoors, it doesn't mean there's AC. You can't have AC running during a take unless it's MOS or it's impossibly quiet

[@elijahmckenzie9207]

Howard Ying I’m no professional but I’m very sure they can remove background sounds such as that very easily considering most sounds are non diegetic and the microphones they use are incredibly good and are designed to eliminate any unwanted sounds

[@Donbros]

@@elijahmckenzie9207 i think they make 90% of sounds in post so no problem

[@elijahmckenzie9207]

Donbros yeah that’s a simpler version of what I said, non diegetic sound means sounds added in post

[@jamesh7469]

I love how Charmaine can’t even contain her smile when she introduces her job, that’s a woman living her dreams

[@paulwalker9608]

Mickey is holding her family at gunpoint

[@nirui.o]

@@paulwalker9608 Why not laugh about that? I would.

[@silenc3x]

@@paulwalker9608 RIP Paul

[@jamesh290]

Hey, we have the same initials.

[@rynjahninjah]

With ILM no less!

[@shafwandito4724]

hopefully, a lot of movie production use this since it's easier for the actors to imagine what set they are in, which creating far better experience for the audience

[@AquaMarino]

Agree with you. Artists and stunt people will be able to fully immerse in the scene.

[@LyricsFred]

Of course more movies will use it, this is Industrial Light and Magic, they are involved in pretty much anything VFX and the company is full of legends in the industry, I'm not surprised is them using this techniques first.

[@kele8559]

Is not like, more expensive?

[@Apostate_ofmind]

this is so true.. it makes me cry remembering The actor of gandalf basically break down during the filming of the hobbit because he basically acted alone in a room, since the actors of the dwarves would be added in post production. Imagine, a scene, where you need to interact with a table full of people. And youre alone.

[@AquaMarino]

@@kele8559 Yes that's how innovations cost in the initial stages. But given the set up of the screen, Im pretty sure this will only cater to a select few high budget film productions.

[@Sharkyktc001]

It must be really neat for the actors as well, acting like you're in a desert while actually looking at desert instead of some green sheets must be a much better experience

[@LiveLoverSubhrajyoti]

This.

[@KP-ul2ep]

yeah the experience is more immersive and seemless for everyone on set!

[@iiCounted2134]

ikr

[@frollard]

immersive and yet also discombobulating - as the screens are projecting a background for what the camera should see, not what the character should see...it's all warped from any perspective other than camera.

[@TheArrowedKnee]

I can't help but think of Ian Mckellen crying when doing a scene with complete green screen surroundings for "The Hobbit"

[@MrDb4894]

So this is why Mando never runs in the show. I've been yelling at him to stop lightly jogging away from enemies the entire show haha

[@thedude5714]

Maybe the Volumes become bigger in time. We will see

[@jamesbarker4306]

Surely they could have a way to have him running on a treadmill or something which is removed in post

[@tegesnripendra9473]

@@jamesbarker4306 that needs a bit of training tho, I'm pretty sure running on a treadmill while wearing costumes and also acting at the same time is pretty hard

[@targattano]

@@thedude5714 well yeah! in season 2 the volume is bigger! they explained it in the disney gallery series

[@bluefernlove]

I genuinely think they could actually turn the floor into a huge VR treadmill (no harness needed there) to allow the whole thing to transpire seamlessly in that little set. Or at least the continuous shots that are not focusing on the floor. I can perfectly imagine the future of sets this way. A little bigger, to allow a lot more action and wider shots.

[@ScytheNoire]

Funny how this is just all the way back to old cinema methods of using painted backgrounds, but with new technology.

[@tristanmoller9498]

Painted backgrounds 🤣🤣

[@DJ5780]

I was thinking the same lol

[@cyberworld9000]

@@tristanmoller9498 ? Why is that funny

[@JohnnyMotel99]

More akin to back projected backdrops

[@brodriguez11000]

@@JohnnyMotel99 : One would think back-projection would be cheaper...and safer.

[@alisakomendova3514]

When she talked about removing the uneven green screen frame by frame, I felt physically ill. They are the real heroes

[@WatchInVR1]

Hopefully only 24fps! And not 60 or 144fps lol

[@manaulhoque6507]

@@WatchInVR1 Dude, it's ILM. That's big boy movies so very high FPS

[@WatchInVR1]

@@manaulhoque6507 I'm sure she embraces the new technology then. Makes the green screen tech seem primitive.

[@Lasharella]

Yes true heroes like firefighters and coastguards and navy seals

[@tonystreet226]

@@manaulhoque6507 Not necessarily. A lot of big budget movies are still done at 24fps.

[@ilsunnylo3562]

If you put led screens all over your house, you can change your home decor with a click of a button. No more renovation.

[@solus2074]

big brain moment right there

[@capitaldude7119]

IMAGINE THE ELECTRICITY BILL! HAHAHAHA

[@AquaMarino]

That's black mirror

[@archanapramod434]

It won't be feasible since it wouldn't look 3D, since here in the video, the 3D effects are coordinated according to the motion of the camera, and in real life, you either need a highly modified Google glass, or a room full of cameras that tracks your eye, to make the decorations, paintings etc look real, i.e 3D Edit: yeah, forgot about the electricity bill. Credits to other replies!

[@ilsunnylo3562]

@@archanapramod434 you can use motion sensors. Like those face cams.

[@AshiqurRahman]

The idea is very old(remember car driving scene, where actors just used sit on car and in background some video was used to play)

[@stevethepocket]

Now they can make the prop car work as a video game controller, hooked up to the computer that's rendering the background, so it reacts exactly to how they're "driving".

[@ryko1478]

Yeah but saying that it's like saying that the smartphones and the old phones are the same thing

[@Kadasberry11]

@@ryko1478 no it’s not. The original comment is very clearly saying the concept isn’t new, that the execution has evolved.

[@ShubhamKumar-rh3dz]

That use to look so unreal with no meaningfull coordination with foreground.

[@Yumyum-yo6op]

Goated pfp

[@ConstantinSPurcea]

Finally, we're back to the old "Get it perfect on camera" instead of "We'll fix it in post."

[@DarkAngelEU]

More chamber music, less dubstep.

[@estidi]

So much this. The technology alone could single-handedly force change the mindset of modern movie executives and filmmakers.

[@INSTAFLIXMEDIA]

That should be approach. Nowadays people are so interested in computational photography rather than sit back and actually learn how a camera and optics work.

[@dianariojas6405]

Right, when the “new” method is actually making a full circle comeback. Love it.

[@StudioArtFX]

@@estidi That's not what makes the show work. They do the entire episode in Unreal Engine first, and after it is edited and locked, they figure out what they need to shoot. That's genius.

[@mbasakosani8386]

forgot to mention the technology that was used to render and build certain elements of not all was done using a video game engine ,unreal engine 4 to be specific

[@PhilEdwardsInc]

Yes! I wanted to get into the weeds on this, but it's a little complicated since S1 used Unreal Engine, but S2 is reportedly using proprietary different software for the renders.

[@LeslieDugger]

This bothered me too. There are several docs before this one that do correctly mention UNREAL. this video is a bit watered down for mass consumption

[@ufffd]

most people don't care about different 3d rendering engines lol. and if you do care you probably already knew.

[@LeslieDugger]

@@ufffd They easily could have mentioned it without any additional effort.

[@superslimanoniem4712]

The one apple wants to ban?

[@Robin-dr5zp]

It's actually pretty cool, the actors can understand the enviorment more easily

[@Numely]

ELZZZ thank you

[@acmiguens]

If you wanna laugh, check out the making of The Lost World Jurassic Park to see how they showed the actors where to look for the T-Rex.

[@IreneWY]

This is a sophisticated return to the moving screen of the 60s/70s cinema era. I am loving it.

[@digimaks]

60's?? The projection screens were used as early as 20's, especially in fantasy films. But yeah, that's pretty much it.

[@Lankku_]

She seems so happy that she can be right up there and be included with everyone else instead of just being excluded and behind the scenes :)

[@amjan]

Or shes depressed and on drugs

[@jkimmyloser]

1000% much better than doing post production in a dark room 24/7

[@americanindeon]

Yeah, because Post Production is way after the filming and action is long over. You miss out on the Director, film crew's, actors and actresses being onset, all that action. It's like showing up to a party excited...and everyone went home already. Yup! You missed it.

[@decay7182]

@@amjan or it's you?

[@Erick-my1oi]

she still behind the scenes

[@DragonballBlack]

This is the NEW Way

[@mememaster147]

The new, old way. It's a modern take on front projection with the convenience of back projection.

[@jeanneaugust]

Blackscape????

[@Izralights]

Go away simp

[@Ownxer]

E

[@alos09]

This reminds me of Titan Fall 2

[@MakeSushi1]

this is the way

[@paramkapur29]

this is how you make sushi?

[@WeldonWen]

We finally no da wai

[@mohammadamir4486]

lol

[@DoctorX17]

This is the Way.

[@miriamatembe2261]

do u kno da wæ?

[@adamskyj69]

"It makes it a cohesive environment", and I bet much more rewarding experience for production staff due to the instantaneous results. It allows actors to understand the direction and make it almost real for them or should I say unreal. A great revolution for TV and shows the merging of the technology with computer games through Unreal Engine. 4k assets in the engine made for the show/movie production can then be used by game developers! LOVE IT!

[@thomaslacornette1282]

Yes the possibilities for fantasy/historcial movies/SF are incredibles!

[@franzmeier4472]

Dude who invented this: "Imagine an HDRI, but like in real life, bro." "That's just called real life bro..." "Bro..."

[@magicl3o]

@L1qu1d S1lenc3r don't you think is muuuuch better to have a VR headset/AR headset instead of a whole room with huge high res TV? i mean, the quest 2 costs 300$, it's already there, and i guarantee you (i'm not just talking, i have it) that the resolution is high enough to don't have problems, now imagine in 5 years a resolution double to that, and maybe a more evoluted AR sistem (for now, on the quest 2 you can only see grey and black, and you can't see display, it gets confused. but imagine with AR glasses or VR headset that are AR capable in 5 years what would happen

[@randombailey1166]

Bro...

[@MrDavibu]

@L1qu1d S1lenc3r This already exist, it's called CAVE (Cave automatic virtuell environment). But what they use is more like a powerwall and is also in use. But powerwall's and cave's used to use projectors, but not because they wanted, because display's weren't up to the task. Especially powerwall's are already used as VR/AR-System e.g. in CAD workflows.

[@ifrazali3052]

It sounds like Todd from bojack horseman bro

[@evilgirl-1]

@L1qu1d S1lenc3r well, not really, as with this, it only looks like a real set from the perspective of the camera.

[@RayMak]

This is the new green screen but not everyone can do this in their homes

[@wormskrughs9016]

Hey, get out from here Ray

[@AdrieneBell]

@Ray Mak That's what I thought.

[@nickryan6787]

@@wormskrughs9016 what's wrong

[@wormskrughs9016]

@@nickryan6787 he is everywhere, that is what wrong about him

[@wormskrughs9016]

But i dont really hate him

[@jakegum142]

“Finalize a shot in camera” is a beautiful concept. The audience can always feel when something is actually photographed as opposed to extensively composited.

[@ejoshcoron]

Great for the actors too. They can actually see the world they're supposed to inhabit

[@thefaulkness]

@@ejoshcoron I WANNA WORK IN ONE, I CANT WAIIIIT

[@TechSupportDave]

@@thefaulkness then study hard. they likely don't just accept anyone into this job.

[@gnosjo]

No, they very can’t.

[@JOCoStudio1]

@@ejoshcoron Yeah, one of the largest benefits asides from reduced CG touch ups in post is the fact that the actors can ground themselves better in a scene. Great stuff.

[@rememberedtoys]

There are so many cool jobs like this out there. I just wish I knew that when I was in school.

[@Spaghettaboutit]

You can always go back to school...

[@vtn08]

With sky high school fees?

[@Spaghettaboutit]

Villific California has community colleges with really low cost per class, and I know other states also have this. States/schools also offer financial aide, so maybe they live where this is a viability. 4 year university isn't the only option for higher education.

[@parvizahmedov1075]

Who needs classes there are tons of online courses about stuff like this

[@milktea_gang]

You can always learn these things online. Most people who work in this industry are self taught.

[@hautakleightontam771]

Being surrounded by a LED screen is fun, until the lions get too close...

[@aaronjaggan]

Sounds like you have alot of pride.

[@Phizzo4real]

Hahah

[@mr.pavone9719]

I get that reference!

[@lightningvolt3150]

I think that's a reference but I'm not sure...

[@througheverything]

I don’t know if I’m right but I read a collection of short stories a while back and I think that was one of them.

[@7heRequiem]

This looks like an ultra-refined version of back when old black and white movies driving scenes would be a prop car with a screen behind them simulating the drive on the road

[@laneythelame]

A great combination of old and new

[@DamienDrake]

James Cameron used tons of rear projection in his earlier movies too. When lit properly it looks fantastic.

[@valeriataylor8337]

i think that some technices are simple but the most effective. Sometimes they try to invent new "modern" stuff and spoil what really looked good originally just for the sake of "look how modern we are". But this is the fusion between the good old technique that worked pretty well, and the modern visual/finishing needed to look good for modern hd cameras

[@caz8135]

The Woman: is Lead Compositor of a multi million company. Also the Woman: 3fps webcam Also the Woman: cropping her background and adding green screen

[@gintokisakata7490]

Exactly my thoughts.

[@malkouhs]

Well she works with hardship so maybe she has no time for that.

[@fuzzypiglet]

@@malkouhs I doubt that she is poor when her name is so high up on the credits list.

[@Carakav]

She has better things to worry about then the quality of her webcam. I bet this is the only interview of this nature that she's ever done.

[@namikazeminato4131]

probably it's more of her video streaming software.

[@DTux5249]

The reflection part was particularly interesting to me. Because I remember reading up on how in Ironman, they originally had a lot of work piecing together the reflections they needed with all the metal

[@pandemonium2431]

And with green screens there will always be a bit of green reflecting in the character that needs to be edited

[@Partyrockscool]

As per usual, Star Wars is once again leading special effects in the world of cinema. From their version of a green screen in the originals to this new LED screen in the Mandalorian. *Edit:* Yes the inventors of such technology do deserve most of the credit, however it was Star Wars that executed the effects perfectly and helped inspire directors to use such effects and technology in their own films

[@michaelheliotis5279]

It's a pity they can't figure out how to make a decent movie these days.

[@sikyfushvanti3605]

@@michaelheliotis5279 true

[@zoraizzia958]

This has been used since 2013, mandalorians just the latest to use and improve upon it

[@ichmachfilm]

Stanley Kubrick used front protection 1968

[@t2hk_]

@@michaelheliotis5279 I'd blame only the sequel trilogy for that. The other movies, especially prequels and the Mandalorian, are my favourites. The original is good but it feels a bit "bland".

[@HolaJulen]

Okay this was extremely interesting.

[@tbi143]

Yes

[@angelabby2379]

Yes hola

[@sujeet1979]

To watch coc in real life visit my channel and pls subscribe

[@appleslover]

As much as a night with you would be

[@Kabodanki]

It was badly edited though and slow

[@xandygameryt]

pfft, this is nothing compared to african movies where the scenery is 100% real

[@amistrophy]

Wakaliwood still better

[@ThisIsFez]

I'm african and I laughed hard...

[@rustyshacklferd535]

Or the scenery from Jurassic park.

[@googleuser9383]

Yeah, or harry potter in which they used greenscreen heavily in every movies. What you didn't know that? Almost like you wouldn't notice green screen if it's done by someone capable of it?

[@moonh34rts]

Yessir

[@Ridlay_]

This is really cool. Granted it’s got to be expensive and complicated when it comes to coordination, but for studios that can afford that it feels more authentic when looking at the behind the scenes.

[@poppyhimbo]

NASA has a huge budget! They've been taking tax payers money for years. All they have to do is make some convincing videos to show some sort of "mission"

[@yeno6492]

4:29 the following scene contains violence that maybe upsets some viewers, viewer discretion adviced

[@LPSWeirdCow13]

Underrated

[@czarkristoff]

A heart attack

[@peterallely5417]

Oh that’s a shame that you guys glossed over one of the coolest part for how this all works! The on-set camera is tracked in 3D space and the separate elements in the digital set (foreground digital props and digital landscapes) adjust their parallax in real-time to match the camera’s perspective and movement 🤯🤯😳

[@ysnsmth]

cool

[@DamienDrake]

Exactly. Were it not for that, it wouldn't work.

[@optimisticnihlist9705]

They said that in the beginning

[@TheSoulGlitch]

@@optimisticnihlist9705 And then never again.

[@ibukuntaiwo2767]

Very true, and would also not be possible without real-time render engines

[@beardwilliams]

I wonder what Christopher Nolan thinks about this. Hoping he can utilize this in the future for his lean towards practical effects.

[@vigneshchillale3449]

yup he'll luv it

[@chrishughes8398]

He did something somewhat like this for interstellar for the scenes filmed instead the ships. The setting outside the ship was projected and you could see it out the windows.

[@kit7868]

I like how the lady is using a green screen, and the background she picks is a green screen

[@poooopoo]

she didn't pick it, this yt channel changed it to be that way, you can see at the end when it reveals her actual room

[@New777World]

@@poooopoo lol 😆 not many got the stunt! though!

[@stimolego9989]

This must be so much nicer though for the actors they are not just in a set full of green curtains

[@Kakimech89]

Cue that shot of Gandalf weeping on set of The Hobbit

[@annaeeee7516]

Disney+ made a sort of documentary series on the filming of The Mandalorian and the actors get to talk about their experience with this setup. It's a great documentary, I highly recommend it.

[@stimolego9989]

@@annaeeee7516 I watched it

[@danieljensen2626]

Yeah, although the perspective is only right for the camera, so some things probably look a little wonky for the actors.

[@shealupkes]

As impressive as it is to watch good actors work with literally nothing, too many films and shows suffer from actors who either aren't naturally talented enough or experienced enough to pull it off, and they don't have a lot to improve upon if they're just talking to a wall

[@morespencer]

i like how shes does vfx for a living but her camera outputs at 15fps

[@Descalabro]

It means she understands how needs and means relate.

[@TwinTurboOnly]

What does that even mean

[@hyuriel7515]

@@TwinTurboOnly It means her camera quality is low

[@Mb-eo6bg]

She’s probably underpaid lol

[@parthsavyasachi9348]

It's like brahmgupta calculated pi to 5 decimals but for himself just used 22/7. And back then 5 decimals was huge deal for pi.

[@davidsymmetry6952]

Fun Fact: The New Batman and Thor movie will be using this technology

[@lupowins]

@James Grimaldi What you’re not excited about MORE superhero movies? Use this for an action adventure like a Romancing the Stone or Raiders of the lost Ark type movie.

[@pratinavtewari452]

Oh wow The Batman And Thor Movie..... The Dark Knight Of Thunder. Amazing

[@mohammedhussain6749]

@James Grimaldi we don’t need a new Batman every few years give it at least a decade or two to actually get a new audience excited about a Batman movie. Nolan’s Batman ended in 2012 then, Zac’s Batman started in 2016 and will end in 2021 now we’re getting another Batman in 2022 just a year after the last one? Give it a break and maybe you will see numbers you actually for a Batman movie.

[@mangenkyo]

@@mohammedhussain6749 shut up

[@sexyyeyo]

We've gotten like 5 batman reboots in the past 2 decades.

[@klumpur23]

it's exciting to see new technology like this. What I'm interested is the cost savings behind using this method versus traditional green screen. Will this save a lot more money vs green screen post production? Also, green screen set seems much cheaper to implement compare to setting up the LED panels. Another questions is what type of LED panel they use? are they different from LED screen?

[@ViralKiller]

I wrote a paper on 'depth cameras' a while back...basically gives you an instant silhouette...but this is cool too

[@deionmccoy3869]

no u didnt

[@aerozz8851]

Are you trying to imply that your paper is cooler than this? Get over yourself, bud... I'm sorry if you are joking.

[@ViralKiller]

@@aerozz8851 not paper, depth...so you basically get a sort of white outline of closest objects, like a kinect, and further away objects are greyer..point is, you get instant masks for keying

[@ViralKiller]

@@aerozz8851 and the background can be anything

[@nathanblanchard8897]

Sorry that people aren’t understanding what depth cameras allow you to do, but I appreciate it :) Would apples use of LiDar in their new phone cameras be an example of this? What the keynote brought to mind for me and how I understand it is that they use the depth map from the lidar to separate the subject from the background, which (I think) could be used to easily mask out the subject in post all together (if that lidar metadata was accessible in post..)

[@surrealdynamics4077]

This reminds me a lot of that moment when Sir Ian Mckellen cried while filming the hobbit. He was acting all alone, surrounded by green screen, when he should have been surrounded by other actors, all playing their role and having a good time with the fantasy they were in. Now THIS takes that magic of acting to the set once again, and even stronger than before! I know green screen is quite useful for certain scenes, it makes a lot, possible. But it also takes away those little things that make acting feel good

[@BaoZwer]

I honestly thought this was filmed on actual places for most scenes. This is awesome

[@Lucas-up9wq]

It often was, but they used the screens on set too, not only in the soundstages

[@thenorwegianbuttercrisisof2011]

I looked at the thumbnail at was like “I don’t think filming at a real location was a new technology” and then watching the video I had an “oh!” moment

[@QUARTERMASTEREMI6]

I thought the same thing too. But I mean for some places, it beats anything that can be recreated on set, yet that comes with quite a lot of challenges, so it depends.

[@thenorwegianbuttercrisisof2011]

WilliamE216 one word: cost

[@HungryLoki]

​@WilliamE216 You don't know see how this is better? How about, you can film in places that do not exist in the first place?

[@DREW-TO-THE-BEE]

Ray Bradbury would be shaking in his typewriter

[@BrotherShamus]

I actually thought the twist was going to be “go back to real sets and practical effects”. The “new” way looked so real to me

[@dogwalker666]

Unfortunately not we are stuck with C.G.eye

[@LD1E60]

@@dogwalker666 I don't see how this is unfortunate

[@marcusmeira5594]

@@dogwalker666 I also don’t see how this is unfortunate

[@edenformaggio4733]

For someone who edit films, working with greenscreen (and keying) is indeed really hard.. This to me, looks like a real game changer, at least it gives us post-production the chance to be more immersive in the process of filming, just like what she said.

[@rosiefay7283]

And now the characters and other foreground stuff can use the full spectrum of colours.

[@edenformaggio4733]

@@rosiefay7283 yes exactly!!

[@1234demilovatofan]

I’m glad that it will help get rid of that thin green line that stay around actors sometimes.

[@JulienNeel]

Fascinating!

[@emillano2779]

To become rich you must value saving more than spending.

[@003soul]

@Caroline Louise 💯

[@IronMan-jj2fd]

Yeah its done with NVIDIAs Ai right? Which they showed in rtx 30 series launch.

[@pokemanic101]

Oh fancy seeing you here man. Love your versions of Yesterday and Black Bird

[@pythondrink]

U got 1.6K likes simply for commenting Fascinating!?🙄😂

[@jensschroder8214]

The most important news program Tagesschau in Germany has a 17.5 meter long curved projection surface. 7 projectors create a seamless image. Explanatory backgrounds are displayed depending on the news. Other programs use the same studio with different backgrounds. For example a news program aimed at children and several political programs. The studio produces 24/7 programs, most of them live. LED screens are not used because you need a high, sharp resolution. But projector surfaces with 7 synchronous projectors were also unusual.

[@RoentgenChernobyl]

Am I the only one think she sounds like trying to hold back crying and laughing at the same time? Great tech btw

[@キラキラくりくり頭]

Definitely not

[@msb3235]

You're not. I'm about to say the same thing.

[@TainaElisabeth]

Some people speak like that, always wondered what it’s about

[@wetdog863]

@@TainaElisabeth it's sometimes anxiety

[@jemiu9525]

it's raw excitement. I love it

[@rikyriky966]

Tip: A big scale version of this technology was used in the movie “The Truman Show” starring Jim Carrey 😁

[@Qaxalvr]

an even bigger scale version was used by heist-o-tron to steal planets

[@anantshankhdhar2299]

It was an amazing movie

[@shelleywelch03]

But what is different and what this video skipped over is the camera tracking technology that “The Truman Show” didn't have back then. When the camera moves on "The Mandalorian" set the picture on the led screens moves with it.

[@rafeisbest]

😱🤯🤯woahh

[@Emiliapocalypse]

Cue sunrise!

[@matthijsrietveld6051]

When watching the mandolorion i thought it was filmed outside like the old star wars movies

[@zolalasmisi7377]

I think the concept is similar to what they used to do in those vintage movies. But instead of a background sheat and a projector now they have large led screen with advanced computer manipulation.

[@rifqihatta]

The Mandalorian managed to make the environment looking more realistic and captivating compared to the actual high budget movies.

[@RaphaelAguirre]

the whole production of The Mandalorian. Even the stories, the atmosphere. That's true StarWars, not like the Disney movies.

[@btrick100]

1 Mandalorian episode costed $10 million......

[@rifqihatta]

@@btrick100 Compared to 1 movie which cost 240 million dollars and for runtime not over 2 hours and 20 minutes................

[@yerzhankurmanbay]

cost

[@jagrulez885]

@@RaphaelAguirre But it's a Disney series hahaah

[@Raima_Is_Lovely]

The blue screen is that one guy that people don’t invite to their parties, but comes anyway.

[@sir6379]

...

[@yallstillreadthis9781]

......

[@gmoshka799]

The only downside to this technique that I can see is that you can’t change the background once it’s shot. With green screen you can change it a hundred times and see what looks the best, but in this case you have to figure everything out beforehand. Just like the old masters did.

[@WobblyBits_X]

@@BoyBlunder66 Exactly. You don't have to wait anywhere from days to months to see how your shot turned out. Reshooting a scene even only days afterwards is far worse than on the day.

[@expression3639]

It really is no different than filming on a set in that regard.

[@krishnakarthikshivaram3234]

if needed would it be possible to create a green screen with the led screens? That way you also have a shot with the green background and the ability to tweak it later?

[@genius1a]

That possible problem seems fixable though: take record of the exakt position and direction of the camera(s) at any given moment and you could remove the perfectly known screen pixels of the background screen without affecting actors and props. The only downside would be the reflections on actors and props that would stay as they are, as it's a normal thing (but worse) on greenscreen applications. So you could step back to sort of a "greenscreen" mode I think if needed in one scene. With the advantage of better matching reflection colors.

[@gonelucid6270]

Really good point. Green screen isn't going anywhere anytime soon

[@OpticalAntenna]

Worked on 2D to 3D R&D at Deluxe and StereoD and love this idea, one side project/idea I was pushing is very similar but with a stereographer working the depth of segmented shapes using sound-board like controls and techniques. Really clicks that the post crew is right there so much efficiency and real-time feedback :)

[@AreaofInterestTV]

Its just like ray tracing.. U dont get what you are missing unless you know it.. 🔥🔥

[@Erlisch1337]

no its defenitly not just like ray tracing...

[@NeoFryBoy]

@@Erlisch1337 I don't think that's what they meant.

[@taytay1030]

Minecraft RTX on vs none

[@abhi4154]

u haven't seen actual ray tracing bruh what unreal gives is not ray tracing its jst a skeleton of what renderman/arnold can give the tech is already ther but hardware not that much

[@siddharthbhatia8815]

That is completely wrong

[@massashihosono]

Important to point out that while this is a huge breakthrough, green screen didn’t go forever. In some situations (like famous Avengers long shot battles in the city) green screen is still the best solution.

[@dinkledankle]

Ok.

[@GhostSamaritan]

Why is that so?

[@martsanchez2413]

Because the volume is only small and they cant fit every actors there and they cant run and do wireworks freely, using green screen in that type of scenes is the best way but if its just small space or small movements scene then the volume is the best way to do

[@ruffle-the2dguy290]

Usually: greenscreen works nicely Yoda: not today!

[@anamorphia]

*Christopher Nolan liked this*

[@PrograError]

well he did use something similar to this on interstellar...

[@cinemasantha2019]

Nope.. He still prefers to goto Mars to shoot a scene in mars..

[@xxDxxism]

@@cinemasantha2019 its true

[@zwmfucqakmal5668]

@@cinemasantha2019 njir

[@7heRequiem]

Well, he'd prefer this over a green screen, yes, but he would rather prefer to go to a remote place and shoot there instead

[@Evantures]

This is unbelievable . An editors dream.They must pay these people a considerable amount too

[@jimmyjango5213]

The people who created the technology are the ones getting the big bucks. These people are essentially just film and set crew, with computers.

[@murishal]

@@jimmyjango5213 this "technology" is just combination of already existing technology. Only movie companies are get big bucks, but without so called "crew with computers" technology would have no idea what to do.

[@jimmyjango5213]

@@murishal Still crew with computers. A dime a dozen

[@murishal]

@@jimmyjango5213 what ever

[@jimmyjango5213]

@@murishal Exactly

[@davidbeddoe6670]

FX people get to routinely be on set now. That's a pretty huge change.

[@shelleywelch03]

But what they don't mention is how many jobs will be effected by this shift in technology. Don't get me wrong, this is the future of VFX and is going save film makers time and money, but shows that used to need hundreds of VFX artists and months of work will done be done by a small group of people that is completed when filming is finished.

[@Sunthaz]

@@shelleywelch03 True, but VFX artists are far from being the only professions affected by technological advancement.

[@Skybar23]

Just finish watching 1899 on netflix which used a bigger version of the vokume..apparently the pandemic forced shows to use this technology and pretty much now is becoming more developed and widely used

[@hayav90]

I can't imagine how amazing it would be to be an actor in that! Talk about being truly immersed in the world!

[@izstrella]

Yeah! Oh my gosh, it would be AMAZING!

[@PixelStacker]

I love how Charmaine can’t even contain her smile when she introduces her job, that’s a woman living her dreams indeed!

[@ryuno2097]

you just copy pasted the same comment below.

[@rhomis]

"Find A Job You Love to Do and You Will Never Have to Work a Day in Your Life" - Mark Twain.

[@MelonSqueezy]

Nice copy

[@relentlessmadman]

@@MelonSqueezy James H 2 days ago I love how Charmaine can’t even contain her smile when she introduces her job, that’s a woman living her dreams Indeed? indeed! I hate to go all Judge on you but! This is very Tlic! InDeed!

[@BariumCobaltNitrog3n]

COPYCAT

[@fah2657]

Imagine having this is your house and just sitting at the beach or another planet.

[@htetmin6959]

Just like holographic room in alien movie

[@slashd]

Probably easier to use vr

[@Muksss]

Nick Fury at the end of Spider-man Far from Home

[@abi9422]

;"Where are you? :"Just chillin' in Mars, wbu?"

[@fuzzypiglet]

@@slashd I’d rather not having to wear huge uncomfortable goggles.

[@mladen7641]

"How about we just... Y'know. Put a background... Except it's round." "Genius! Why didn't we think of that?"

[@sharad3454]

Because they didn't have the technology to do it before.

[@sharad3454]

@Corbex11 yes, we didn't have tech to have realistic instantaneous rendered objects put in that LED background (round) screen. Thank "unreal 4" for helping us and "5" for pushing it further. And that's not just a round background, it is a showcase of Human civilization's advancement. And I hope we continue to grow and appreciate these things instead of taking them for granted.

[@mindbomb2000]

It's not just a round screen. It's a round screen that adjusts for parallax.

[@knightsljx]

@Corbex11 Not just the software but also the hardware. You would need pretty high resolution curved bezel-less panels. Not to mention the computing power to chug out the scenes

[@amouramarie]

I wonder if someday they'll have sets like this, but the size of an airplane hangar. That would be wild to be in.

[@atuck6082]

Hologram projections are next.

[@Currywurst4444]

That is unnecessary. The space only ever has to be as big enough for the characters to move in. If you were to shoot a scene that needs a lot of space this technology isnt needed. The actors are already immersed if the set on the ground is large enough and there wont be any reflections or lighting if the screens are too far away. Brightness would also become a problem because the screens would have to be much brighter if they are further away.

[@DiecastinMotion]

Later Cessna pilots: Oh look when did we have a dark looking hanger! lets taxi in there! "smashes entire set"

[@MsHaggisBreath]

@@Currywurst4444 The hanger set would allow them to actually run.

[@desertaliend_b9840]

That would be awesome

[@ajspice]

Okay, the fact a lead compositor at ILM is saying even THEY struggle with keying makes me feel a LOT better.

[@Network126]

Same.

[@yourdaddy9061]

The humans too at the end of the day

[@Network126]

@@yourdaddy9061 Yes but they have the most expensive technology

[@starbeekbeek3179]

What is keying

[@no1DdC]

@@starbeekbeek3179 Cutting out the actors who are in front of the green or blue screen so that the background can be replaced with e.g. a space scene. In the past, this was a laborious process that involved complicated film printing methods (and even scissors at times), but today it's done on a computer. It can be somewhat automated (that's why a blue or green background is being used) by simply defining a certain color range as transparent, but for perfect results, you have to manually go through each and every video frame (24 per second with movies) and make sure that there are no issues like strands of hair being removed. It's slow, labor-intensive and profoundly annoying to the people who are doing it. Bad keying, which still makes it into a ton of released films and especially TV shows, is very obvious to the viewer, whereas nobody will notice good keying. It's a necessary, but completely invisible job if done well.

[@maddynewhouse143]

A lot of theaters have been doing a version of this for a while as an affordable, high quality alternative to painted backdrops! I had never thought about applying it to film! I love the idea of including typically BTS and post production roles into the filming process.

[@brandon3872]

What do you mean by BTS? I only know the K-pop group. 😅

[@maddynewhouse143]

@@brandon3872 just Behind the scenes 🙂

[@brandon3872]

@@maddynewhouse143 Ah that makes sense, thanks.

[@xXNickPXx]

It's weird they didn't demonstrate the thing that really sets it apart in film though - the perspective correction. Moving the real-world camera also moves the in-3d-world camera, so that the 3d-world actually has depth in the final product. For theater you wouldn't be able to do that. Would have been really cool to see it in action here (and how weird it must be for the actors when the camera is moving around but they're standing still and seeing the whole "world" around them moving).

[@bellecwy]

@@brandon3872 🙄

[@MiljanBojovic]

The amazing thing is that they're using a video game engine tweaked to perform at maximum rendering capabilities, which is Unreal Engine 4, soon to be Unreal Engine 5. That is just so cool!

[@marquisdelafayette3333]

Lol I use that (for games )

[@MiljanBojovic]

@@marquisdelafayette3333 me as well :)

[@jordanosburn5009]

I’ve met Charmaine once presenting at my college campus, it was really amazing to see how much change these led panels would introduce to the visual effects world!

[@crudboy12]

I kinda assumed that most of the Mandalorian was filmed on location with the backgrounds edited in later. Compared to the creature and vehicle CG it looked almost flawless.

[@blairemendoza]

Props to her team for making the show look visually pleasing 🙌

[@bewhitey]

Hilarious that I did this years ago one drunken night. Dressed up my friend as a samurai and tried to use my led screen as the background. Needed two screens, one to correctly color light my friend from the front and one as the background. Turned out exactly like Industrial Light and Magic......if they were all drunk

[@digimaks]

That's pretty much it how it works. This technology was used very often since 1920's with projection background! What it seems is that we coming back to older tech that actually has the future!

[@BostonianJake]

This technology feels like an evolution of matte paintings... it's quite impressive!

[@jonathancummins6234]

شكرا!

[@thoticcusprime9309]

tf?

[@lorenzsanjuan]

Post production - *exists* Mandalorian - “ I don’t know her”

[@silversunset]

I know this is a joke, but they still have to do vfx for the ships and baby yoda, compositing, sfx, and more.

[@hxcyns2191]

@@silversunset but most importantly, sequencing XD

[@ganeshpatil1448]

So, nobody's gonna talk about Christopher Nolan who used this technique while filming Interstellar?

[@robtennant98]

Did he?

[@Justin_Ports]

He sure did, but I think there are differences in the way these rooms looked, or functioned. Same general technique though!

[@ProfessaJ]

led walls have been used for years but this was a first for this method of using it on a big scale

[@markh9755]

Same goes for Joseph Kosinski's who used the same technique for Oblivion

[@shizukagozen777]

@Gap Yup.

[@nightrider_]

this is such a good video explaining the new tech they used for filming Mandalorian. Star Wars franchise from the first movie in 1977 to 2021, still is the frontier in filming technology. That's one of the reasons I love it so much. I'm glad even though Lucas is not there this tradition still continues with the franchise.

[@davidanderson5310]

It's a neat idea, to reduce the dependence on "we'll fix it in post". If the "compositing" is set up ahead of time, filmmakers won't defer challenges that could turn into post-production nightmares later.

[@julianglass2607]

There’s a book in the background called “beautiful Minecraft” at 4:32, that kinda warms my heart Edit: bought it

[@naomipurple679]

Where can I get it?

[@timogloor5041]

😂😂

[@clownfromclowntown]

How is it?

[@jad43701]

Walmart, Amazon, Barnes and Nobel among others. I believe there is an ebook as well

[@opedromagico]

Loved it!! Thanks for this video

[@SamsEnvision]

I am glad that I am ur first reply

[@IronMan-jj2fd]

I will just get an rtx 3070 to do this effect. Thats it end of the story!

[@iamagood6452]

@@IronMan-jj2fd yea thats what I was also thinking lol

[@moodberry]

Next step...Holodecks! But seriously, I can see an evolution of this volume where the actor is on a treadmill so that he can actually run instead of having to stay in one place.

[@stevethepocket]

That only works if you don't have to film the ground.

[@spoopypoods7485]

saw this on Tom Scott’s channel. He used it for his Disconnected series. He rented a studio for it. dedication amirite

[@deepstariaenigmatica2601]

yeah loved the series. deserving win.

[@sitisarahabdulrahman]

Yeah. When I saw this video, it immediately reminded me of Tom Scott's Disconnected.

[@gangstax2131]

She's a lead compositor in a huge Hollywood industry but films herself with a *potato* nice

[@coyraig8332]

I'd probably blame the internet before the camera, but I don't know how good or bad the internet is in either place so idk

[@ka_noerra]

that's because she used a webcam not a DSLR or mirrorless

[@robertt9342]

It's pretty silly to assume that she would have inclination to setup or own the equipment to do a "proper" video for a simple interview. She may be working in Hollywood, but the expectations of the OP do not lineup with her job. It's not like she is a professional videographer or KZbinr or something where there is a reasonable expectation of quality video.

[@rosyrose7078]

DOES IT MATTER @GangstaX??????????????

[@ianmunsell3915]

The cobbler's kids have no shoes.

[@reckuss]

finally, a good affordable alternative for home moviemakers

[@kerocz3363]

I don’t think this is affordable tho. Not yet at least

[@n7issac94]

Affordable? Lol, for millionaires yes

[@selamau3]

R/whoosh

[@reckuss]

@@n7issac94 there is something flying above you, it starts with j

[@tadeobessega4393]

@@reckuss hahshshds reckus ily

[@kuroneko1m334]

"Who killed Captain Alex?"- movie with realistic scenery

[@catalogueboys2538]

The shocking thing is that stanley kubrick did a rudimentary version of this in 1968. Genius.

[@no1DdC]

He didn't invent it though. It has been used since the silent film era and became very popular in the '30s and '40s. The difference is that Kubrick and his team did it at a level of quality that is impressive to this day, which is quite rare. There are very few films prior to 2001: A Space Odyssey that hold up in this regard.

[@gonelucid6270]

Very cool! I did the same on a short film before I got green screens last year

[@samgod]

@@no1DdC Gone with the Wind had some pretty impressive rear projection in 1938.

[@fabianofrombrazil]

So, basically, the Star Trek Holodeck version

[@TazTalksYouListen]

I'm surprised they didn't just say "We've created a holodeck for film production."

[@fabianofrombrazil]

​@@TazTalksYouListen Exactly!!

[@Alienami]

How I would explain it.. (PLOT TWIST) SHE IS THE REAL MYSTERIO!

[@jocelyndeguise]

@@TazTalksYouListen They didn't because Holodeck creates solid stuff that you can interact with.

[@TazTalksYouListen]

@@jocelyndeguise - So we can just count you among those that thinks a holodeck is a real thing? Gotcha.

[@DkLnBr]

2060, "The technology that's replacing The Volume" Today's special effects are done by bringing the whole set with us and filming on location

[@acmiguens]

Those new Star Wars movies are gonna be great hehe

[@Krugster]

@@acmiguens nope

[@SKsuprakirby]

New Star Wars movie. NOW WITH ACTUAL HYPERSPEED.

[@WillSmith-ui1pb]

Capsule Corp??

[@acmiguens]

@@Krugster If you already watch all new Star Wars movies expecting them to be bad, guess what, you'll not enjoy them. That says more about your attitude and personality than it says about the quality of the movies :) If you're not happy with yourself, you won't be truly happy outside your own self

[@sgartner]

The question I wanted to ask was if the parallax changes,, in response to camera moves, made it nauseating for the actors on the set (weird combinations of items on the screen behind them would shift, causing potential motion sickness)?

[@maurizioabile1034]

And she explained everything though a Green Screen

[@treeoflife7151]

Nope the channel made it that way

[@maurizioabile1034]

@@treeoflife7151 I'm just kidding bro

[@N-Lee]

@@maurizioabile1034 That's just the LED technology being used to mimic a green screen. Amazing ain't it?

[@levince9315]

The one thing i’ll never understand in life: *Why tf do webcams have such an awful resolution.*

[@funnlivinit]

Because strippers can't afford $30,000 cameras. And you can't afford 1 terabyte/sec internet.

[@alphaxfang]

small sensor, want a better resolution? pick an apsc or full frame camera...

[@espakol21]

That's a network communication problem, probably someone's internet speed or the transfer rate of the two ports aren't that good...

[@dethswurl117]

Yeah the issue is the amount of data being sent If you ever look at a picture on your computer it usually ranges from 5mb to 50mb in size. Since we usually watch videos at 30fps, that means the network would need to send ~60mb to ~600mb of just the video data over to show a nice, high quality video Most people's internet speeds hover around 50 - 100mbps so it makes sense why they have to downgrade it so much

[@MrDavibu]

They are lazy, it's as easy as that. They make more money with using bad sensors. I mean if it was about resolution, they would still be able to have bigger sensors and less background noise. And even for smaller sensors just look at Smartphone cameras they show what would be possible. There are 4k cameras with bigger sensor and better resolution which are cheaper than webcams, it's just a scam. I mean you could still downsample the picture and have a overall better picture quality, if it was about bitrate of the video. And even then we have much better compression video codecs than we had 10 years ago. AV1 is about has 50% higher data compression than H.264(see Wikipedia). Under these circumstances we would be able to use 1440p AV1 with the same amount of data as 1080p H.264. And it was tested against the then newest version of H.264. I mean the infamous Logitech C920 was released in Janurary of 2012 more than 8 years ago. And is even the goto nowadays, it's ridicolous. And it's not like internet-bandwith has stagnated since then...

[@yesyoucanTellme]

Ugandan Film maker : "Hold my Alex".

[@PHlophe]

Dimitrije from uganda eh

[@chinesesparrows]

Well Charmaine-chan has anime

[@moosemuffins2191]

@@chinesesparrows well Wakaliwood has Bruce U

[@sateayyam3192]

Supa action packed movie I forgot the line ;-;

[@eddieb5452]

I remember watching that Ugandan movie on acid

[@jamesn7156]

This tech is awesome. Looks so real. The lighting on the actors is perfect.

[@user-fm6yf5hh7q]

I was lucky enough to see one of the screens they were using for the Mandalorian, they're incredible

[@theunholyviper]

How did you get to see it

[@theunholyviper]

@Ar S strong with the force they are

[@sstressfl]

I am so impressed by this creative and innovative solution and by the talented folks like Charmaine that utilize it to bring such immersive and believable environments to life. I've been making short green-screen marketing videos from my garage recently (WFH) and on a microscopic production scale I can relate to Charmaine's frustration with green screen. Great video! I enjoyed learning about the latest in VFX!

[@stormbreaker82]

Green screen is the easier method compared to others. Im glad display bg got introduced. But they're really costly.Nice video Vox

[@silversunset]

They’re easier on the editors and vfx artists because they have slightly less work to do. With green screens you have to key them out and/or rotoscope but with a real led backgrounds the backdrop is already there. It also helps when you have transparent objects. Because the light is really there and bouncing off nearby objects and actors, it gives the scene a more realistic effect.

[@silversunset]

Also this video is kind of old news. Insider and Corridor Crew made videos about this exact topic already

[@okvyokta]

@@silversunset yeah it's also not the first time for me to hear about this

[@MegaIrgendetwas]

I think ILM developed the Volume to reduce cost because traditional VFX would not be affordable with a show like this.

[@Jaypoof]

That cost is recouped by the elimination of post work that has to be done when using green screen.

[@Wildicon19]

This is an expansive advantage in a movies creative process which really brings the set and its characters to life! Amazing work Charmaine Chan!