Virtual Production Explained - Is This The End of the Green Screen?

[@StudioBinder]

Chapters: 00:00 - Introduction to Virtual Production 01:03 - History of Virtual Production 03:46 - Chapter 1: How It Works 06:42 - Chapter 2: Built-In Lighting 09:50 - Chapter 3: Flexible Locations 13:46 - Takeaways

[@Korcsmaros]

I studied filmmaking in a university, but I learn filmmaking from StudioBinder.

[@StudioBinder]

🔥🔥

[@chrisdickersonfilms]

Did you find university worth the investment?

[@Korcsmaros]

@@chrisdickersonfilms The first year, yes. The rest? Not so much...

[@krissyskitchen]

The natural lights and reflections from the led screens are really nice, also how the environment can be updated in real time.

[@AtlantaTerry]

*LED*

[@StudioBinder]

so helpful to filmmakers

[@greggranderson3164]

Absolutely. Seems to take the guess work out of lighting which seems more efficient, cost effective, and promotes better time management.

[@arturlago-varjapetian3210]

As an actor/writer/director myself, I love the real location more than anything just because it's an adventure in itself to engage with the real environment.

[@StudioBinder]

For sure, after all VP is great because it gets us closer to the real environment

[@crweewrc1388]

That's awesome! How many movies have you made?

[@nictheartist]

True. But sometimes, when a real location isn't an option, this looks like a great alternative.

[@misscee6629]

Thank you for saying this. As an amateur photographer and very new to filmmaking, I love being in a location. It's a character in itself

[@WhyteLis21]

At the end of the day, this tech are just another tool to get the job done. I'd say if flim making wasn't mostly about making money and it was just for pure creative art, real location sets would be the go to for the most part. Unfortunately, we live in a world where everyone has to get paid for their time and make a living off of from flim making. Lol.

[@jackgeneium4184]

The Footage, the production, the montage, the topics... BREATHTAKING! Thank you very much dear Studiobinder Team for constantly providing us with such detailed and high qualitative content! Keep up the good work! Much love to you all and everyone reading this comment. May you achieve anything you envision!

[@StudioBinder]

Thanks for watching!

[@B10eProductions]

My favorite new invention in film production, it’s really exciting to be around in such a important change to the whole industry.

[@StudioBinder]

truly a game-changer!

[@TheWrathfulSlayer]

StudioBinder is literally like Film school except in forms of informative videos that go really in-depth and show the process of filmmaking!!

[@StudioBinder]

That's the idea!

[@burbex]

The Mandolorian’s epic set pieces are really a step forward in immersive sci-fi

[@StudioBinder]

Hopefully more shows will follow

[@ResoluteGryphon]

I think Virtual Production will lead to better stories too. It requires much more pre-production work, which means directors must have clear intention BEFORE they start filming. So many of today's films are shot on a green screen without a clear idea of what the scene is going to look like. "Doesn't matter. We'll fix it in Post." CGI artists and editors are left polishing a turd; the former often getting blamed for a movie's failure at the box-office.

[@StudioBinder]

Good point!

[@Yodd]

Thats not at all how it works. Green screen is planned to absolute details. They have a pre viz so detailed that it could stand as an animation on its own. Vfx supervisors are also on set to make sure everything is set up propperly.

[@Felix-sb5wp]

Hahahaha polishing a turd 😂😂😂

[@hglankshear]

Unfortunately a hefty amount of the time we still have to change the background in virtual production situations. LED screens have made it a lot more difficult and time consuming in that regard. Especially with edge corrections.

[@zhenchang9579]

Are CGI artists required to adjust the imagery on set while shooting ?@@hglankshear

[@TheBrokeGeek]

Loved how they used a clip from 'Thor: Love and Thunder' - I was on that set! Seeing the background shift to create parallax was trippy! 😂

[@StudioBinder]

Amazing!

[@laveyanist]

this Virtual Production is absolutely going to lead to some huge revolutions in filmmaking and I'm excited to see how it develops. Definitely not the end of the green screen, since it has the lighting and flexibility of post-production issues, but certainly a powerful tool in the right film crew's hands.

[@StudioBinder]

Can't wait to see what more filmmakers will do with it

[@donhendricks3190]

If I"m gasping it's because this just took my breath away. Oh the possibilities. Bravo StudioBinder! With love from Atlanta.

[@meganmurderpint8119]

My husband recently did a virtual production project. I don’t know a ton about it but I do know he REALLY enjoyed working on it. Can’t wait for it to be released!

[@StudioBinder]

Congrats!

[@TheWrathfulSlayer]

What I like about virtual production is the realism it brings whenever the audience is watching and that it feels like the actors are actually in a setting when in reality they are on a stage!!

[@StudioBinder]

Cool!

[@MrMejia187]

Really really excited to see where it goes. Only 10 years and it's already staggeringly marvelous.

[@creatinotionchannel2680]

This actually reminds me of the screen they put up in MIssion Impossible 4 in the hallway in Russia. That idea was ahead of its time.

[@StudioBinder]

Great point!

[@_Adrian_Llarena_]

Virtual production is basically a combination of practical effects and special effects. I love how they came up with this idea. The scenes looks more realistic. With this innovation, the actors are not anymore limited as to what colors they should wear or not, which is a major problem in using a green screen/blue screen/chroma keying.

[@y_fam_goeglyd]

That tech is outstanding. It's so much more realistic. The old rear projection looked bad on our old CRT TV screen when I was a kid, eh hem years ago lol, and it's just as bad on my small tablet screen. But the new tech - wow! Thank you for explaining it so well. I'd heard bits about it but now I feel more like I can thoroughly appreciate it.

[@StudioBinder]

Happy to :)

[@andrewreynolds912]

The mandalorian was the first series at least to ever use back ground TV led screens than green, and it was absolutely game changing

[@StudioBinder]

one of many great things about the show

[@andrewreynolds912]

@@StudioBinder yup it was revolutionary for the time

[@r.c.c.10]

The main problem is the space constraints. The volume, as they call it, will probably never replace a well done and lit blue/green screen. The sets in the Mandalorian feel fake, restricted and flat. Everything is at ground level. When you get accustomed to it you can clearly see the rounded background wall.

[@fernandomaron87]

​@@r.c.c.10 Agreed, also films like 300 or Sin City could never be made like that, only by blue/green screen.

[@christiandebney1989]

I know from a reliable source that every single VP shot on the mandalorian was rotoscoped and replaced with CGI backgrounds.

[@wiuwiu9820]

VP is an amazing tool for filmmakers to create an environment that's hard to find or go irl. For eg, I have to find a certain apartment that has 2 blocks facing each other with a certain kind of color in a certain kind of place or hue or whatever, VP will make this process faster by removing the process of location scouting and helps us to save our time and money. There's so much more VP provides like it removes the unnecessary noises that you can find when you are shooting outdoors like the cars and whatever since you are shooting on set. I wish this technology will be more accessible for all filmmakers cuz it helps so much

[@StudioBinder]

all great points!

[@EVOlutionHTC4g]

The possibilities and the time and money savings are huge! You don't have to get a location permit, stop or monitor traffic, deal with delays due to wrong weather conditions. The list goes on and on😉

[@StudioBinder]

Hopefully it'll promote more mid-budget films

[@hglankshear]

Sounds cool for the future! Currently for most productions LED screen virtual production is more expensive than other methods, but with wider adoption I'm sure this will change! Though if you have to film with children or in many different changing environments there are situations where it becomes cheaper! Crazy world we live in

[@JustWasted3HoursHere]

Pretty impressive that turn-key virtual sets for amateur filmmakers are available (starting at) under $10,000. Pretty cool. I heard that the "Volume" used by Lucasfilm costed about 20 million dollars to create...

[@StudioBinder]

Will love to see what indie filmmakers produce with this tech in their hands

[@JustWasted3HoursHere]

@@StudioBinder Indeed!

[@toptrends88]

Been waiting for this. Thank you for the awesome explanation.

[@StudioBinder]

Thanks for watching!

[@bostonbravenec]

Honestly, this sounds like a blast to use. I'd just be stoked to stand in the middle of one of these sets.

[@StudioBinder]

It's awesome!

[@stephenwilliams3807]

James Cameron has a history of innovation and development that places him at the forefront of people who have pushed the industry forward. He has never allowed himself to be constrained by existing technology. It will be, perhaps, his greatest legacy.

[@StudioBinder]

Agreed!

[@harrisonsmovietributes1689]

This channel is my film school! So insightful and covers everything you need to know. Thank you StudioBinder

[@StudioBinder]

Thanks for watching!

[@lpentertainment7995]

Personally, I love the idea of vp. As an amateur filmmaker with a rediculously low budget, I really like the idea of framing an lcd screen for a window shot.

[@StudioBinder]

It would be a worthwhile investment

[@omdeeppabla6111]

Definitely the future of film making. Challenges that need to overcome are the ability of the camera movements and creating realistic imagery that can look very real. One step and technical advancement at a time.

[@StudioBinder]

Excited for the future

[@PatrickDuganOFFICIAL]

This is the best explanation of the virtual LED wall I've seen yet. Thanks.

[@rayancedrichaddad1197]

Spectacular! Thank you StudioBinder for this Inspiring video.

[@StudioBinder]

Glad you liked it!

[@craigthebrute6032]

Glad to have our suave Englishman back for the voiceover.

[@StudioBinder]

✔✔

[@powerfist80]

The O.G voice is back!!!!🔥

[@StudioBinder]

👍👍

[@CarlosVixil]

Seeing these compilations makes the limitations more apparent. Lots of closer shots, and like they mentioned, limited movement. Feels like a set, moves like a set, is a set.

[@smlambert2]

Welcome back!! Not saying the other voice over guy was bad, but just missed the accent!

[@StudioBinder]

We work with multiple narrators!

[@RoodeMenon]

Such a clear explanation. Great job. Also, a cheaper alternative is rear projection instead of led screens but its dimmer with lesser light falloff.

[@steemboat]

I think when it comes to stylized or what would be insane budget locations, VP is an amazing tool for allowing the cast and crew to visualize the scene, rather than having to imagine it. Though, I also believe that shooting in actual locations are the most realistic option if available. Plus, it's always fun to scout out locations.

[@TheWrathfulSlayer]

Virtual production is the future of shooting a film and the use of it will revolutionize the way we make films thanks to constant technological updates and innovations!!

[@StudioBinder]

We'll see!

[@Gho5tKni9ht]

now i understand why those high priced screens are for, love every episode of "what is" ♥

[@StudioBinder]

Thanks for watching!

[@TUCOtheratt]

This is very interesting and an improvement on green screen but location films are still much more interesting.

[@twistoflime]

VP has arrived at the right time to meet the insatiable appetite for streaming content.

[@tellabee1851]

This is indeed the future. Thank you always studiobinder

[@PedPaul]

I always learn so much from StudioBinder videos. Thank you so much!

[@lonerblader85]

Studio Binder never misses 🙌

[@StudioBinder]

Cheers!

[@eminosose]

Virtually the best channel on KZbin 😏😏😏😏😏

[@StudioBinder]

Virtually and practically we hope haha

[@metalgamingwarrior2714]

Absolutely Fantastic! Verily the future of filmmaking. My producer sent me this video, and I'm definitely in.

[@MagneticDonut]

Unreal Engine is really powerful, which other 3D software is good for vp? Perfect video as usual, thank you SB team!

[@3dchick]

Using Unreal now, and the only other I'm aware of, altho it's back to green screen, is Blender. I think Unity is moving in that direction, too, after they bought Weta, but Unreal is lraps and bounds in first place.

[@MagneticDonut]

@@3dchick wow didn't know they bought weta, that could yield really interesting results! Thank you for the insight!

[@3dchick]

@@MagneticDonut You're welcome. I want to say it was about a year ago. ☺️

[@StudioBinder]

There are other programs that can create 3D elements in the shot, but Unreal Engine is really the only thing people are using for virtual production like we showed here

[@WhyteLis21]

This tech is probably best advancement for many flim makers and especially, actors who just don't like green or blue screen acting.

[@madnessbydesignVria]

It looks like a very valuable tool with significant plusses. But I don't see it completely replacing outdoor shots (at least for awhile), for some of the reasons mentioned (difficulty emulating direct sunlight, limited space on a soundstage, limited camera movement, etc). Still, there's no reason you couldn't mix and match to get whatever your production needs. I'd love to play with it... :)

[@StudioBinder]

It'll never replace real locations, we were comparing it to other techniques that simulate environments like green screen

[@madnessbydesignVria]

@@StudioBinder Right, that was the feeling I got. It certainly has its place, and the tech will only get better. It's a cool option to have... :)

[@projectmorfeo8451]

I actually use Unity engine to create a virtual set, where I place my actors from 2D planes. One issue in the mentioned LED screens is that is more expensive to get than a huge green screen room, but later you pay it on the post compositing. All of this is quite fascinating. Just remember that in most big budget films, like DUNE they construct real sets for a lot of scenes. One huge difference on having a surrounding huge LED screen is that the reflections are cast on the actor, while in mine, its limited as it is a 2D plane. My actor do cast shadow and reflection, but its a plane, it lacks the volume.

[@soorya7lk]

This is one of the best channels ever .

[@FroddeB]

"Live-keying" is also a type of virtual production. You don't always need LED walls to create a live recording with a final output, while LED walls make the image look better because of the lighting it's still a lot more expensive than a simple green screen. The cheapest virtual production method is live-keying, using softwares like Aximmetry will give you a really good key as well.

[@blallatef]

Do you know how much I have waited for this episode

[@StudioBinder]

Hope it was worth the wait!

[@LamondoHillII]

Amazing video, thank you for putting it all together. I would be lying if I didn't mention its a bit overwhelming. Its so difficult to keep up with everything changing in the world of filmmaking.

[@metabugs7702]

We are working with VP a lot now in natural history shoots, it's been fantastic and is becoming quite the norm now, both with LED screens but also by using the unreal on a Terrace high res tv screen. Definitely feel that this is the future or at least another tool for us to use.

[@stayprofessional2453]

I was not prepared for that opening

[@StudioBinder]

😅

[@BBoy_PopTart]

Wait, do a video on the availability of virtual production sets made to order, that sounded amazing.

[@zez_gval]

It must be amazing to work with led screens, but is important that directors don't get too accommodated with that like some did with green screen, because although is more realistic most of the time, the limitations like space and sunlight can still ruin a good scene. Not to say you need to plan everything very carefully cause is harder to "fix in post" if necessary. Also, filming in the real world and with real built sets might be a lot more expensive and bureaucratic, but is always more fun and adventurous.

[@mobetstudiosx]

I can’t wait to get into Hollywood film production

[@MakerSchoolTV]

I made it mom ! I'm in the video ❤

[@theshubhamydv]

I am eagerly waiting this to arrive in Indian Film Industry. So, we can experience it.

[@StudioBinder]

Excited to see what you guys do with it!

[@WeeMoDesign]

Thank you very much for all the explanation. I had to read on Virtual pRoduction in Production Pipeline Fundamentals and I had a hard time visualizing what it really was. Very good video and informations on the subject

[@LeiDavidChen]

The first time someone put up a green screen and said, "We'll add that part in post," it completely changed film production. We've been living in that world for over 40 years, an entire career for some our colleagues in this industry. The interesting part in the craft of virtual production is that it's conceptually a return to Old Hollywood shooting, where all shots just had to be planned out with creative solutions beforehand and then entirely and practically actualized on set. Then we just edit, color, sound and deliver. With tools like simulcam, LEDs, XR, etc., we are conceptually moving more towards WYSIWYG shooting, so workflow stages like digital assets need to shift way earlier while previz and techviz need to be far more rigorous and accurate. It seems appropriate that the most notable VP example is still a Star Wars series, considering the original three movies pushed practical effects to new frontiers in the 70's and 80's, while the prequels did the same for green screen in the 00's.

[@mudflapsmoviereviews]

The Mandalorian really changed the game for the movie and tv shows going forward! This is the way.

[@JLOFlix]

Absolutely BRILLIANT explanatory video! WELL DONE!!

[@neo_bellic]

Green screen isn't going to end, but will probably used for smaller productions and some specific kind of scenes.

[@StudioBinder]

Time will tell!

[@fernandomaron87]

A film like 300 could never be made without green screen, neither Speed Racer or Sin City.

[@hglankshear]

Definitely! One of the main issues is that LED walls only look convincing in certain lighting situations. We currently have no proposed solution to a variety of lighting situations like having large light sources like the sun look as realistic on an LED stage as opposed to other filming conditions.

[@stefansteff13]

​@@hglankshear Yes, and nobody is talking about it! No high speed shots also. LED entry level price tag is 100% more vs green screen. Background always has to be out of focus. You cannot pull the focus on the LED wall itself. No post prod is true, but time required to prepare the environments is quite substantial.... Not to mention that you can catch moire effect and then post production is required...

[@juanda_4795]

I love the voice behind this video

[@happyhour1517]

This was very informative. I think it’s a great new discovery. As an actor that would help me greatly so I would have to use my imagination to see what’s going on, but I could see where I am and what I’m looking at would make it easier to let go and let my emotions flow easier. This is fascinating and I think it’s something that’s not gonna take over completely meaning we will still use locations and we would use this new technique. It’s wonderful that we can combine do with old. Again, thank you for this informative video.

[@shenogood]

I can’t believe you guys used “The Room” in this edit 😂

[@StudioBinder]

Had to use a classic

[@IShowRomania1]

This is very interesting and the editing makes it more enjoying! Great job!

[@StudioBinder]

Glad you liked it!

[@matthewcole4753]

Crazy that the Wizard of Oz tornado scene is not mentioned despite being just that! Most realistic tornado shots in movie history!

[@user-yl4lf9mh1w]

lol I loved the Dirk Diggler scene at the end.

[@MrBluekat69]

Very interesting as always. Thank you StudioBinder : )

[@StudioBinder]

Cheers!

[@keithwaynejones]

i want to be a part of the film industry! i’d love working on a set. even if i was just doing mindless physical work not making much i’d still be happy

[@lualejo2015]

This is a great video! I learnt a lot of things! Thanks for sharing!

[@StudioBinder]

Thanks for watching!

[@R3TR0J4N]

Saw it utilized in The Batman, it was handy during COVID quarantine

[@theironclads]

Absolutely stunning and revolutionary!

[@hikaritsumi2123]

I think the biggest strength of VP is the fix of eye line problem, you're supposed to look at "something" on green screen so.. where is it? Also I think it's good for a natural low-light scene, since you have limited time to shoot at dawn/dusk or difficult lighting in low light area in real location.

[@antimatters6283]

While there is an upside to this, it also locks complex issues of visual effects into a shot. Everything has to be figured out and prepared ahead of time, with priction, first unit intense deadlines. While that is normal for physical sets that might get by with some parts not being done, for these CG sets, anything not done may turn into a bigger problem. The visual effects pipeline, occurring before production (rather than in post), is a huge change, and it also prevents directors from changing VFX later in post. That has advantages and disadvantages.

[@HenryLoenwind]

Not quite. Every part of the background that has no real element in front of it can trivially be replaced. The camera is tracked, so changing the model and re-rendering the camera's view, then roughly cutting out the actors, is trivial. The seam between the camera picture and the rendered picture is quite small, basically just the errors introduced by the real-world screen not being exactly where the computer thinks it is and the real lens not being perfect.

[@antimatters6283]

@@HenryLoenwind What you describe is exactly what virtual sets are supposed to avoid: camera tracking and new VFX in post. The goal is to get the shot in camera, otherwise this is like any VFX shot through traditional post methods. That is the promise sold to studios and directors, that they don't have to do this. It isn't previz, it is finalled in the camera.

[@pedroesteves3018]

Lubezki used a less sophisticated Volume in Gravity, 'The Light Box', to match the lighting from the cgi sun and stars in the actors faces

[@StudioBinder]

It was well done!

[@adzero]

I love when they use The Room as an example 😂

[@StudioBinder]

It's a classic

[@Ayogenius67]

This the new one invention and I have already loved it

[@StudioBinder]

It's making waves for sure!

[@nirmalyasengupta9013]

Amazing.. recently was read the article of Media Monk agency regarding this subject

[@hornet718]

Like WOW!!! To see it in context, this is great!!! I would like to see more about virtual production, specifically if you can upload a virtual Unreal environment, can you upload a B-Roll environment? Do you need a 3-D aspect or will 2-D work the same? So like walking down a city street and you film it with a camera, could that be uploaded or would this have to be created in Unreal to simulate the street? Whatever the answer, this look into the virtual production is both fascinating and daunting. I feel overwhelmed as a novice filmmaker to learn and master one more technique but also intrigued to learn it. As Ben Kenobi said in "A New Hope", "You have taken a step into a larger realm." Thanks for the video!!!

[@StudioBinder]

Thanks for watching!

[@hglankshear]

To upload the video to unreal you would have to use photogrammarty and lidar to convert the video to a 3d mesh. LED walls monitor the position of the camera and change the what is shown in the background accordingly to get accurate parallax. So unless you are planning your shots in accordance with the angle of the video you've taken, this wouldn't be possible without building a 3d environment of some sort.

[@prabhasyadav03]

Man! Kudos for your hard work and kindly watch “Dasara” movie by Srikanth Odela it’s a Indian Film(Telugu language) 🇮🇳 for sure it’s a fest for movie lover we’re waiting for yours explanation and breakdown love from India ❤

[@StudioBinder]

thanks for the suggestion!

[@idanlewenhoff2295]

its interesting to see the use of this technology vs green screen vs shooting in real places. also the combination of the unreal engine and nanite are truly on another level, some people are fricking hard working geniuses. i would assume this also makes the filming time and costs much easier, and also might make it easier for actors as youve mentioned in the video. just a follow up question, do you know who invented this?

[@StudioBinder]

I don't think the concept of VP was created by one person as it involved prior tech like Unreal Engine and LED screens. But The Mandalorian seems to be one of the first mainstream projects that put the whole thing together

[@hglankshear]

As of the current situation for most productions switching to VP is not cheaper. However, for the productions that have been using it so far have a unique set of circumstances that make it cheaper.

[@brettcameratraveler]

We are creating a kind of hybrid VP technique. The lighting and reflections of LED walls but it appears three dimensional to everyone on set yet has the flexibility of relighting and comp, if need be in post. VP, as it is done now, will evolve to not require as much preproduction time. It will need to in order to become more widely used.

[@StudioBinder]

Can't wait!

[@sadness212]

Great video as always 💚 please Focus on writing Topics

[@SupamChang]

Very well explained topic with clear concept 👏👌👍

[@JacobPatrick1]

I'd never argue with the GOAT Deakins but I might ask the question... What if the stage was larger and the screen was larger and the entire floor was a giant treadmill?...

[@BakhtiyorKarimov]

I think this is the future of filmaking

[@StudioBinder]

It'll definitely be a part of it!

[@lucinematic]

I will wait until this thing will be very affordable :)

[@StudioBinder]

May come sooner than you think!

[@brandbird]

Like always, the future of filmmaking will be a combination of both new and old ideas, techniques and technologies.

[@StudioBinder]

The evolution continues!

[@ZawadSamadsCrafts]

Make a video about framing, I mean I don’t know if it is called framing or not but I mean like the actor is looking at the right so the camera needs to leave more space at the right. Make this video where to leave this space, when and why

[@3dchick]

Unreal is amazing, and free, which is more amazing, but if you're new to it, just know there is a huge learning curve, so be patient. 😇

[@StudioBinder]

Yup, but worth it if you're all in!

[@3dchick]

@@StudioBinder It absolutely is!

[@abbysnation5245]

This was my thesis topic thanks a lot helped me very much .😎💯👽⚔️⚔️⚔️

[@gonzalogolpe]

Very instructive. Thanks! 👍

[@StudioBinder]

Cheers!

[@PakeSalmon]

LOved watching this!

[@StudioBinder]

Great to hear!

[@mehtacotute]

Seems like quality control is very important. So many disney projects have been trash using these LED ones

[@-of7mb]

You guys are the best !!

[@beargeistdesign5174]

'its a diffuse light because of the distance'; is this because of the limited contrast ratio you can produce in the medium/ at the distance? and the fact that its probably not perfectly matte, so its reflecting light back?