The Virtual Production of The Mandalorian Season One

A behind the scenes look at the groundbreaking virtual production technology used on The Mandalorian, Season One.
Over 50 percent of The Mandalorian Season 1 was filmed using this ground-breaking new methodology, eliminating the need for location shoots entirely. Instead, actors in The Mandalorian performed in an immersive and massive 20’ high by 270-degree semicircular LED video wall and ceiling with a 75’-diameter performance space, where the practical set pieces were combined with digital extensions on the screens. Digital 3D environments created by ILM played back interactively on the LED walls, edited in real-time during the shoot, which allowed for pixel-accurate tracking and perspective-correct 3D imagery rendered at high resolution via systems powered by NVIDIA GPUs. The environments were lit and rendered from the perspective of the camera to provide parallax in real-time, as if the camera were really capturing the physical environment with accurate interactive light on the actors and practical sets, giving showrunner Jon Favreau, executive producer and director Dave Filoni, visual effects supervisor Richard Bluff, and cinematographers Greig Fraser and Barry Baz Idoine, and the episodic directors the ability to make concrete creative choices for visual effects-driven work during photography and achieve real-time in-camera composites on set.
The technology and workflow required to make in-camera compositing and effects practical for on-set use combined the ingenuity of partners such as Golem Creations, Fuse, Lux Machina, Profile Studios, and ARRI together with ILM’s StageCraft virtual production filmmaking platform and ultimately the real-time interactivity of the Unreal Engine platform.

[@lifeinsf]

"The ability to shoot a 10-hour dawn" was the real eye-opener for me. Shooting a sunrise or sunset always seemed like such a time-sensitive crap-shoot, and now you just film/create the perfect moment and re-live it as many times as you need. Incredible.

[@qqqfuzion2582]

Good point. This is litteraly revolutionary for filmmaking and it isn't even a film! That said i beleive this technique has been around since the film oblivion if I'm not mistaken.

[@thebacons5943]

lifeinsf it’s Truman show technology... but good!

[@TeddyLeppard]

It’s a major production advantage for Disney-Lucasfilm and I predict they’ll be rolling this out across all of their movies.

[@DanteYewToob]

It's basically those cheesy old Star Trek style sets taken to a crazy futuristic level! Imagine this used for films like 300 that were filmed almost entirely on one stage in green screen, or films set in really logistically awkward locations or times. This is absolutely a game changer, especially with the game engine where they can alter stuff in real time. Amazing! You can have as many dawns as you need and throw a second sun in there if you want in real time!

[@mitchellp7739]

Quantum Fuzion Animations oblivion’s tech was similar but not dynamic. Rogue One used Oblivion’s tech too. That was just pre filmed or created scenes that were projected on screens behind the actors or sets. This new tech is fully dynamic and changes the background perfectly depending on how the camera moves. So same idea just not as dynamic as this

[@525Lines]

The disney+ page for mandalorian has only the trailer. They need more stuff like this. Documentaries, commentary ...

[@nivekian]

if we are not getting a blue ray, then load up channel content, indeed

[@collinsmin]

facts

[@ZachBobBob]

All the streaming services need to start putting special features on there. We miss out on them when we don't get blu-rays

[@Justin-nx3pw]

525Lines Disney+ still has many shows, on their app, with their episodes wildly out of order.

[@writerpatrick]

While watching the Toy Story 4 commentary, I was thinking that adding a commentary to the Mandalorian would be a cheap way to add content to their most popular show. It would give fans hours of new content to watch.

[@b1icky]

"We really wanted to take Star Wars to the next level, so we built a holodeck."

[@chwenhoou]

Somewhere, Gene Rodenberry is shaking his fist in anger.

[@jeffreyhaas]

If you're gonna paraphrase, you don't need quotes

[@Jan_Strzelecki]

@@chwenhoou Why would he do that? Isn't that the best possible acclamation he could get?

[@thomasjuniardi3559]

What in the hell is holodeck ?!? 🙄

[@alex2363]

@@thomasjuniardi3559 It's something out of the Star Trek universe, it's basically a room that can create environments, plants, people and even bring books and films to life. Gene Rodenberry is the man who created Star Trek in the 60s. :)

[@beckamodeo9045]

most developers overuse the word "mind blowing" but this is actually mind blowing. using a game engine to make the sets is genius!

[@tcg1972]

@@chinesecovidanalswabs4752 There's always one. Hi one!

[@pem3480]

@@tcg1972 make that two :)

[@user-ic7dn8wz5j]

VFX is a complicated profession.

[@RoodeMenon]

That is why it requires thousands of talent synced up around the world.

[@fatleg1000]

This is the way

[@jedipolaris2312]

“Wouldn’t you agree?”

[@qqqfuzion2582]

I can render you hot... or i can render you cold.

[@Digital111]

You have spoken

[@dindjarjarin]

I honestly thought these scenes were shot on location, and I have a 4K tv. This is awesome

[@boxingbull523]

I thought so to

[@raimee81]

Herzog's office completely took me by surprise! The others i could imagine being projections.

[@dustinakadustin]

I agree, the scene at the start of ep 2 walking through the caves I though was a real location.

[@danzelhill]

Man, and we in Germany still waiting for this release. Not one single episode yet. T_T

[@rutgervandesteeg]

oh you have a 4K tv... I'm so jealous..

[@angrydalek]

Everyone thinks Star Wars is George Lucas’s only Legacy. Without George Lucas, there’d be no ILM.

[@eatyrghost]

Honestly think ILM is his greatest contribution to movies. Their hands have been in so many pies, and till WETA, they were unequaled.

[@MrDukeSilverr]

@@eatyrghost and now they work together

[@jdrukman]

Don't forget Pixar.

[@skycat04]

Don't forget about Skywalker Sound...

[@AndersMundtDue]

Star Wars is the byproduct of his Legacy

[@ZachFoxPhotography]

there are some extremely cool moments in here that they don't even talk about...! like the moment at 3:40. as the camera moves, the geometry in the background on the LED wall shifts to create a very specific kind of shot that only works when viewed from the 2d perspective of the camera. that is some incredible attention to detail. i love it!

[@mrclarky]

I know right! I wish they would show us more of these shots, I could watch all day!

[@Nautilus1972]

But it's just a game engine, in a sense that's been around for 20 years.

[@treeinafield5022]

@@Nautilus1972 the game engine part isn't the impressive part of this thing you're missing the point, it's the combination of different technologies to for this application

[@jackbarbey]

I know! The parallax shift tied to the motion of the camera is what makes it work so well, and they never even mentioned it. Those final shots they showed looked amazing.

[@joco9958]

in combination with an optional movable green screen for when the background is too lowres kzbin.info/www/bejne/qqG4emurhNh-iq8

[@retroverdrive]

This is the way.

[@johnnydiabetes6563]

I’m gay

[@retroverdrive]

@@johnnydiabetes6563 I know you are! xD

[@johnnydiabetes6563]

EndGamer93 I don’t remember you being such a fat piece of meat

[@retroverdrive]

@@johnnydiabetes6563 EVERYONE knows, being a fat piece of meat is THE WAY! 😉

[@retroverdrive]

@Bere18 Random Put the 🧀 in 🍔, it is the way.

[@checotey]

come on guys, this report of new technologies you came up with, would have easily filled a 60 minutes video, at least. we love to watch these videos, so come and help us out here!! but thx 4 this video though

[@BigManJD]

I agree, Peter Griffin.

[@sanschungus5496]

I agree copylike pewdiepie

[@LukeLetellier]

Get the next print Edition of Cinefex; they'll have a deep dive into it all.

[@yungchum2073]

I can agree with this comment on so many levels.

[@pian-0g445]

checotey they didn’t actually come up with this, it was first used a few years ago, but they’re definitely the first to use it to such a degree that it shines its advantages.

[@Leprechaunproduction]

I love that line about being able to do sunrise shots for ten hours; this really is a game-changing technology, and I can't wait to see where it goes. Even better, I can't wait for the inevitable home version that will let hobbyists and amateur filmmakers create their own epic sets without having to spend thousands upon thousands of dollars on props or location shoots.

[@AllThingsFilm1]

Yes! I, too, would love to see a "home" version.

[@creole533]

It’s probably a matter of time before some guy builds one of these in his basement. And then never leaves it!

[@JasonCobble01]

Considering it's been speculated to cost over $20 million for their screen alone. It'll be a minute before I can afford even the basement version. I don't even own an LED TV yet.

[@toqkaizogou1636]

@@JasonCobble01 It may be a while, but I have faith in time (even be it a few decades), technology will develop to allow for a more affordable one that can achieve today's quality of the expensive one.

[@JasonCobble01]

@@toqkaizogou1636 for sure! I thought about this method a few years ago when I went to school for VFX. I didn't expect it to be used so soon simply due to cost. In fact I've recently played with the idea of using unreal engine to generate the background for green screen rather than traditional CG rendering.

[@StarWarrior91]

Knowing how it’s done the final product still completely fools me. It looks 100% real. Congratulations

[@superdougie4637]

This is almost like a real life holodeck! Incredible!😮

[@CaptainJackMorenzo]

one step closer.

[@SquidkidMega]

computer...freeze program

[@blenderguru]

Incredible. This might replace the green screen one day.

[@donajello]

4 likes and no replies...

[@culturesex3803]

No replies

[@donajello]

@@culturesex3803 No replies

[@leonardosouza2153]

One day?

[@SahilP2648]

It already did for this show

[@adolfopena7358]

This NEEDS to win the Emmy for Best Visual effects. And I also want a nomination for Best Original Score.

[@ZakEmber]

I work in Los Angeles in TV and Film, and I can NOT overstate how game-changing this is! This has the potential to re-write the book on filming big-budget shows. So much time is lost in a day due to rearranging the lighting, cameras, actors, etc. With this technology, you move the WORLD. It's incredible, and it's only going to get better!

[@Nardril]

Crazy that realtime graphics have come so far

[@DanteYewToob]

Holy shit. I'm almost speechless. That is absolutely incredible. It reminds me of the cool sets used for Oblivion but taken to a whole new insane level. I absolutely need to go rewatch the show now and see if I can tell where this was used.

[@Lumibear.]

Yes I thought of oblivion too.

[@EmoChicken746]

My mind is blown away, I actually thought it was a full outdoor set

[@kotkaconforza]

Oblivion came to mind, as well. Also the mountain office in Spectre was shot using gigantic translights.

[@AbiNubli]

Because they are the same people who build virtual sky in Oblivion. The difference is back then they use projectors

[@optillian4182]

You guys have been a part of the franchise for more than 40 years, and I'm thankful.

[@jonchan8990]

This is why ILM is the best, they are the pioneers and innovators who continue to excel.

[@lucatorta2992]

ILM proving once again to be the absolute Grand Masters in terms of VFX. with you guys, Jon, Dave (true visionaries like George) and the rest of the crew, Mando is in very good hands. This is the way!

[@sampsoninc916]

I agree with you. They're the grand champions of VFX. Question is, why do so many big movies go to the MPC, or Moving Picture Company in London to do the VFX instead of ILM? What's wrong with ILM? Are they too old school?

[@notoriousblt1038]

Jordan White price probably

[@RAYtheMEME]

@@sampsoninc916 Time Constraints. Price. And also specialization. ILM has always been a game changer for Environment and Hard Surface Art but character and stuff are done by WETA or framestore cuz they're much better at that.

[@mitchellp7739]

Jordan White Most movies use many different visual effects houses. For example, avengers endgame had about 10 different visual effects houses working on it because each one specializes in certain things

[@skycat04]

@@RAYtheMEME nope, they are definitely not "much better" in character animation... maybe WETA, but only by a tiny, tiny bit... Gemini Man had some truly disappointing shots of the digital Will Smith (which is a recent example)... Framestore and MPC and Double Negative are simply not in the same league as Weta and ILM, even if they are very good in their fields.

[@rade-blunner7824]

So this is the thing Bill Burr's been raving about in interviews. I've seen examples of this done before in recent years, but onto a single, flat wall, not to this scale. That it could be also used to actually create the insides of a room is surprising, doesn't it mean the projected room is actually smaller than the space it's projected into? I suppose that doesn't matter when it's tracking the camera position. For all the talking in this video, which is clearly a promotional tool for this technology, I feel the visuals didn't actually demonstrate what was going on very clearly. I guess this is intentional?

[@peterjoyfilms]

What part of the process is unclear to you?

[@Orangeflava]

@@peterjoyfilms how do they adjust for loose hair? how long does a scene need to be adjusted (e.g. removing the seems of the canvas and cameras) and replaced before it is in its final state? and how many people does it take to do one scene?

[@OskarHelgason]

There is an extensive article from ASC about this: ascmag.com/articles/the-mandalorian?fbclid=IwAR3YSSTgs_AELdOONXxpgfURGmn4bWpO16Vgeb-0ONuvnN5qi3sh_Irt928

[@Spencer635]

It's not a projection, the images on the walls are 100's of big screens all connected to look like one, playing video from the unreal engine in real time, that data is also linked up with the camera and changes the perspective of the background in real time.

[@supervegeta101]

@@Spencer635 looks like Unity to me.

[@JerkyMurky]

The fact that this and the prequels where both nearly entirely shot in sound stages, digitally, is amazing... considering that with every shot in the prequels you can tell, but until right now i had no idea you where not shooting on location.

[@CinematographyDatabase]

so happy they released this BTS footage

[@uipex9333]

Yeah

[@rjkzbkfy9665]

This is freaking incredible. I thought they were shooting in real desert location when it's not. When it comes to visual effects Favreau is truly a master.

[@JudgeFudge57]

Well.... ILM is the real star but Favreau did envisioned one magnificent show !

[@JasonRasmussen]

Epic Games and their revolutionary Unreal engine.

[@rjkzbkfy9665]

@@JudgeFudge57 I know a lot of ILM workers should be praised for this also.

[@_MaZTeR_]

Prequels or the original trilogy with this short of tech... Would be a dream.

[@delicious9905]

_MaZ_TeR_ well for what they were they were incredible

[@thebacons5943]

_MaZ_TeR_ if they prequels had these effects and a steady hand like Favreau to adapt Lucas’ vision they could have been really good

[@milddiffuse]

I don't think it would've really made much of a difference. CGI backgrounds still have to be made with the same amount of care as back then, they are probably even more used here than in the Prequels, since it used many miniatures for Backdrops. The only thing this tech actually improves is lighting on the non CGI objects and people which I never found to be a problem in the prequels, plus I guess easier immersion for actors.

[@_MaZTeR_]

@@milddiffuse It makes a lot of difference. Lighting technology has changed a lot since then.

[@JoseCruz-dk3fi]

Im sure they can re-do the prequels CGI to today's standard and they would be absolutely breathtaking.

[@Mautar55]

Now reflections in the armor and other shiny objects are reliable! Imagine how awfull they would look if they had to rely on a blue screen. Truly nailed it.

[@dustinwashere]

This is revolutionary. There is no longer an excuse for cheap or bad backgrounds in large productions.

[@musikafossora]

dustinwashere I wish they’d had this technology on a larger scale when Attack of the Clones came out-some of the green screen work has not aged well.

[@kinja73]

More BTS content for Mando, please! Also, major kudos to Favreau, Filoni, and all the vfx geniuses responsible for bringing this series to life.

[@jonathanxdoe]

Imagine tracking your head as virtual camera position and having a multi direction treadmill...

[@mikeflannery7905]

A real life holodeck. I bet we're within 10 years of it actually happening

[@I_am_ARTBOT]

Already been done. Tried one a year ago at a trade show. Wore VR goggles while standing in a shallow bowl-shaped unit, with a belt-high fixed hoop about 3 feet across, wearing a belt harness, hand controls and slippery foot slides attached to feet. It wasn't as clunky as it sounds. Got to run around the surface of Mars! ;-)

[@FindecanorNotGmail]

I did it twenty years ago at university. We used shutter-glasses with motion trackers. Much lower graphic fidelity back then. Used projectors on frosted glass in a dark room instead of LED displays.

[@realpauldano]

have you ever seen ready player one?

[@gigatronusprime]

@@realpauldano I've read it and watched it, and I'm hyped for the sequel

[@kaerus7096]

This is the future. We've made it. This is the most insane technology I've seen in the film industry.

[@PinkiePyro2011]

There's gotta be some sort of irony that a real life *holo-deck* was developed to film _Star Wars_

[@kjw79]

Haha true!

[@jorgepeterbarton]

But imagine in decades where we participate in holo-programs, like in ds9 or voyager...but this production is what started it (its coming well before warp drive that's a certainty. We'll likely never have interstellar travel tbh!)

[@StudioArtFX]

Man, I need to watch this video, like, 17 times! I can't catch everything that goes by so quickly. I still can't believe some of what I'm seeing. Even some of the *interiors* are on that screen?! Amazing stuff. I can't wait for season 2 or any other shows that use this tech!

[@trishapickelhaupt7772]

Hello! I'm working on a project and wondering - If you were able to see more about the process behind these technologies - what facets of the production would you be interested in seeing?

[@StudioArtFX]

@@trishapickelhaupt7772 If you're creating a video about this technology, I would like to see more of the front end of this method of production, initial setup of the video wall/dome, how to hide seams, size and resolution of each screen, for example. On the Unreal Engine side, I would like to see the integration with Megascans, the camera tracking mechanism, (does it work with multiple cameras?) and the specs of the computer, number of GPUs and memory etc.. Also, from an HDR standpoint, I would like to see what the limits of interactive lighting might be. I will note, though, that in the nearly year since this video came out, Disney has released a good amount of behind the scenes materials on their Disney Galleries series on Disney+ and new material for season 2 is coming out now.

[@trishapickelhaupt7772]

@@StudioArtFX Thank you so much for your reply!! This is so helpful. I appreciate it!

[@Bladerunner93]

When I first heard that most of The Mandalorian sets were done by computer graphics, I was a bit disappointed 'cause I felt doing that led to the unconvincing parts of the prequels (i.e. how the actors admitted it was difficult to act when all they could see was a blue/green screen etc.)...but now that I realize that they basically constructed a holodeck, I'm impressed and look forward to seeing what they do with it next!!!

[@arrowheadwaterbottle6815]

Did you know the Prequels had more practical effects than the Original Trilogy? Heck even The Phantom Menace alone had more practical effects than the whole OT.

[@lameduck1690]

@elPinguino The prequels were not perfect. The acting in Attack of the Clones, for example, is definitely not perfect. Jar Jar's animation is bad. But a lot of the effects in the prequels were great.

[@larniieplayz6285]

Aleksandr no

[@TheKenji2221]

@@lameduck1690 Are you kidding ? When TPM came out, JarJar was the most impressive 3D character "on set" with real actors ! Of course it didn't age well, but at the time it was impressive !

[@saricubra2867]

Because green screen was a novelty at the time.

[@WCGwkf]

It's amazing how good it looks when the behind the scenes camera pans up and shows the boundary of the screen and it still looks real

[@blammod664]

Jon Favreau needs to run Lucasfilm. He has the credentials, he has the skill, the talent, and most importantly, the VISION.

[@churlish_hambino]

DAVE FILONI though..

[@blammod664]

@@churlish_hambino I love Dave but I wouldn't want to ask him to run the entire ship. But I would love if he was head of creative or something and still worked closely with Jon.

[@blammod664]

@2freeIvX You don't seem to be aware of his career. He is a director, a writer, and has been a PRODUCER SINCE 1996. He has all the skills and experience necessary, and most importantly, he has creative vision.

[@ma2443]

after watching all the episodes 100 fucking percent.

[@davidroberts3262]

Dave Filoni for creative story overseer. Jon for managing all the directors.

[@Nick-kz6dg]

"Just like the good old days" HECK YES! Once again, ILM and Star Wars is advancing the next generation of film making.

[@night1hal1]

0:30 4:28 Let me hold the ACTUAL Bab-Yad puppet, and stand in front of the hyperspace wall, and I will give you any amount of money, Disney.

[@abdmin3268]

its animatronic, i though it is cgi

[@flamingarrow2474]

@@abdmin3268 combination of both, mainly puppet

[@creole533]

FYI, Hasbro announced preorders for an animatronic plushie version of Baby Yodes, that should be available by Christmas. They announced it yesterday, so it’s probably sold out though...

[@_GeneralMechanics_]

Fake environment, REAL Muppet! Jon Favreau needs to tell George Lucas "that's how you're supposed to do it!"

[@Sarchitekt]

@@creole533 they haven't gone on pre-order yet. there's still time

[@cambritton]

My mind is blown. The realization is so good, I assumed this show was shot on location.

[@YT--um6mu]

This work of art should be nominated for oscar.

[@diogocatalano9557]

The Mandalorian has everything: Heart, soul and visual quality.I wonder if Star Trek will have someone as Favreau in charge someday.

[@Texticles]

I saw something similar to this at CES this year at the Sony booth. They had a much smaller setup of course but it was still insanely cool to see in person. Sony had the original Ghost Busters car in front of of one of these LED walls with a camera that was motion tracked to it. It looked so seamless in person. Absolutely incredible technology.

[@steprockmedia]

This is a breakthrough. To see it being used like this and in conjunction with game engine software??? Genius. It's the biggest thing since green screen, I'm sure of it.

[@Texticles]

steprockmedia Agreed. ILM has always been and always will be one of the most innovative companies on the planet. I can’t wait to see how this system is going to be used on other projects by them and other studios.

[@YahbiiCot]

.Something like this was used in the Tom Cruise movie Oblivion (2013) for his sky-house. It wasn’t nearly as complex as the one used in The Mandalorian though.

[@funtourhawk]

Damn it really does look flawless when everything is working together, the real future of vfx

[@eyeteyteras1717]

so this is why mandalorian looks so clean.... already cant wait to see movies with these tech

[@orbaitv5991]

I love how some of the crew also wear mando helmets

[@StudioArtFX]

I noticed that. I was, like, why is there a guy in a helmet and regular clothes?!

[@farseer2043]

@@StudioArtFX This is the Way!

[@AlexanderWilcox]

lol I wouldnt be surprised if he was standing in with it on for camera/lighting tests

[@jacobpapaly378]

@@AlexanderWilcox That's probably it honestly

[@kjw79]

Best job ever

[@sampsoninc916]

Absolutely amazing! You can go anywhere in the universe, and to any time period, and never have to worry about leaving the studio. When filmmaking got started, people used backlots to build mockups of real locations. In the late 50s-1960s, that approach was abandoned in favor of shooting in real locations. Then Star Wars came and more fantasy films were made, requiring some more building of large sets. The last time I think anyone did a true backlot movie was Tim Burton's 1989 Batman. Around the 90s, CGI came into play and people starting filming more on green/blue screens and shooting indoors (like 300). Green screen to me somehow takes out the magic of filming on both a backlot and on location. This technology create a bridge. It's both practical effects like in the past and new and cutting edge technology. It's the modern day successor to rear screen projection. This technology is coming at a good time. Not only do people want more realism and believability in filmmaking with more practical effects approach, but also more and more countries are creating national park areas and refusing new construction on pieces of land and refusing development to cut down trees. One of my favorite movies around is White Christmas, which was shot almost entirely indoors, but using more primitive methods such as painted backdrops, because those were the days of the studio system. This virtual production method can allow you to create a movie like White Christmas and shoot it at any time of year. I live in a state that is not famous for snow, and people in the media want to say that snow doesn't exist, like it's a myth. It's not. Quite the opposite. With this technology, just like when they made White Christmas in 1954, you can film a movie like that in a place like the Los Angeles area which doesn't get snowfall. Of course, you can still use fake snow for the set, but with this virtual production technology, you can extend the snow beyond the horizon or vista. Totally fascinating, all practical effects, and it's totally limitless.

[@trishapickelhaupt7772]

Hi Jordan, I'm working on a project and wondering - If you were able to see more about the process behind these technologies - what facets of the production would you be interested in seeing?

[@sampsoninc916]

@@trishapickelhaupt7772 Being able to use Thomas the Tank Engine style miniatures and models the way they shot the old Thomas the Tank Engine, and to have a chariot race in a sound stage, plus having TARDIS like tech to increase the amount of space humans can occupy whilst decreasing our interference with natural systems. I also want the pandemic to end after 10 months like this, and the vaccination campaign is underway. 4.36% of Americans vaccinated as of yesterday.

[@humansrants1694]

I want a home like this, imagine coming home from work and having your dinner in your space hanger overlooking the death star.

[@madebymelz7702]

This is mindblowing I can barely comprehend it, I’m looking at it and I know it’s not on location but it looks so real

[@liteoner]

That's how quality VFX should be. You know it's not real, but it still feels real.

[@PASTRAMIKick]

oh my god John Knoll, this guy is the OG bless him.

[@daliasaravia1443]

Absolutely brilliant. The Mandalorian is one of the best pieces of story telling in the Star Wars universe.

[@locolama]

No I finally know why the cg backgrounds felt so much more pleasant and believable to the eye. Lighting is everything.

[@deecilla5087]

Started this hoping it was a short video since my battery was running low. Ended with me wanting to have an hour more about the whole thing, battery be damned. This was so impressive! Grew up loving practical effect back in the 80s, 90s, then segued to CGI. This mix of practical and tech is amazingly sublime. I wish there was more. Great vid guys! This was an astounding production.

[@RobertF-]

They're really just having fun now.

[@MattproThe]

Simply Amazing, this will make things a lot easier for Fantasy/Sci-Fi movies, specially with the fact that they're using UnrealEngine 4+ and tons of modern games uses the same engine so there'll be no excuse to avoid making a great film from a great game (like Halo, Assassins Creed, Metro, MASS EFFECT, etc etc etc...)

[@sampsoninc916]

It will also make it easier for historical period pieces to be made. Ancient Rome doesn't exist anymore, just ruins. Neither does Ancient Jerusalem, specifically how it was during the time when Jesus walked the earth. One of my favorite movies to watch during Easter is Ben-Hur from 1959, which is a remake of a 1925 Ben-Hur made during the silent era. Ben-Hur 1959 was made using what we consider now to be primitive technology. They physically built both the Colosseum for the chariot race, and they physically built Ancient Jerusalem on 10 square blocks at Cinecitta Studios in Italy. Now, not only has the backlot been significantly downsized, but something in me feels that if you ever tried to build a fake set for Ancient Jerusalem on 10 square blocks in Italy, the government may not allow it because they feel that building something that big could damage the environment or that cutting down some trees for the set is illegal or that it could endanger protected species. All over the world, I'm seeing national parks being created, giving me the feeling that we can no longer physically build on some new land. This approach is not only practical effects and makes me feel like the Hollywood of old, it's also more environmentally friendly. Greenscreen doesn't seem epic enough to me. This virtual production approach with LED screens is.

[@Justin-nx3pw]

MateoDeBonis but Fortnite bad.

[@MattproThe]

@@Justin-nx3pw diugh, we are being serious here

[@Justin-nx3pw]

MateoDeBonis you must be fun at parties.

[@MattproThe]

@@Justin-nx3pw you're god damn right.

[@solarstoned]

we owe George and ILM an unlimited amount of respect, for progressing the 3d industry to where it is today. thank you so much

[@williamcolgin1987]

Mind blown. The backgrounds also serve as ambient light sources for the subjects. This is such a huge deal.

[@steprockmedia]

OMG. I literally felt like crying looking at that. It's revolutionary. And if you don't know the name John Knoll!!! Photo freaking Shop!!!!

[@TeddyLeppard]

Well, John has worked at Lucasfilm for decades, so he’s never been a non-factor as long as he’s worked there.

[@rickylovesyou]

I feel like this should be longer much longer. Would love a documentary on the development of StageCraft.

[@KINOMENTOR]

Well this clearly puts back the "Magic" in ILM'S name! Great innovation !

[@CeeJayDK]

I think virtual sets are a fantastic innovation. Not only do they provide much more believable lighting and reflections, but you can also see the final shot (or something very close to it) as you are working and can get a much better sense of the final product immediately. And it has to be much better for the actors who can now feel much more connected to the scene, rather than having to imagine it while walking around a green set.

[@bibimcmacky]

This will be the future of film-making, especially after COVID makes it impossible for outside acting to take place. Every studio is going to get in on this, mark my words.

[@tung1700]

Right on This is the way indeed

[@trepidati0n533]

What makes you think COVID is going to stop the world? The world is already fatigued dealing with it and it will get to the point of people just saying fuck it in greater and greater numbers. If you think the youth (e.g. the future) are going to tolerate being holed up much longer....I got news for you.

[@FindecanorNotGmail]

Twenty years ago, I wrote some small apps for a small CAVE with motion-tracked goggles, and images rendered by one of the biggest graphics computers at the time. I never imagined then that the same principles would be used for motion-picture production such as this. Now when you see it, it looks so obvious.

[@_atinsy]

:)))) init lol technoilogy

[@trishapickelhaupt7772]

Hello! I'm working on a project and wondering - If you were able to see more about the process behind these technologies - what facets of the production would you be interested in seeing?

[@STAT3201]

This is crazy & probably one of the most awesomest things I have ever saw. Just imagine being on set & seeing that in person

[@jesseyules]

Definitely deserves an Emmy for cinematography.

[@stingymcduck5450]

The part that impressed me the most is the fact that they said it's real time.

[@PragmaticOptimist_N7]

That's just amazing... Like a real life holodeck (well almost as not literally run up a mountain in the background but truly mind-blowing) Who and why has people down voted this technique of filming/video?

[@battlecatsgo]

Amazing - the lighting from the screens make it.

[@vr4ever645]

Jon Favreau + Dave Filoni = Masters Of The Universe! They finally saved Star Wars. Thank you so much!🙏❤️🙏❤️🙏❤️🙏

[@matthew3114]

jeez that looks sweet, another decade or so and i think we'll have our star trek holodecks up and running.

[@BLKSRS]

The future is here! Such amazing technology! Can't wait to see where this takes season 2! 🔥🔥🔥🔥

[@lothean2099]

One day, this technology will put into our homes. Taking TV and movies to a whole new level. The first to do this somewhat was in the movie oblivion.

[@user-em4wh5ji3w]

This is a huge advancement for filming. Looks so much better than cartoonish CGI that plagues the prequels

[@jonathanxdoe]

Unreal Engine FTW!

[@Justin-nx3pw]

John Doe but fortnite and epic bad.

[@SangheiliSpecOp]

Gears of war good ;)

[@mistick2010]

Unreal Tournament good ;)

[@romanjustroman7445]

Holy shit, I was absolutely sure they filmed that desert stuff on locations

[@lyconxero457]

Wow, this is actually really cool. The fact that they're using a game engine to render these backgrounds in real-time to simulate locations seamlessly is quite amazing.

[@thebacons5943]

This is deeply impressive. Pushing new boundaries while getting back to the originals of special effects. May the Force be with you!

[@danteneverdiesgamerblog5491]

Really impressive. ILM always at head in innovation. Great show and great new technologies, like the original saga.

[@louissivo9660]

I want a smaller version of this in a room of my house. Eat breakfast on an alien beach, later read my book as I'm on top of a mountain, ...

[@TotalGAMIX]

Yess

[@ottebya]

this blew my mind, I dont even understand half of what I just saw but it seems an incredible paradigm shift

[@JediPug15]

It's truly amazing what you all are able to accomplish. My unending respect to everyone involved!

[@Nateson]

Fascinating

[@griff311]

I’m sure they’re going to use this tech for the Cassian/K2SO series too. Can’t wait for that and season 2 of Mando!

[@josejaro3788]

And Obi Wan Kenobi series.

[@griff311]

Absolutely!

[@ZachBobBob]

I've genuinely been waiting for this behind the scenes

[@Gideon0297]

The Mandalorian is soooooooo awesome!!! Thank you ILM for all your hard work!!!

[@dan_noo]

Unreal Engine in shooting games : *random miss & unregistered damage Unreal Engine in Movie: THIS IS THE WAY

[@GatlingHawk]

Just aim lol

[@w0mblemania]

You don't understand how an engine works.

[@Janobot]

That is so awesome!

[@jamesmackey1798]

Love the show hope there will be more seasons to come

[@johny24]

This makes sense for the level of movie style production, the scenes and everything to cut down on costs. Just traveling to locations and building stuff is really expensive..

[@theBolderBoulder]

Now this is Star Wars! Where there's innovation in the filming, where the story is good, free of politics, and actually has a moral to it. Much like what we had before. Can't wait for the next season to this show!

[@paulbateman858]

This tech is the future for all of us in the business of building worlds.

[@dynamicphotography_]

Amazing stuff! Looked fantastic!

[@rhobertthecelt4785]

The future of storytelling has been changed by ILM once again.... ❤️❤️❤️❤️❤️❤️❤️

[@Guykhan]

Some people don't realize how amazing this is for the film industry.

[@TeddyLeppard]

I’d love to know what resolution are these massive images being run in real time. And what kind of hardware is driving this system?

[@_atinsy]

9 big ass pc's lmao

[@valentin0h]

Ancient Chinese secret

[@romanjustroman7445]

These screens must be some IPS tech with really high DPI, given how realistic the stuff on the screens looks

[@alwaysyouramanda]

This is amazing! No wonder it all looked so good!

[@phillip.dustin]

The fact that the imagery updates according to the camera's position/perspective is just extraordinary. How incredible.

[@ohwnosrepeht]

This is amazing, the next step past greenscreening. The amount of authenticity you'd add to the actors performing in a believable space is just fantastic!

[@georgeking315]

Anyone here after SuperStar Prithviraj's announcement of the First Complete Virtual Production Indian Malayalam language Movie?🤩

[@aadinath553]

😍😍✌️

[@davethepak]

This was incredible. As an performer - I can see how this is a thousand times better than green screen - the actors get to have a greater sense of immersion into a scene, and production can be a lot more dynamic. Absolutely amazing.

[@obiopiah]

Jon, Dave and their crews are just such magic makers :)