Virtual Production Explained: Intro to Unreal Engine, Camera Tracking, Green Screen & LED Wall VFX

[@bernierao]

Awesome to see NextWave TV coming back! Virtual Production is where it's at

[@bencarlson7104]

Thank you Bernie Rao! We are glad to be back! We are working hard to ramp up our content creation so we can hopefully bring you more interesting and useful videos! Feel free to let us know what you would like to see on the channel.

[@JaredHoyman]

I made the cut from your recap. Whohooo.

[@vendacious]

I wonder if there's a way to use techniques / materials from the old rear projection TVs from the 90s-00s to project onto the back of a screen... No idea if you could use a projector with the sort of screens they used, but I imagine they had screens on those sets that would be able to tolerate lighting, if you put the projector behind the screen with that sort of material. Just a random thought. Very interesting video!

[@8bitzgr]

That is awesome information, very informative, thanks!

[@VegasDominic]

Would love to learn more about your HTC Vive camera tracking setup. The new $5000 HTC Vive Mars Camtrack system might be too high for indie users… wondering about the components of your HTC Vive tracker setup. Would it be the Vive 2.0 tracker and a base station? Thank you for sharing your videos. 😊🙏

[@hethfilms]

A fascinating technique. We're trying to include virtual production for our current Star Trek fan film project, using greenscreens and camtrackAR on iphone to record the 3d movements on set and do the rest in post with Unreal Engine. There's one thing regarding the LED walls or projector nDisplay tech I never was able to wrap my head around: depth of field. When you focus on the actor in camera, you blur the background, but the background only gets blurred to the point of its distance to the subject and camera. E.g. the screen ist 3 meters away, so everything in the background gets only blurred as much as something that is 3 meters away. If your virtual scene is large with a lot of depth, the objects furthest away would have to be much more out of focus. How can you compensate for that during the shoot or is there any way to link the focus settings of the real camera to the virtual one? Otherwise it would probably in some cases ruin the illusion, right?

[@NextWaveDV]

I know there are ways to link your lens focus to Unreal and allow it to adjust the DOF to realistically mimic the correct out-of-focus for distance. I haven't tried it out myself though.

[@michaelsedlacek]

Great post. I would be very interested in how you balance this with screen brightness to make it look real.

[@silverbulletin1863]

just found your channel via unreal fest - iv been looking on the unreal 5 since i found out 1 year agow that mandalorian was via backdrop - from digging into this - my toughts was Stopmotion art with unreal 5 world in 2 diffrent version, 1 video importet into unreal world and after some time > into realtime cam via a vive controller with a backdrop Oled tv´s or 4k lazer projector. i have a few hardware questions. 1 for gpu / cpu whats the entry level - i myself have a 3950x amd and is AMD or intel - nvidia better to run inside unreal and other programs you would use? 2 whats the gpu entry level to work with all the data.? ex 3080 - 12gb or you need more GB like 24/48gb cards *3 any recomend on camera setup - i myself was thinking iphone to start with CamTrackAR app + iphone 12/or 14 but im not sure thats even a good idea - so maby a BMP 4k or 6k or Ursa mini used? any recomendations? thanks alot ill be watching in your videos

[@cjadams7434]

wonder if ndisplay you could use 2 projectors to get a larger screen

[@NextWaveDV]

It can, but it can be challenging to get the two projectors to blend well together, especially with an ALR screen.

[@patfish3291]

I think, it needs min. two projectors (corner) to really get a usable setup. Because the parallax effect is all why we do virtual production ;) . Next Step would be a projector from the top or front (blurred) for a accurate lighting from the scene.

[@jibonsharma1543]

It's a really halfull video 📸....thanks 🙏 sir....

[@chevbradford5850]

𝓅𝓇o𝓂o𝓈𝓂 🤩