Virtual Production with a Projector & Unreal Engine

Use code FILMRIOT14 for up to 14 FREE MEALS + 3 Free Gifts across 5 HelloFresh boxes, plus free shipping at bit.ly/31DnWTC
To learn more about HTC VIVE, visit www.vive.com/
Where to buy LG CineBeam HU810P (Amazon) : geni.us/jgbpNU
More information for LG CineBeam HU85LA : bit.ly/313QPrV
Follow latest LG CineBeam news & giveaways! : geni.us/gvBJQ01
Puget Systems:
►hubs.ly/H0ZlLC70
Our Unreal Engine Episode:
► • Is Unreal Engine the F...
TUTORIALS:
Setting up Tracked Camera:
► • Livelink XR Camera Tra...
Setting up nDisplay:
► • Unreal Engine 4.27 In-...
Using Switchboard:
► • Unreal Engine 4.27 In-...
More Resources:
►docs.unrealengine.com/4.27/en...
Corridor Crew:
► • I Spent 1 Year Trying ...
JSFilmz
► / jsfilmz
Matt Workman
► / cinematographydatabase
#FilmRiot #VirtualProduction #UnrealEngine
-----------------------------------------------------------------
*GEAR WE USE*
COLOR GRADING LUTs:
bit.ly/buyFRluts
SOUND FX:
bit.ly/buyFRsfx
MUSIC:
bit.ly/storeFRmusic
VFX ASSETS:
bit.ly/buyFRvfx
Envato - 50 Million Resources for $10:
geni.us/8Yd7
CAMERAS:
Blackmagic Ursa Mini 4.6K G2: geni.us/xJ8yIm
BMPCC 6K Pro: geni.us/SoxUs9p
BMPCC 4K: geni.us/OXwec
A7s II: geni.us/GpLqxEU
LENSES:
Rokinon: geni.us/exWno
PLUG-INS:
15% off Mocha Pro. goo.gl/MZKwCv Use coupon code: filmriot
AUDIO:
NTG3: geni.us/a4ww1
H4n Zoom: geni.us/aBJ1fnj
Zoom F8: geni.us/hbAze
TRIPOD:
BV-10: geni.us/EdMy8
-----------------------------------------------------------------
Connect with us:
TWITTER:
FilmRiot - / filmriot
Ryan - / ryan_connolly
Josh - / josh_connolly
Ryan Thompson - / 1vfxproductions
Emily - / emily_connolly
Justin - / jrobproductions
FACEBOOK:
Film Riot - / filmriot
Ryan - / theryanconnolly
Josh - / thejoshconnolly
Ryan Thompson - / vfxproductionsrt
INSTAGRAM
Film Riot - / thefilmriot
Ryan - / ryan_connolly
Josh - / josh_connolly
Justin - / jrobproductions
Ryan Thompson - / rjt_vfx
Emily - / theemilyconnolly
WEBSITES:
Ryan - www.ryanconnollyfilm.com
Ryan Thompson - www.vfxproductions.com
-----------------------------------------------------------------
Theme Song by Hello Control: bit.ly/hellocontrol

[@gregjoblove672]

This feels like what Film Riot has been about since day one. Taking tools that Hollywood productions use and putting them in the hands of indie creators. Keep pushing guys, this is looking sick!!!

[@kyokosgarden3779]

I love how you guys don’t gatekeep any information! Resourceful! Like you guys really care about us filmmakers and want us to succeed in whatever we do 💕

[@CinematographyDatabase]

Great to see the new HTC tracker in action. Looks pretty solid :). Focusing on the wall/projection looks so much better than trying to focus on a LED wall.

[@Fennworld]

Speaking of focus, Ryan, how are you handing focus sync with this indie setup?

[@filmriot]

It's a lot of fun for sure. Still figuring things out, but super exciting!

[@henrikandersen4777]

it Sdi connection on camera nessery for this

[@GlassboxTech]

Totally! Fantastic video showing that the Mars system is going to be a game changer!

[@robertvanbarlingen1446]

Wow, I honestly could not tell that the background in the initial clip was CG. I actually thought for a second that it was just a clip from some big budget movie with a real environment. Absolutely amazing job. I have not been this impressed in a long time. Brilliant!

[@Thesierrashow]

I can honestly say I had no clue it was a projector in the intro (I didn't read the full title lol)

[@filmhackYT]

I've been researching this for a while because I have access to an LED wall and wanted to build a practical set around it. Everything I've read is the trackers are still not the best but what you have here in this video makes me think it's much further along than when I started my research for small productions. Thanks for posting this video as a great point of data for future projects.

[@JeremyAbles01]

This feels like classic Film Riot, Ryan taking us along the journey as he learns something new great work !

[@JayLippman]

I just started learning Unreal. It's amazing to see how fast you have been picking this up. I feel like I'm still lost in the weeds, but videos like this keep me motivated!

[@CinematicCaptures]

Great work man! That opening shot looked fantastic! I've been meaning to try out ndisplay myself but have only done tests the same way as you so far. Can't wait to see how it looks when you get it all figured out! For me the hardest part about working with a projector has been trying to light the subject without washing out the projection.

[@TypicalEveningPictures]

I feel like ndisplay is such a pain, I am looking forward to this HTC device.

[@JoshuaMKerr]

Great to see you joining the virtual production community. Through my experiments with back projection with Unreal it's perfectly viable but gets harder and harder the wider you want to shoot. Great for closeups and medium shots.

[@aiiaznsk8er]

Love the show, been a fan since the beginning. It's great to see you all evolve with the new tech and I get to feel like I'm learning right along side. Thanks for showing your whole process, and making it OK to not know everything. Putting experimentation above all else is really cool. Thanks.

[@Jsfilmz]

Ry! the speed of your progress is amazing brother. Keep it up man! I cant wait to see what you do with this. Unreal is super frustrating sometimes but its worth it! If all fails, like always blame it on Josh

[@3BVideo]

And that... is a bammy wham!

[@UnchartedWorlds]

Yo

[@MrUglyDave]

Really appreciate the honesty and humility in this. Great job !

[@tensefx4655]

Save the LiveLink settings as a profile once you’ve added the Mars and change the project settings to load it automatically on start up. nDisplay will then load it up with the profile you’ve saved activated.

[@tensefx4655]

Also check the switchboard and make sure your unicast endpoint ip is set correctly for the nDisplay node I.e. the ip address of the computer running nDisplay with a ‘:0’ at the end.

[@GGNPC]

Loving these Unreal videos. These are gonna be a huge help to a film I'm trying to make in the coming months. Thank you guys so much!

[@RobAiello]

Wow! So glad somebody tried this. I always assumed there would be sync issues with the background, like rolling or tearing, but this looks great.

[@clintcompose]

I love that you guys are exploring this I know you will provide value

[@temporaryspacestudios]

This is so cool! This is the future of small production! I hope this can eventually give people the means to make big budget looking stuff in their living room!

[@Max16604]

I love series and where it's going! Been a fan for a long time and your videos are always amazing and entertaining

[@Thesierrashow]

Love the Unreal videos, keep em' coming! It's insane how good it's starting to look.

[@Kris-ym2zr]

This is awesome, thanks for sharing this info. The close ups of the screen you did made it easier for me to understand, at least in that regard, how 4K projectors can compare to using LED tiles.

[@ginotarabotto]

This was awesome! Thank you for including us in your unreal learning journey.

[@3d_Something]

Yay my tutorial mentioned on film riot, what an honour. You guys should try DMX lighting next.

[@shadowproductions969]

Nice to see you finality able to do this. I know you commented on my comment talking about this months ago. I really think as these short throw projectors get better and ue5 gets even more polished with plug-ins and such, this week be the future of filmmaking, replacing most uses for green screen. As a side note, you said you're figuring unreal out. Using quixel megascans, you can create super realistic outdoor scenes with drag and drop simplicity

[@astonishingnews3729]

This is amazing and just what I was looking for. Please stay on this and dial it in as user friendly as possible as this is the future of DIY filmmaking to be free of location issues and to let the imagination run wild for story ideas no longer chained to budget and location.

[@jdsmedia]

Yes! More of this unreal with live tracking stuff please! Good stuff.

[@JOEFRAUST]

This may not be a tutorial but it is very educational as well as giving me a good idea of how much is put into it and I'm excited and can't wait to get my hands into this world of virtual production.

[@yamrez1902]

Great video man, ive been wanting to experiment this and seeing someone pick it up for the first time and being able to make it look like this is inspiring! One thing id like to add, i think you can add more realism in the shot if you use something for a hair light for when that window os light is directly behind her. Even mandalorian with their powerful led walls had to use external led lights configured to a dmx system of sorts. Good luck, and i hope to see more!

[@bloodswarms]

I was really impressed at first. The keyshot guy at work, after I showed him this, said: "Yeah mate, but there's a reason the subject isn't moving. The light wouldn't match the virtual environment if the subject moved around instead of how they just stood still." After hearing that, I watched it again. If you can get the subject to walk around in the environment and get your subject lighting to match the environment, I'll be REALLY impressed. I hit the like button anyway.

[@Mr.ThomasAnderson]

Interested… more… yes. This plus the Unreal/Matrix collab on the same day is enough to overload a creative brain, in a positive way. My mind is blown 🤯

[@brettgoldsmith8584]

Speaking of corridor, film riot got a mention on their second Channel during a VFX review. A lot of the aspirational filmmakers who watched your channel regularly (including myself), but you guys inspired the people making cool stuff now. That is a cool retrospective.

[@vince6625]

Keep the Virtual Production content coming. Thanks!

[@Kmankeg]

Well done! An intriguing start, I very much look forward to seeing more :)

[@aehro]

wish i could try this out for myself, this looks so fun to work on ! insane what unreal can do 🔥

[@shannonwilliams2713]

Very, very, very cool! Great video and I enjoy watching your progress!

[@LIGA-SHOW]

Thanks for all your help

[@RednWhiteWorld]

Exciting ! Thanks for sharing ! As Indie filmmaker , managed to get Alexa Classic few months ago and just now LG Cinebeam 85 LA is on a way in a week, will be trying to put this together soon... Very inspiring and crazy cool, insane ! Love your passion !

[@54V4]

Absolutely LOVE IT.

[@AndrewConway]

Hi Guy's! Loving this Unreal thing you are taking us through... I was hesitant on learning one more thing, but I guess I'm going to jump in because it's to cool... Keep up the great work, and post everything you do "Unreal"

[@alljapankaratedo]

You all have always been so consistent! ive been watching since 2015! Keep up the great work...This tech Btw Is on a WHOLE nother Level lol

[@brettcameratraveler]

Perfect timing :) I'm building a 4 camera virtual production stage for a school right now. A space for mocap, VR and VP for the future of immersive interactive education. Keep these VP videos coming! Are you going to be doing a video about len mapping? The indie world needs a affordable or DIY option for lens encoders as well.

[@brentpolk2431]

OMG! This is great and I forgot about your channel. I bought one of your signed posters way back...

[@Classy-mg6mb]

Great video big fan of the show I watch you every week keep up the good work 👍

[@DaysOfFunder]

I'm at a similar stage using Unity, a quest 2 and a green screen. It's actually working, but its a bit of work. What I have done is mount the quest headset and the physical camera to a two handed grip, then set the headset as the virtual camera which films the virtual world - and the camera records the actor in the real world, these can then be stitched together (if using a green screen) or if projecting can run the virtual camera to the big screen in real time. The quest can airlink to any display or output source. I'm still yet to get fully operational but it does have potential to work a s a cheap diy of this type of solution

[@johnnyray5515]

I want to learn this. This is the future of filmmaking.

[@chidi21]

Very awesome setup!!

[@Justin_Allen]

I have been waiting for more information on the new Vive system. It's on my list as soon as it comes out.

[@therealjoseg6341]

Oh, how times has changed! This is awesome and definitely the future

[@305kubrick]

Amazing tech that is actually attainable!!

[@VorticieFilms]

This is unrelated but I bought a handful of assets on Black Friday from the Triune Store and it’s helped me so much. Thanks guys.

[@YAKUILLASIN]

I love these unreal tuts.

[@ContactLightYT]

This is fudging awesome I love this stuff and can't wait to see a bunch of indies(your audience includeed) making amazing films with this

[@acadia5898]

as a starting point, it's mindblowing! great shit!

[@sebaspi]

Thanks so much, I studied cinema but ended up working on live tv, now I'm trying to get on virtual production and want to help my fiend who is an indie filmmaker.

[@user-rd5lt2xj6g]

Great job! Looking forward to more of this video! bravo!

[@AFXGuru]

Amazing work guys - honestly a lot of what you were saying was like listening to the teacher from Charlie Brown :) but we are about to go down this Unreal route also with Virtual Productions and am excited to get going.

[@OVERHEAL]

Neat! Love working with Unreal for this stuff. Saved us during the lockdowns! :P

[@innocentmmeto]

Reminds me of early film Riot videos where we were going on the journey with you😂....this is awesome cant wait for next episode

[@PupShepardRubberized]

OMG i would love to see that htc system and get to use it myself!!!!!!

[@ALARICFILMS]

So great stuff: thanks you Rioters! As usual: Only the best...

[@michaelbarlow1700]

Awesome , so excited to follow this journey, keep up the good work and thanks :)

[@Magictrickslol]

This is WILD. I'll watch whatever progress videos you post on this.

[@patricepuiberneau9288]

We are are doing similar things here at the University in Montreal thank for your Great presentation!

[@TimoBirnschein]

This is really really cool!

4:03 yeah I'm interested! Thanks for the video!

[@MichaelSavidgeStoryteller]

I love that this isn't a full-blown tutorial, but more of a "check out this cool thing! Isn't filmmaking amazing?!" Man, filmmaking is so cool!!

[@adrjs]

Amazing video !!

[@rustyspurproductions]

I had Puget System build me a new editing monster. Love this beast.

[@AndyTheCameraGuy]

Love it, I am obsessed with unreal as a filmmaking tool as well!

[@kasperstenbom]

Beautiful 🙌🏼

[@shaunramkelawon]

beautiful - would love to see your progress since :)

[@robertwesterfield3454]

Thanks for posting this

[@Holtenstein]

This is Awesome!!! Yes, More on this and he HTC Mars

[@edisonlopez9154]

Men this is crazy I am loving it

[@Soluchi-InfiniteCoCreatorGod]

Nicely done. 😊

[@mclefferson]

this is amazing. It's nice to see an alternative to massively invasive tracking systems and an army of servers!

[@S9universe]

awesome guys, this is where video making is going now

[@sage_morei]

So I built this setup too after seeing this (latest video on my page) and definitely see awesome potential and application for it; it looks great. But one is definitely limited on the ambient lighting strength and the field of view. It kind of only really allows for portraits like in this video’s opening sequence. So here’s an idea … You know how you can use the nDisplay to connect multiple screens to make one larger screen? One could connect two Cinebeams - one on the floor, one upside down on the ceiling - and connect their projections to make one large surface that would allow full-body shots. Absolutely ridiculous idea but damn that would be great.

[@devondavis4295]

This look dope 🔥

[@jarkenmer]

This is really fuckin cool. You guys have come such a long way, you all should be proud!

[@dushyantm9579]

The background looks so clean you'd never guess it's projected.. Probably the next level of this would be merging the real video of the background with the correct proportions and overlay it on the frame while keeping the person still in the frame( it's pretty easy these days with face / person detection ).

[@otegadamagic]

Im more excited about the new htc tracker. It it works as good as the antilatency or mosys, it will instantly sell out. I hope we see something concrete from them soon. Thanks alot Ryan

[@simonmcallister6418]

Omg, that's unreal!

[@whowanito]

5:16 its four 6s so we're safe HAHA

[@BrianElliottFilm]

While I only understood about 20% of the technical details, it's pretty freakin' cool. Hopefully in a few years this will be even more accessible and won't be so insanely complex to set up. I can dream at least.

[@MrJonFinger]

I have almost exactly the same setup and it works with both live link and ndisplay. You just have to save your tracker preset and have the project set that preset as the default. Even if it’s not that I may be able to help I just went through all this for the film I’m shooting now. Feel free to reach out if you need more info.

[@carabing]

That Is Insane ♥️ It!

[@samolive2528]

Absolutely amazing results. I totally said "Logo" after the sponsor segment. 🤣

[@RamirosLab]

Great results! ... I am waiting for that new Vive tracker! You didn't mentioned lens calibration. Did you calibrate your lens?

[@DethronerX]

Badass indeed.

Fantastic video! For a bigger projection, could potentially use a back projection with inverted image in place of the UST from LG?

[@davidcox6176]

Love to know how you did the focus pull that reflects in the volume...

[@SFCFilms]

Thank you I’m interested in learning more about the tracking sustem you mentioned, was it called Mars?

[@sparkytheguy1220]

I wish I had money for all of this cool gear and tech. I want to try it out so bad!!

[@jesusblanco6069]

Hi, great video! Did you have some kind of system to control focus simultaneously in Unreal and the physical camera? Or is it something you tweaked afterwards? Thank you!

[@recmode9223]

Awesome video! Thanks for all those tips! How did you managed to sync the real and the digital camera? I just can’t seem to get the right parallax… I’m using a Elgato 4K

[@alp692007]

AWESOME.. what camera track are you using?

[@RoPanuganti]

I'm extremely excited when I see these videos, as Virtual Production at home feels insanely cool and inviting.. I do wonder how a budget setup might work since so many of these ideas require an expensive new projector (or else green-screening is an option that may defeat the benefits a little).

[@sauce8277]

Well, I feel the video is probably more on showing what is possible and available more then what is budget friendly. Technically, a expensive projector is wayyyy cheaper then the alternative technologies that are starting to be used so it actually is a budget technique for small studios in the mean time(maybe not home studios).

[@liannecho]

Holy shit Ryan 😳 this is amazing

[@pythonfam4504]

I love this

[@otiagomarques]

Oh fuck! The effect is amazing!