Virtual Production at Home with an iPhone and TV - Unreal Engine

[@J_Costa15]

this is incredible! That fact we can get so close to the quality of a volume at home, so freaking cool

[@Mikegpine]

dude - that error fix!!!! WORKS!!! finally!!!! took about 6 month to finally get her - thank you

[@rico5818]

This channel is criminally underrated. Holy jeezus. I swear it's always the best channels that have less than a 1000 subscribers.

[@MaxRovensky]

Thank you 🙏🏻 😌

[@_justnick]

The best channels have less than 1k subscribers because they haven't tasted monetization yet. Which means they only have to output good stuff to get recognized. As soon as they start earning more and more money, enshittification ensues and they start caring more about the money, because by then, they can.

[@MaxRovensky]

@@_justnick I’m eligible for monetization as of this morning. I’ll continue to only make videos when I have something valuable to say 🤷🏻‍♂️

[@enkiandenlil]

@@MaxRovensky can you update this tutorial I tried but keeps failing to connect to pc they updated the iOS app looks different no idea if it is me or the fact that I have pc on wired connection and the iphone on wifi this is the second or third tutorial i tried on UE 5.3.2 ios 16 which is the highest ios version i can get 😞

[@MaxRovensky]

@@enkiandenlil I'm traveling right now but will take a look this week once I'm back home 🙌🏻

[@vidaveo8666]

Great vid. Your advice about prioritising the importance of the foreground 'stuff' was invaluable.

[@weeliano]

I love this! I managed to use Connectify to directly wifi connect between my iPhone 14pro and my windows laptop and this works like a charm with very little lag I might add! Thank you so much for figuring this out! This is an excellent setup to teach Virtual Production to my students and very little cost!

[@MaxRovensky]

That's awesome! Glad I could help 🙌🏻

[@dwoo101]

Amazing! Absolutely love what you did and with minimal budget and ladders on ironing boards, I laughed a lot (the things we indie filmmakers do)

[@estrangeiroemtodaparte]

Keep up the grind, mate. I'm glad I found this channel.

[@brainsconceptnetworksstudi4916]

this guy just changed my future... subscribing is not enough... how can i support you BROOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO

[@MaxRovensky]

Stay tuned 😉

[@ivonmorales2654]

Thanks friend for your tutorial. One question, can this be done with a DSRL? A nikon D810... Thank you.

[@polatkemalakyuz2021]

That was good bro. I finally found an usefull video about virtual production, thank you!

[@MichalCilekAI]

Hello Max, big thank you! I just tried every step of your tutorial and it works! Wow! It is awesome, I love it. Only it seems the iOS app changed a bit over time, but it worked immediately. Very valuable tutorial, I am excited to start experimenting with the setup. Thanks!

[@Lalambz]

welcome to the new era of youtube! Your sir are one of the fore runners!

[@Fearlesskirii]

the acronym too! god damn. You have such a good eye for visuals and god you are talented. Thank you so much for sharing your knowledge!

[@MaxRovensky]

It's the most sci-fi clothing item I own 😁

[@Husmanmusic]

Dude this is next level!

[@MaxRovensky]

Thanks! 🙌🏻

[@TheWanderer1111]

One of the best step by steps i've found been trying to learn unreal engine hopefully you do more longer tutorials on unreal film making and more also if you recommend any other videos to watch or paid courses that would be great.

[@MaxRovensky]

There's definitely more coming, but I want to get more familiar with the engine stuff first I feel like the second video I made is as far as I can take the current "stretch the viewport" setup and I need to look into the proper ways of doing things more The best sources of info I've seen are the official Unreal Engine channel, Epic Games forums (helped me figure out the pixel streaming vs. remote session issue) and just random people on Reddit :D

[@rafu2]

At 10:17 you caught me off-guard and that reminded me some hazardous installation I also had in the past 😂 Brilliant video nonetheless, thank you for that!

[@vptoolkit]

I love this! Setup like this can get you some great results but watch out for the fact that the viewport in UE does not actually account for the physical tv so objects will be unrealistic sizes and you will not have correct parallax with this setup!

[@MaxRovensky]

Matching the focal length in unreal with the actual camera lens generally helps with this, but yeah, one of the things to keep in mind!

[@LydiaSalem]

i did something very similar to this many years ago using johnny lee's head tracking system using a Wiimote. Very cool stuff! ty for sharing!

[@MaxRovensky]

Wiimote was ahead of it's time

[@fluffykeebz]

Your c-stand has so much character 🤣

[@3dchick]

THANK YOU for this! So much more straightforward than most of these! ❤❤❤

[@michaelb1099]

Do you have more tutorials on this subject as I find you very clear and concise only question is how to get the background on to the tv screen is this just using casting like we use for youtube videos to tv??

[@MaxRovensky]

I filmed one for how to do a more real-world project with this, coming soon, hopefully this weekend 🙌🏻 Re: getting it on screen, I did it via HDMI cable for this one and via AirPlay in the upcoming one. Cable has less latency so that's preferred Also I'm not doing it the "proper" way, there's more setup for that that I haven't gotten around to (nDisplay and all that), so I'm just moving the Unreal window to the TV display and collapsing all panels so the viewport is as large as it can be

[@michaelb1099]

@@MaxRovensky ok I understand now. I did see tuts on that nsai or whatever but they do lousy tut where you explain things so well. I look forward to the upcoming video tut. Thankyou

[@1000pointsoflite]

just saw this reply. will try this@@MaxRovensky

[@ivonmorales2654]

What if you just put an FBX or USD cup without gravity floating and moving naturally? It is simple to insert objects. Thanks again.

[@CompositingAcademy]

$100 green screen sheet and you can do full body shots, I think it’s still better than rear-projection especially for indie creators

[@MaxRovensky]

Yeah but I like the in-camera approach cause all I have to do is grade and deliver, I don't need to spend time cleaning up spill 🙂 Green screen will eliminate reflecting though which is an issue on consumer TVs

[@Jed_Herne]

This is insanely cool. Going to give this a try for my videos in the future.

[@leoribeirop]

great technical and content quality my dude

[@StasyIce]

That's awesome! And your haircut is not that bad, btw.

[@James-op6ls]

Those reflections weren't too bad with just the talking headshot! Would love to see another video on this, optimizing out those reflections.

[@MaxRovensky]

A projector would basically solve it, but with a TV the lights might need to be pretty far away depending on the shot, which isn't always viable

[@asolidmindproductions]

@@MaxRovensky Hey, great video! Would a polarizer filter on your camera perhaps help with the reflections?

[@MaxRovensky]

@@asolidmindproductions it would, but depending on the TV it could also help with removing the picture from it 🫠

[@asolidmindproductions]

@@MaxRovensky Haha true. Guess we’ll just have to test it out! Again, great video and thanks for the tutorial, its really appreciated!

[@joseeduardobolisfortes]

If you hava a Datashow and a reverse projection screen, you can enlarge the background to a big wall. Need just space enough behind it.

[@eversparx]

How’d the projector work for you? It’d solve the reflection problem (this vid’s awesome and very useful, but can’t believe no one’s mentioning his reflections clearly being visible on the screen in any dark background area/breaks the illusion if the viewer notices). Did you have any problems with light falloff towards the edges while using a projector? Thanks! Cheers

[@joseeduardobolisfortes]

​@@eversparx First of all, I'm not a video producer, just an entusiast that made a few experiences with it. For this, I used a room of 8 by 6 by 3 meters and put a trnasluced but not transparent film 6 by 3 meters at 5 meters from one side of the room and used the the 3 by 6 by 3 space that had no windows, just a door at the corner. The projector (a powerfull model but, since it's not mine, I dont know the specifications) was on the other side of the film and we needed to seal all the windows on that part of the room to avoid light entrance. The scene was very dark; a cockpit of a spaceship and the prejected scene was the space ahead the ship window; it was used by the owner of the projector to a small production of himself. I owner only the space in this case. Since all was very dark, there was no problem with light projected at the counter-side of the film that could destroyed the bright of the projection. also, the walls of the ship arround the frontal window hided any possible losses of bright at the edges of the image projected and keep the focus on the center. Hope I could help you more but it's all I have to tell. Good luck if you intend to try yourself. Cheers.

[@alexeypankov1999]

Awesome tool. Look forward to trying it.

[@rne1223]

That was cool. Nicely done sir.

[@morganpage]

Hey Max - the iPhone app no longer allows a choice of connection type - doesn't seem to connect at all now :(

[@MaxRovensky]

Yeah a couple of things changed in Unreal since this video, I'll make an update over the weekend and upload 🫡

[@morganpage]

@@MaxRovensky awesome - thank you!

[@Alice8000]

dude i like your STYLE BOY

[@salazar665]

Woh.. Subbed.. need more. Amazing job

[@Dominik-K]

Great video, really cool stuff!

[@ITSEGFILMS]

Looked amazing.... except for your reflection on the TV screen. How would you do this exact process using a screen and a projector? Would it cast a shadow on the screen?

[@MaxRovensky]

At that point you'd probably want an ambient light rejecting screen, which counters that issue, and because the projector has to be short throw for this to work, the screen would _technically_ be a light emitting surface that would counter the shadows, unless you put a light that's brighter than the screen such that it casts an obvious hard shadow onto the screen

[@ITSEGFILMS]

​@MaxRovensky So I'd be better off with a 75-inch TV, then...How would I get rid of my reflection on the TV then? I saw yours when you did the two passes before going off the screen...

[@MaxRovensky]

@@ITSEGFILMS you _might_ be able to use a polarizer, but it depends on your TV As I’ve shown in my follow up video, in my case the polarizer cuts the image from the TV before it cuts reflections, so your mileage may vary The approach that worked best for me so far was to use a scene that’s less dark and place lights at an angle that points away from the TV more

[@woodswork]

I like the idea of using the iPhone as a live view camera tracker. I’d like to use the same idea but using a green screen so I have no reflections. So basically shoot in real time with a film camera against a green screen with the iPhone mounted on top but displaying the unreal image via a monitor. Now that for me would be very interesting

[@MaxRovensky]

That's what I've seen a lot of people do with Unreal - record the motion track, render out the scene offline and composite via green screen. Might explore it in the future since apparently I am an unreal engine channel now 😅

[@woodswork]

I’m actually following an account who does it in real time on a green screen. I’ll find out how’s it’s done and share

[@andrewwelch5017]

Have you tried using a polarizing filter on your camera to eliminate or minimize reflections?

[@MaxRovensky]

@@andrewwelch5017 yes, doesn't work in my case (see my last video) but your mileage may vary

[@BrianHuether]

​@@woodswork Hi, is there a video somewhere showing this green screen approach?

[@CONTACTOLAB]

Hi dude, great video. How can you do to output de video from the unreal engine to the tv. i only be able to do it using another visor. what i'm doing wrong?

[@xXx-lfg]

Doods even got the custom thumbs! lol, what a legend..5k subs should be 5 trillion subs fr.

[@charzulu]

Very cool, thanks for making this entertaining

[@studio500]

This video is AWESOME!!!!!!!!!!!!!!!!!!!!!!!!!!!! Thank you so much!!!! Your jokes are top notch, totally lmao 🤣🤣🤣🤣🤣 I am going to try this at home. Thanks again!!!!

[@BradleyInghamiom]

Thanks for showing the process! Would a polarizer filter help you with reflections on the TV? That's the only thing that I found jarring about it

[@MaxRovensky]

As I mentioned in the other comment - it might, but depending on the exact TV you have, it might also remove the entire image from it :D Mine is a Samsung Frame 75" and it goes black with a polarizer while retaining like 60% of the reflections 🤷🏻‍♂ Your mileage may vary

[@inaltavamos1967]

Fantastic! Thank you. I now need only to change my Android for an iPhone or to get a PC if I understand correctly? 😀

[@MaxRovensky]

The OS that runs Unreal doesn't matter, but at the time of making this, the LiveLink VCAM app was only available on iOS That might have changed though, I haven't looked

[@lucaia9710]

Excellent video, thanks for sharing it, how do you send the image to full screen without all the information on the screen? do you run ndisplay?

[@MaxRovensky]

Not yet I just fullscreen the window and collapse all the panels, so the viewport takes up 95% of the vertical space and 100% horizontal You also need to disable sprites, see my latest video. It doesn’t show up in this environment, but likely will for whatever you’re using as your scene

[@lucaia9710]

@@MaxRovensky Thank you very much for your response, I will watch your latest video, thanks again

[@lucaia9710]

What I don't see is how to remove the rule of thirds graphic and the other icons from the Vcam actor

[@MaxRovensky]

@@lucaia9710 8:12 🙂🙏🏻

[@MrWhitehawk67]

I liked that hit button

[@TiagoRamosFullsix-jr5wt]

Thank you so much for this! this is awsome!

[@sonidojamon]

Now you keed to get a "reflection free" TV, and you're set!!

[@motoristube]

Love your work man. recpect . do you think this might work with gyro system in Blackmagic cinema pocket too? 🙌

[@MaxRovensky]

I don’t think there’s a way to stream gyro data from it in realtime and even then UE needs a specific flavor of data to be streamed It’s possible to run the clip through Gyroflow in post and export the motion data in its format, so there’s a chance someone will engineer a way for UE to ingest that and apply to a camera path, but I haven’t seen such a solution and it would definitely not be realtime 🤔

[@motoristube]

Would it be possible to record the virtual camera in UE without all the gizmos and details of camera on the screen? Thank you @@MaxRovensky

[@MaxRovensky]

@@motoristube Check the followup video for removing gizmos. As for recording in UE - it's definitely possible, but I haven't looked into it yet

[@daemonjofficial]

Love this! Nice job!

[@smepable]

Came from FilmRiot, ...amazing Tutorial! So you need to correct perspective in UE5 because the iphone is a bit over the camera sensor?

[@MaxRovensky]

I think it would only matter if you're using a longer lens At 35mm the distance between iPhone and sensor isn't noticeable enough to matter but at 50mm+ it would probably affect the shot Alternative solution is to attach the iPhone directly to the back of the camera with like, electrical tape 😁

[@moisesdelcastillo6703]

Love this bro!

[@flaviomasson]

amazing tutorial! ☺

[@mariorodriguez8627]

Great work!

[@Geck0n]

Thank you mate! It’s just awesome. I just start to research vp. Thanks!

[@Paxmet]

порекомендуй айфоны между iphone xs и iphone 11, у которых из них лучшие датчики вроде гироскопа итд?

[@Chitown_cookin]

If you're ever in Chicago, you'll have to let me buy you a frosty pint of thank you!

[@jjhosseiny]

Great video. Super funny. Cut the dialogue (not tutorial) faster, less silence makes the pace easier to follow

[@Shauny_D]

I spotted those fpv drones on your desk! Next is tracking an fpv drone in unreal... I have tried with a different approach but didn't have a big enough drone to carry a phone at the time... haha

[@MaxRovensky]

I mean, it probably makes more sense to just make a motion track for the camera in Unreal at that point 😁 The selling point of FPV drones is they let you get angles only possible with CGI, but if you’re already doing CGI - might as well go the easy way haha

[@Shauny_D]

yah but you wouldn’t have the bragging rights

[@GiancarloBombardieri]

wow! it looks amazing!!

[@NASA2008]

Hi Max Rovensky Which iPhone did you use?

[@sylviofleurimond1236]

Hey Max. Can you please create a stl file for Mir 37b lens? I would greatly appreciate it if you could create one.

[@smfknj6010]

Now that’s cool. Thank ya

[@HariBonda]

Nice video :) What screen recording software do you use?

[@MaxRovensky]

Screen Studio by Adam Pietrasiak

[@chosenonemedia8337]

WOW, this is cool!

[@DarrenMonks]

That was amazing

[@romanbruni]

brilliant ! why didnt you shoot w the iphone ? loved the story too... cheers from Rio !

[@MaxRovensky]

I not sure if the app will stay connected to Unreal when in background, haven't tried it 🤔

[@scottdpeterstv]

So you are using on a Macbook Pro then correct? I've been really weary about switching to Mac because I've heard horror stories about using Unreal with it. Can you tell me your experience please? Thank you! Great vid!!

[@MaxRovensky]

Complex scenes start dropping frames after about 10 minutes (baseline M1 Pro) I just upgraded to M3 Max, haven’t tested it yet, but should be much better

[@scottdpeterstv]

@MaxRovensky if you could do an M3 Macbook Pro review of how it handles UE5 you'll be like the first online to do so.

[@MikeyNavarrete]

Hello there! Thanks for this wonderful tutorial. But you said at the last part that I just need to plug in the tv. So I assumed that when I do that the virtual background will just go full screen automatically on the TV but mine didn't work. Am I missing something? Thanks for the help :)

[@MaxRovensky]

Nope, what I'm doing is just expanding the viewport as far as I can, it's still showing the engine's "shell", I'm just filming underneath it There is a "proper" way but I'm still investigating it, tutorial coming in the future

[@MikeyNavarrete]

@@MaxRovensky Hi thanks for the reply. So what you are saying is I need to drag the whole UE window to the extended monitor/TV?

[@MaxRovensky]

@@MikeyNavarrete yep, and collapse the side and bottom panels

[@bossekoch1264]

this video is fucking great! I have the excact projector u showed and mainly use it for rear projection but ur method looks super interesting… definitely gonna try it out!!

[@Safarlens]

this videos solve my problem

[@armondtanz]

Hey just subbed. Was wondering why when u stsrt talking then showing every1 your space ship, something goes wrong. Looks like your not grounded to thd floor. Would live to know how and why this is happening. Its a strange optic that breaks the illusion.

[@MaxRovensky]

The frame rate drops a bit at that part, the movement is a little behind and choppy It's a hardware issue - I'm using a battery powered laptop to render everything, which isn't a great idea 😅

[@braudhadoch3432]

Why not just use Aero or AR tech ? Would do the same thing with a far less learning curve?

[@enkiandenlil]

can you update this tutorial I tried but keeps failing to connect to pc they updated the iOS app looks different no idea if it is me or the fact that I have pc on wired connection and the iphone on wifi this is the second, third tutorial i tried on UE 5.3.2 ios 16 which is the highest ios version i can get

[@davidthomasnewman]

How would you use a projector without casting shadows? Seems like an insanely efficient low-cost solution compared to renting an LED Volume for $50,000 / day lol...

[@MaxRovensky]

Ultra short throw, they're set up like 30cm from the wall, you'll pretty much always be in front of it

[@jorgecastilleja5356]

Quick Question, how do you send the output to your TV? without any UI

[@MaxRovensky]

HDMI cable and collapse the panels so the viewport takes up the most space, I mention it in the follow-up video I'm working on a "proper" output setup for a new tutorial cause a lot of things have changed since this video The channel will be resurrected soon 🙌🏻

[@michaelb1099]

can we use a webcam instead of iphone?

[@guillermonippermedia5595]

Nice thanks!!

[@1000pointsoflite]

plug in to tv and "film stuff" seems like it's skipping some steps. is that an nDisplay set up or a second monitor ?

[@MaxRovensky]

Nope, expand the viewport as much as you can, collapse all the side and bottom panels and disable gizmos (I mention it in the follow-up video) I'm looking into the proper nDisplay setup, but this was perfectly sufficient for what I was trying to do, only sacrificing about 3% of the top area of the TV

[@AkbarAli-ie2uv]

Sir how to project to tv unreal scene

[@MotionFriend]

Hi, is it possible to set this up to use the iPhone as the actual capture camera as well? Rather than needing a second camera?

[@MaxRovensky]

I'm 50% sure it will stop transmitting the gyro data when it goes to the background, but I haven't tested it

[@MotionFriend]

@@MaxRovensky okay thanks for taking the time to respond. I’ll do some testing in the next couple weeks and report back here if I find anything interesting

[@AVISIONMUSICTV]

This will only go so far for a film lol. But backgrounds for a static talking theme, why not lol

[@MaxRovensky]

The more serious you want to go, the bigger display you need - bigger TV, projector, dual projectors, all the way up to a proper LED wall setup

[@PavanKumar-le4qd]

Which iPhone is required? Any iPhone works? Or only iPhone with Lidar scanner (pro models) Please confirm.

[@MaxRovensky]

So long as it can run the app - yes. Any iPhone that can run at least iOS 16 should work, so anything from iPhone 8 up theoretically

[@PavanKumar-le4qd]

@@MaxRovensky Thanks

[@injectionAI]

Great video btw, even if my misophonia was raging with the swallowing spit sounds 😩

[@MaxRovensky]

I did not realize how audible it was until it was already uploaded it 😅 It'll be better next time!

[@injectionAI]

@@MaxRovensky noo! You’re totally fine, it’s us with this condition. It’s maddening. Your video was excellent and helpful

[@MrGennadymc]

where are you based in max?

[@BadRadBR]

I don't have an iPhone but I do have an iPad. Will that work? Thanks!!

[@MaxRovensky]

The app should work, but it's going to be really annoying to attach to the camera 🙈

[@adityathosar2026]

hey, after adding Vactor i coundnt resposition my camera. it just goes in forward and backward direction no right, left, up or down.. how?

[@MaxRovensky]

You should be able to use arrow keys and mouse, just make sure that proper camera is selected (the one inside vcam actor)

[@rmanj2300]

really cool hack!

[@TheBenjaminBanks]

This would be even better if i didnt see your reflection in the tv in the final product

[@MaxRovensky]

The scene is mostly glass so it’s technically not awful 😁 But yes, I mentioned it in the follow up video, using a projector solves this

[@moviedorkproductions9465]

Does it cross over to PC's and Android phones?

[@MaxRovensky]

PC most likely will work fine, but the LiveLink VCAM app is iOS-only at the moment as far as I remember Though that might change or someone might make a 3rd party one, I haven’t checked

[@YanivCreations]

is there a lag between camera motion and the projection? were you able to get rid of it?

[@MaxRovensky]

Yeah, shutting off stuff that's out of camera helps, also not using a laptop on battery power 😅 This is purely a hardware constraint, the better your hardware - the more you'll be able to run at >24fps

[@YanivCreations]

oh! I thought it's due to the wireless connectivity. Thanks.@@MaxRovensky

[@MaxRovensky]

@@YanivCreations there's slight wireless latency, it's kinda immovable because it's using Wi-Fi instead of a custom RF protocol like VR trackers would, but so long as you don't do any super fast pans - should be fine The delay you're seeing in this video is definitelt just framerate drops

[@gudeandi]

So it's only rotation right? Cause it's visible when you finished setup the iphone.

[@MaxRovensky]

It tracks every axis, but forward/backward motion isn't as noticeable at 35mm as when you pan

[@gudeandi]

​@@MaxRovenskyhm... doesn't looks like moving at all at 08:09 for me... anyway... good work

[@MaxRovensky]

@@gudeandi it does, but baaaaarely, not enough travel distance to be meaningful

[@AwesomeSauceShow]

Looks great, to bad you had the reflection of you in the first seconds, that disperses the illusion a bit.

[@MaxRovensky]

Yeah, it's hard to get around it unless you have a TV that's coated against reflections or a projector. It kinda works here I think cause those are windows and metal beams, which can be reflective/glossy 🤷🏻‍♂️ But yeah, something to keep in mind for other types of shots

[@allago11]

Its cool to me

[@cgivfxshortfilm408]

Nice

[@MuhammedBasil]

Wow !!!!

[@sanilalkuttimon1755]

❤❤❤

[@rayge]

The question is can you do it on an android device?

[@MaxRovensky]

As far as I know the LiveLink Vcam app is iOS-only at the moment, though that might change

[@ALOKSHARMAMD]

can i use ipad instead of iphone? i dont feel invested in iphone.. feels like way too overpriced for the hardware.

[@MaxRovensky]

The app should work, but mounting an iPad to the camera is probably gonna be annoying :D

[@ALOKSHARMAMD]

@@MaxRovensky yeah, but android have much powerful hardware in same price.. but the app is apple exclusive for now it seems.

[@MaxRovensky]

@@ALOKSHARMAMD I don't personally care about marginal differences in hardware I use iOS because of the ecosystem, Apple Log and software availability (such as this app for example 😅)

[@chBd01]

Hello Is the app still exist?

[@MaxRovensky]

I think it was upgraded and renamed, I'll make an updated video soon 🙌🏻

[@TriSutrisnowapu]

Supercool

[@synbios2009]

The Mandalorian bad?

[@MaxRovensky]

It’s visually great, but unfortunately virtual production can’t do anything to help the writing 🫠