How To Set Up A Virtual Production Shoot

[@nsmithcine]

I love how Jetset is getting virtual production a bit closer to general use. It doesn't feel like it's quite accessible for everyone YET, but within a year or so, I can see most of these processes being automated as hardware and software improves. Exciting times indeed.

[@amen5850]

I don't have .USD option available in UE5.4

[@ivanvargas5295]

This awesoem I hope you do a real deep dive into this. Is there a way to color corect or match color in Unreal when doing this?

[@JoshuaMKerr]

Unreal isn't a great live compositor. You can do despill and basic corrections. That's as much as we did for this shoot, knowing it was going to post anyway

[@redmercurylondon]

Really great video, and amazing to see how far you've come since the early days of comping yourself into Unreal videos! Just a question on using Lightcraft. I've gone ahead and ordered a Seemo 4K based on your demos, however it does seem that you must have the $80 a month Jetset account to be able to do the callibration. Also I normally shoot 4K with my mirrorless, and I see it only does 1080. Is this going to be a problem? I'm using a Canon R6 if that helps.

[@Patrick-jj5nh]

Great, seems like the perfect project to display all the advantages, the transparent part of the window especially, and the fact you could replicate the naval vessel with a perfect golden hour sunshine for the entire run if you wanted lol

[@JoshuaMKerr]

Haha, yes, good point. Shooting on a naval vessel is hard enough without needing golden hour to last...six hours

[@Patrick-jj5nh]

@@JoshuaMKerr indeed, not to mention the nightmare that sound recording is on a ship - but i guess this wasn't necessary here perhaps

[@marcfruchtman9473]

Thank you for making this! Very cool. It's a glimpse of the massive amount of expertise you need to do your job... staggering amounts!

[@JoshuaMKerr]

Thanks, man. I see you've been enjoying my content. Thanks for the thoughtful comments.

[@gabrielgerstnerpineda9167]

Is it possible to do it with the Accsoon SeeMo HDMI 1080P 60FPS for iOS? I need to now ASAP ive already ordered it hahaha

[@JoshuaMKerr]

I think it is possible but not 100% sure

[@gabrielgerstnerpineda9167]

@@JoshuaMKerr Just got it, ill let you know if it works

[@JoshuaMKerr]

@gabrielgerstnerpineda9167 awesome man

[@gabrielgerstnerpineda9167]

You didn’t use the tentacle right?

[@JoshuaMKerr]

@gabrielgerstnerpineda9167 No, not on this shoot

[@mpatercologne]

This is fantastic! I will try to setup our system in a couple of weeks. Hopefully I will be able to sort out all the settings. Thank you for your content!!!

[@JoshuaMKerr]

Thanks for watching. Please reach out with any questions when setting up.

[@amen5850]

Can you do a tutorial on jetset app + unreal engine virtual production

[@theonfink6145]

This is super cool! Can this calibrate an anamorphic lens?

[@linktproductions7721]

Have really enjoyed these videos. I have a couple questions. 1. Is there a way to connect the phone and camera without the accsoon? 2. The phone records the virtual camera movements so you don’t HAVE to watch in real time on anything other than the phone right?

[@garthmccarthy4911]

Just got my I phone, I couldn't find a reseller for the Accsoon I South Africa so had to have one imported, I should be getting it today. Should be able to play with it all this week end

[@JoshuaMKerr]

That's awesome man. Have you joined my discord?

[@garthmccarthy4911]

@@JoshuaMKerr I have not, let me do that now. next gen filmmakes, right?

[@JoshuaMKerr]

@garthmccarthy4911 Thats the one

[@beyondcinema]

How does this kind of tracking compare to quality you get from Vive Mars?

[@JoshuaMKerr]

I've only used vive trackers, and I'd certainly choose it over those. Im not sure about how the Mars improves on the trackers asside from setting and origin easier. The vive trackers almost always jitter when left stationary in my experience.

[@beyondcinema]

@@JoshuaMKerr Thanks man, I'm definitely going to give this app a try at some point!

[@abdulrahmanelawady4501]

Can you ask jetset to make a windows and mac apps to facilitate connecting the game engine with the phone. It seems that there's a step in the middle where things get a bit confusing

[@JoshuaMKerr]

Autoshot is made by Jetset for exactly this purpose. Which part did you find the most confusing?

[@abdulrahmanelawady4501]

@JoshuaMKerr it's not confusing that a wrong word to use but maybe a little not as simple as click and play. It should be just link the phone bluetooth or wifi to the Pc and it will guide through the steps. Without showing me the technical stuff. Think of it this way, there's no way the owner of the production company would have got it to work without you being there to help. It should intuitively made so that less experienced people would be able to fellow the steps without needing to search online on how to do it.

[@gabeo9740]

How do I get fizz data inside unreal engine for POST production

[@djJustJay]

Hey i have a question. Could you use the seemo 4k and get the same result? Or do you need the pro in particular? Mind you with a hdmi cine like blackmagic 6k pocket……. Can you utilize the seemo 4k for tracking into the programs in the cine level subscription of jetset?

[@JoshuaMKerr]

seemo 4k should work, yes. Remember, it's just for lens calibration.

[@Rosseboi]

Hi Joshua i would like to start animating in unreal could you tell me how I should get started please and/or poiint me towards any resources?

[@Kumarswamy_Hosmath]

With a matte box on, can it still do the job at a larger distance between the lens and the mobile cam? What is the maximum possible seperation? Why is no single video of true pro grade film set up till date?

[@JoshuaMKerr]

I don't live in a place where any realy big shoots happen. And If I ended up working on one I'm not sure if I'd be allowed to casually film a youtube video. I havent pushed the limits of separation to see what works. My guess is that as long as the phone can still see what the cinema camera can see then if should work.

[@MiDaY_i]

this final result wasss mind blowing!

[@roselynreed6445]

Hey. Thanks for sharing this on how to set a VP Shoot. On the next one kindly move the camera around and different views. The shot here is only one static camera shot so hasn't really captured or shown power of the tracking, genlock zoom in out.

[@JoshuaMKerr]

There are handheld shots in the selection of shots I show at the end of this video. This was also a real client shoot, so I didn’t have a big influence on what angles they chose and the style of shooting. This was not a genlocked shoot. We were not tracking iris and zoom.

[@sayedsalah893]

can you explain also for blender !!

[@JoshuaMKerr]

I'm not much of a blender user but the lightcraft team have tutorials on their website for this.

[@dothefilmTV]

hey, can you describe what gear used to rig phone to camera please ? looks like the smallrig cage, what about the rest ? thanks !

[@JoshuaMKerr]

Hi, yes it's the smallrig cage for the iphone. Other nan that we used a magic arm to mount the phone in place and it seemed to work nicely.

[@dothefilmTV]

@@JoshuaMKerr ok so you do lenses calibration per day, as magic arm wont always keep the same exact place

[@JoshuaMKerr]

@dothefilmTV We only shot for one day, so a magic arm was fine. Otherwise, you could use rails to mount it. I used rails and rail mounts at the NAB show.

[@injectionAI]

this is a good start. I can't wait for it to be further streamlined

[@JoshuaMKerr]

There's a lot in tne work to make it easier.

[@injectionAI]

@@JoshuaMKerr I’m super excited for it though, even at this state

[@stivan_music]

Great Josh🤘👌

[@JoshuaMKerr]

Cheers!

[@marcdelaunay1]

Wow. This is amazing!!!! Well done Joshua!!

[@JoshuaMKerr]

Thanks Marc!

[@MoorishMade]

Can you use something other than the acsoon?

[@JoshuaMKerr]

As far as I'm aware the accsoon is the only gardware that bridges the gap between camera and ios.

[@parsec3d]

Layer pannel is no working for me in 5.4 can't add anything.

[@JoshuaMKerr]

Thats strange. What happens when you select it in tne window menu? Does it not come up?

[@parsec3d]

@@JoshuaMKerr nope no menu if I click on the layers tab and nothing happens if I drag things manually

[@JoshuaMKerr]

@parsec3d sounds like its bugged. maybe try verifying engine content in the epic launcher.

[@parsec3d]

@@JoshuaMKerr I have :( , for now Im just saving all selected and works.

[@sanjimanga8923]

What is the axon thing you’re using? I couldn’t really understand what you said and can’t find it online

[@JoshuaMKerr]

It's called an accsoon seemo. It feeds the video from the cinema camera to the phone

[@sanjimanga8923]

@@JoshuaMKerr ah okay so the final footage that’s used is from the camera and not the phone since you’re using that? Will this work with a black magic cine camera?

[@JoshuaMKerr]

@@sanjimanga8923 Any camera with an HDMI or SDI output. The key piece of hardware is the Seemo from accsoon to get the cine footage across to the phone for calibration.

[@sanjimanga8923]

@@JoshuaMKerr thank you!

[@bit-studios1]

Outstanding end-to-end tutorial!!! This is the easiest implementation of virtual production that I have seen thus far. I am definitely going to get the Jetset Cine and implement this on my next Virtual Production project. ❤️👏🏾👏🏾👏🏾👏🏾🙌🏾

[@JoshuaMKerr]

Let me know how it goes. I've found it just so simple that it is hard not to get totally enthusiastic.

[@bit-studios1]

Will let you know how it goes. Thanks again for the great video.

[@smepable]

😂this is so funny. I Plan to get into Unreal and Virtual production and its so crazy you call it simple. So many Apps, menus, Buttons, calibration, rigging, cables, Greenscreen Studios...

[@bit-studios1]

@@smepable Every tool seems hard to use from when you first start using it. The good news is that it will get easier the more you use the tool. ☺️

[@smepable]

@@bit-studios1 i very much Hope so. Have you Seen the Video of Joshua on the event where it stopped working and He needed hours to find out that all He needed to do was to Push the refresh Button. Thats the nightsmares I am talking about. Sony made a new App for their Cameras to Connect and Transfer to phones and its a Nightmare because it Just wont connect If you do it the exactly right way. You know, in Video you want to make great Things but then, even the simplest things dont work.

[@FLVXVLF]

This is incredible! I'm so beyond lost though 😂

[@JoshuaMKerr]

Feel free to ask questions. Otherwise I am planning a course.

[@RSill25]

Are you coming to CineGear?

[@JoshuaMKerr]

I believe Lightcraft will be there but not me I'm afraid. I think my next one will be IBC.

[@AshR6-y3e]

What type of pc spec do you have?

[@JoshuaMKerr]

Not mine but the studio had a 4090

[@AshR6-y3e]

@@JoshuaMKerr is it okay to use ryzen 7 7800x3d bec i also do gaming

[@ZeroNineFilms]

This petty much how to set up a camera which using my voice trackers seem alot easier I wanted to see how the recording was done and the export that's what I been having trouble with the most

[@JoshuaMKerr]

Im sure I'll get to that. I find the tracking plus lens calibration super easy. Not to mention the iphone doubling as a monitor for the virtual and physical elements.

[@haydenbushfield6351]

where do I get autoshot?

[@JoshuaMKerr]

ligthcraft.pro Their website

[@MiDaY_i]

4:12 i was like wooooow, felt like a child see 3d video games for the first time ever

[@JoshuaMKerr]

Haha thanks man

[@nathanhackerbts9081]

great video!

[@JoshuaMKerr]

Thanks!

[@aashay]

Great video. Will it work on iphone 14?

[@JoshuaMKerr]

It should, the main requirement is the lidar sensor. The iPhone 14 should be able to handle a fair bit of geomtery too.

[@Foxynhoz]

9:18 My reaction was: Why are they building the scene in real life if they already made the trac...*notices Final Result at the bottom....Oh...ohhh....OOHHHHH

[@dansmith904]

The 3D environment looked like a bad ps2 game haha

[@JoshuaMKerr]

It's not photoreal for sure, but the quality level we arrived at was what the client needed.

[@ZvilgantisKailis]

This or any virtual studio is way too specific collection of knowledge. I just wanted to be a filmmaker. To grab a camera and tell stories. And with this I have to become a 3D designer and 3D animator so I can create an ultra realistic 3D background just for a couple shots.

[@JoshuaMKerr]

If it's not for you that's fine. I just happen to enjoy it. For me it offers the freedom to tell certain kinds of stories like science fiction, which can be prohibitive at scale. Not everyone will need these tools.

[@ZvilgantisKailis]

@@JoshuaMKerr I am into sci-fi :) And funny thing is I never made a short film in sci-fi genre, horror, mystery or something like that.

[@JoshuaMKerr]

I've done it at the very low budget end without virtual production but decided to dive into this so I could work on a bigger canvas

[@ROBOTRIX_eu]

[@HITI_]

Lets Go

[@Justin_Allen]

A bit of a clickbait title. This is really a Jetset commercial. Is it sponsored by them?

[@JoshuaMKerr]

I do mention right at the start and the video is marked as paid promotion. The title is representative of the content.

[@andrewnaysmith2954]

First 😂

[@JoshuaMKerr]

Nice one