Indie Virtual Production is HERE!

[@CinematographyDatabase]

In the final comp you will see a bit of noise/bounce in the footage. I believe this is because the Vive Base Stations didn't both have a clear view of the controller the way I setup the set. On top of that my Composure settings were a bit rushed and I think that may have added a bit noise as well.

[@CinematographyDatabase]

also the Base Stations don't like lights pointed at them, so I need to control the on set lighting much better in the future. And I can also try adding more Base Stations for better coverage.

[@GreenCaveStudioVR]

Yeap! We have ATEM from blackmagic and we have timecode setup, after that the sync is much better. HTC TRACKERS have big potential, but the software was made for fast reaction so the prediction algorytms are making this not so accurate. I hope VIVE is working now on new driver for this virtual production new market :)

[@DreamingJapan]

​ Cinematography Database 4 Base stations should cut down on that jitter and a dedicated "Vive Tracker" would be great, it's easier to mount on a rig and it'll free the controllers up to do other things. Putting a similar set up together with a buddy of mine. Exciting times!

[@GregCorson]

Unfortunately, the vive trackers do jitter a bit. Even with careful setup you will see some when the camera is stationary. You can see an example here kzbin.info/www/bejne/fmewZoOimrh9epY there is also a link to a small unreal project that lets you dump tracker stats to a spreadsheet for analysis. Handy if you are trying to fine tune your setup and want to see if it really reduced the jitter.

[@CinematographyDatabase]

Greg Corson yeah I saw your video. I’m going to keep trying different setups and experimenting. Have you used the Vanishing Point solution?

[@smepable]

Wow, this IS a game changer! Full tutorial please!

[@AAa-tn5rz]

Yes please do a full tutorial.

[@GiantVFX]

YES PLEASE!

[@BAI-LEY-Studios]

Amen, please Matt more... keep em coming you're on fire.

[@CinematographyDatabase]

you are the OG

[@timdahn998]

Yes!! Count me in on the in-depth tutorial!!!🤓

[@Nathankinamorh]

This is revolutionary, yes I would love to see more!

[@antonmelekh155]

Never saw you more excited 😆

[@dangaud]

You're killing it Matt! Keep it up!

[@David.g0mes]

You’ve opened my eyes to a all new world for me or a virtual one I should say...very interesting and inspiring, I’m going to try and dive head first into 3D, hope to survive 😄🤞

[@АаааКааа-м5б]

I just found this channel and i have to say your videos are amazing! This is exactly what I was looking for and wanted to know! Thank you very much for this content!

[@ibrews]

"This is the way" 😁

[@VivekLakhanpal15]

Hi Matt, great tut !. You can use vive trackers for a better experience. Using it you can measure the distance, from the mount position to the camera sensor plate . Add that to your Virtual camera to get the best position.

[@saltycherrypie6918]

This is super clean dude!

[@ronzobot]

This is great! Simulcam however was combining virtual camera and actor mocap. What you're doing here is incredibly impressive at indie levels but it's called virtual set. The bigger term virtual production, usually refers to using all these technologies to break down barriers between previs, shooting and post. This is a big step towards opening this up and bravo!

[@CinematographyDatabase]

Ron Fischer oh really? You would know! I may have massively just “re branded” the term to the next generation 😂

[@ronzobot]

@@CinematographyDatabase But we shall not confuse words with deeds 😁. Rock on.

[@legendtreemedia2968]

Thank you so much for this - I'm working on a streaming series and this is soooooo helpful!

[@AjayKumar-rg3ld]

Hi Matt, would appreciate if we could get a step by step video tutorial as the hardware connectivity seems a bit complicated. May be a blueprint document would also do. Thanks a ton for sharing the pipeline and process behind virtual production. Its a major game changer for visual effects industry in terms of cost an time both. Thank you once again. Good day !!

[@CallumHattingh]

Long involved setup yes!

[@sebastienjurkowski]

Full tutorial would be great! Like really really great

[@skapunasus3493]

Show the long and detailed steps on how you do the composure... I think this is amazing there is alot of creative things you could do with this technique

[@unrealhabitat]

This is amazing!!!

[@stevenlee6353]

I would love to see a complete compositing tutorial which includes tracking real actors and compositing them into the scene and finally exporting.

[@arnoldwinford1096]

Thank you for a good clip, I want to know, after finishing this step, how should I use Sequence recorder or Take Recorder? and what steps must be taken I want you to make a clip, please.

[@ario6819]

Do we want to see a detailed tutorial? Sure man this is amazing and I will appreciate it a lot I am sure many others do, so Please do so Mat, and you are awesome thanks for all you do, and Cinetracer as well, you are inspiratioal man

[@CodyPyper]

Would LOVE to see every single step broken down. I know that would be a lot of work for you, but would really appreciate it and I would love you forever

[@cire30a]

was looking how to do this with blender and a cell phone, but this will work well.

[@michaelybecker]

amazing work. Part 2: makeshift DIY LED Walls?:)

[@JENILPATEL]

awesome work sir can i do this with a Canon 700D camera and VIVE controler ??

[@CinematographyDatabase]

Technically yes, assuming that camera has a clean HDMI out.

[@rolandtung1457]

The camera signal is not synchronized with the video card signal and there is a delay. Solved by obs delay in time, or there will be a problem that the camera cannot be matched when the camera is moved sideways because of the signal is not synchronized, how to solve it?

[@CinematographyDatabase]

For Vive tracking we delays the UE4 render by 2-3 frames and they sync reasonably well. I usually comp in UE4, not OBS

[@Myshowbro]

I wanted to suggest that if people have to go buy digital hardware for it then so be it I rather have two buy additional Hardware then be limited I'm referring to when you're iffy how you were going to roll it out I would say have the best of both worlds we have your consumer and prosumer in one package

[@PalemanFPV]

4:16 Bro, can you please explain it a bit detailed how to pass the camera to create sort of projection to the plate like you have in scene. Yes lame question but I'm just stared and really exited to build such setup and bring this to my country market 😬

[@CinematographyDatabase]

you should join the Facebook group, it's too much to try to reply into a comment.

[@leestripp7387]

Very interesting, how are you dealing with lens distortion?

[@angelonoziglia5854]

Can anyone share the top end PC setup to run smoothly Unreal Engine with an indie studio size LED wall and be able to edit 4K video with no problems... The introduction of both the new CPU and GPU from AMD looks promising and seem to crush the NVIDIA 3090 / Intel

[@christianpavlovich7252]

Have you figured out how to record the "COMP" at a high resolution? When I try to use the take recorder or sequencer it only records the CG layer and I never get the Media plate to form the full comped shot

[@OscarHernandez-js3pk]

wanted to ask, can you just buy the tracker with out the whole HTC Vive kit?

[@懒人-b5d]

I have many years of shooting experience.And experience in MAKING AE PR。Learn about MOCHA C4D tracking，I just don't know the UE4 blueprint。Can you make an unreal blueprint tutorial。thank you

[@alexbrunner1900]

Is virtual production really hard to learn, especially for someone like me who’s not a genius when it comes to using technology?

[@CinematographyDatabase]

It’s a fun challenge. There are more and more content creators showing how it works these days luckily.

[@alexbrunner1900]

@@CinematographyDatabase cool. Cause it’s something I wanna use when I finally start making my own movies.

[@HamdanBasri]

Hey, how did you get the comp on to the plane?

[@Postposterous]

Likes likes baby. You are my jam right now over at Posterposterous. I try to have the same values on Postposterous. haha!!

[@jointchiefz]

Where's the full tutorial? Just left us hanging.

[@bhabanishanakr]

1000k no like by me and I m a big fan of urs

[@DmakProductionsTempe]

You cover a lot of interesting tips in the video production space! We like what you do, keep it up. Anytime you are in Arizona hit us up. If you can, direct message us @dmakproductions on IG and we can chat. You kill it!

[@mitchcnnn]

I literally just asked Reddit on this subject.

[@CalebPearsonOfficial]

Would love to see the nitty gritty. Would also love to see if say an OLED monitor could work as a “window” similar to the Mandalorian method but on a small scale like a window .

[@CinematographyDatabase]

yeah I'm definitely going to try a Mini Mando set with a TV soon.

[@SimonRandall]

the screen needs to be far enough away so the camera cant see the pixles/LEDs so your OLED might not be big enough

[@Nathankinamorh]

Here in Nebraska, most of my paying work is StageHand realated. I have local partners I can potentially rent a pretty nice Live Event Video walls from. So I am super stocked to see how I can potentially incorporate this workflow for live events & music preformances! Especially when I pair it with the projection mapping equipment I am gonna be picking up. OMG I'm so pumped right now.

[@GregCorson]

This absolutely does work. I know a guy at a movie studio who did a setup with 4 regular TVs as proof of concept before they got a big video wall, they say it worked great! If you do see pixels you can just setup your depth of field so the background is a bit out of focus to cover it.

[@thejetshowlive]

@@CinematographyDatabase Yes pls

[@cakeller98]

This is incredibly cool! Full tutorial?? yes please!

[@valcriston]

Don’t get your hope high.

[@cakeller98]

@@valcriston hahah it’s been 11 months since this comment - hehe. not about hopes it’s about “did it happen” i’d have to go back and look :-)

[@NineldelaBraila]

hey I'm a beginner and you could make a video tutorial for us from the beginning to the end with all the steps so we can understand something

[@andrewwilkins3644]

It's crazy how accessible this technology is.

[@scottheath2028]

just about to set this up and found your page awesome work thank you!!!!! Coming from video so lots to learn

[@MattyBeavs]

This is so monumental! I wish I had all the equipment to keep up with you, it was easy with C4D but this is a whole new monster and I cant wait to play catch up with you and this new technology as soon as I can :)

[@Nathankinamorh]

If you come forward with the right attitude you'd be amazed the businesses/studios you can partner with in your region.

[@ExpressiveImagery]

What you are doing here is truly amazing Matt. I love how you are trailblazing the process for us Indie folks 😀

[@Illasera]

I think that you "Have to do" a long tutorial because you are trying here to cover too many topics with few examples.

[@hightowerjared]

amazing!!! thought id never be able to get into this!

[@GreenCaveStudioVR]

Thank you for your VLOG! DO you use 2.0 base stations?

[@lugerginyu]

We want the long and detailed version!!!!

[@honeycooler]

getting that simulcam to really lock in I think is the make or break for the project. Listening to what you were saying about 'where is the camera' and how that position would change based on lens and zooms is a very interesting complex problem. I feel like lens manufacturers have all the info you would need, but getting that from them is the tricky part. Super exciting to follow your indie approach. I look forward to seeing it progress and learning from your hours of trial and error.

[@cruzbonilla]

Hi! Can you save the unreal camera and then save it in a video? so you can mount it in AE later? Also... export the axis camera to ae camera?

[@bgmikrafton4502]

hello sir, i loved your videos they are great and well explained please can you also make tutorial on how to setup camera and connecting with pc all setup

[@maxvfx]

Great work!! Would love to see an in-depth tutorial !! At School, we have a Mo-Sys Jib and a green studio that was used with BrainStorm virtual studio ughh which now is outdated but will be getting some new equip from Blackmagic Design. Would love to see this working with Unreal Engine!! I know there is a plugin for Mo-Sys in Unreal but would love to see the workflow !!! Keep up the good work!

[@golf_friends]

i need full tut plz

[@MrGreenfields]

Yo! i am in with you! I just ordered my Decklink 8K Pro and HTC Vive Pro. Thank you Mat!!

[@iainswales]

Hello. Just getting into virtual production at work and have a video wall and vive kit to test with. I'm basically doing an indie set up, but am struggling to get the basics like lining up the tracked space and getting the scale and position of the real world screen set up (fixed lens, no zoom yet!) - are there any tutorials covering these basic essentials yet? Im using Unity at the moment just because im familiar with doing architectural and training visuals, but also happy to use Unreal if its any easier to get up and running. My scenes never quite seem to match the perspective and skate around, look wrong scale because i think i have to scale and move the virtual camera and scene for the screen size etc. My mind is blown right now after a few days doing a rough set up. absolutely loving it, but there's only me really thinking about it at work so its difficult on my own!

[@rishigolembiewski]

Would this be possible through HDMI? I'd be very keen to see if the same thing can be achieved with camera like an a7iii. Also I've seen people do this with an iphone instead of a vive to record the motion data. Do you think there's potential in that for indie production? (even if movements aren't as accurate as with a vive)

[@reddcube]

How hard is it to calibrate the scale of the virtual world to match the real world?

[@CinematographyDatabase]

In theory SteamVR calibrates the Vive Pro to the real world scale and UE4 is natively real world (cm). From there you may scale the Vive Motion and/or the UE4 world per asset as needed. So you could make yourself a giant or you could make the world smaller. How well they actually match 1:1 I have to do some testing and it comes down to how well you calibrated your SteamVR/Vive Pro.

[@vishalverghese]

Just a quick question. Can we use this for Still Photography instead of Film? If it's possible, I would love to know.

[@motomaker8550]

Hi Matt question here. Would you think a 4k laser projector could work as a budget friendly way. Because led wall at home would cost alot for a home setup. And you can skip the green screen

[@SpirusFilms]

Awesome work. Would love to see a budget projected real-time background like you did with Unreal on the motorcycle shoot

[@dbahsee]

what would I need as a beginner to the virtual studio space.. I dont ahve a bunch of money but want to try getting into this....any recommendations on good stuff for beginner lets say inder 500

[@MrKetanom]

Hi from where I get virtual sets, assets, which markets place.

[@tilkymacky]

how do u match the virtual camera position to the cinecamera in the scene? How can we link the virtual camera to scene camera. I'm using uremote 2 app for virtual camera tracking and ivcam for live camera feed. When i hit play, the live composited feed is suspended and position of virtual camera is really off position somewhere in the scene.

[@toranfarrow9864]

Would love to see a full tutorial on how you set this up I have been wanting to do this since I bought my Vive.

[@emiplays7126]

I was trained to film on 35MM Film Reel Cameras. I was taught to edit by physically SPLICING actual reels. This...is magic to me.

[@mjaegerj]

This is brilliant! If you can please share the depth! Its would be great to learn the whole stack!

[@omc7250]

I would love to see the long version of how you do everything!

[@Hencekevin]

my goal is achieve to make music videos or shorts scenes like this ! if you have a blog to chat a bit that would be great :) greetings from argentina

[@tugrulsarikaya]

Why the subject is wobbling? Can someone please explain that?

[@BlackCat.Designs]

Lol thats indie??? Your set is more expensive than my car xD

[@tatendampofu1311]

Please do the most detailed stepiest step by step tutorial with sub steps and side steps too

[@raulmoreno2499]

We audience would appreciate a deep detailed tutorial 🙏🏻 :)

[@chillysea1]

What computer ?

[@TK8177]

please tutorial

[@aldiansudarnoto2169]

Awesome Matt! Appreciate you sharing with us

[@dennysvital5033]

That's possible to do with the Oculus Quest?

[@mokdednadhem2875]

did u make the full tutorial yet :'( ? ?

[@SilconOne]

Definitely do the step by step.

[@tahaabolfazlmohamady5503]

thanks for the great video

[@jattjazbati2524]

This video is just a show case.

[@SirJoeYama]

TUTORIAL PLEASE...

[@InteractiveDNA]

You can do the same thing without paying a dime. 1. Create a 3D environment in AE with walls. Use a Blend mode over the Key footage from the 3D walls/lights in a Comp. With some little adjustments when you change the light or background the Key footage will automatically change in real time. So, when you rotate the walls you will see in real time light buncoing over the Key footage. You can even it more real if you create a Emboss of the Key footage that gets of the lights from the Walls, making the light have some 3D FX to it. Got use the imagination when comes to FX.

[@ady7d77]

TUTORIAL PLEASE

[@lukekenny3242]

In-depth please

[@andygagarin3725]

nice. thanks!

[@alessandrofortin5920]

Amazing, there is one thing that i dont understend ' what do i need to connct my camera to a pc and be ready for virtual production ?

[@IlluminanceWeddingFilms]

A Blackmagic capture card or NDI output capable camera (video over ethernet)

[@Sebbir]

Your last week of uploads have been insane. You have really blown my mind when it comes to whats possible with virtual production. Keep it up mate!

[@Kōnran_YT]

Hi, are you leaving the Cinetracer project? I'm confused. Kinda bought this over a year ago and i can't even get actors to sit?

[@CinematographyDatabase]

Cine Tracer development continues 🍻 CC actors can sit.

[@Kōnran_YT]

Cinematography Database Hi, thx for quick reply. I found it. I had been searching for a new full tutorial on the latest version of Cinetracer, but i can only seem to find short fragmented ones on the channel. Maybe i'm whining but i think it would help a lot of users to have one where everything is explained. All in all still a good software as it is, i hope to see big things in the future and thanks for bringing this to us.

[@CinematographyDatabase]

@@Kōnran_YT a lot changes between releases right now, so the older longer tutorials are not longer relevant. When things settle down for the v1.0 I'll produce more in depth tutorials and getting started guides again.

[@garycooktwo]

Loving the virtual production content! Would absolutely LOVE to see a long and involved step by step process!!!

[@indrakomara6966]

very interesting, thx for this sharing...this is what I am looking for....god job

[@CodyPyper]

You still working on CineTracer? Please add undo!

[@jeremyhle]

Yes I absolutely want to see a full step tutorial!

[@karl_raymond]

YES! Please do a full rundown. My basement is definitely becoming a virtual studio. Thank you so much for pushing the enveloppe for us indies.

[@MrChuyvs]

Thanks!!, Two questions but the same purpose: Can I use the Blackmagic UltraStudio Recorder 3G instead of Design Decklink 8k as video source input in a laptop? Can the blackmagic input plugin identify it? Thanks for the knowledge, keep going please!

[@jeremiahmathers5081]

DUDE I've been watching your videos and this one has super excited man! Thought that I subscribed a while back (must be on another account), but I had to subscribe after this!!! How well must a DP know Unreal Engine, I'm trying to learn it now on Udemy (Learn C++/Unreal Engine), any advice on the depth of knowledge to really be decent at this setup?