HTC Sent Me a SECRET WEAPON for Virtual Production

[@JimmyWebs]

We're just in the middle of choosing between in-house indy rnd, or buying complete solution. So, it's INORMOUSLY interesting for me

[@CinematographyDatabase]

which systems are on your radar?

[@d3tach3d]

The ideas for photography and filming are endless with this new movement.

[@TheMonicaProject]

Matt, I am interested in ALL OF IT! I watch a lot of KZbinrs but you are in a league of your own!

[@AshNair26]

Definitely interested in the high end camera tracking and LED walls

[@ammodigital2939]

Same here.

[@puyakhalili]

Yes that would be amazing

[@haq765]

same here

[@JAMs6504]

Same

[@RKspadelhi]

Yess

[@fanjan7527]

YES!!!! High end camera tracking.

[@c_f97896]

Hey Matt! I'm a working Cinematographer here and ex techie from years back. Just a shoutout to you as I'm stuck at home for all your content and knowledge sharing. I've always been fascinated with VR back in the Mark Pesce VRML...saw him at Comdex along with a little company called Netscape exhibiting years ago. Thanks again! I'm getting up to sped on Virtual Production due to you. Stay safe!

[@cornuArietis]

Very Cool setup! Thank you for doing/sharing all this great information.

[@arneKalypse]

Great series. Looking forward to your comparison.

[@GhostIntheShodow]

Informative as usual. It would be nice to see the other end of the spectrum. Gives us starter an idea of the progression path or if a project comes along, we can quickly ramp up. Keep up the good work.

[@ChandlerWildProd]

Loving these videos. Answering all the questions I've been having

[@anthonymiles2302]

Can't wait to see more on indie virtual prodcutin and gettign the most out of it.

[@JQhardge]

It would be super cool to see the high end stuff in action.

[@lubruz7164]

I love watching your videos! Is just amazing how the virtual production is evolving. In a close future indie filmmahers will create the most higher production level films in their garages.

[@CinematographyDatabase]

I know several filmmakers setting up indie virtual production stages in their garages right now lol.

[@lubruz7164]

Amazing! that future is here... I want to play with this new toys right now.

[@ronzobot]

Hey Matt great video as always! You mentioned accuracy (in tracking and lens modeling) and also tracked volume size. There's also setup time, setup cost and scaling of cost as the tracking volume gets huge. This is why, as the volumes get large, you'll see mocap systems taking over. One last point is occlusion. You're a DP and once you get all your flags and rags up there may be nothing for an optical system to see. In that case encoders may work best. Lots more as you know!

[@CinematographyDatabase]

Yeah I imagine there are quite a few different scenarios that require different techniques. I had a lengthy chat with NCam and they were telling me about their IR filtered system vs the non IR system and the other types of sensors they combine in their system.

[@LMDToolbox]

Following you since a while with great interest. I have Cinetracer installed too. I can't wait to see the comparison between Vive and high end!

[@JLOFlix]

Thank you, Matt! Great presentation as always. And, YES, please, we'd LOVE to continue right up to the LED wall status! And thanks for the Facebook blog page BIG time! As far as high end tracking, are you referring to something like OptiTrack?

[@CinematographyDatabase]

Specifically Mo-Sys, NCAM, Stype. OptiTrak/Vicon are maybe, I haven't reached out to them yet. But I've used them on shoots.

[@Vaynamar]

@@CinematographyDatabase Yes that would be amazing we're hesitating between nCam and Mo-Sys for a LED wall setup - more info on the pros and cons of those systems would be GREAT! Thanks for your work Matt - it is really, really helpful.

[@judgeworks3687]

I like the indie path. Would be interested in seeing the differences between the indie and high end but prefer the main focus staying in the indie level as you’ve been doing. Such helpful info and videos. Thank you for making the time do. Cheers- k

[@TheBrhulk]

Thanks a lot Matt, you're helping us a lot!

[@leanperrins]

To see the comparison between both sides would be very cool. At home I really like to fiddle around with the equiptment i have around, but on a professional set I mostly want an out of the box solution with 24/7 support. ...But...I want to get as near as it get's with my old vive.

[@chrisfoley1065]

This is great during corona

[@mullinsmediaLLC]

Thank you!! I am debating between the Canon C300 Mark iii, C500 Mark ii or Blackmagic Pro G2 for my first camera for virtual production. I would prefer autofocus but am concerned after watching your video about the C300 Mark i that the Mark iii won’t work? Any thoughts?

[@lucas1207]

I’m veeery interested on how is the high end virtual production works, price, etc. I literally check if there’s new videos from Cinematography db every day, awesome work!!

[@KwasnikPictures]

your studio is AMAZING! :D

[@The_Burly_Bat]

This sounds flat out amazing!! I've read and done a lot of research about virtual still making it very interesting in the higher end tools. Hopefully you can demo some of those mechanics and share some of that information with us indie filmmakers! I'll be following along to see what you come up with! Cheers!

[@hoodaffairstv]

Definitely waiting to see it

[@KristopherrLove]

You dont need a dual follow focus on the same control. The green screen subject needs to be in focus at all times for the best in engine effect anyways. Stick a vive tracker on your projection plane. Set a blueprint to control axis rotate with the tracker but only on X rotation, set the camera to be locked to the Y rotation. Attach the plane as the autofocus point or the tracker as the auto focus point in engine. Now as long as you can keep the camera in focus in real life, you should have full mobility to walk around and treat the subject as they were a real object with no fear of a vanishing point. use the second tracker you have as a virtual focus and that's what you use to control your final focus point. likely needs a second operator. I been doing this too and its a game changer.

[@saurabhranjan5427]

Thanks for the video, Matt! I am starting a Virtual production setup in Mumbai. For now, I am looking at only indie level stuff but since some of my clients already want to do some heavy production work, I would definitely be interested in the high end tracking systems.

[@petrsehnal7990]

Definitely interested in comparision with high-end solution!

[@sinanarts]

hey dude thx for amazing tuts. Would you advicemeto go with a ViveController or a Vive Tracker..? For realtime virtual prod.

[@GeorgesEmmanuelArnaud]

yes Please make some review/tutorial !!

[@SokheanJonathanOuk]

I'm deff interested in all the flavors of every aspect of Virtual production. UE4 and tracking are the topics of what I'm interested in but I'd be interested in knowing more about the LED walls as well. Really exciting times and I can see lots of cool things that can be done with this tech.

[@reddcube]

Looks great. Only addition is maybe the “greenroom” needs a room divider.

[@CinematographyDatabase]

B. Winky GIR!111

[@HumbleHerman]

PLEASE start doing the highER level pro stuff ... NOT the highest end LED walls, obviously, but the next level up from the VIVE suitable for independent features. Also, is there anything that hooks up with the 5 Xbox kinect sensors I have hanging around?

[@goodenna]

LED wall will be the future for VP, but like you said there isn't much information about it. Please show more secreat about it.

[@fernsehdesign]

hm, but what about the floor? have an LED lying flat to walk on? Otherwise YES!

[@JavierBarrera1981]

Thank you, Matt!!!!

[@vishwassavanur8185]

It would be highly appreciated to have a series on high-end tracking and greenscreen keying technology.

[@sandeepsajeev6048]

Definitely interested in detailed production ready content!

[@MattysEdits]

very interested in what you were talking about at the end!

[@leomaverick]

What about Iphone vs HTC vive for tracking?

[@tyldarprod1399]

Let me show you my new studio. We have to step over the baby pen, maneuver around the walker and through the lego and rc car world. We are now there. What do you think? Thanks Matt. It looks great. That control mount looks like a wireless handheld mic clip. Hmmm. Please start with MOSYS for the high end tracking system. Hook it up man.

[@CinematographyDatabase]

that is what the rest of my house looks like

[@mg4u4ever]

Man. You are awesome. I have been using cine tracer for previz and it's amazing. Please please please add vr support to cine tracer so a can creat scenes from within my vr headset. And maybe you can enable recording of the vr player movment to be used as a character movement ( so i can act build the scene in vr,then become the actor and act the scene in vr then i become the cenimatographer and shoot the previz in vr) that would be a dream come true :)

[@creativehuman3d383]

Fantastic

[@breadchooch6054]

Very nice!

[@thejetshowlive]

Wonder if HTC will release that .stl, I'd love to print it out

[@peterpetertorres]

Can you flip the Vive controller upside down so you have better access to the trigger. You'll obviously have to flip it in Unreal as well but it might be a temporary solution.

[@djdavewarren]

i have seen some videos where people are using an iphone as a camera tracker .... do you think that the tracking will be better with the Lidar sensor on the new ipad and future iphone 12 ?

[@EanMartinTays]

Very nice looking VP studio! I'm VERY interested to see the high end tracking system. Also how high res can Cine Tracer go and does/ will Cine Tracer have VR support similar to Unreal Engine?

[@CinematographyDatabase]

I could enable VR, but the majority of users do not have VR ready systems for Cine Tracer from what I see. People struggle with even basic maps with dynamic lighting and basic Ray Tracing, which is why I removed the old maps from the game a while back. As the user base evolves so will the system. On my machine I can load huge maps and do VR etc. it's possible.

[@chfilm]

Definitely interested in the high end tracking solutions!!

[@EnricoGerominProd]

Very cool as always. Would be nice to be able to map/control via USB some dmx lights linked with the 3d environment. Also something in slowmo!

[@CinematographyDatabase]

UE4 4.25 got DMX, ArtNet, and a few other protocols that I have to try out for controlling real world lights.

[@ДмитрийРубин-ж4м]

Tell me please. what mount is used for the tracker? I have a hand milking tracker, how to fix it?

[@jerrtinlsc]

Hi, if I'm not shooting in 8K, can i use Atem Mini Pro for the capture card? Also, would love to know what kind of jobs Virtual productions can bring in and the prospects of it the near future. thanks!

[@NiteshKumar-cs4wo]

what if the chroma background which is 3d is replaced by 360 video. Is it possible to do it. If it is then please make tutorial about that

[@CHTFilms]

Can it record my camera movement then apply it on a scene rendered of Unreal Engine 4/5 (for example I shoot person i real life on a green screen and this thing tracks all the movement of the camera within the shot and then apply it to add background generated in UE behind my person etc... I really need some tutorials as I am music video maker and it will be a great opportunity to level up my production. I am ready to pay if you offer this type of tutorials personally!

[@andrewwilkins3644]

Have you been able to get your hands on the Ncam reality setup?

[@hasancivili]

Can I do this setup with mocap trackers in 16 camera mocap workshops? and can any dslr camera be used instead of black magic camera?

[@Zaqariyah]

Interested in camera tracking export to use in VFX (when footage tracking is not good idea)

[@puyakhalili]

LED wall would ba amazing to explore. Just curious if a rear projection setup would also work instead of a LED wall?

[@d3tach3d]

It should if you have a powerful enough projector with the write kiind of material.

[@ClipAds]

Vive : whats the difference between the controller and tracker?

[@archonoff]

Hi Matt. We're still waiting for a video about high fidelity tracking solution for indies

[@Nugromant]

Hey bro, can you talk about the PC Requirements to do nice Indie VP ?

[@letsplaychronicles9483]

can this also be used while livestreaming? I.E. with vMix? If you have any information, please feel free to give some advice, please :)

[@iamcrisanto]

I have a Wii Remote and Wii motion plus attachment as far as I know it has similar tracking capabilities to the Vive controller. I currently have them coneccted via bluetooth using Dolphin emulator. Could I connect my wii mote to it? That would be super cool indy production!

[@AshNair26]

Hey Chris, are u aware on the ballpark costs on a LED curved wall?

[@daniilkzorin5645]

Hello. Where can i buy the "SECRET WEAPON"? Any updates?

[@juancasacuberta1958]

awesome mate... I want that controller clamp! where can I buy it?, is it avilable? do you know?

[@juancasacuberta1958]

or maybe where to find that file in order to print it...

[@CinematographyDatabase]

The STL is linked in the Unreal Engine Virtual Production Facebook group

[@color_barz]

Do you know fi that special piece can be purchased?

[@endorfineproducties9499]

Hi Matt, just watched a few post from you (including the hour about Cine Tracer. Great job) and curious about your new posts on the higher end tracking devices. I own a big permanent Green Screen Studio (the liimbo Green is 12mx12mx5m with full light mesh) in the netherlands and want too specialize myself in the Virtual Studio Broadcasting and mixed reality market. I think the Mo-Sys technology StarTracker is an easy too use tracking system for a permanent and "mobile" green. The also do body tracking with it. What do you think? Dont have prices yet do. Brainstorm InfinitySet together with UE4 will make it into a pro studio. But on the other end its good (and a aim) too consider "low budget" options too. Thanks for all your post. realy apriciated. Peter

[@CinematographyDatabase]

We will hopefully we showing some Mo-Sys stuff in the future, for a big professional studio you definitely want to jump right into a turn key solution for hardware and software, unless you are also a VFX/Real Time studio with tech artists/programmers etc. and can build your own. I think the Vive in the context of a professional studio is good for a smaller break off virtual scouting or virtual camera setup. That can be run by one person and doesn't require actors, unless you are putting someone in a mocap suit etc.

[@TheDavidPosada]

definetely interested in led screen mixed reality, already own a bunch of gear and would like to get into this area of production

[@jaimevives4098]

When using the camera view, I'm scrolling to change the focal lenght, but it rotates instead. Does anyone know why?

[@dannylammy]

Looks amazing! What kind of projects do you do with this system?

[@CinematographyDatabase]

I develop previs and virtual production tools for filmmakers (Cine Tracer), so this is a testing stage.

[@GregCorson]

Is there some place where we can buy one of these? Or did they ever release the 3d printer file for it?

[@CinematographyDatabase]

HTC released the file, it’s in the files of the Facebook group

[@PlanetFrosty]

Extremely interested in high end camera tracking.

[@levantestream5]

Please fríend, one tutorial of how connect htc with unreal ANd tracking camera with chrome. Use aximetry Is possible? Regards

[@joelarvidsson]

I saw a post yesterday of using the vive tracker to get a tracked "live action camera" to be able to place 3d object without the need of running a 3d tracker software. They did not demo it, and I cant find that post. But I get back on it if i do find it.

[@SportandnewsProducci]

Yes please, really interesting

[@rushboardtechuk]

It's only a shame LCD wall panels are not seamless like LED; instead having a minimal, but still very noticeable bezel. Have you considered, therefore, Transparent Colour LED Film on a black glass wall, as many are self-adhesive and would have a lifespan of 50,000hrs before replacement? Some sources are also fairly affordable for entry-level.

[@adrianoufrb]

Can we use Windows Mixed Reality instead of Vive?

[@iwanhutapea8843]

hi, im really interested in the cheapest pro system for entry level

[@Solovision2024]

Do you have an example of a person using a motion capture suit with a green screen suit over it so the actor can interact with the real environment then replace green screen actor with animated character.

[@zzjack1426]

Hi，matte，i have follow you so long,I Have a problem, i want to use HTC vive handle for UE4 virtual camera，if i need buy a dongle ？

[@noahstudio3717]

Can some one tell me the list of equipment for UE4 camera tracking please.

[@TheWillvoss]

Do you need a HTC vive for this to work? I see someone used the Valve Index --- Will any VR system with baystations work for this as long as UE4 compatible? I have 0 intrest in VR but I do want to do In Camera UE4 content/talent.

[@CinematographyDatabase]

You can use just a base stations and a vive controller or vive tracker. You don't technically need the headset.

[@TheWillvoss]

@@CinematographyDatabase Sir, thank you so much for doing all of this. As a VFX compositor, its something i definitely see reducing our workload, for better or for worse.. I can only imagine clients with this power in their hands, but this is the way the world is turning. You're a pioneer. Thank you very much. Looking at HL-Alyx though... i may have an interest in getting the headset... lol...

[@sinanarts]

Never Answers 🙂

[@iordirequena]

Will Cinetracer work with other VR Systems? Aka Oculus

[@CinematographyDatabase]

Right now only Vive and Index.

[@thejetshowlive]

Hiya Matt, is there a .stl file out for this that you know of?!

[@GoldenPickaxe]

Hey man, does CineTracer have support for the Steam Controller?

[@CinematographyDatabase]

Not sure, but if it's just a normal twin stick controller I would guess yes. However, it's just partial support mainly for controlling camera in real time.

[@GoldenPickaxe]

@@CinematographyDatabase Steam Controller has an analog stick and two congifurable touch pads, l/r 1/2 (with analog trigger), l/r squeeze paddles, and a gyroscope. I was just hoping anybidy had attempted using these controls, especially the gyro, for camera movement. I would presume if I bought Cinetracer on Steam I could just make a config but I'm just out of the loop

[@luisjavier1781]

88/5000 hello, excellent video. Where can I download the STL for mounting the HTC control

[@mrpuma141]

does anyone know the shoulder rig he has the controller on? Thanks!

[@CinematographyDatabase]

made by Redrock Micro 🍻

[@dothefilmTV]

we used some highend systems, most of the time it's around 30k$

[@CinematographyDatabase]

nice, what systems have you used?

[@dothefilmTV]

@@CinematographyDatabase halidefx one, actually we are in talk with mosys

[@CinematographyDatabase]

@@dothefilmTV very cool, I know the Halide dev and I used their older Previzion Lightcraft system. I've chatted with MoSys is well, hopefully we can show their system later this year.

[@miguelbenitezparga1368]

hello how can i contact you

[@gregmar7469]

Would you be interested in partnering with us to produce a full 180deg LED back wall Mixed reality demo? We have a very large inventory of 2.5mm LED panels and multiple warehouse locations in US and Canada. We are very interested in this industry.

[@westleyleonstudios]

Is that just a Microphone clamp?? That's what it looks like.

[@CinematographyDatabase]

it basically is, but it's specifically formed to the Vive Motion Controller and designed to keep it in a very particular angle. Using a clamp or bongo ties etc. works but it's never perfectly level.

[@wstolk]

@@CinematographyDatabase Is there any news or possibility of Vive releasing this clip file or someone making it? It looks so much safer than the clamp setup

[@rodelioferrer6187]

I havent learned anything from what you said