Studio and Camera Rig Build | Mixed Reality Masterclass - Episode 2

[@blomproductions]

Hey when will the next Mixed Reality Masterclass come out? I am rely looking forward to see a tracked camera

[@ragesaq]

Stunning work as always Togue. Latest studio looks fantastic! I wish I had that much room!

[@TougeVR]

I don't think either of us would ever be satisfied with the amount of room we have XD

[@ToastedShoes]

Insane the amount of work and dedication that goes into this style of content is crazy. You're criminally underrated

[@Andy_Gensch]

These are SO helpful. I’ve scoured KZbin and articles for this info with no luck so it’s incredibly appreciated. I’ve subscribed! I work for a vr game development company & will be applying ALL of this. Can’t wait for episode 3 to tie it all together ❤️

[@TougeVR]

LOL putting myself out of business, one episode at a time 🤣

[@TougeVR]

Oh and just to clarify, ep 3 won't be the last. The core of how everything works will be explained across the first 5 episodes, followed by some more specific episodes on various composition techniques and some BTS on special projects.

[@Andy_Gensch]

@@TougeVR Haha nah Elon Musk does an open source approach too. With all of this being such a mountainous learning curve, you will always have clients unwilling to do the work. You can teach basics & setup all you want but you’ll forever have clients since none of us can repeat your talent 👌 Looking forward to your unrivaled content on this topic along with the rest of your channel 🤘😤🤘

[@raven2192]

Couldn't agree more

[@montydj85]

Many thanks. I was waiting for this episode.

[@TougeVR]

Hopefully it was worth the wait. Been a busy few months, which you can see a few glimpses of in this vid.

[@MaszekMester]

Dear m8.. I would like give a huge thanks for your videos.. It realy helped me seeting up my environment. Altough my methods are different due to room limitations, but I couldn't done without your videos which gave me HUUUUGE inspiration and motivation.

[@TougeVR]

That's awesome to hear, thank you!

[@XoRoseGold]

Touge, I really gotta say... these videos you put together are a masterpiece. Words cannot describe how much we appreciate learning from all of your trial/error and expertise. Cant wait to hear more about LIV dump mode. Keep up the great work! 😀

[@TougeVR]

Thanks, you're very welcome 🙂

[@JesterLind]

Subscribed for Masterclass Part 3 - Can't wait!

[@naxxtor]

Looking forward to the next episode “soon” :D awesome seeing how you’ve built this up.

[@TougeVR]

“Soon” yes. 😅 My return is imminent.

[@kevincary2885]

Dude, this is absolutely amazing content. Thank you for that ! Liked an subscribed. :) Looking forward to part 3 which will certainly be excellent as well ! Cheers

[@JO-id6ms]

excellent work. the quality of your MR videos is superb

[@GetHip]

Oh man, that lighting 2.0 looks fucking incredible. Can't wait to see that in action in a future video.

[@TougeVR]

Sometimes I think it's overkill to have 18 light sources for this little space, but it's genuinely needed. In fact I think I need more 😅

[@GetHip]

@@TougeVR It's easily the last step to make MR videos look the best they can. Anything not using "lighting 2.0" is gonna look so ass now.

[@TougeVR]

@@GetHip if you're referring to that last shot in lighting 2.0 with the RGB light wands in Beat Saber, there's a lot more work done in post to get it to look that way. There's at least 20 layers in that comp. Straight out of LIV it doesn't look anything like that, but that's how it *can* look.

[@atreides-]

More videos like this please, Incredible!

[@Monkayg]

This is a fantastic resource thank you so much for putting on this platform

[@ichderhorst2832]

I think thats the best setup in the world for Mixed REALITY i can bearly imagine that someone have a better one with more skillz.

[@TougeVR]

Thanks, but check out Splitverse to see what a much bigger budget and team can achieve in MR.

[@DonSibleyGames]

Awesome video mate. Do you have a link for that LUT mentioned for flattening the greens. 10:58 ?

[@TougeVR]

It wouldn't be much use unless you were also shooting on my camera in this space. Flick me a DM if you like.

[@DonSibleyGames]

@@TougeVR oh ok. I thought it was like a generic one for making greens easier to key.

[@giorgichoxonelidze8264]

Thanks so much for this contract

[@360look]

Hello Touge :) we are still waiting for your promised masterclass since last year :) hope you are doing well and you can make it soon

[@hosnehosne250]

Excellent

[@chriscodling6573]

Amazing can't wait till I get to this level on my stream 🎥

[@virgilcheung4968]

Thanks a lot！Looking forward to the new episode！

[@PaulMowbrayPjmowbs]

Nice one, thanks for sharing your workflow, looking forward to more episodes

[@TougeVR]

Thanks, just scratching the surface here too.

[@PaulMowbrayPjmowbs]

@@TougeVR interested to see your Quest workflow and whether you using Oculus Tools or just virtual desktop wirelessly

[@TougeVR]

@@PaulMowbrayPjmowbs VD & LIV

[@the.virtual.samurai]

Great stuff can't wait for the next episode 💚

[@tbeezie4sheezie]

Amazing setup! Been thinking about putting together a tracked camera myself. Thanks for the tip about using a gimbal to steady the footage, I can see that making a huge difference. Keep up the great work bro!

[@TougeVR]

Yeah, gotta stabilise everything otherwise it's a shaky mess. Even then it's super hard to keep steady. More on that next ep.

[@MrExoVR]

Oh my god, thanks for all your work :o you should be a permanent virtual reality teacher :)

[@mikecamo2353]

Hey great tutorial, i am looking for the brand and type of the tall tripod on wheels you are using.

[@Skeeva007]

These are helping me so much, man! Thank you! I eagerly await part 3!!

[@sukifree]

Only I can say it's awesome! We would like to try the same (but more simple than yours) using your videos to understand all steps. Thanks for your job and your time.

[@ethanalloway5946]

Love this! Might recommend a Hollyland wireless HDMI/SDI workflow for a wireless all in one camera monitor.

[@TougeVR]

Wireless everything would be lovely!

[@ethanalloway5946]

Agreed! Left you an email on your site regarding that DMX lighting question. :) Would love to discuss a solution I’ve already used.

[@ANABURN]

So coherent and well explained! There is a lot to learn from your expertise!

[@joshbrooks2827]

Hear I was thinking you'd abandoned the series thank goodness you are back

[@TougeVR]

I have been SO busy. 😅

[@alonelysnakeinvr587]

how did u put the lights on ceiling That what i am doing in my studio just need to no what to buy to hang the lights an thank you

[@TamasKalman]

fantastic, informative video, thank you. subscribed

[@syrsly273]

Great tips and great video.

[@98765theyoutuization]

these videos are great when will episode 3 come out !???

[@DestroMedia]

Holy crap your camera quality and everything is such a high standard makes me feel like mine is peasant xDD, Fellow aussie my guy

[@sircarlton6647]

very nice dude!

[@karliemorris7318]

I’d love to see how you’ve advanced since this video Great work you’re doing tho

[@mica4977]

12:12 Oh come on! I came here from the first episode seeking information on how to utilize Liv or other tools to composite a video in post after hearing you'd explain it in episode 2 and now this episode is speaking about it being on ep 3. Episode 3 better not say it's on episode 4 and/or on a missing episode! XD My current computer doesn't have the GPU power to do real-time compositing so I'm having the curiosity if I could record both scenes separate and composite them myself afterwards to save on resources mid-game.

[@TougeVR]

It really do be a massive topic though. It's important that I set a baseline understanding first (episode 1), then run through the hardware you need to take it to the next level (episode 2). Manual composition itself will be explained across 2 videos (ep 3 and 4), and that's only an introduction. It's a much more complex workflow compared to regular LIV. If you're hoping it will be lighter on resources though, it's actually even more demanding than regular LIV. If you're having trouble with performance in LIV, I'd suggest switching to a 1280x720 workflow, or lowering in-game settings. You can also lower the headset resolution scaling to free up some GPU. I often have to do this myself.

[@mica4977]

@@TougeVR After watching both episodes it's understandable you'd give the topic its own spotlight considering the quality & depth you provide throughout each step. I'm a multi-medium artist with a baaarely VR capable system but after buying the Quest 2 last month I've been having a bunch of fun playing Beat Saver! Since Liv was on the verge of working I was looking for info on using my own compositing skills to do the key'ing and other post processing effects myself and hopefully take some of the load off my low spec system while gaming but it's been difficult to find any info on the topic. Is sad to hear doing this is more taxing but at the same time I'm glad it's even possible! Saw an example of the output the Liv SDK Dump provides which does seem promising for a future when I have better gear. Thank you for the high quality free content you're providing David. I was only planning to have some fun with mixed reality but can tell you're already helping out many more people, some of which might be learning for their professional work so this means a lot to everyone.

[@TougeVR]

@@mica4977 if you have a Quest 2, I'd recommend trying the latest public beta from LIV. There's a native Quest version now which can work on potato PCs.

[@mica4977]

@@TougeVR Shall look into it! I've also learned about Oculus' native "Mixed Reality Capture Tool" geared to work with a select few games on the Quest 2. Allows the workload to be split between the headset (Game) and PC (Compositing). Sadly a crucial downside is that audio isn't transferred over to the PC so it has to be recorded externally and added in afterwards/through other means.

[@TougeVR]

@@mica4977 the new LIV tool leverages Quest games MRC integration. The advantage is you'll actually get the audio.

[@MrBcj226]

yeah! he is coming!

[@AlteradasTV]

Congrats for your awesome work! But, when'll you publish next episodes? There're some questions that I don't know how to get thru. First, I have a Rift and 2 Quests 2. And I'm having a lot of trouble for calibrating with a static camera. And I tried everything I could to use one touch controller, Rift or Quest, as the tracking. I'm using an iPhone 11 Pro Max as a camera, and I want to invest in a new camera, a Go Pro 9 or a Go Pro Max, but you said there is better and cheaper options... which? I'm in Brazil, and I'd really appreciate some help.

[@LouisPallascio]

Thank you so much for this! I see you haven’t posted the next episode yet, any plans to do so?

[@TougeVR]

Yes very much so. I have a tonne of work complete on Eps 3 and 4, but there is much to go. I had to take a hiatus for much of 2021, but regular activity will resume here very SoonTM.

[@LouisPallascio]

That’s great news! Thank you for the quick reply as well! Would you be open to offering coaching for a consulting fee should we need it? We’re working a rather serious project and your help could be crucial!

[@TougeVR]

@@LouisPallascio sure, find me on Discord if you want to chat - TougeVR#0001

[@brettcameratraveler]

Perhaps using something like a black, light absorbing backdrop would work better than a green screen in such a small space. Seems like it might open you up to playing a lot more with motived, dynamic, directional colored lights on your subject. You might be able to save on expensive studio lights, green screen etc. DMX, while versatile, might be overly expensive and complicated as well. They make those ambient LED strips for the back of TVs. Extend out a few of those ready made kits over the larger border of your studio in a place just off camera. Might do the job.

[@AaronRiceHelps]

Awesome content. Thank you for sharing. I’m really looking forward to seeing your next video on how to make my Oculus Rift & Quest rigs work much better for MR.

[@TougeVR]

Yep, the Oculus ecosystem is a challenge for MR, but we'll make it work!

[@ViverMan]

Cool! 👍

[@aaronyim5552]

Hi! I want to ask if there is any way to set two camera and capture the MR scene at the same time on live I havent figure this out but if yes that'd be cool

[@thegrandjourney8441]

Look, I get how some of this is niche but...seriously people subscribe. Thanks Touge for another great video.

[@BeamDeam]

So awesome. Now i just need 2 things: room space and money :D

[@TougeVR]

Yeah, unfortunately MR need a little bit of both of those.

[@aggrogahu]

Your desk is the IDÅSEN from IKEA, right? Were the wheels from IKEA as well? Also, I was worried about the structural stability of the table top when it comes to supporting a dual monitor stand, but it looks like yours is holding fine? Did you do any kind of reinforcement to the area where the monitor stand base is?

[@TougeVR]

Yes that's the desk. They have cheaper ones, but the table tops are just cardboard on those. This is solid "wood". I have a separate stand for each monitor which might spread the weight more evenly. Honestly the desk is putting up with far more weight than it reasonably should, but have had zero issues with it. The wheels came from my local Bunnings. Since filming this I've changed them for slightly bigger ones that roll better.

[@DogustanMerakli]

Amazıng vıdeos, you have been really helpful thank you. keep up the good work

[@lepatenteux592]

Did you ever try to mix an Oculus Quest with moving camera in Liv ? I wanted to experiment something of that kind... Camera on a semi-circular rail (easier to control the "blind spots") One or two lighthouses to track the camera and the rest inside que quest (I find movement tracking to be amazing on that device!) My other idea was to use an array of cameras to make a super wide field camera and pan inside that to simulate camera movement.

[@lepatenteux592]

Oh... I just found that one... so yes you do it... kzbin.info/www/bejne/pGKahWSna82pqrs

[@thomasfessler]

Thanks for the tips. I've just gone through the whole - which mirror less camera to get. Settling with a Sony a6400, the colors are great but overheating while recording 4k@30FPS over HDMI with a $1000 camera is kind of a bummer. It looks like your next video will be in the Lunix G85, that is known to have Autofocus issues. Can you cover what's working and what fails with your Lumix setups? I have a week to decide if I should keep the a6400...

[@TougeVR]

For MR I stick to Manual Focus. Panasonic cameras are known for pretty average auto-focus, though the GH5 isn't that bad these days. My only complaint with the GH5 is the amount of noise you get at high ISOs, but I'm otherwise super satisfied with it for the price.

[@thomasfessler]

@@TougeVR Good points. The last upgrade to the GH5 firmware fixed a lot of issues. Are you shooting in 1080p/60 or 4k/60?

[@TougeVR]

@@thomasfessler 1080p60 10bit VLog L

[@thomasfessler]

@@TougeVR @TogueVR thanks for the info. I appreciate the info. The GH5 is known to have a good level of sharpness and I'm sure that comes in handy with Keying a green screen. Your tips on lighting are well taken and it's really the key to good quality with the green screen.

[@ragesaq]

@@thomasfessler One reason he's shooting at 1080p60 is that Panasonic GH5s do fantastic oversampling and downscaling, the quality of what you get out of 1080p is really incredible. I had a Sony a6400 that I returned because of the overheating at 4k30 and the terribly soft 1080p.

[@RazorianBuck]

Great video!!!!

[@digitalmesh]

Still waiting for Episode 3 ! I have a go pro 5 with hdmi out to capture card in pc. Green wall and green cardboard & 2 lightboxes & overtop light. Does the job for entertaining friends :D but integrating the moving camera would be absolutely amazing. you can do it with a oculus quest, so maybe that would work for a rift S ?

[@TougeVR]

Hey, yes sorry I keep having to push back the filming of this series. Working on a number of Quest releases at the moment which unfortunately take priority. My moving camera process will probably work on a Rift S too, but it's definitely not a nice process. Prepare yourself for a lot of pain XD

[@digitalmesh]

@@TougeVR haha 😂 alright looking forward to those vidsa anyway! Really enjoy learning here and afaik you have the most amazing MR vids!

[@TougeVR]

@@digitalmesh thanks, appreciate the kind words. Tell your friends 😅

[@digitalmesh]

@@TougeVR will do! 😂

[@battlewands]

Hi, great work. I followed some of your initial videos. Are these techniques still valid with new vr tech coming out and can it be used for any game or just games with built in support. Thanks and keep up the good work...

[@hosnehosne250]

Is there a tool or program for calibrating the camera and controlling liv mixed reality? Thank you

[@TougeVR]

Huh? That's LIV.

[@awjpd3491k]

Hi, can we use Go Pro camera too??

[@killabyte888]

Waiting on you to drop knowledge on quest 2 mrc non stationary tracking

[@TougeVR]

SoonTM 😅

[@motioneer]

do you have a detailed tutorial on using that vive tracker on liv?

[@TougeVR]

Next episode in this playlist ;)

[@motioneer]

@@TougeVR Wanted to know how does a quest 2 and the vive tracker work for a mixed reality setup. Thank you :)

[@killabyte888]

Btw amazing video

[@hosnehosne250]

Can HTC VIVE TRACKER help calibrate the controls in mixed reality?

[@piXati]

Hi! Could you please give me some clue to how do you work with liv dump mode, because, as far as is see, the dump mode only capable of render all the layers in one screen, i thought it will be separated outputs. I'm waiting to the next masterclass so long and i don't want to hurry you, everybody need some rest ;) , but now i had to ask this, because, i'm not seeing the big picture about this.

[@piXati]

Never mind, than i'll just wait for the next episode...

[@farooqksa]

Please Make a setup video for Quest users too

[@TougeVR]

Yes! I'll have a couple videos dedicated to this.

[@adityathosar2026]

Hi, if I buy only one Vive tracker is it enough to track the motion? or base stations are compulsory?

[@TougeVR]

Vive Trackers rely on Lighthouse base stations, so yes you'll still need them

[@yuanpao9559]

I Need Mixed Reality Masterclass - Episode 3 please 🥺

[@TougeVR]

I’m sorry! I’ve been on hiatus, it’s still coming soonTM.

[@raven2192]

Great video. Quick question... Do I need a cam link for my GH4 to shoot in a stationary setting? Or can I just have a long micro to regular hdmi plugged into my el gato and then that’ll be enough to capture the mixed reality.

[@TougeVR]

You'll need a capture card of some kind, whether that's one of the Elgato PCIe cards, like the HD60 Pro I use, or a USB one like the Camlink. Either is fine.

[@raven2192]

@@TougeVR You da man. I have an hd60pro so I’m all good. Thank you for your time

[@learnersseries1167]

Can oculus mixed reality capture tool further enhances this process?...thankx❤️

[@TougeVR]

In general I advise against using Oculus MRC. LIV is a much more powerful and user friendly tool. At some stage I will talk about how Oculus MRC can be used in a pro environment, but it still falls a long way short of LIV's capability.

[@duchmais7120]

Hi. Can this technology help pay some bills or ots just for fun?

[@UpDownLeftDie]

I'm the market for a new camera and would love to know what the mirrorless is that costs less then a Gopro is!

[@TougeVR]

Having a few issues with that solution at the moment, so can't really recommend it until I work out all the issues with it.

[@hosnehosne250]

Does HTC VIVE TRACKER work with hp vr

[@sparkwebdesign]

Subbed and liked. Any updates on episode 3?

[@TougeVR]

Hey, yes, eps 3 & 4 are just around the corner. Update: kzbin.info/door/6fucrCGO-yWYyQvZx8nBCgcommunity?lb=UgkxUdzSxalTnqCtcS9xADbjGc7cakbx5251

[@ivvedoll]

Awesome

[@zilangleon]

EP3! EP3!! EP3!!!

[@TougeVR]

It's coming I promise! Sorry for the delay.

[@leon2133]

@@TougeVR i still waiting haha

[@vrfam3507]

What was that game you were playing on “beat saber” and jumping.

[@TougeVR]

That's from this video - kzbin.info/www/bejne/ppPTfKSojd2nmpI

[@vrfam3507]

@@TougeVR thanks for the link!!

[@happyplacetraveler]

Are we going to have an Episode 3?

[@TougeVR]

YES! I’ve been on a hiatus for nearly 6 months now, but am returning in 2022.

[@VictoRs107]

It would be great, if you could tell about "Unreal Engine". How to do the same in "Unreal Engine"

[@VirtualRealityCheck]

nice

[@Konakwa]

Is that a G7 + 7 artisans 7.5mm f2.8 ?

[@TougeVR]

GH3, but G7 is probably fine too. Not sure I’m ready to recommend that for MR though. The distortion is significant.

[@lazarobosch4260]

Where can I find the rest of this course?

[@TougeVR]

Hi, I'm still making it 😅. Yes it's been a while, but I've been buried in other work. It's coming as soon as I can.

[@lazarobosch4260]

@@TougeVR This makes me so happy! Looking forward to the next one!! I’m using your masterclass to build out my studio for my university :)

[@RonnyViana23]

Hello my friend I'm your fan and when will you have episode 3

[@TougeVR]

While I don’t have a date for the release yet, I will have some news to share on that “soon”.

[@Sventra]

I've been waiting for this video for sooo long!! Thank you for this episode, have you checked the new Tundra Labs trackers? They claim they are far more accurate than vivetrackers with a smaller footprint (and lower price)

[@TougeVR]

Yes, still super early though. Would love to get my hands on one to talk about here.

[@vresportsbrasil]

Sventra, can you tell me more about this Tundra Labs trackers?

[@TougeVR]

@@vresportsbrasil they're in development, Kickstarter launching soon. Available later this year.

[@vresportsbrasil]

@@TougeVR I just saw a video of those and I'm wondering why it took so long for someone to launch such a simple and smaller gadget than those bulky vive trackers. I'm getting a vive tracker by the way, I should be receiving it by next week, to use with the base stations with my quest 2!

[@TougeVR]

@@vresportsbrasil if you have the option, use a lighthouse based headset. Lighthouse + Quest is a guaranteed bad time. I mean it can work, most of the BTS shots in this video show me doing it, but it's not a nice process. I'll be covering that in a video here soon.

[@PaulMowbrayPjmowbs]

Hi, any news on episode 3?

[@TougeVR]

Hey, it’s still “soon”, but it’s getting sooner. Eps 3 & 4 will be coming together. They’re finished writing and am filming for them now.

[@vr9560]

我等了一年了，在线等更新第三集😂

[@TougeVR]

第 3 集将在 14 天内发布 :) 7天内频道更新视频 via Google translate, hopefully that works

[@vr9560]

@@TougeVR 好的，谢谢你

[@lepatenteux592]

When using a moving filming camera, you loose the ability for live compositing, is that what I am understanding?

[@TougeVR]

That's not strictly true; I've done live streams with a moving camera. Normally with a moving camera you are dynamically masking in post. This is a manual process that you wouldn't be able to reproduce live.

[@tukugr]

Lighting is still my weakest skill on mr.

[@TougeVR]

It can definitely take some practice, and trial and error.

[@Leiriel]

How did you find a tripod as tall as you bro 😮

[@TougeVR]

lmao, right?

[@supercoolmunkee]

One day when I get a house of my own, I like to invite you over to help me make an ultimate green screen studio using what you learned over the years for mixed reality videos. My dream is to have a home theater that is connected to my VR game room so that if I ever have families and friends over, we can enjoy both movies and game nights! This will be my inspiration for my dream home one day. I think home theaters is the future because of this pandemic and movies are now being released to online streaming services.

[@TougeVR]

Sounds like fun!

[@nyhc999]

sad for no episode 3?!?

[@TougeVR]

😢 hopefully an update on that soon

[@joemeyer9446]

have you fooled around with the concept of mixed reality with a 3D camera? you could use the same vive tracker right? just duplicate the location with an IPD offset for the 2nd perspective. There is a surprisingly large demand for good true recorded 3D content to watch in VR apps from Deovr to TV to youtubevr & Bigscreen. probably too much for the PC to handle live but I dont think there's any 3D livestreaming platforms really yet anyway.

[@skypup-s1x]

just saying im still waiting ona episode three

[@TougeVR]

I know right? I had to take a bit of hiatus, but it is coming back soonTM.

[@Paintingsvr]

😮

[@Kymgs]

Episode 3?

[@TougeVR]

Coming soon :) I’ve been on hiatus

[@alexbjorge1999]

Hey TongeVR how are you doing today

[@TougeVR]

Hi, well thank you.

[@alexbjorge1999]

@@TougeVR I’m glad you are doing well

[@moncimoov]

the cost 😭... I can only afford logitech brio and a pair of cheap soft box.. 😂.. with 2 10$ neon led..

[@TougeVR]

Mmmm, it does get expensive. Maybe I need to do a vid on the cheapest possible tracked camera setup. Even the budget setup I talk about here is over 500 dollarydoos.

[@DacyAndEric]

And he never another master class, again. :(

[@TougeVR]

Hey, it is coming back soonTM. The hiatus is almost over.

[@PatrickJoshua]

This is surprisingly very tedious and expensive. I hope you're earning them back from the trailer projects.

[@TougeVR]

Yeah unfortunately doing mixed reality at a professional level is a bit expensive, and is only going to get more complex from here.