Mixed Reality Capture with META MRC Tutorial on 2024

[@monzagreatvr]

Thank you so much for this!

[@veinbermain]

my pleasure bro☺

[@CloudSEKApps]

Hi, Thank you so much for this. One Question. Does this work with hand tracking and passthrough?

[@veinbermain]

Your welcome. Yes it works with game/app that support MRC with hand tracking and passthrough, you can check my other mixed reality capture video with hand tracking (vacation simulator) and zosu zoo home (passthrough)

[@hackedmixedreality]

So glad you got this sorted!

[@veinbermain]

but the number of supported games heading to an extinction 🥲

[@jmcwaterworld6036]

Do you have tutorial for mobile apps like iphone android mixed reality capture

[@veinbermain]

Hi, for android mobile yes I do have the tutorial but it's oudated, you can check it on my playlist TUTORIAL and I'm afraid the APK (LIV Mobile for androoid) no longer work, sadly the developer decided not to continue the project 😥 As for iPhone, since I don't have the device so I can't make the tutorial. but no need to worry you can check it here : kzbin.info/www/bejne/aWnVaohrbbWIqaM

[@lady-astronaut]

gracias , pero por desgracia me sigue dando error ... solo funciona con gravity sketch?

[@veinbermain]

well basically it will work with app/game that support mixed reality capture (MRC) but unfortunately not all app/game support MRC and even worse some apps/games that used to be support this feature were not able anymore since quest got firmwire update v50 and above. yes, gravity sketch is one of the app that until now still support MRC seems META do not care about MRC anymore, they focusing on AR passthrough mixed reality

[@Vitas.Lejang]

Sangat berguna videonya bang👍🏻

[@veinbermain]

terima kasih 🤩 🙏

[@renaudsteve5799]

thanks!

[@veinbermain]

you're welcome. fingers crossed though, because it's hard to find games that still support MRC

[@hicksa1]

Hi why did it connect to my Android instead of my Webcam? Thank you ☀️

[@veinbermain]

Hi, have you set the camera layer on OBS to your webcam ?

[@hicksa1]

@veinbermain Happy Holidays it doesn't show up, I will restart everything again thank you so much.

[@veinbermain]

@@hicksa1 happy holidays to you too 😊 there's button labeled ACTICATED/DEACTICATED when you double clicks on Video Capture Device in the Sources tab, sometimes it switched to DEACTIVATED

[@MezzaVRchannel]

thanks om tutorialnya

[@veinbermain]

ok, sama2, kabarin hasilnya ya, penasaran sama Q3 bisa nggak pake metode ini

[@MezzaVRchannel]

@@veinbermain di quest 3connect kalibrasi oculus mrc bisa, tp pas di OBS gagal connect terus om apa karna saya pakai sistem os v62 kali ya jadi udh ga bisa lag pakai MRC

[@veinbermain]

@@MezzaVRchannel OBS pakai versi berapa ? game yang lagi dicoba MRC nya game apa om ?

[@MezzaVRchannel]

@@veinbermainobs versi 2.4 sesuai versi rekomendasi dr oculua mrc, dan biasanya ga mesti masuk game tp aplikasi quest oculus mrc nya bisa connect ya dengan obs inipun ga mau connect malah disuruh restart headset tetap setelah di restart ga bisa juga

[@veinbermain]

copy manual mrc.xml nya ke folder com.oculus.MrcCameraCalibration di android>data nggak bisa konek karena nggak ada file itu di foldernya, jadi hasil kalibrasi emang nggak ada yang kesimpen di headset meskipun udah pakai MRC Tools v5.1.2 coba om pakai MRC Camera Calibration yang versi SoapyMan di kolom deskripsi, itu lebih manjur, saya nggak bisa cobain soalnya Quest masih di fw v50 😅

[@jmchan]

Is this work on reality mixer on iphone

[@veinbermain]

I can't confirm myself since i don't have iphone to test with, but according to Reality Mixer's developer it still work as long as you have the mrc.xml file then copy it to the game folder and also the game itself need to support the MRC feature which is many of them no longer support it. You may want to check here for detail explaination : github.com/fabio914/RealityMixer github.com/fabio914/RealityMixer/blob/main/Additional-instructions.md

[@jaevaera7369]

thanks man :)

[@veinbermain]

anytime 😉 but fingers crossed bcoz lots of devs pulling support for MRC 🥲

[@yongcaiwu9144]

Connection failed Please verify the Quest IP address, and if MRC-enabled game is running on Quest. Reboot the headset and re-launch the game if the issue remains. What should I do if I can’t connect to the IP tool?

[@veinbermain]

hi.. what games were you trying to capture with MRC ? sometimes the connection is fine but the game itself doesn't not support mixed reality capture

[@M41D3R]

Pistol Whip not working with MRC.xml help

[@veinbermain]

hi, make sure OBS and Quest is the on same network and same IP address

[@M41D3R]

@@veinbermain .. Just pistol whip

[@veinbermain]

ah i see, if that so developer may pull the MRC suppport of their game, sadly many did that like beat saber quest version

[@harp8282]

Does this work on Quest 1 connected with oculus link cable to a pc? meaning does this work for playing steam games?

[@veinbermain]

hi, this method on video is an MRC for native Quest game, technically it should work for any Quest version as long as the app/game itself support for MRC. if you want to make an MRC content for steam games you have to use LIV and choose PCVR Mixed Reality Capture, as for PCVR MRC you can use any VR headset as long it can connect with steam (for Quest headset you can use virtual desktop, steamlink, airlink or cable link) but i recommend to use virtual desktop instead

[@harp8282]

@@veinbermain thanks

[@veinbermain]

@@harp8282 anytime 😊

[@deluxemixer7649]

great and fun tutorial! followed all steps :) if i run the Mixed Reality Capture APK from the headset, then I can see the text of my IP adres as an overlay in the foreground of my camera feed > so it seems to work! but if i run another APK such as Beatsaber Demo or Gravity Sketch with the MRC file added to their app folders it keeps saying "Connection failed" when pressing "Connect to MRC-enabled game running on Quest"... Any idea how to fix this? Help is much appreciated!!!

[@veinbermain]

Hi, thanks for dropping by. Beat Saber Demo version was never meant to support MRC because back that day even the full version of Beat Saber need you to toggle the MRC option inside setting menu but if you buy that game now you won't find that option because Dev made it 'automatically turned ON for MRC' but then again, Dev decide to shutdown the MRC support for Beat Saber Quest, only Beat Saber PCVR (steam) that support MRC through LIV 😭 As for Gravity Sketch I can confirm you that it's till run well on MRC, i use Quest 2 on firmwire v66. Try to restart the headset and OBS, run the game again, make sure the IP address match with your headset IP (sometimes it changed when failed to connect/reconnect to headset on unsupported games). You may want to try to connect with game that you know for sure it run MRC without problem then start with Gravity Skecth.

[@veinbermain]

You might want to check it out about Beat Saber Quest MRC on reddit www.reddit.com/r/beatsaber/comments/1bv4dtz/comment/kysdsvy/

[@deluxemixer7649]

​@@veinbermain Highly appreciate your reply, Vein! Unclear to me: both FIGMIN XR and SHAPESXR work. Gravity Sketch (version 6.3.5) still won't connect, even after some on-and-off attempts. I am running on a Quest2, firmware .67. Any other guesses, how to get Gravity Sketch connected? This would be my ultimate goal... Thank you so much for your guess...

[@veinbermain]

@@deluxemixer7649 hi, i'm so sorry, i must have mixed up gravity sketch with openbrush, my bad. openbrush working well on MRC and as for gravity sketch last time i tried MRC was before i update to latest build and fw v66 that's why i recommend other to try gravity sketch to test MRC i just tried it few hours ago, you are right MRC did not work on gravity sketch you may shout to dev to let them know that their latest build has broken the MRC

[@deluxemixer7649]

@@veinbermain thank you so much for checking and for your suggestions! i will let you know if i make it in the end :)

[@FunBabyBeatSaber]

@veinbermain Thanks for the tutorial. How do I get to my MRC.xml file? I was able to follow the tutorial up till saving my calibration as a json file, but I couldn't find my mrc.xml file

[@veinbermain]

it's under : C:\Users\[your user name on PC]\AppData\Roaming\Mixed Reality Capture\savedCalibrationData are you planning to do MRC with Beat Saber Quest version ? if you do, it will not work since Beat Saber Quest version no longer support MRC

[@FunBabyBeatSaber]

@@veinbermain Yes, I was trying to do MRC with beat saber. Thanks for the heads-up

[@veinbermain]

anytime 😉

[@veinbermain]

@@FunBabyBeatSaber hi, i don't know if you still interested on MRC for BeatSaber Quest version, i have done some test and you can actually make MRC with BeatSaber Quest as long as you downgrade it to version 1.28, it support mods and MRC as well

[@kavurivijayababu9432]

what are the mrc supported games on quest 3

[@ja_walker5415]

Great tutorial. But, can you help me? When I try to connect I get this: Please verify the Quest IP address and if MRC enabled game is running in Quest. I do everything you suggest but can not get connected (used same network for pc and quest) Thanks!

[@veinbermain]

may i know what game were you trying to do the mixed reality capture ?

[@ja_walker5415]

@@veinbermain Hi! I try with: beatsaber, gravity sketch, open brush. I use Quest 2.

[@veinbermain]

@@ja_walker5415 sadly Beat Saber quest version does not support MRC anymore neither does the OpenBrush, as for Gravity Sketch MRC you're good to go, just restart the headset and OBS if it failed to connect

[@ja_walker5415]

@@veinbermain Hi Vein. Thanks. I tried but I still can't establish the connection. Is it possible that I need to make some configuration for the port in the firewall? Again thank you very much. It's the best video I've found!

[@veinbermain]

@@ja_walker5415 Glad that my video can help you, sorry for the trouble you've found so far. You may want to try to make some configuration on firewall for the port but i myself leave it to default. Let me know how's the result after the configuration done. Cheerz 😊

[@fyexoz7651]

record nya wajib pakai obs ya? kalo pakai recording driver bawaan dari Amd/Nvidia bisa kah?

[@veinbermain]

OBS selain untuk recording dia berfungsi juga sebagai compositor (menggabungkan layer Background, Camera/player dan Foreground) kenapa compositornya wajib pakai OBS ? karena plug-in Mixed Reality Capture dari Oculus/Meta khusus untuk OBS (khususnya OBS v2.4) kecuali compositornya pakai LIV Quest-on-PC nanti recordingnya bebas pakai aplikasi apa aja, sayangnya LIV QoPC ini udah nggak bisa lagi dipakai, developer nya fokus ke project lain dan sepertinya tidak dilanjutkan, padahal QoPC ini lebih gampang waktu proses kalibrasi dibanding app bawaan Oculus/Meta beberapa video MRC saya pernah pakai LIV QoPC, ada keterangan sufix di judul video 'LIV QoPC' kira-kira begitu penjelasannya, semoga membantu ya 😁

[@viniciusplaygames6042]

work in liv app? and works with contractors?

[@veinbermain]

LIV Connect app refuse to align it's virtual camera to the real camera so the calibration is impossible to be done correctly, i have no idea what happen because the last time i used it for others mixed reality video was just fine If you calibrate exactly like steps on video, LIV can read the mrc.xml file but your calibration is off on LIV output screen, i don't know why 😅 As for Contractors (not the SHOWDOWN i haven't test it yet), yes it works but the alignment is off, your virtual hand will appear below the real hand on the screen output (OBS) i hope this will help you, feel free to ask if there's anything else thanks for dropping by

[@viniciusplaygames6042]

@@veinbermain yes, it helped me a lot, exactly I was talking about the contractors, not the showdown, I would like to suggest recording a video of the contractors in mix reality, I would really like to see

[@veinbermain]

i will test it again on steam version, see if that makes any diff on the calibration result, fingers crossed bro 😅

[@veinbermain]

i've been doing some test here and there, sadly pcvr contractors didn't support LIV anymore, Dev pulling the feature years ago. On Quest version, it can be run on mixed reality but the calibration is way off so it won't be a good video/content

[@viniciusplaygames6042]

@@veinbermain :( thank you

[@kavurivijayababu9432]

what games does this MRC support

[@veinbermain]

V-Speedway, Gravity Sketch, Roll-A-Mech, Figmin XR, Fore VR series, Beat Saber v1.28, Pistol Whip Developers may change it to not support MRC on their upcoming update then you need to downgrade the game version to be able to use MRC

[@kavurivijayababu9432]

Tq u ... i do followed what you said but it shows connection failed please verify ip address and if mrc enabled game running on quest ...even if i reboot and tried same thing occurs ...i tried it on gravity sketch on quest 3

[@veinbermain]

@@kavurivijayababu9432 latest update of gravity sketch break the MRC, you need to downgrade its version in order to use the MRC feature this may help you find what version of Gravity Sketch that still support MRC Version 6.2.22-generalqc (8627) ---NO MRC Version 6.1.8-generalqog (7825) ---MRC OK Version 6.1.6-generalqc (7756) ---NO MRC Version 6.0.11-communityqog (7238) ---MRC OK Version 6.0.2-qc (6857) ---MRC OK Version 5.6.0-qc (6304) ---MRC OK

[@adyray]

nitip sendal dulu bang, biar nanti kalau di rumah bisa ujicoba lagi

[@veinbermain]

@@adyray okay 😁

[@adyray]

@@veinbermain cara download/install OBSnya gmn bang?yg asset itu ya?kok gak ada exe nya

[@veinbermain]

@@adyray bukan EXE tapi ZIP, yang didownload cuma pluginnya aja dengan asumsi OBS v29 udah terinstall di PC ini direct link ke ZIP filenya, extract terus copy ke folder yang sesuai github.com/SoapyMan/obs-plugins/releases/download/1.40.0_release/oculus-mrc-obs29.zip

[@adyray]

@@veinbermain itu untuk plugins tambahannya kan ya? untuk OBS v24 link directnya ada bang?aku nyoba lewat link abang dapat zipnya terus bingung gmn ngejalaninnya

[@veinbermain]

@adyray betul, plugin itu file tambahan untuk OBS plugin untuk OBS v.29 file ZIP nya extract terus copy ke folder OBS studio di folder Program Files di drive C atau di lokasi OBS nya diinstall kalo waktu paste folder2 tadi lalu ada peringatan file sudah ada/existing file, timpa aja nggak apa2, itu karena sebelumnya sudah ada plugin Oculus MRC yang terinstall dari proses kalibrasi sebelumnya kalo sudah dipaste plugin tadi, jalanin OBS seperti proses kemaren, tes klik properties/klik 2x di Foreground atau Background supaya keluar menu Connect to Oculus MRC Game

[@fyexoz7651]

kamera nya bisa pakai dari hp gak di hubungin, soalnya gak punya webcam

[@veinbermain]

bisa, saya dulu pernah pakai droidcam

[@keniride3255]

Does it work on quest 3

[@veinbermain]

yes it does as long as the game/app itself support MRC

[@rickygalaxy1189]

nyari file mrc.xml nya dimana ya mas bro? ngubek2 ga nemu hehe

[@veinbermain]

cek video di menit 07:51

[@simspedezlvl8]

Ka webcamnya pakai merk apa?

[@veinbermain]

pakai Logitech C930E

[@QueenTorVR]

Mrc works now?

[@veinbermain]

works on few native Quest games not as much as before the new firmwire (v50 and above) update, certain developers still gave support to MRC and some drop their support, maybe you want to try MRC on ForeVR series and FigminXR just to test it out, gravity sketch works well. now AR passthrough is META's new toy called mixed reality,t hey won't bother about MRC anymore

[@QueenTorVR]

@@veinbermain I play synth riders and beat saber i attempted sr today but no luck i copied step by step ill try different games to ssee if it is just the sr game thankyou for replying

[@veinbermain]

beat saber's developer pull their support for MRC on quest version 😥

[@veinbermain]

@@QueenTorVR try do downgrade your Beat Saber version to v1.28, this one still support MRC