Mixed Reality With Unity XR Toolkit - Part 1 : Setup

In this video I'm going to show you how you can use OpenXR with the Unity XR Interaction Toolkit to do mixed reality on the Quest 3.
❤️ Support on Patreon : / valemvr
🔔 Subscribe for more Unity Tutorials : www.youtube.co...
🌍 Discord : / discord
🐦Twitter : va...
👍 Main Channel : / @valemvr
🔥 Tiktok : / valemxr
github.com/Uni...
github.com/Uni...
····················································································
❗❗❗ WISHLIST MY FIRST VR GAME ON STEAM ❗❗❗
store.steampow...
····················································································
📝Best VR Assets ( These links are Affiliate links which means it costs the same to you and I get a small commission. Thanks for your support!)
VR Interaction Framework
assetstore.uni...
Hexabody (Physics VR Player)
assetstore.uni...
Mirror and Reflection for VR
assetstore.uni...
Auto Hand (automatic hand grab pose)
assetstore.uni...
Hurricane VR (vr physics interaction)
assetstore.uni...
3d Hand Model for VR
assetstore.uni...
····················································································
Full Series on How to make a VR game • How to Make a VR Game ...
····················································································
If you enjoyed this video, here are some other really good channel you should appreciate :
⌨️ Game Dev
Brackeys : / @brackeys
Dani : / @danidev
Code Monkey : / @codemonkeyunity
👨‍🎓 Vr Dev
Justin P Barnett : / @justinpbarnett
Vr with Andrew : / @vrwithandrew
····················································································
#vr #vrdev #madewithunity

[@Lordsi]

I Been waiting for this XR Toolkit AR Series!!! Thanks VALEM! excited for this one

[@bencrystalofficial]

Can't wait for more of this, thank you so much! Two questions: first, any recommendations for OpenXR hand tracking in AR? And second, any estimate of when we'll be able to see passthrough in editor? I'm making a lot of small changes back and forth and it would be so much more convenient!

[@squashi2701]

Excelent video , cant wait for more!

[@mikashki]

A couple of questions; have you looked into the new Unity Mixed Reality Project Template (for Unity 2022.3) with which you can create a new MR project right out of the Unity Hub? How is that different to your approach? Also, would this MR app (yours or the Unity template) also work in Pico4, or what would need to be done to enable it to work in Pico4?

[@szafa1858]

love your tutorials, also your accent is on higher level, good progress since i first found your channel, keep up the good work

[@poolguymsj]

You suggest that we should ask in the comments if we have problems. I'm curious why we can't use HDR and post processing with the universal render pipeline in mixed reality. Can you reply with an explanation of that?

[@ValemTutorials]

It's messing with the passthrough shader and stop it from rendering it seems.. :/ But I hope they will fix it soon

[@taratust2735]

Thank you for your every video

[@ThisisthegreatestPLANN]

Does this work with quest 2?

[@freakingreninja7790]

It technically should, the passthrough will be black and white but for prototyping it should work

[@nyghost9991]

EXCELLENT VIDEO

[@TheShittyBeatles]

Which two VR tutorials of yours does this pick up from?

[@thomasvanbeeck6837]

Could you do a video on how to setup OpenXR with the Quest 3? I simply cannot get it to work at all with OpenXR. MetaXR works fine and in Unreal Engine I'm also able to use the Quest 3 to test everything. Just the combination of OpenXR and Quest 3 doesn't seem to work for me.

[@G3David]

really looking forward to a tutorial with upper body tracking, have a game that got put on hold because the core needed some body tracking for bobbing and weaving. plus, once we have this, can be implemented in a lot of different games where it matters, like anything first person where you might have to dodge or, even hide and seek where you want to make sure you keep your body hidden, ability to lean out around a corner without o look theres my whole right side poking out

[@suryavijayy]

Dear Valem, Can you make some XR Tutorials and Videos for UNREAL ENGINE :)

[@SuperSonic68]

It seems that, so far, OpenXR's passthrough APIs only support the calibrated cube volumes and not Quest 3's room scan mesh. Is that correct? If so, I think I will hold off until OpenXR and AR Foundation support it.

[@HansMilling]

I am missing the AR Feathered Plane, what did I do wrong?

[@tobiasandrea]

You need to import the AR Starter Assets from the XR Interaction Tollkit via the package manager/XR Interaction Toolkit/ Samples

[@antonolivaresjuanjose2992]

Yo ya he realizado alguna aplicación con xr interaction y quest3

[@sampalacio]

Will it work with Quest 2?

[@hoainhan9118]

I am experiencing FPS issues when implementing Passthrough in Unity VR. My FPS drops to below 5, even hitting 0, but it works fine without Passthrough. I've tried just adding a cube and even creating a completely new project, but I still face similar issues. I have also attempted exporting the APK file and distributing it on App Lab, but the problem persists. Please Help me!

[@mistafisha]

My AR Foundation package had a problem with allowing the scripts to be added as components with versions other than 5.1.0-pre.10. I'm using Unity 2022.3.1.0f1. They would become disabled or behave like they didn't exist.

[@christiantoffalori5355]

With Oculus Quest it is possible to achieve exact plane detection, automatically obtaining the angles of the physical object?

[@futuremapper_]

Can you show mixed reality setup with the all in one meta xr package? I have got it running but i cannot seem to get the passthrough to show even though i enabled it

[@GrzegorzKiernozek]

nice!

[@brurrik]

My app doesn't open on the quest pro. Just goes back to the menu

[@WilcoBoode]

I have the issue that the Quest 3 does not accept Vulkan as the Graphics API, (app instant crashes with a "Invalid Device" warning. Did you encounter this at some point as well? If we disable Vulkan, then we get another warning and the app doesn't show any output (which is fixed after locking and unlocking the device) "Unity Skipped rendering frame because GfxDevice is in invalid state (device lost)"

[@ZhengMa-ix8gh]

how to exchange a vr game to mr game in vision pro

[@williamcousert]

Is it difficult to create a mixed reality app that can compile and run on both a Quest 3 and a Vision Pro without changing the source code?

[@oshinomeme6687]

Hey i wanted to switch between ar and vr but after i load the vr scene from the ar scene the vr camera doesnt work anymore.. The scene are identical just the actor has the setup changes from ar. Does someone know why?

[@DavidZobristGames]

thanks

[@gikisTSB]

Hi, do I have a chance to finish this tutorial if I use Quest 3 and Macos? (M1 max). Thank you.

[@somediedrank]

not explained how to get open XR plugin (no such a plugin for Android)

[@bencrystalofficial]

Hmm I just rebuilt and followed this process with the "XR Interaction Hands Setup" prefab and the background color is always opaque. I set it to black and then other colors with an alpha of 0, and have added the AR session, AR feather plane, camera manager, and camera background to the scene just like before with the same packages in the project. Does anyone know what I might be missing?

[@danielruizleyva3825]

same here.

[@danielruizleyva3825]

I was also experiencing a black background, even after disabling HDR from the Render Pipeline Asset as Valem explains in the video. What removed this black background was setting the "HDR Rendering" to Off instead of "Use Settings from Render Pipeline Asset" within the Main Camera GameObject, under the Output Settings section. However, I am not using hand tracking.

[@ansar2137]

​@@danielruizleyva3825bro! thanks a ton.. this fixed my problem

[@sheenaVR8]

@@danielruizleyva3825 thank you for the tip!

[@barakawins]

@@danielruizleyva3825 This Fixed it for me. Thanks!

[@jacksonpham2974]

Hi, I am using the version Unity 2022.3.15f1 but I cannot find the "OCULUS QUEST 3 in BUILT SETTING/ANDROID/Run Device (Menu Select Option)

[@drewswanberg6722]

Same problem, did you get a solution figured out?

[@白乌鸦异乡]

somebody tell me PLEASE！！！Can quest3 using ar foundation image tracking function？

[@Outerman_]

u getting not ENOUGH views likes comments u are soooooooo underrated

[@TheCrazyGetawayGuys]

He's the GOAT

[@opafritzsche]

@@TheCrazyGetawayGuys he s great, but always: ANDROID, STAND ALONE. i need exactly this, for PC VR , or Seam VR. Stand alone is just: NO Option. not usable, not performant, ... nothing, for bigger Projects. This makes whole AR Senceless.

[@TheCrazyGetawayGuys]

@@opafritzsche more people use the quest = more money

[@tajin8122]

Is depth occlusion possible in openxr?

[@snufkrill]

Does that mean I can build a project that starts in vr with xr toolkit and using a scene manager i can go to a scene that works in Mixed reality?

[@alexrayoalv]

x2

[@opafritzsche]

@@alexrayoalv Most Problem is: i need this for PC VR. Not for this Stand Alone trash. Any idea if this works ? if i set my glasses to "Developer Mode" May work, but this needs an Occulus Developer account, and no costumer have this. This "Stand alone" APK and Android S...t. is just no option.

[@A_walk_in_the_park]

Hello Valem, a simple question. How would you go about making a gas spring in Unity? So that it expands as you open a door that has a hinge joint added to it. I would appreciate you answering my question for a change.

[@somediedrank]

not explain how to set renderer pipeline asset..

[@imdeet]

early gang

[@AndrewTSq]

Is there any one who do tutorials for real beginners? That shows how to setup everything? :)

[@tracytracy2664]

Does it work with Quest 2?

[@flym0]

This is what I am doing on behalf of a potential business partner who has a Quest 3.