Mixed Reality With Unity XR Toolkit - Part 1 : Setup

[@Lordsi]

I Been waiting for this XR Toolkit AR Series!!! Thanks VALEM! excited for this one

[@bencrystalofficial]

Can't wait for more of this, thank you so much! Two questions: first, any recommendations for OpenXR hand tracking in AR? And second, any estimate of when we'll be able to see passthrough in editor? I'm making a lot of small changes back and forth and it would be so much more convenient!

[@squashi2701]

Excelent video , cant wait for more!

[@mikashki]

A couple of questions; have you looked into the new Unity Mixed Reality Project Template (for Unity 2022.3) with which you can create a new MR project right out of the Unity Hub? How is that different to your approach? Also, would this MR app (yours or the Unity template) also work in Pico4, or what would need to be done to enable it to work in Pico4?

[@szafa1858]

love your tutorials, also your accent is on higher level, good progress since i first found your channel, keep up the good work

[@ДианаПугач-ь9в]

But what is the type of tamplate to use in this video?

[@taratust2735]

Thank you for your every video

[@poolguymsj]

You suggest that we should ask in the comments if we have problems. I'm curious why we can't use HDR and post processing with the universal render pipeline in mixed reality. Can you reply with an explanation of that?

[@ValemTutorials]

It's messing with the passthrough shader and stop it from rendering it seems.. :/ But I hope they will fix it soon

[@SuperSonic68]

It seems that, so far, OpenXR's passthrough APIs only support the calibrated cube volumes and not Quest 3's room scan mesh. Is that correct? If so, I think I will hold off until OpenXR and AR Foundation support it.

[@nyghost9991]

EXCELLENT VIDEO

[@TheShittyBeatles]

Which two VR tutorials of yours does this pick up from?

[@thomasvanbeeck6837]

Could you do a video on how to setup OpenXR with the Quest 3? I simply cannot get it to work at all with OpenXR. MetaXR works fine and in Unreal Engine I'm also able to use the Quest 3 to test everything. Just the combination of OpenXR and Quest 3 doesn't seem to work for me.

[@ThisisthegreatestPLANN]

Does this work with quest 2?

[@freakingreninja7790]

It technically should, the passthrough will be black and white but for prototyping it should work

[@Outerman_]

u getting not ENOUGH views likes comments u are soooooooo underrated

[@TheCrazyGetawayGuys]

He's the GOAT

[@opafritzsche]

@@TheCrazyGetawayGuys he s great, but always: ANDROID, STAND ALONE. i need exactly this, for PC VR , or Seam VR. Stand alone is just: NO Option. not usable, not performant, ... nothing, for bigger Projects. This makes whole AR Senceless.

[@TheCrazyGetawayGuys]

@@opafritzsche more people use the quest = more money

[@sampalacio]

Will it work with Quest 2?

[@suryavijayy]

Dear Valem, Can you make some XR Tutorials and Videos for UNREAL ENGINE :)

[@christiantoffalori5355]

With Oculus Quest it is possible to achieve exact plane detection, automatically obtaining the angles of the physical object?

[@hoainhan9118]

I am experiencing FPS issues when implementing Passthrough in Unity VR. My FPS drops to below 5, even hitting 0, but it works fine without Passthrough. I've tried just adding a cube and even creating a completely new project, but I still face similar issues. I have also attempted exporting the APK file and distributing it on App Lab, but the problem persists. Please Help me!

[@mistafisha]

My AR Foundation package had a problem with allowing the scripts to be added as components with versions other than 5.1.0-pre.10. I'm using Unity 2022.3.1.0f1. They would become disabled or behave like they didn't exist.

[@futuremapper_]

Can you show mixed reality setup with the all in one meta xr package? I have got it running but i cannot seem to get the passthrough to show even though i enabled it

[@HansMilling]

I am missing the AR Feathered Plane, what did I do wrong?

[@tobiasandrea]

You need to import the AR Starter Assets from the XR Interaction Tollkit via the package manager/XR Interaction Toolkit/ Samples

[@GrzegorzKiernozek]

nice!

[@antonolivaresjuanjose2992]

Yo ya he realizado alguna aplicación con xr interaction y quest3

[@Akshay_sTechChannel]

Hi Valem! Does this work for the Meta Quest 2? I am not able to see the dots pattern or the yellow plane. I also did the room setup on the quest 2. Edit: Apparently Meta removed the ability to see furniture using space setup. Since the quest 2 uses this data to detect planes, this is currently impossible on the quest 2.

[@martammrib]

Hello, were you able to make the images from the headset camera show up when playing? I'm having some issues trying to make this work for quest 2 as well :/

[@WilcoBoode]

I have the issue that the Quest 3 does not accept Vulkan as the Graphics API, (app instant crashes with a "Invalid Device" warning. Did you encounter this at some point as well? If we disable Vulkan, then we get another warning and the app doesn't show any output (which is fixed after locking and unlocking the device) "Unity Skipped rendering frame because GfxDevice is in invalid state (device lost)"

[@G3David]

really looking forward to a tutorial with upper body tracking, have a game that got put on hold because the core needed some body tracking for bobbing and weaving. plus, once we have this, can be implemented in a lot of different games where it matters, like anything first person where you might have to dodge or, even hide and seek where you want to make sure you keep your body hidden, ability to lean out around a corner without o look theres my whole right side poking out

[@gikisTSB]

Hi, do I have a chance to finish this tutorial if I use Quest 3 and Macos? (M1 max). Thank you.

[@brurrik]

My app doesn't open on the quest pro. Just goes back to the menu

[@williamcousert]

Is it difficult to create a mixed reality app that can compile and run on both a Quest 3 and a Vision Pro without changing the source code?

[@DavidZobristGames]

thanks

[@oshinomeme6687]

Hey i wanted to switch between ar and vr but after i load the vr scene from the ar scene the vr camera doesnt work anymore.. The scene are identical just the actor has the setup changes from ar. Does someone know why?

[@bencrystalofficial]

Hmm I just rebuilt and followed this process with the "XR Interaction Hands Setup" prefab and the background color is always opaque. I set it to black and then other colors with an alpha of 0, and have added the AR session, AR feather plane, camera manager, and camera background to the scene just like before with the same packages in the project. Does anyone know what I might be missing?

[@danielruizleyva3825]

same here.

[@danielruizleyva3825]

I was also experiencing a black background, even after disabling HDR from the Render Pipeline Asset as Valem explains in the video. What removed this black background was setting the "HDR Rendering" to Off instead of "Use Settings from Render Pipeline Asset" within the Main Camera GameObject, under the Output Settings section. However, I am not using hand tracking.

[@ansar2137]

​@@danielruizleyva3825bro! thanks a ton.. this fixed my problem

[@sheenaVR8]

@@danielruizleyva3825 thank you for the tip!

[@barakawins]

@@danielruizleyva3825 This Fixed it for me. Thanks!

[@tajin8122]

Is depth occlusion possible in openxr?

[@jacksonpham2974]

Hi, I am using the version Unity 2022.3.15f1 but I cannot find the "OCULUS QUEST 3 in BUILT SETTING/ANDROID/Run Device (Menu Select Option)

[@drewswanberg6722]

Same problem, did you get a solution figured out?

[@白乌鸦异乡]

somebody tell me PLEASE！！！Can quest3 using ar foundation image tracking function？

[@snufkrill]

Does that mean I can build a project that starts in vr with xr toolkit and using a scene manager i can go to a scene that works in Mixed reality?

[@alexrayoalv]

x2

[@opafritzsche]

@@alexrayoalv Most Problem is: i need this for PC VR. Not for this Stand Alone trash. Any idea if this works ? if i set my glasses to "Developer Mode" May work, but this needs an Occulus Developer account, and no costumer have this. This "Stand alone" APK and Android S...t. is just no option.

[@somediedrank]

not explained how to get open XR plugin (no such a plugin for Android)

[@ZhengMa-ix8gh]

how to exchange a vr game to mr game in vision pro

[@guilhermefrancisco1956]

this is still not possible using unity

[@somediedrank]

not explain how to set renderer pipeline asset..

[@A_walk_in_the_park]

Hello Valem, a simple question. How would you go about making a gas spring in Unity? So that it expands as you open a door that has a hinge joint added to it. I would appreciate you answering my question for a change.

[@AndrewTSq]

Is there any one who do tutorials for real beginners? That shows how to setup everything? :)

[@imdeet]

early gang

[@tracytracy2664]

Does it work with Quest 2?

[@flym0]

This is what I am doing on behalf of a potential business partner who has a Quest 3.