Unity AR Foundation Simulation Tools Are Here !

In today's video I am happy to announce that AR Foundation Simulation tools are now available in Unity AR Foundation 5 pre (pre-release) or greater. This version includes the following XR Simulation features which allows you to run AR Foundation components right inside the Unity Editor.
📌 AR Simulation Features:
- Device Tracking
- Plane Tracking
- Point Clouds
- 2D Image Targets
- Meshing
- Raycast
- Session Management
- XR Simulation Environment Settings
- XR Simulation Environments
- XR Scan Simulation Settings
- XR XR-Ray Shader
📌 AR Foundation Examples including AR simulation tools:
github.com/Unity-Technologies...
📌 AR Foundation Simulation documentation:
docs.unity3d.com/Packages/com...
📌 Support me by Subscribing to avoid missing future videos!
/ dilmerv
📌 Support me in Patreon so I can keep doing stuff like this for free!
/ dilmerv
📌 Get XR & game development tips from me in Twitter
/ dilmerv
🥽 Learn & Get my XR Training from:
www.learnxr.io
👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io
#XR #Metaverse #Unity

[@dilmerv]

Ok there seems to be an issue with 2021.3.4f1 LTS but you can bypass the package manager by going to your Unity project root folder > Packages > manifest.json and add this line: "com.unity.xr.arfoundation": "5.0.0-pre.12", also here is a copy of my manifest.json in case you like to compare but if you just add that line it should work. gist.github.com/dilmerv/20ff7bdebac928524f46fb0a4160accf

[@anonymousnayahack2452]

Hey man, I manually edited the manifest.json file and it added the ar foundations 5.0.0 pre version. I also manually added the xr simulation environments using the tarball package. However, I cant access the AR Environments. As soon as I navigate to the AR Environments, it shows AR Environment not available, which is weird because I installed the xr simulation packages

[@michaelperkins1119]

Awesome, was waiting for something like that for years 🙂

[@dilmerv]

Thanks Michael and same here my friend 🙏

[@jeffg4686]

thanks for the share. lots of great info packed in here.

[@dilmerv]

Glad it was helpful! Thank you

[@caleb1183]

How would you compare AR for iphone and android both from a user and developer perspective?

[@patrick_wade]

Dilmer always fantastic. Question, Could I ask would it be possible to use a single image q code to place a statue in the corner of a room. The simulated room dimensions in unity match the realworld, I was hoping to use the Q image target as the placement trigger mechanism once as a person enters and then freely explore the world locked ar statues after. In a gallery environment. Just wondering if this might be possible in foundation?.. Thanks.

[@achinthashiran5100]

Hi, do you have any idea why when i build the apk and test it in an emulator the camera won't turn on? it asks for permissions, but won't turn on

[@xyzconsultingarvr3ddesign8]

Some cool new features, great video as always. Do you know if you can use target images to align a model in the real world? Like the first image being the pivot and maybe the second one the rotation for alignment?

[@arxzero1915]

My first idea would be that the trackable images spawn in anchor points which search for other nearby anchor points and a model to move. Then something somehow adds a anchor controller to the model which moves the model depending on the found anchor points. I dont know if that could work but your idea sounds really interesting!

[@ikarosound2504]

always awesome content, thanks!!! anyway, did you already take a look at the new Apple RoomPlan API?

[@dilmerv]

Thanks a lot for your feedback and yes I have looked at it, also evaluating it right now :)

[@ikarosound2504]

​@@dilmerv I will coming forward for a video!! Btw I tried the Simulation Tools, but the classification meshes seem to not work properly, the component Simulated Mesh Classification is present

[@kamend]

Which version of Unity should I use on MacOS, so I get a stable AR Environment, I tried both latest 2022.1 and 2020.2 and for some reason on both version I get very weird crashes :( Running on M1 Pro MacBook

[@lop258]

Same problem here, but only on Apple Silicon version of Unity, Intel Unity (2022.1.9) works fine

[@masterlitheon]

Camera intrinsics are 0,0,0,0 and you cannot get the raw RGB image etc. And no display matrix. Or am i doing something wrong Pfft

[@BjarkeHellden]

Could some of these features work using the passthrough images from the quest 2 headset as input?

[@dilmerv]

That’s a great question but currently this is only supported on iOS and Android, I will keep you updated as AR Foundation expands to other platforms which currently also supports Magic Leap. Thanks

[@BjarkeHellden]

@@dilmerv thanks man

[@unityandyb8118]

@@dilmerv Note that AR Foundation also supports HoloLens 2 via OpenXR bindings.

[@unityandyb8118]

The Simulation feature runs fully in-Editor. It uses the Camera attached to your active XR Origin in the scene, and allows you to preview your AR app in a simulated environment in the Game view without building to device. I think you're describing what we call "AR Remoting", that is, rendering your app in the Editor but using inputs from other devices. We are also actively working on a Remoting solution, but have not announced any specific features or release dates.

[@pemainsolo94]

hi dilmer you are great !!, can you make a simple tracking finger tutorial? for my school work please...

[@dilmerv]

Thanks for your feedback and yes I will look into making a tutorial like this in the near future.

[@craftercis]

Nice tutorial! I was waiting for this one :). It seems only that I have a problem. When I build the app to my android I can click on the screen and spawn an object. When I click in the editor there is object. How can I solve this?

[@craftercis]

I use the raycast manager

[@craftercis]

Oh Anchors are not supported yet..

[@dilmerv]

Yes I am glad you figured it out, thanks for your feedback and time in watching the video Cis !

[@cecere2042]

am i wrong, i the XRI gestures do not work in AR Simulation? i tried averything... only "normal" AR raycasts work...

[@dilmerv]

I believe you are correct to say that, I tried it a while back and I believe I couldn’t make it work either.

[@pass8613able]

Hey Dilmer, any idea why the AR Foundations 5.0 pre release is not available in the package manager. I'm using Unity version 2022.1.5f1

[@dilmerv]

There is an option in the package manager to allow viewing pre-release versions, be sure to click it and it should show you all packages with pre and also production ready ones. Thanks let me know if that works.

[@pass8613able]

@@dilmerv Hey thanks for your reply. Yes, but it does not have 5.0 pre released version. It's quite odd 🤔

[@henryqng]

It also happened to me. I did not see AR Foundation 5.0 pre-release even after enabling the pre-release package. I'm running on Windows 10 / Unity 2021.3.4f1 LTS

[@dilmerv]

Let me install that version on my windows machine and find out, I looked at their package dependencies and it should support it, but there are other packages also required, stay put…

[@dilmerv]

Ok there seems to be an issue with 2021.3.4f1 LTS but you can bypass the package manager by going to your Unity project root folder > Packages > manifest.json and add this line: "com.unity.xr.arfoundation": "5.0.0-pre.12", also here is a copy of my manifest.json in case you like to compare but if you just add that line it should work. gist.github.com/dilmerv/20ff7bdebac928524f46fb0a4160accf

[@DevDunkStudio]

Finally! Do they also have input handling, so you don't have to make 1 script for mobile and 1 for mouse?

[@dilmerv]

Great question and you don’t have to do anything, just click anywhere and the XR simulation handles input seamlessly without having to write any code.

[@DevDunkStudio]

@@dilmerv sweet! AR foundation catching up to Lightship it seems. Do you know if meshing also works on android or is that still a lightship thing

[@dilmerv]

I agree ! Meshing works in Lightship because they acquired a company which provided the algorithm, Unity doesn’t build things on top of AR, it utilizes tech so in the case that ARCore were to provide meshing then Unity would as well ;) Great question !

[@DevDunkStudio]

@@dilmerv thanks for the fast answers! Keep it going👌

[@unityandyb8118]

@@dilmerv Yep! This is due to an unrelated change we recently pushed to the Samples project. We have a base class that we use now to route the new Input Systems's "/press" binding. Pointer will resolve to a mouse input on PC or a touch input on mobile. Sample Code: github.com/Unity-Technologies/arfoundation-samples/blob/main/Assets/Scripts/PressInputBase.cs Input system docs: docs.unity3d.com/Packages/com.unity.inputsystem@1.4/manual/Pointers.html

[@ashishdubey94]

I want to know if anyone has tried to build a WebGL build with ar foundation to create a web AR app having image tracking and plane tracking features?!

[@dilmerv]

Great question but that’s currently not supported, there is one project we have been excited about which makes exporting to a web browser with threejs possible 👉 twitter.com/needletools?s=21&t=6PXpKLeri0D-65fUR7BSug

[@chillywilson]

is this completly broken now?

[@dilmerv]

It should be working, I tested the latest version few weeks ago. What errors did you get?

[@dilmerv]

📌 AR Foundation Simulation documentation: docs.unity3d.com/Packages/com.unity.xr.arfoundation@5.0/manual/simulation.html 📌 AR Simulation Features: - Device Tracking - Plane Tracking - Point Clouds - 2D Image Targets - Meshing - Raycast - Session Management - XR Simulation Environment Settings - XR Simulation Environments - XR Scan Simulation Settings - XR XR-Ray Shader

[@pemainsolo94]

hi dilmer you are great !!, can you make a simple tracking finger tutorial? for my school work please...