Unity AR Foundation Tutorial - Plane Detection

Join our in-person XR Hackathon in Berlin and win up to $25k in funding and prizes 👉🏽: www.xrcc.events/
Want to build a fulfilling and well paid career in AR/VR (Spatial Computing)? 👀
Our best tips, strategies, and secrets from teaching AR and VR since 2016 - everything distilled in one Free Course 👉🏽: bit.ly/48MBgT0
Our AR/VR Education Platform offers
✔️ AR/VR Courses
✔️ Private Discord community
✔️ Expert Q&A Hangouts
✔️ and much more
learn.immersive-insiders.com/
How to create Augmented Reality Apps using Unity AR Foundation?
In this Beginner-friendly Unity AR tutorial series, you'll learn how to create amazing AR Apps for your iOS and Android phones. (ARKit + ARCore)
This Unity AR Foundation plane detection tutorial will teach you how to use ar foundation to visualize vertical and horizontal planes.
Check out this Unity AR Tutorial for beginners playlist here (AR Foundation Basics):
• Unity & AR Foundation
🔔Subscribe to our channel to get started in AR/VR for Development, Business, Design, and much, much more: 👉 / @dineshpunni
🔻Let's connect!
Website: www.dineshpunni.com/
LinkedIn: / dineshpunni
Instagram: @dinesh.punni
🔻Let's collaborate!
If you have any questions leave them in the comments below,
for business inquiries contact me via e-mail: [e-mail]

[@gcma1999]

this was amazing! the only ARCore tutorial i've been able to implement successfully. Thank you.

[@DineshPunni]

Thanks for your kind words! Highly appreciated :)

[@Arkensor]

Works very well. Thank you for the easy to follow tutorial

[@rickimoore7972]

Best tutorial ive seen so far on AR and Unity. Thanks alot Dinesh

[@DineshPunni]

Thanks for the kind words!

[@AdamTeale]

Clear and concise, another great tutorial! Thank you very much!

[@DineshPunni]

Thank You!

[@cristopherwibowo6846]

Thank you, its worked, i will go to the next video

[@zyonneo]

Why the red lines are not connected or joined...I see a gap when finding planes ..how to add the white dots as AR plane as shown initially.

[@nv7287]

Awesome tutorial and style - subbed :) thanks a lot!

[@DineshPunni]

Thanks for the sub and your kind words! :)

[@LearningToBuildStuff]

Could you do a video on how to mask XR elements (like the plane prefab), using a ui element? Basically, a way to limit the XR elements in view for the user, without modifying the XR elements themselves.

[@ibrahimloukili4817]

Nice! I Love your tutorials on these subjects. Not many video's about AR Foundation / ARCore on the web. Could you make a tutorial in the future explaining Cloud Anchor API functionality in Unity AR Foundation? That would be awesome!

[@DineshPunni]

Hey Ibrahim, thanks for the kind words :) Will plan to do some Cloud Anchor videos in the future. So stay tuned!

[@akshays4709]

@@DineshPunni hi.can we do the plane detection through webcam..as i donot have ar compatible mobile .

[@kumarvaibhav4376]

Can we get the data like 3d camera angle and displacement from tracked pose tracker in AR Camera?

[@gerritfellisch4309]

Have you already tryed to combine it with image tracking? For example placing walls where images are that colide with objects placed on the plane.

[@DineshPunni]

Yes, that works without any problems. Just a matter of how you write your code. I'll do more tutorials where we use those features in real apps, so stay tuned :)

[@helloworld3003]

hello! , so from where can i get the dotted material for the plane instead of this that has a border line?

[@valentingulaev6736]

Amazing explanation, thanks for your work!

[@DineshPunni]

Glad you enjoyed it! :)

[@yokj9081]

@@DineshPunni excuse me can i ask some question

[@JafferArshad]

Hello We are using AR Foundation's image targets. When it is tracked, an empty gameObject with a script is created. This script instantiates another gameObject containing the rest of the scene (characters, tables, ...). The reason we're doing it this way is because once the image is tracked we don't want the models to be linked to it (so that if we stopped looking at the image, the models won't start jittering). When we instantiate the models this way their rotation is towards the AR camera's start position. Even if we set the rotation of the objects to zero, they still face the AR camera's start position.

[@vikramkalagi6314]

Hey Dinesh, Awesome videos. how can achieve indoor navigation ?

[@-st0ne-quin961]

awesome tutorial!

[@DineshPunni]

Glad you liked it! :)

[@ramu1404]

hello bro... i m staring install unity in my PC it was installed but While creating project in Hub getting error i was stuck in the place can you help for that issue

[@MartinVaupell]

hell it actually works,, nice video..

[@DineshPunni]

Glad it helped you :)

[@DineshPunni]

To all aspiring Creators in the AR/VR field! Join our amazing XR Creators Discord server to meet and connect to like-minded people. We have a lot of amazing people (Devs, Designers, Businesses, etc.) helping each other there already. The Server is completely free, so join and introduce yourself! :) discord.gg/9RqT4cv6Pa

[@AndreasKurz]

About DEBUGGING of arfoundation. Can you do that? Last time I checke (November 2019) it was not possible to do so. Any changes on that front?

[@yannis486]

Isn't that a feature of the Pro version?

[@yashvardhan4200]

hey, thanks for the tutorial, very crisp. unity 2020 and pixel 2 here, the indicator just floats in mid air and doesn't move to the plane. Any suggestions? I had to move to AR raycast manager to get the indicator for at least show up.

[@DineshPunni]

Hey, Which version of AR Foundation are you using? The issue you are facing could be because of bad lighting. Try it out in a brighter environment.

[@lucutes2936]

EPIC

[@cryonisc]

Hi there, My plane is not becoming transparant. Where should I edit the settings to edit the visualisation of the plane itself? Is it in the prefab or the Visualizer?

[@DineshPunni]

It's on the material of the visualizer 8:23

[@guitaredenx6528]

Hi, recently I am developing a AR application that use a virtual 3D box to measure the size of the parcel for my final year project.Can you advise me where should it start ? *I have zero knowledge in AR

[@radhikamaheshwari3930]

From where are you learning AR??? My final year project is also on AR.

[@ssojyeti2]

thank you for this

[@DineshPunni]

You're very welcome! Happy to help

[@kamillatocha]

where can i find the prefabs so i dont create my own ?

[@aziznr5705]

why when opened on my smartphone there is no permission for the camera, so the application can't. how to solve it

[@user-zg7xu1pj3r]

Hi, this video is very helpful. But after following this tutorial my game cannot detect any plane, my phone is Galaxy S8 SM G950F. is it because my phone or some extra things I might need to consider?

[@DineshPunni]

Galaxy S8 should be working fine. You'll have to allow camera permissions on your phone when installing the app

[@gangotrimishra6971]

does it matter which phone we are using..i mean should ar apk run on evry phone or is there any minimum requirement to run these apps

[@DineshPunni]

Hey, for iOS it should be working, unless the iPhone is older than the iPhone 6. And for Android you have the list of supported devices here: developers.google.com/ar/discover/supported-devices

[@guruprasadkamat2011]

How to export AR application for iphone?

[@abhi9raj776]

hello sir , i have seen lots of ur videos and found very very very helpful. sir i have one question , i have successfully connected my hololens ,but i want crosshare instead of that white dot , can i do this with hololens ? and could find in game view of unity3d , but not in the hololens. plz sir help me out on this.

[@DineshPunni]

You'll have to change the texture of the planedetection to crosshairs instead of dots. Open up the prefab and check every single component inside of it. There you should see the origin from where you're getting the dots and then you can replace it

[@abhi9raj776]

@@DineshPunni thanks sir. Will try and let you know. 🤗

[@rabah4306]

First thanks alot for this awesome Tuto ! How can we improve the performance of the detection ?

[@DineshPunni]

Mostly by getting a new phone 😅😅

[@sovanmondal2621]

@@DineshPunni can u plz suggest a new configuration of a phone to test al this apps.!?

[@LearnWithJahangirJadi]

Hi Dinesh. Thank you for this tutorial. It's working fine but there's one problem, the planes are overlapping with each other. Any solution for that?

[@DineshPunni]

Hi, you can write a script that will keep storing all the detected planes in a list and then filter out the plane as per your requirement. By default, there is no way to avoid overlapping planes.

[@LearnWithJahangirJadi]

@@DineshPunni Thanks bro.

[@abhimanyubundela2568]

I'm new to AR and this tutorial is very good, but don't you think it's not very accurate?

[@AlteraLin]

What's the best way to turn off the planes on your screen after you've spawned the AR object?

[@DineshPunni]

The best way would be to have a code that will store all the planes that are detected in a list. Then, you can simply delete all the planes from the list once you've spawned the AR object.

[@souviknath974]

Hello there its important i made this app on unity ver 2021.3.9f .build is done but i am faccing an issue whenever i start the app my screen goes black and its not working help me

[@DineshPunni]

The black screen issue can happen due to a number of reasons, you might not have checked the ARCore plugin or you might not have enabled IL2CPP backend scripting. Checkout this blog and make sure you have the correct settings: blog.immersive-insiders.com/setup-ar-app-for-google-play-store/

[@ramkeshsingh4051]

How we can know which is corner in a room ? . I am detecting plane i want when corner detected we should know it is corner ? Please reply.

[@DineshPunni]

Hey, are you using the same image as the one in the video?

[@ramkeshsingh4051]

@@DineshPunni No . Own points or shadow for detected plane . We are also having problem in white wall detection. If you have anything please let me know.

[@emiyashirou3192]

can you help me why is there random planes floating and incorrect plane detection, I'm pretty sure that i have good lighting in my house and i think the planes are easily detectable but why is there still some random planes generating? please help

[@DineshPunni]

This article should give you a better understanding of how planes are detected: developers.google.com/ar/develop/fundamentals#environmental_understanding. Basically, your environment needs to have different patterns to clearly distinguish between two different surfaces.

[@VeneDrummer]

Any common reasons why no planes show up? Just the camera. I point at the floor and tables and nothing gets visualized. I checked adb log and no errors. I'm looking for the sample ground check now to see what it does.

[@DineshPunni]

Make sure you allow camera permissions on your phone when installing the app. That could be one of the issues

[@VeneDrummer]

@@DineshPunni thanks! I needed to update the AR Core app even though it wasn't asking for an update. that did the trick :)

[@ashraypai5540]

It takes a lot of time for the planes to get detected, and vertical planes most of the times don't get detected at all, what could this be due to ? I thought it could be due to Room lighting , but its the same everywhere , its not as smooth as the one seen in your video , i am using OnePlus 6 to run the app.

[@DineshPunni]

My first guess would be the lighting as well but I think the phone you are using is the reason. Haven't tested it on the OnePlus 6 but just from experience I can tell that ARKit is definitely better and faster than ARCore. Is possible you could try your setup with a different phone (ideally an Android flagship) to see if it's the phone you are using.

[@DineshPunni]

By the way, the phone used in the video was an iPhone Xs

[@ashraypai5540]

@@DineshPunni i just figured , i was a bit close to the surface , once i moved far it worked well . Thanks a lot .

[@gamecastimus]

Thanks , your question helped me to see the output. I was too close to the plane :)

[@midhunkrishnaks4748]

the app is not accessing the camera of my phone. It is showing only a black screen.

[@DineshPunni]

This could have many reasons, maybe this post can help you out github.com/Unity-Technologies/arfoundation-samples/issues/2

[@siddhantgautam4884]

hey. How to stop generating Multiple plane detection .

[@DineshPunni]

You can set it in the ARPlane manager

[@roslim0848]

How to invisible the plane detection. Or make it transparant?

[@DineshPunni]

You can set the alpha value of the material used for plane detection to zero. But how would you know if a plane is detected if it's transparent?

[@roslim0848]

@@DineshPunni i use marker, when it actives mean it is Ready to spawn

[@technouniverse7372]

After installing ar foundation and arcore pulg in XR is not showing in hierarchy?

[@DineshPunni]

What Unity version and what ARFoundation version did you use? Cheers

[@technouniverse7372]

@@DineshPunni solved sir...i installed both arkit and arcore....thn i uninstalled arkit

[@DineshPunni]

@@technouniverse7372 Awesome!

[@ZwaneMakki]

Does this work with 2019.4 Unity?

[@DineshPunni]

As per the Unity's documentation, AR Foundation is compatible with version 2020.3 and above.

[@rabiyakhan9670]

i tried the exact same thing as this tutorial but plane doesnt get detected on phone! using android version 10 and unity 2018

[@DineshPunni]

Try to upgrade to the latest stable 2019 Unity version with the latest ARFoundation

[@siyifu3918]

same here, only see lines, no plane, why?

[@CptSparky]

@@siyifu3918 I had the same problem. After quite some searching and looking in other tutorials and comparing my stuff to the arfoundation samples I just realized that I've only forgotten to add an AR Plane Mesh Visualizer.

[@rahuljeevan7644]

Sir, I did the same as u did and only black screen appeared after build (what can be the problem?).

[@MrHassan07cse]

Try different version of ARFoundation if anyone elses have same issue

[@_chadrose]

yeah, same problem here!

[@ananthuspillai4204]

I am also having same problem

[@MrYanissab]

Same here

[@haznemil]

Player Settings > XR Plug-in Management and tick ARCore to enable it for your device

[@nikshepamin8570]

i have a problem when i open my phone shows black screen doesnt show camera :( any idea?

[@DineshPunni]

Yea, that problem occurs to many developers. What phonr are you using and are you getting the message that you need to allow the camera usage, when opening the app ?

[@nikshepamin8570]

@@DineshPunni No Camera Permission Popup So I Enabled Camera Permission Manually. Still its not working. i am using Nokia 3.1+

[@imperialdynamics5346]

same here. I think it is because our phones do not support plane detection

[@mrsmile1387]

same problem ... any solution pls ??

[@nikshepamin8570]

@@mrsmile1387 i believe this happens because the phone doesn't support ar core. Not sure.

[@bharathitamil6990]

Sir I am a clg student I learn myself unity so please me my phone is not support AR foundation if any possible to run this in my phone .

[@DineshPunni]

Ideally, you get one as soon as possible. Meanwhile you can already start to learn about C# and Unity, since this is the content that I recommend and teach on my channel

[@bharathitamil6990]

@@DineshPunni thanks sir ,waiting for that video sir🥰

[@anshulsingh8326]

can't see the mesh or lines. Just camera opens up. Any advice?

[@adnanahmed5892]

same here

[@rezaadityam6400]

same, you find the solution?

[@anshulsingh8326]

@@rezaadityam6400 It just doesn't always work. Try keeping your phone parallel to surface and rotate your phone little bit. It might take upto 1min to show up.

[@anshulsingh8326]

@@adnanahmed5892 .

[@riddheshzaveri8103]

It detects plane but its quite less accurate. How can I detect more accurately?

[@tanishachaudhry4809]

Did you find a solution?

[@riddheshzaveri8103]

@@tanishachaudhry4809 Use latest ar foundation. In iOS the detection is very accurate. But in android it highly depends upon the device. Use Ar Foundation 4.0+

[@tanishachaudhry4809]

@@riddheshzaveri8103 ohkay, i have a question, if we want to make a project related to olane detection, what can it be? Can you help me with that?

[@tanishachaudhry4809]

@@riddheshzaveri8103 thank you😊

[@riddheshzaveri8103]

@@tanishachaudhry4809 You mean which platform?

[@amrutmujumdar]

My Device is not compatible to ARCore what should I do?

[@DineshPunni]

To make use of ARFoundation you need to have a device which has ARCore/ ARKit. Maybe you should try out other SDK's like Vuforia but I don't have much experience with these.

[@jaiminshimpi8413]

Sir, I recently came across your video and tried exactly the same steps you navigated, but sir after building the APK and installing it on the phone...it just shows a black blank screen...Can u pls suggest me the solution!?

[@fuadhasan6161]

You can try going to Player Settings > XR Plug-in Management and tick ARCore to enable it for your device I think the video skipped on this step

[@MrYanissab]

@@fuadhasan6161 this didnt work :(

[@DineshPunni]

Unfortuantely since I created the video the SDK has changed quite a bit. Make sure you grant camera access from your phone. If you don't see the popup when starting the app you may want to reinstall the app

[@jaiminshimpi8413]

@@fuadhasan6161 Thnks man for this!!

[@jaiminshimpi8413]

@@DineshPunni Yeh this I tried, then it was giving gradle error...but it got solved by another method. Thanks again for the solution :)

[@sandeepkulkarni8835]

Nice video how to paint a wall in AR If you know help me🙂

[@DineshPunni]

You mean a real wall with a digital overlay? This is something I may do in the future

[@sandeepkulkarni8835]

@@DineshPunni yes like I want to build AR App like Dulux and color snapvisualizer

[@dharaladani5087]

I tried this tutorial for plane detection but when i installed .APK file in my device and check it at that time i can't detect any Plane so any one can help me out?

[@DineshPunni]

Which version of Unity and AR Foundation are you using?

[@brianthomas9148]

@@DineshPunni I'm using unity 2020 and AR Foundation 4.1.7 and ARCore XR Plugin 4.1.7

[@chihowoo718]

Nothing showing on the mobile, just a black screen. Do you know what's the problem? is Redmi note 7

[@boyettt]

same problem. black screen. maybe my phone, its only have 2gb ram.

[@DineshPunni]

Did you guys get a request for camera access on your phone when starting the app? That must be accepted. Also your ARCamera should be the only one in the Scene

[@user-ng8re2iu1g]

@@DineshPunni hello i have the same problem. the program did not ask for permission to the camera but I included it in the settings. and the ar camera is the only one in the scene.i also have redmi not 7

[@xiaocao1866]

im not sure... but i think the app only work on the AR core supported device..the one dinesh show is on API 26..for me if i remove the vulkan and install the ARCore from the package manager is not work for me ....because I'm using oppo f5 and it is not support AR Core....I have been try many ways to solve the black screen too, still no have solution...so sad

[@haznemil]

Player Settings > XR Plug-in Management and tick ARCore to enable it for your device

[@athiras6323]

When I open it in phone it just shows black screen I am using Nokia 6.1 plus phone and there was no camera access request also What is the problem???

[@brianthomas9148]

I'm getting the same error, I have the Redmi Note 5 Pro

[@mrsmile1387]

same problem ..any solution ?

[@Crazmer]

Hey followed ur steps but the plane is not getting detected

[@DineshPunni]

Hmm that's weird. What phone and Unity version do you use?

[@Crazmer]

@@DineshPunni unity 2020

[@rezaadityam6400]

same, on samsung A51 too, i use unity 2020

[@celinaroca6825]

広めてください」、