Augmented Reality Tutorial: Vuforia 7 Ground Plane Detection SLAM

Vuforia's augmented reality SDK for Unity 3D uses ARCore and ARKit to detect ground planes in AR. Today's tutorial will use their native integration in Unity to make an AR app for Android or IOS. We will also go over doing video in AR.
MEET SINGLE AR DEVELOPERS HERE (Discord):
/ discord
Follow me on:
Facebook: / matthewchallberg
All my latest projects go on my Instagram:
Instagram: / matthewhallberg

[@JITHINMANOJS]

People using newer vuforia version don't need "deploy stage one " script.There is something called Duplicate Stage in Content Positioning Behaviour now.Just untick it 😊

[@diegoviveros556]

Could you elaborate on that? Where is the content Positioning Behaviour thing?

[@ajaygamedeveloper6148]

Thank you

[@32_bhavesh_patilauto27]

thanks a lot sir

[@AbhishekSingh-ml9ww]

To play the sound when it hits the ground you can easily use OnCollisionEnter(Collider col) function

[@rabiyakhan9670]

there isnt code for displaystageonce on the vuforia website anymore what to do

[@michaelwu9014]

Hi Matthew, Vuforia recently replaced the "Deploy Stage Once" script with a "duplicate stage" checkbox in the user guide: library.vuforia.com/articles/Solution/ground-plane-guide.html Will you be doing an updated tutorial?

[@richardugwu8795]

I absolutely appreciate this tutorial. This is exactly what I've been looking for. Great job. ✌🏼

[@pacevi3319]

It's good but can you please share this code? I can't find it in vuforia portal, I want to place objects with script only like anchors in ARCore or ARKit

[@neelk7445]

Those who Can't find the script , In 2018.1 the Deploy Stage Once script is no longer necessary. It is recommended for this version that you set up the PlaneFinder as normal and if you want to have deploy once behaviour, make sure the "Duplicate Stage" box is unchecked on the Content Positioning Behaviour component.

[@jonny5alive]

Do some more tutorials please. These are really good. Maybe some user interaction with buttons and tool tips

[@John-ic7dm]

DeployStageOnce script I receive error I cant drag the script to the component.. "Can't add script component 'DeployStageOnce', because the script class cannot be found. Make sure that there are no compile errors and that the file name and class name match".

[@ammarkhan5658]

make sure to check the spelling (name) of the class, both inside the c# script and also in the unity script folder.

[@paipai_yy]

After two years, still enjoying your amazing videos!! :D

[@MatthewHallberg]

Thanks! You still at NYU right?

[@paipai_yy]

I am not at NYU😂 I am at Columbia😂

[@MatthewHallberg]

DAMN, I was close kinda haha

[@theindiankid8879]

Lambo door script is not working, no animation of opening or closing. Everything is checked twicely. Any guesses?

[@syncframes]

That's awesome dude! I love all your works... i came here as soon as i got the notification.... keep rocking!!!

[@MatthewHallberg]

Thanks dude!! Means a lot!

[@aravr_project]

For Android build you need to give the app a Package Name using the reverse DNS convention. Also you need to disable the Android TV Game Compatibility as Vuforia doesn't support that.

[@aravr_project]

Actually, I am having trouble getting the app to work in Android. The AR camera remains inside the car with a view of the outside world through the dashboard. As far as I can see all the parameters and scripts seem to be working ok.

[@LiWenno]

I hava a problem with the script of DeployStageOnce, it notice that 'Anchor' does not contain a definition for 'transform' and no accessible extension method 'transform' in function of OnInteractiveHitTest. Can some one tell me how to sovel it ?

[@b3armonk]

Hey Matthew, just want to write in to say how much i appreciate your videos. Thank you so much. Han from Malaysia.

[@MatthewHallberg]

+Peng Han that means a lot thanks dude!!

[@miltonvai5816]

Hey! Your tutorials are awesome. Can you please make a tutorial on how to show a 3D model in Augment Reality (AR) inside WordPress website. Please make a tutorial on it. Will be very very helpful. Thanks

[@that-kannada-guy]

5:41 - The script is unavailable right now. Can not deploy once the screen is tapped.

[@AzadariUpdates14]

Awesome Work Sir! Do you have Video tutorials of AR Online shopping App tutorials if not then please make video tutorial on that. Thank you very much.

[@kristopherchayadi615]

Hi Matthew, just wondering if you can share your project or just the "add by touching" script. Because on 5:41 there's a script from the vuforia website for adding the object by touching, but it seems there's no more on Vuforia's website. I'm new at here so I don't know where to find the script. Thankyou and pardon of my broken english

[@scorpia2009]

Really nice work!! Many thanks!!!! I found the script but it does not seem to work. Some error happens. stackoverflow.com/questions/50908789/deploystageonce-script-for-vuforia-unity. Also you can find the whole tutorial here! www.instructables.com/id/Augmented-Reality-Vuforia-7-Ground-Plane-Detection/

[@gabrielfleuri]

@@scorpia2009 this tutorial working for you Nektarios?

[@scorpia2009]

@@gabrielfleuri I did not use the code from this tutorial but followed the steps for initiating the ground plane and setting vuforia the way it is shown here.

[@kristopherchayadi615]

@@scorpia2009 Thanks! I'll check on it

[@simonrijnbende7501]

@@scorpia2009 In 2018.1 the Deploy Stage Once script is no longer necessary. Read more on: developer.vuforia.com/forum/ground-plane/deploy-stage-once-script-now-broken :)

[@joshuafranco3401]

dude how can i fix the anchor? "Cannot implicitly covert type Vuforia.Anchor to UnityEngineGameObject"

[@10lbsandwich]

Great tutorial, just spent the last few hours going through everything. I somehow have a ton of errors despite following everything exactly, but it was a great intro to box colliders and the first thing I've built to iOS!

[@wiwo007]

Great video ..... thank you very much for sharing Is it possible to make the grid of the Ground Plane visible through the mobile camera?

[@substanceshift]

Hello i can use somehelp here, why the sample scene of ground plane isnt on my phone? my phone version is 6.0 android any ideas?

[@user-ge6oi8lb7h]

Watch this kzbin.info/www/bejne/nX_alaiLhtefgNU

[@batidavital]

Pleeeasse create a vuphoria course. You are the best. Great work

[@MatthewHallberg]

Thanks! Yeah I want to do more though like that mid air feature and the object detection.

[@joshhassin9530]

Great work as always. Would love to see the new image recognition in ARKit. Triggering SLAM off of images.

[@MatthewHallberg]

Good idea I will definitly do that soon.

[@akshaykatare5494]

Hey man.. These videos are just awesome.. simple straight forward tutorials.. funfact I work as an AR developer but usually the first thing I search for are your videos. One request, can You please make a video on real time object detection or face detection or using the new IBM watson sdk in unity covering all its features. Thanks a lot..

[@MatthewHallberg]

Thats awesome to hear!! Yeah I just played with watson this weekend, so I have a little one coming out on getting that set up and using the sample voice to text feature. I will probably end up doing the next video on using their Vision stuff before my free trail runs out.

[@JavierGarciaGonzalez3D]

Could someone help me with the tutorial script? I enter the page of library.vuforia.com/articles/Solution/ground-plane-guide.html and just when you reach point 15 it does not appear

[@sooaolongtian5848]

help! cant find the script in the link anymore

[@kurjak021]

If you want to build in ARCore, add Rigidbody and Box Collider to the First Person Camera (child of AR core device). If you add components to the AR Core Device, collision won't work.

[@sowelaar3531]

you're awesome man, thank you so much and please keep making videos

[@MatthewHallberg]

Thanks so much!

[@siarheibrazil4110]

Thx, I am curious about video player placed on quad. If I am not mistaken somehow it is activated due to collision with arcamera’s collider. Sound for sure is controlled by space distance. It would be great to make similar for sound as for the doors ..

[@JoSh-yu6jt]

Awesome video! One hurdle... @ 12:18 the Center of your Box Collider is set to 22 for the Y-axis (which means that Box should be located way up high over the car model), but the respective Box is still perfectly around the car. What am I missing here?

[@tarunsujanani5621]

Another Awsome work by this guy... Very approachable... Very helpful.... Awsome guy... Love your videos.

[@MatthewHallberg]

+Tarun Sujanani thanks so much man that was super nice!

[@substanceshift]

Guys i cant find the "DeployStageOnce" script and forums says its not working now,

[@YadullahAbidi]

I don't have any Device Tracking mode options in the Set Device tracker area in AR Camera. It's just the one checkbox. Any idea why?

[@futuristicbot]

You’re the best! Keep up the awesome work!

[@MatthewHallberg]

Thanks!!

[@futuristicbot]

:)

[@vladsamonin9794]

If anyone like me spent an hour looking for the DeployStageOnce script. You don't actually need it anymore. Simply uncheck the "Duplicate Stage" inside Plane Finder (prntscr.com/k91t1j) The official: In 2018.1 the Deploy Stage Once script is no longer necessary. It is recommended for this version that you set up the PlaneFinder as normal and if you want to have deploy once behaviour, make sure the "Duplicate Stage" box is unchecked on the Content Positioning Behaviour component.

[@SimonSeagrave]

Thanks for sharing this information, it saved me a lot of time. Much appreciated.

[@frontliner3697]

Thnks mate!

[@vigneshsree3115]

Thanks, bro I am really happy with your video, really made my day thanks, thanks a lot bro.you rock it.

[@MatthewHallberg]

Glad to help! I know this one isn't super exciting but I feel like a lot of people don't know about Vuforia 7 and how many phones it supports so I had to do it.

[@mohsinmalik324]

The script you took from the webpage is no longer there. Can you post it somewhere for us? Update: I web archived the how to site and found the script.

[@SimonSeagrave]

Hi there. Did you ever track down the script? I've had a good look for it, though unfortunately can't find it.

[@Roiik16]

You no longer need the script. You can simply now choose if you want to have duplicate objects by ticking "Duplicate Stage"

[@AdamAmbarus]

Why is my rigidbody behaving right in the Scene (Play Mode) when I verify it, but dissapearing/not appearing at all on the phone app? Colliders are all set

[@vladsamonin9794]

Very great tutorial 10/10. Going to do it RN!

[@alsammirbackos]

Great Work!

[@mostafamostafa-fi7kr]

what i must do to stop moving object with ground plane after the object initialized ? i want when mobile rotated 180 dagree or moved my object be at same place that i initialized

[@arpitbharadwaj8799]

I am facing two problems first is my 3D model disappears when i hit play and second is that box colliders of both car and ground plane stage gets disabled on hitting play button

[@lawrencIUM214]

is it possible to make an augmented reality with a mix of location based and plane detection? (to be honest im still learning tho)

[@lucapreziuso2025]

Hi Matthew I follow you from trump tutorial :-) Thanks a lot for your tutorial very interesting, I have a question is possible to detect the vertical plane with vuforia?

[@MatthewHallberg]

I dont think they have it available yet, only arkit 1.5 has it as far as I know.

[@aravr_project]

Hey mate. I am just trying to make a simple markerless AR app that lets me view a 3D model that I can move about and position on the screen, rotate and resize that lets me compare the model with an object viewed with a camera. Or in other words I want to look at an object with the phone camera and be able to manipulate the 3D object so that it matches the size and orientation of what I am seeing with the camera.

[@sowelaar3531]

If you only want to deploy it once and not have it move on the next tap, just add a public gameobject into the DeployStageOnce script, drag your planeFinder in there, and set it to false after the line AnchorStage.SetActive(true);

[@samyourwell-wisher7008]

Excellent explanation

[@ramuchilla6551]

bro , please do make a video to place paintings on wall unity arkit plugin

[@davejones8956]

Hi Matthew, I was wondering if you could do a tutorial on the vuforia mid air feature?

[@MatthewHallberg]

Yes, I am doing that next cause I am gonna try to make a facebook picture viewer in AR and I will use that mid air feature. Hopefully this weekend I will get a chance to start working on it.

[@studioofminimalinterventio1877]

hi thanks for the tutorial. I could not find the c# script. could you help me? thx

[@fernandovalenzuela2087]

In new versions of Unity and Vuforia, you don't need the script even with the script you get errors, follow the link library.vuforia.com/articles/Solution/ground-plane-guide.html

[@burhanuddinlimdiwala6754]

Hello sir there is a problem when I upload this thing on my phone and look through it my object is moving with the camera and I cannot walkthrough inside the car.

[@bellicose2009]

Matthew in your opinion which technology do you think is better, Vuforia or Wikitude? Also in terms of SLAM? - Ritesh

[@SanthoshKumar-gh4tt]

Hi bro, This is Santhosh here, your videos are awesome I've learnt many things from your tutorials. My request is can you make a tutorial on object detection with description using Tensor Flow and Vuforia where you can create your own objects and related information. One video of your about machine learning and augmented reality was awesome but then I couldn't figure out it properly, like I'm stuck when i wanna create my own object and related content should be displayed. If you could help me out that would be great bro.... Thanks, Santhosh.

[@samyourwell-wisher7008]

Keep it up 💪💪💪👌👌👌 Matthew

[@harshitchandrabose6677]

if I have to change position instead of an angle then what should I be writing in the script, should I replace "transform.position" in place of "local.eulerangle" in the script?

[@Nikhil-sh9oi]

Hey nice man, Really want to see AR tutorials with mapbox navigations , I find AR maps an practical application

[@MatthewHallberg]

Yeah that would be pretty awesome I will have to play around with that, I havn't had much luck with GPS based AR lately.

[@imperialdynamics5346]

It should be noted that only a small number of devices support ground plane detection. I wasted time trying to understand why it is not working on mine only to find out that my device is not supported.

[@harshitchandrabose6677]

the origin of the game object and the original object does not change in my case ......please help , new to this sector

[@tejaskasare1858]

it is not working for Android...I have did same steps as you have shown....but when I install that app on my Redmi note 5 pro, it only shows one white horizontal bar(as am using cube initially for testing purpose)

[@andreassvanberg4175]

i have followed the whole tut, but im getting a bit of a problem...when im moving closer to the "car" it just keeps getting away to the distance it dosent stay in position "/ any ideas?

[@AdarshsAwesomatic]

These videos are totally awesome! It would be nice if you could dynamically change the models through the scripts like we do in the ImageTargets. Is it possible here in Ground Plane? If it is, could you make a video or tell me how to do it in the comments?

[@tanmaynath4833]

This was great!! Thanks a lot man!

[@MatthewHallberg]

no prob!

[@MO-cx9rp]

Hi, Thanks for the tutoria! But, how can I scale my object to real size in Unity? I mean, I don't know how much I should scale my 3D object (a building) to achieve the approximate size I nee. Thanks

[@Shadaniyasar]

Hi Matthew, thanks for posting this. I have see many videos and really thanks for posting such new features. I got a small problem in this exercise.. After completing this tutorial, when i place the object, i see that another object is also show in the view. Did you get this kind of issue, do you know what could be the issue.

[@ydtan1]

Great content, may I know if it is possible to first detect the image target or Model Target then use ground plane to anchor the 3D object?

[@vidalmateos3416]

The issue mentioned at 1:50 with IOS is still not resolve in the latest Vuforia right? I got that black screen yesterday and took me all the damned afternoon and part of the night to find a solution. I didn't downgrade but erased Canvas in my unity scene, and turn off automatic API and metal and chose OpenGL 3 instead. Thanks for your tutorials :))

[@pouyaparsaie]

Do you know how to appropriately switch between multiple AR Scenes in Vuforia? it sounds simple but when I use conventional way (Application.LoadLevel()) and it crash the scene....

[@hamzahahmad1670]

What effect does changing the mode from AUTOMATIC to INTERACTIVE achieve?

[@hafsahmahmood8888]

Can I move the augmented object on ground plane detection as well. Please help me in this regards. Thanks

[@georgbackert8050]

is there a chance to link the created object to a certain position? so it gets created and stays at that position? for example whenever you look at corner X an AR chair is visualized, always with the same position and direction, without placing it by hand

[@xc2765]

Awesome video! Can you do one on PC building? Like let the user build a PC and be able to remove components (CPU, RAM, etc) from a motherboard and put them back into the motherboard? With labels of each component! Thanks!

[@sumittimalsina3589]

can you add touch screen buttons and enable the car to drive maybe?

[@batidavital]

is it possible to use the same intention but without the ground plane feature? i am trying to use a image target and then the child mesh of this image target needs to drop to the top of the image target! but when i try out, the models falls through the image target and desapears

[@MatthewHallberg]

Yeah it should work the exact same way put a collider on the image target and also one on the object and you should be good as long as the colliders are big enough.

[@ashishankit9911]

Please update the tutorial to the latest version of unity, as the script used have errors because of the changes in latest unity.

[@MatthewHallberg]

I did a new version of this but it’s with arfoundation and it’s on the third aurora KZbin channel.

[@ashishankit9911]

@@MatthewHallberg ok thank for helping, hope it will work.

[@heartsking175]

can we apply collide to the real world objects. to avoid the collision of augmented objects with real objects..??

[@tobeythebullymaguire7804]

Hi, I come from the future, the deploy stage once is not available now on the vuforia's website. So, I'm not sure whether they remove it for good or not. If anybody found other alternative to replace the deploy stage function that would be helpful. Thanks!

[@esukumar]

Hey Matthew, wonderful tutorial… I have one concern please help me. I have followed your video step by step in one of my application. But i am getting problem that In my app after tap on ground, 3d Object was generated but Its not stable it is following the camera. How can I make that object stable? Requirement - I need to place 1 object with static position even if I am changing the camera continuously.

[@iloveAkiraXP]

is it possible to have selective markers in unity using Vuforia? For example, with the option to choose whether you want a certain object to be scanned or not(?)

[@tusharjaiswal8647]

hello sir my program is running in unity but after i installed it on oneplus nord ce it just opening the camera but not working please help!!!!!!!!!!!!!!!!!!!!!!!

[@analysed750]

Great!, can you please make video to make the same ar app with wikitude?

[@vivekchauhan7680]

Just go rocking man 👍😊👌✔

[@ali3n_8]

um..hey i cant seem to get my the car to appear on android? I'm using Xiaomi Redmi 4, althought the Redmi 3s is on the supported deviced for ground plane.....it wasnt working on that device too(i checked on Redmi 3s too, not working). Can u help me thanks

[@AnkitGupta-un4vp]

hey, a very helpful video. but I am curious, is it possible to put the model in predefined place.

[@rinsondavis3458]

Can vuforia's ground plane feature be integrated with smart terrain feature which it had before???; since right now, when AR image is placed on the ground, it can't recognize the real objects in the surroundings.(The real objects can't be seen through the AR image)

[@nishantsthalekar8857]

Hi, I just had one question. Is it possible to spawn the car only when fits the available ground plane? I am looking for something that specifies the size of the available ground plane

[@protoy3d44]

Greetings. I have problems with the anchor class, I am using Unity 2018.1.03, I do not know if with this version they already removed that class or how I can use it to follow the example. Thank you very much. I hope some answer.

[@mominarazzaq7711]

Hello! I have a question .... I am on Unity 2018.1 and I am beginner in this AR field ..... Can you please tell me that is there any need for OnInteractiveHitTest() function in this version of unity? Thank you

[@luisflorescuenca9058]

I have Unity 2020 beta. But it doesn´t show AR setting and vuforia Augmented reality like 2:58 could anyone help me... ? note: I already installed vuforia :(

[@matrikasgaming9047]

Hi Matthew. Love your videos and they are very helpful. I was wondering, could you give me some advice on how to combine an AR app in android with some hand detection algorithms? I mean without using specific devices like Leap Motion, only the camera of your phone. I'm trying to make something for students to use and I intent to make it as cheap as possible. I don't need something too complex. Made some research in image processing but didn't have much success. Thank you for your work!

[@MatthewHallberg]

If you have seen my Instagram hand tracking is all I have been playing with lately and it kinda hard to find something that works well enough to interact using colliders and everything. Manomotion is the best I have found so far but its closed beta, it only does one hand as of right now, and it doesn't have depth estimation yet.

[@matrikasgaming9047]

Thank you for your reply. For now I'm only looking for something that detects a right->left, left->right movement. Maybe top to bottom and reverse, to simply rotate an object by hand movement in front of the camera. Manomotion also peaked my interest but I don't think I'm able to get my hands on that because I'm doing a small project. I will keep on searching.

[@dafsadfjsadfsakdf435]

HI, I WANT TO MAKE GAME IN WHICH WHEN SURFACE OR GROUND DETECTED THEN RANDOM ENEMY GENERATE AROUND CAMERA AND WHEN WE TOUCH OR CLICK ON ENEMY IT'SHOULD BE DESTROY. PLZ HELP ME HOW CAN I MAKE THIS?,

[@raxitajmera1755]

Hey Matthew is it possible that first we use image target to place the 3D object and after that we can switch it into ARCore or ARKit so if we remove that marker then also that 3D object stays on that same place and we can move it wherever we want without image target.

[@nigelmatheson58]

brilliant really good work

[@PavansinghBeeR]

Lovely tut. But the first script you copied from Vuforia site isn't available there. Can you please check and put a notepad file link in description. Thanks, Cheers !!

[@JhollQodesh]

Hello Matthew Hallberg! Sorry for my English, I live in Brazil and I'm starting in Unity and I want to develop for IOS, I have an Ipad Pro 2020 and I know that I need a MacOS to use XCode after Unity, my doubt is: I can do the entire development process of do I play on my Windows PC and later on MacOS to use XCode or do I need to do the entire process on MacOS (install ynity on Mac too)? Another question is: I have a very low budget to buy a Mac now, if only to run XCode what is the minimum or cheapest I need to have it? (Macbook Pro, Air, Macmini)? I don't even know which old model runs Xcode. Thank you!

[@ishagudhka603]

I m facing vuforia Initialization error, i have made different scenes inside one project, so while switching that scene isnt displaying anything but showing INIT_ERROR can you help it out

[@maurawidjaja6138]

Really awesome work! I would like to ask you, as I found a problem with Vuforia ground plane that the object sometimes jitters or drifts.. I need to fix/lock the object to stay there all the time steadily once established.. Do you know any solution about it? that would be really great help.. Thanks alot!

[@VolkanKutlubay]

Hi Matthew, Great Content here! I am trying to make an AR app only Deploy Stage Once Script seems not working with the current version of Vuforia! It gives compiling errors. Is there a work around of this situation so I can create an object on screen only once and when I tap another part of the floor it moves the older one to the new position or delete the previous one kind of thing. Thank you!

[@diegocruz9313]

Dude, i wanna tu make this but with another 3D model, but when y start the app it doesn't spawn, just show my camera, what can i do or what may i did wrong?

[@chakreyayan5534]

Thank you very much for your tutorial, it is awesome. Could you make a tutorial of ground detection using Vuforia in Unity: . Does it possible to recognize the floor, if I want to placement with big 3D object ( around 3 meter x 1.5 meter )? . How can I touch screen to placement only one object on the floor? after that, can interact on 3D object, such as rotation, scale or move . Is it possible to make ground plane detection measure , whether that place is enough space to place 3D object or not. and if it not enough place, disable user to place 3D object. Thank you very much.