Hololens 2 Development Tutorial - Getting Started (MRTK v2)

Join our in-person XR Hackathon in Berlin and win up to $25k in funding and prizes 👉🏽: www.xrcc.events/
Want to build a fulfilling and well paid career in AR/VR (Spatial Computing)? 👀
Our best tips, strategies, and secrets from teaching AR and VR since 2016 - everything distilled in one Free Course 👉🏽: bit.ly/48MBgT0
Our AR/VR Education Platform offers
✔️ AR/VR Courses
✔️ Private Discord community
✔️ Expert Q&A Hangouts
✔️ and much more
learn.immersive-insiders.com/
In this Hololens 2 Unity tutorial, we talk about setting up your Unity project for HoloLens 2 development. For more Hololens 2 Tutorial videos feel free to subscribe!
On this channel I teach everything about AR, VR, and MR development.
This is an augmented reality tutorial for beginners, so you don't need to be an advanced HoloLens 2 developer, but some Unity basics are helpful.
MRTK GitHub repo here:
github.com/microsoft/MixedRea...
🔔Subscribe to our channel to get started in AR/VR for Development, Business, Design, and much, much more: 👉 / @dineshpunni
🔻Let's connect!
Website: www.dineshpunni.com/
LinkedIn: / dineshpunni
Instagram: @dinesh.punni
🔻Let's collaborate!
If you have any questions leave them in the comments below,
for business inquiries contact me via e-mail: [e-mail]

[@DineshPunni]

To all aspiring Creators in the AR/VR field! Join our amazing XR Creators Discord server to meet and connect to like-minded people. We have a lot of amazing people (Devs, Designers, Businesses, etc.) helping each other there already. The Server is completely free, so join and introduce yourself! :) discord.gg/9RqT4cv6Pa

[@krishnavsaikia9841]

Can the footages be more realistic...?

[@ruchirnaphade]

Very nice that you started with MRTK v2. Kindly keep posting videos about this. I would love to learn!! 👍🏽

[@DineshPunni]

Are you working on the HoloLens 1 or HoloLens 2?

[@ruchirnaphade]

@@DineshPunni I am working on MRTK application for HoloLens 2 as a part of my project...I have just started learning and would like to see more tutorials about it...

[@Capnmax]

Have you tested the ranging ability? How far away will the helmet detect a surface and be able to successfully map upon? Like outside hillsides for example...Too far?

[@salu7962]

Very nice to know where I can find MRTK! I will catch up to you soon my man! ✨👍🏽 2:32 NO I like to see more of that handsome face 🤣🔥

[@DineshPunni]

Link to the repo in the description :)

[@usmansmir]

@@DineshPunni I mean the beard alone is enough to watch XD

[@DineshPunni]

@@usmansmir hahaha thanks man

[@JavedulFerdous]

Good tutorial. very helpful.

[@carolinacadenas7524]

Very good video. May I know if I can install the Hololens2 emulator on an Azure VM with Win10 Pro?

[@carlosliomar]

nice channel, looking forward to learn more about MRTK. I current work in the wind turbine industry, I have very good idea where I can apply the hololens, already think this can be a huge business opportunity for my carrear.

[@DineshPunni]

Welcome aboard! That is a great industry that can benefit from Mixed Reality. Since Microsoft strongly focuses on industry clients it's a great use case for the HoloLens 2.

[@carlosliomar]

@@DineshPunni I loved the idea of mixed reality for training and help the technician on the field, I even thought about helping our store depatment on a AR app for virtual spare parts catalogue, where you can see exactly where the parts will be fitted this would be amazing. I know is early stage but I definitely can see the potential and I was waiting for this inspiration for a good few months. Nice to see the job you are doing, very inspired. Wish you all the best and many likes on your video.

[@sigifredovalenciaensinales7080]

thank you bro!

[@DineshPunni]

Happy to help!

[@haraldgundersen7303]

This looks great wish the days had 48 hours to get the time to dive into this with Nreal Light right away...

[@DineshPunni]

How was it? I‘m planing to get the dev kit to make some tutorials and reviews. Do you think it’s worth it?

[@haraldgundersen7303]

@@DineshPunni It's exciting to experiment with in unity. Great clearity except in outdoor sunny conditions. Found SLAM to be of the better I've used. Even used the glasses in local store with out creating too much attention. it's still a bit buggy in their SDK but are making noticeable improvements for each iteration.. I would say it's a very nice future investment in development skills to go in at this moment but there will be coming better hardware both from Nreal and competition... You might want to wait for they're hand tracking system and see how this turns out, but then again so far they have had prob s with long delivery time and that might be a continuing issue... Allso Im still a bit confused if you have to have a dev kit for developing in unity or if you might be able to use the consumer kit for developing. Overall I don't regret bying at... :-)

[@rafaelrivero9194]

Thank you very much bro for this great tutorial. When trying to build Appx from the Build Window, I'm getting a console error of "MSBuild.exe is missing or invalid!", do you know what's the problem?. EDIT: I've fixed the issue, it was related to visual studio installation. Thank you!!!

[@DineshPunni]

Glad it helped!

[@chainarinthanakulithiwat5585]

Hi Dinesh I have problem about how to use Halolens 2 that I had just buy Halolens 2 from USA this week but I have no any knowledge about its. Could you please help me to suggestion for setup in detail and tutorial for beginner to getting start sir. Thank you for your help. Chainarin.T

[@natalieieyoub5756]

Can you develop with mrtk on macbook?

[@snehapampatwar7937]

Hi @Dinesh Punni Can u please help me to understand which is better mrtk toolkit or xr interaction toolkit for hololens 1 and hololens2 projects. I want to make project for hololens1 but in future it should work on hololens 2 also. So could you please help me to understand which is better to start the development.

[@DineshPunni]

As of now I'd say use the MRTK for HoloLens + HoloLens 2 development with Unity

[@charrystheodorakopoulos4843]

Do you know why building an appx through ms build window results to launching the app in HoloLens with excellent frame rate, but while building it to the device through the visual studio solutions lowers the performance (low fps)?

[@DineshPunni]

Good question, never realized that. I'm usually building directly through the build window. One reason could be that you use .NET as scripting backend instead of IL2CPP (which afaik is default for the build window)

[@charrystheodorakopoulos4843]

Is there a way to to have an image tracking algorithm in HoloLens 2. Either integrate a plugin like AR Core (has image tracking functionality) to a MR project for HL2, or if HoloLens has already one.

[@DineshPunni]

The HoloLens2 has a QR Code reader by default that you can use. For image tracking (as far as I know) you can use 3rd party tools like Vuforia.

[@charrystheodorakopoulos4843]

@@DineshPunni wait is this qr code reader in MRTK because I didn't find it.

[@philippschleer8249]

Hi Dinesh, I followed all the instructions in your video and I am able to build the project and build the Appx. I also manage to access the device portal and to install the package. However, when i open the app on the Hololens a window appears and when i click it, it is loading a bit and then I do not see anything. After a while the window pops up again and if i click it again the same thing happens again, but I don't see anything. If i start the app in the Emulator in Unity it works fine. Do you have any idea what the issue might be related to? I tried Unity 2019.4 and afterwards to make sure I also tried 2019.3 and I also downgraded all the way to MRTK v2.2.0, but nothing seems to resolve the issue. Any ideas what this problem could be related to or any suggestions how to resolve the issue? Thanks

[@DineshPunni]

Try to check if VR Supported is enabled. Otherwise Unity just builds a normal UWP app. And make sure that the architectual type is set to x86 for HL1 and ARM64 for HL2. Check out this for more infos docs.microsoft.com/en-us/windows/mixed-reality/develop/development?tabs=unity

[@camilomedina8029]

Hi, I have the same issue, could you please tell me how you solved it?

[@user-we7lb1xg1v]

Hi have you find solutions?

[@153ridzzzz]

Hey Dinesh, this is sort of unrelated to the video but im currently in the process of adding AR functionality into my mobile game (The base game is almost complete) through Arfoundation and ArCore. I could use some of your help with the issues that im facing as AR is new for me, i have been watching lots of videos on ARfoundation and ARCore but still struggling with the topic. Was wondering where/if i could talk to you privately to show you my project perhaps to recieve any guidance or tips.

[@DineshPunni]

Sure, just contact me via email [e-mail] And we see how I can help you with your project.

[@alexaelena8680]

Hi! In the "Player setting" I don't have "XR Settings". What can I do?

[@botaoli2475]

Hello, I am a front-end development engineer. Now I want to start developing ar from 0. What should I learn from you? If I can get your reply, I will be very grateful，pease😊😊

[@DiegoHernandez-lg1nd]

Awesome! Do you know if there is a way to create your own hand gestures?

[@DineshPunni]

Didn‘t need it so far but it should be possible. The MRTK probably also offers a low level hand detection API.

[@DiegoHernandez-lg1nd]

@@DineshPunni do you have a link to the docs of that API?

[@onurcaba9896]

Hi, i have an issue when deploying app to HL2, I get an error "bootstrapper could not connect to machine", can you please help?

[@briandiago1414]

where can i install the app

[@tangkitty411]

my app is head locked. the screen will not updated by moving my hololens 2. I use unity 2019.4.2 and Microsoft.MixedReality.Toolkit.Unity.Foundation.2.5.3, visual studio 2019 I installed Universal windows platform development in visual studio installer. However, I got the warning in build setting. "the local machine does not support running projects complied for the ARM/ARM64 architecture" could you help?

[@themanas100]

Hey, do you have or can make a guide on how to Develop on the hololens 2 with an emulator in case you dont have a Hololens but still want to develop on one.

[@DineshPunni]

Noted! At the moment there is not much HoloLens (2) content planned but maybe that changes in the near future

[@liorc.9273]

GRAET VIDEO!!! But trying to get: Unity, MKRT & HoloLens. What between all of them? Differences? etc...

[@DineshPunni]

Unity is the game engine MRTK is the SDK (Software Development Kit) HoloLens is the actual device

[@liorc.9273]

@@DineshPunni Thank you for the clarification!!

[@dllsearch]

Hi! Thanks for your tutorial. MRTK 2 workswith hololens 1st generation?

[@DineshPunni]

Yes it does

[@groesster158]

Hi Dinesh, the "Mixed Reality Toolkit" section doesn't appear in my toolbar at the top so I'm stuck at minute 9:40. Can you help me?

[@DineshPunni]

Most likely you're using a newer version since this video may be outdated already. I'd recommend to check out our Discord server and ask your question there. We're working on updating the most important videos (incl. this one) in 2022, so stay tuned. Here's the link to the Discord Server: discord.gg/9RqT4cv6Pa

[@groesster158]

@@DineshPunni thanks for the reply! 😊 In which section should I post my question? The general section is locked for me 😧

[@syberdino]

Hey Denish, I followed this tutorial but got stuck at the build window My MRTK doesn't seem to have this option. Any ideas why this could be? I used the Foundation 2.4 version and the Examples 2.4 version.

[@andrzejciereszko4085]

Me neither, no Build Window...

[@DineshPunni]

There is a bug in the MRTK v2.4 with the build window. Try using MRTK v2.3 that should be working. Hopefully they'll fix it soon...

[@gamedevdanny]

Try downloading the tools package below the foundation package. Showed up after I did that.

[@gamedevdanny]

@@andrzejciereszko4085 Try downloading the tools package below the foundation package. Showed up after I did that.

[@gamedevdanny]

@@DineshPunni Try downloading the tools package below the foundation package. Showed up after I did that.

[@nabilhamouda1472]

Thank you for this amazing video ,, can you please tell me how to write a JSON file for that and connected with azure server for example to get data from this server and thank you :)

[@DineshPunni]

Noted. Thanks for the kind words :) Definitely check out the Microsoft documentation on connecting your HoloLens 2 to Azure docs.microsoft.com/en-us/windows/mixed-reality/develop/unity/tutorials/mr-learning-azure-01

[@RohanHazara]

I do not have the MSbuild option. Is it any other way to build the application. what type of file it will be, like apk or something

[@DineshPunni]

It's also possible to build manually. But I'd recommend you to use a different MRTK version. Unfortunately there are some versions (I don't know which ones exactly any more) that have bugs where there is no build window.

[@RohanHazara]

@@DineshPunni thanks for responding. I have many problems with hololens application which does not run on emulator. But I think I can figure it out :)

[@DiegoHernandez-lg1nd]

will you be posting anything on MARS when it releases on June 1st?

[@DineshPunni]

Definitely 🤓 looking forward to play around with MARS. What I do on this channel really depends on YOU guys. So just let me know in the comments what to focus on :)

[@DiegoHernandez-lg1nd]

@@DineshPunni I would love to see a video of that in action, since the keynote in the AWE was a little bit blurry I missed most of the details on how to use it. but your explanations are great! keep it up :)

[@DiegoHernandez-lg1nd]

@@DineshPunni check this link out, I think it is really cool that with MRTK you can compile to mobiles too! :) medium.com/xrpractices/doping-ar-with-mrtk-by-jatin-pawar-4d4cedd60c0f I tried it on a redmi note 8 and it worked fine!

[@SatyendraKumar-wg9rl]

sir, i want to work on a school project with my team i.e. hide_n_seek using AR, but i don't know how to start. sir please reply you can help me.

[@charrystheodorakopoulos4843]

Hey, did you ever have a boot problem with HoloLens? I tried every single troubleshooting solution thing based on MR documentation, but the problem is that when I am turning on HoloLens it makes the sound indicating that the system si running but it is not displaying anything. It's like the camera, or the sensors are not working. It is fully charged and no Leds are blinking It is like a pair of regular glasses rn, no holograms at all, from one day to another. Have you ever come across with this problem?

[@DineshPunni]

Yeah, we had similar issues with some glasses. Sometimes it just worked after a few day. If nothing works try to connect it to your PC and reset it with the Advanced Recovery Companion.

[@charrystheodorakopoulos4843]

@@DineshPunni I tried that but it said that i must be logged in in my HoloLens device. But i can't log in when I open HoloLens device since there is no UI to log in :P :P

[@DineshPunni]

@@charrystheodorakopoulos4843 Okay that's weird. I didn't have to be logged in when we had this issue. Maybe try to hold to power button for like 15+ seconds. For some reason that helped to boot one of our HoloLens 2's

[@cupiid18]

Charrys Theodorakopoulos did you figure it out? I had the same issue, but fixed it by reflash

[@areebakhan6003]

In case of deploying any object to emulator then?

[@DineshPunni]

Should be working fine. Check out docs.microsoft.com/en-us/windows/mixed-reality/develop/platform-capabilities-and-apis/using-the-hololens-emulator

[@srisitchianrabutra3782]

Could you share how to setup a spectator view from android mobiles in your KZbin Channel, please ?

[@DineshPunni]

Not exactly sure how/if spectator view works on Android but I've done spectator view a few years ago on the HoloLens 1 so I'll keep it on my list. What is your use case for it?

[@srisitchianrabutra3782]

@@DineshPunni Thank you very much. I have only one hololens 2 and I would like to record the scene during the interaction between a user and a virtual object.

[@jari56ify]

These videos of owners of the headsets who know nothing of how to use them are so damn hilarious.

[@DineshPunni]

haha I hope my videos are a bit more helpful 😁 Let me know if you have any video suggestion!

[@faizanalam1646]

but i want to develop mr and vr app ....

[@DineshPunni]

If you have an AR (Augmented Reality) capable phone than you can do that. For Virtual Reality, you'll need a VR headset

[@uchungnguyen1474]

why these models always look dull?

[@DineshPunni]

Most likely it's due to the capturing and the not stereoscopic view. If you see the holograms directly from the HoloLens2 (not from a screen) they actually look quite good

[@faizanalam1646]

can i vr develop without hololens

[@DineshPunni]

HoloLens != VR

[@faizanalam1646]

sorry typing mistake my Q is can i mr(mix. reality) developer without hololens ... if not then how mr develop will make app for hololens ?? every developer is not rich especially student developer like me .🙁🙁🙁🙁. can i make my own hololens using raspberry pi single computer ?? we can use rasspberry pi camra and we can connect leap motion device for hand dection like hololens??? please relpy all above Q. thanks bro ...

[@faizanalam1646]

hololens is very expensive bro!!!

[@DineshPunni]

True, but it's also pretty cool 😎 It's also not focused on consumers at the moment. The HoloLens 2 is mostly used for enterprise applications

[@callmemoa8701]

Hi there, I want to develop a Mixed Reality using Unity (until now I have developed for Quest 2). I would like a suggestion between using Quest Pro and Hololens 2. I am really struggling to choose among those products. Could I chat with you in private about this? That would be super. Thanks.