(HOW TO CREATE A FACE MASK IN LESS 10 MINUTES) - Unity AR Foundation in Unity 2019.3 !

In this video I show you how to create a Face Mask with Unity 2019.3, AR Foundation, and ARKit in less than 10 minutes. The time here is important because I want to show you how easy it is to do it with the latest versions of packages mentioned.
If you want to download the code shown in this video then get it from either Patron with "Early access to source code tier" or here in KZbin with "Exclusive VIP tier" - Thank You !
Project can be downloaded from:
github.com/dilmerv/FaceTracki...
** Support me by Subscribing to the channel as it will help me in bringing a lot more content **
bit.ly/2NmnFMu
Support me in Patreon so I can keep doing stuff like this for free!
/ dilmerv
Get realtime indie development tips from me in Twitter
/ dilmerv
Subscribe to my indie development videos & game releases newsletter
www.dilmergames.com
Blog about Indie development and startup
www.dilmergames.com/blog

[@JGeco]

Hello! I was wondering, does this works only on iphoneX/11 , or is It enough It runs ioS 11? Thanks

[@dilmerv]

iPhoneX/11 are the only ones supported and I believe ARCore also provides face tracking features.

[@hyperdragon1013]

@@dilmerv 5:54 you need to hit assets

[@MyApanas]

I was looking for something like this! It's great!

[@dilmerv]

Thank you I am glad you found it helpful !

[@andreschavez6168]

Great video! Found it very helpful and I'm surprised by how good the face tracking works on an iPhone 11 I have a question for you, is it possible to have both plane tracking and face tracking configurations on the same Unity project (not the same scene just the whole project/app in general)? The thing is that on the scenes where I'm using plane detection the camera it's automatically swapped to the front/selfie camera by itself, would appreciate your help thanks!

[@abhi_ava]

Hey! This is amazing; thank you for this tutorial. Anyway, I had a doubt: Is it possible to extract the facial landmarks(3D) of such a 3D FaceMask generated; like the landmarks of the nose,etc.? If yes then how can I approach to do so?

[@muhammadasim7316]

Hi!! thank you for the great tutorial. Could you please explain to me how can I build this for Windows(PC, Mac & Standalone)?

[@atulyaaman7320]

How can we make the masks change by using a button or something of that sort?

[@ankur1503]

Thanks a lot Dilmer, Please let know if you have any idea on how to put live feed of face as a texture on the FaceMesh. Like SparkAR does .

[@shahnazansari1938]

Hi, i followed all the steps..but when i deploy on my android phone, it is not opening front camera..can you suggest me something..i am using unity 2020 version

[@user-nt1lw9ss1x]

Hello! i have Azure Kinect so i want connect your Demo Secne. how can i connect??

[@pemainsolo94]

Hello Dilmer !! can you create hand tracking on fingers ?? like a ring stuck to a finger

[@NabilMajid]

Its and android export? can put a 3D instead of the mask

[@jrpringle8980]

Hi Dilma, fabulous video,please keep up the good work. Just wondering if you could assist? I followed your video also opened your project in unity (using MacBook Air) but when I press play all I get is a black screen also is there a way which I can preview the face mesh with png texture attached also how can I make the face interactive? I’m working on a project.

[@user-in2gd3wv9n]

when I try to run this on android I get "Current Rendering Pipeline: UniversalRenderPipelineAsset" as text in the middle of the screen but then the app crashes

[@saikatpatra9365]

Same way how can create a Hand Mask....on Hand Skin....Please tell me....

[@heidilee6678]

Hello Dilmer, do you know what's the name of the application before selling to Apple as ARKit?

[@dilmerv]

Heidi thanks for your question but I am not sure what you mean ?

[@mustafaesengun5407]

Thanks for the video. Is there a guideline for creating custom textures for face masks?

[@hyperdragon1013]

i tried not easy but look on youtube like uv mapping ,face unwrap ect

[@ttttkk2]

great tutorial, but my face has no eye sockets and month hole, it is a just mask, did I do something wrong?

[@dilmerv]

That's how it works with Android, ARCore implements it a bit different than how ARKit does it.

[@rendermanpro]

Ok, it is need iphone10-11, but do you need Unity running on Mac? Or Windows version will work?

[@dilmerv]

Correct you need an iPhone X at least and a Mac computer since it needs to be built in XCode, thanks for your questions !

[@wiebkevonbremen6047]

I just started with AR Foundation and your tutorials are a great help, thank you! Is there a way to switch from the default front to rear facing camera while using face tracking? Is it possible to implement some sort of button for that (like instagram lets you do with face filters)? I´m working on a project for which I would like to use both cameras.

[@dilmerv]

Face tracking is only supported on the front facing camera, currently I don’t know of a way to force it otherwise as this is an iOS restriction.

[@wiebkevonbremen6047]

@@dilmerv okay, thank you though!

[@Jc-vh7zm]

I am using Ipad pro, but it seems the app accidentally quit when I open it, i don't know why:(

[@dilmerv]

Interesting, I would say keep it connected to XCode and post the error here as we can help you troubleshooting

[@haruniki1386]

the thing is,i have ios phone but with windows laptop. And when I switch platform to ios, I cant seem to get the build n run button turn on...

[@dilmerv]

You can only build iOS application in macOS, that’s currently an Apple requirement. Best to you and thanks for watching the video.

[@puddyman]

is this possible using the rear facing camera?

[@dilmerv]

Currently is not possible...

[@danielguindelgonzalez4167]

Gracias Dilmer gran aporte!! Intenté realizar una demos basándomelos en lo que hiciste pero para mi sorpresa al compilar y desplegar para un iPad 5 generation la aplicación se inicia con la cámara trasera y no realiza el Face Tracking, he repasado si hice algo mal pero yo lo veo todo correcto. ¿Algún consejo?

[@danielguindelgonzalez4167]

Es un iPad 7th Generation perdona xD

[@zaibi2890]

Hey great video. I have a small question. how will i switch it to use ARCORE for andriod?

[@dilmerv]

Easy just select ARCore XR Plugin instead of the ARKit one I selected ;) thanks for your feedback.

[@zaibi2890]

@@dilmerv Thanks

[@Kalimullin]

@@dilmerv Thanks a million!

[@marthatinoco360]

@@dilmerv HI! the configuration in bluild and settings is different for android? thk :D

[@AsasinoManik]

Good video, I will do it for Android

[@alea6770]

Hey Dilmer, Loved the tutorial! Quick question - can this process work on a Windows app too? Eager to try it out. Thanks a lot!

[@dilmerv]

Thanks for your comment, currently this only works on ARKit or ARCore. For a Windows app I would recommend looking into developers.google.com/mediapipe good question!

[@aldinowildhankurniawan8175]

I Have Question how to switch to front camera im using Android ?

[@dilmerv]

Take a look at this article developers.google.com/ar/develop/unity/augmented-faces/developer-guide

[@tasook]

Hey man, great video, super straight-forward to follow along and very quick, which is great!. One issue with my attempt though, I managed to build both for my iphone x and iPad Pro and I have the same issue; after the "made with Unity" screen, it just gives me a black screen. I suppose it's not accessing the camera? But it should, right? Plase advice. Many thanks again for doing these!

[@dilmerv]

Few things I can think about is to make sure you set the PlayerSettings as shown in the video, Camera Usage Description needs to be set, ARM64 needs to be set, etc.

[@dilmerv]

Thanks for your feedback and question :) let me know if my previous response helps.

[@tasook]

@@dilmerv Hey, thanks for your reply! Yes, I've set all these properly, the only difference that I see is that in my Project Settings panel, I don't see the XR and XR Plugin Management categories on the left, not sure why or if it matters. Anyway, thanks again!!

[@tasook]

No worries, restarted Unity and all is good. THANKS!

[@Rizky-xv4kz]

But if I want to build it for android, do I still need ARKit?

[@dilmerv]

In that case you would need to download ARCore from the package manager.

[@ThePravenpjose]

Hi, Let me know one thing? Is it possible to crate Oculus Rift/S game using Oculus Quest + Oculus Link Cable?

[@dilmerv]

At the end of the day it is unity so yes you can develop and test that way but I would say that before you release your game you need to test in the Rift. Good luck !

[@ThePravenpjose]

@@dilmerv of course,Thank you for your reply.

[@akash_the_phenomenal942]

please help , how Do I add accessories like Hat , Big ears etc , currently it being Face masked and cutting other things , Please Help

[@dilmerv]

Hi thanks for your comment, currently there is not an easy way to target specific areas, I know that Unity MARS offers those options but that would be a paid service. Here is a video that can help you kzbin.info/www/bejne/goisnoSJpciDesU

[@akash_the_phenomenal942]

@@dilmerv thank you for the reply ❤️... Yes I had looked other comment and seen that mars video you shared also in that comment. Thanks I will consider that

[@Gajendra.Sukalkar]

HELP! tried same for android, but the camera never does face recognition, it just shows normal face, HELP!

[@hyperdragon1013]

hope this helps Newer device models will have AR software already integrated into your phone. Make sure you are running iOS 11.0 on your iPhone or have the ARCore app installed from the Google Play Store. Requirements for ARCore for Android: Android 7.0 or later (some devices will need at least Android 8.0 in order for ARCore to work)Feb 7, 2019

[@nithyashreeraja5241]

is it possible to create a 3d face, like a complete character head that can replace the whole head (including, ears, eyes, etc.)

[@dilmerv]

Take a look at this video as well it may help you kzbin.info/www/bejne/kJvHqGuYfdipjsU thanks for your great question !

[@nithyashreeraja5241]

@@dilmerv Thank you

[@dilmerv]

Anytime 🙏

[@FrancoPenizzotto]

Thanks for the video, quite useful for my. A question since I am new with AR: Do you know why could be the reason of this issue? Thanks a lot, Library/PackageCache/com.unity.xr.magicleap@4.0.5/Runtime/Raycasting/MagicLeapRaycastSubsystem.cs(33,28): error CS0246: The type or namespace name 'IProvider' could not be found (are you missing a using directive or an assembly reference?)

[@dilmerv]

You are very welcome, I am not sure Franco what version of Unity3d are you using?

[@FrancoPenizzotto]

Dilmer Valecillos I download it this week, so it is the last one (2019.3.something)

[@FrancoPenizzotto]

@@dilmerv I have just found a single difference with respect to the steps shown in your video: when clicking XR Plugin Management, I have to install Magic Leap, or Oculus XR Plugin, or Window XR Plugin before being able to add the AR Kit Loader as you did it. Using Magic Leap XR Plugin or Oculu XR Plugin I get the same compiling error. Can you send me the project so I test it or I send you my project since I think the error is around some missing library or complement in my laptop. Thanks again.

[@newsrah]

@@FrancoPenizzotto i have the same problem

[@dilmerv]

Here is the project :) github.com/dilmerv/FaceTrackingDemo let me know if that works for you.

[@bharanidharan3142]

ARKit occlusion and "tracking" of vertical planes using unity ... plz do a tutorial for that!

[@dilmerv]

I have a lot of videos about that, look into the AR Foundation playlists, thanks !

[@ilthizamimtiyas3482]

How can I put some sunglasses on the face? and some earrings

[@dilmerv]

This feature won’t be as accurate since this is using AI models behind the scene for a face, I would suggest looking into other solutions as least until iOS and android provide more accurate information for the exact position of the eyes and ears.

[@niyal]

the app is started but with rear camera, any specific setting for front cam?? also face is not projecting.

[@dilmerv]

What device are you using ?

[@niyal]

@@dilmerv iPhone 13pro, but it solved now. I got the solution. Thank you for the prompt reply. And I must say your videos are so much helpful for us. Thanks a lot for all the stuff.

[@dilmerv]

That’s great news thanks for letting me know ! Best to you Niyal :)

[@georgiagallant1667]

@@niyal How did you solve this issue? I am having the same problem!

[@mauricioalbarracin]

Hola Dilmer, gracias por el tutorial, una pregunta este tutorial es solo para Iphone, o también funciona para Android y windows?

[@dilmerv]

También funciona para Android :)

[@leabarrionuevo]

Funciona par android? Pensé que arkit era para iOS.

[@dilmerv]

Si ARCore también tiene la funcionalidad de face tracking.

[@sungjinchun1094]

Tried everything but did not work.... Using an iphone11 pro and tried on unity 2019.3.12 and also 2019.4.2, with the packages of 3.0.1 and to 4.0.1.....The 3.0.1 package did not even build due to errors in the console, and for the 4.0.1 the build succeeded but it did not recognize my face... any suggestions please?

[@dilmerv]

Did you get a pop up asking for camera user permissions when the app opened for the first time ? Also do a developer build and watch the console for any type of errors when running in XCode.

[@sungjinchun1094]

@@dilmerv Thanks for the reply. No I did not get a pop up. Now I am trying to figure out the difference between my file and your source file. Think I did everything you told on the video...

[@muhammadhamza3440]

Thanks a lot it works on android. But mouth and eyes have closed texture. How to open texture at these two points. Please tell....

[@dilmerv]

That’s how it works in Android looks like other users reported the same results.

[@muhammadhamza3440]

@@dilmerv ok thanks alot can you please make a video as to how Augment faces with stuff like glasses...

[@godril90]

@vital science does it work on androids (7 or more) that don't support Arcore for you?

[@muhammadhamza3440]

@@godril90 no it work only on devices which are ARcore supported

[@savanbudheliya5076]

@@muhammadhamza3440 how can I know where my Android is ARcore supported or not?

[@idkkkkk5194]

How to upload these filters to Instagram or snapchat

[@dilmerv]

These aren’t compatible with instagram or Snapchat, instead these are to create your own standalone mobile application.

[@siarheibrazil4110]

Muchisimas gracias, pero...) You do indie game dev , could make some more realistic tutorials ?)) I mean ar tuts look similar to Official samples , but we need more :))

[@siarheibrazil4110]

I would rather see some game dev tuts

[@dilmerv]

Thanks I will bring more videos on the game development side as well :)

[@kwakuojr8749]

Is there something I am missing here? The camera on the scene goes black every time I run the scene. I feel I am missing something

[@dilmerv]

What device are you using ?

[@kwakuojr8749]

@@dilmerv iphone 11

[@kwakuojr8749]

@@dilmerv So I'm using Windows with my iPhone connected via unity Remote 5.

[@seifmostafa58]

I just followed the tutorial and build was successful with no errors , yet no face masks were created, I'm building this on android , is there any extra steps I'm missing ?

[@dilmerv]

Did you add the ARCore Plug-in Package ?

[@seifmostafa58]

@@dilmerv yeah I added the ARKit,ARCore and face packages from the package manager

[@seifmostafa58]

@@dilmerv I just noticed this warning occurs when I try to run in the editor "No active UnityEngine.XR.ARSubsystems.XRCameraSubsystem is available. Please ensure that a valid loader configuration exists in the XR project settings" but it doesn't show in the USB debugger on the android , so I don't think it would be the problem

[@yudnai5577]

i stop following you long time ago because you don't do it for ANDROID only for IOS and i'm using ANDROID hope in the future post for both . but it was helpful. thank you

[@dilmerv]

I will very soon and thank you for your feedback !

[@praveshsharma9194]

Is it will be same for Android ??? And one more thing which one is better ARcore sdk or unity AR foundation ???

[@dilmerv]

I haven’t tested it this for Android but you could test it by adding the ARCore XR Plugin instead of the one I added.

[@praveshsharma9194]

@@dilmerv Thanks a lot it works on android. But mouth and eyes have closed texture. How to open texture at these two points. Please tell....

[@user-ib7rt4jr2c]

@@praveshsharma9194 I have the same problem

[@dilmerv]

That’s the behavior I see everyone having with Android, I would say check with AR Core docs and see how it should behave. This docs shows a mesh that covers the eyes even from ARCore docs developers.google.com/ar/develop/java/augmented-faces

[@underbelly69]

possible to develop and build for iphone on pc ?

[@dilmerv]

Hello, that’s not possible, you need a mac to build the project and submit it.

[@underbelly69]

@@dilmerv thanks Dilmer

[@underbelly69]

another Question - A client (VR Training) wants to run my apks on their own Q2s.. but they don't want to login with private FBs to every Q2 - how do they manage several Quests - without FB logins?

[@dilmerv]

You are welcome 🙏 great question !

[@StampedeGames]

To create a face mask even faster, you can use this plugin: forum.unity.com/threads/ar-foundation-editor-remote-test-and-debug-your-ar-project-in-the-editor.898433/

[@dilmerv]

Thank you

[@erlanggachakra1074]

does this work for android?

[@dilmerv]

Yes face tracking is supported by ARCore and therefore also by AR Foundation...

[@sachethsanal3110]

XR Plugin Management Instable Xr PLUGIN 1. MAgic Leap XR 2. MockHMD XR 3. Oculus XR 4. Windows XR which one do i install

[@dilmerv]

You don’t need to do anything with those since this is for face tracking, you will the ARKit or ARCore plugin from the package management.

[@komakinex]

Hello, Nice tutorial thank you! I succeeded build app but app never launch. Do you know why? iOS 13.3, ARKit Face Tracking and AR Foundation 3.0.1

[@dilmerv]

What device are you currently using?

[@komakinex]

@@dilmerv iPhone XS!

[@komakinex]

and Unity 2019.3.3f1

[@dilmerv]

When you run your project in XCode take a look at the log and let me know if you see any errors.

[@komakinex]

@@dilmerv Hi, I built it in Unity2019.2, then the app ran! Thank you. I heard that Unity2019.3 doesn't go well with iOS13.3.

[@Scrapemist]

Not working on iPhone 7 .

[@dilmerv]

Correct you need at least iPhone X due to the camera requirements.

[@Scrapemist]

Dilmer Valecillos I have a feeing all frontfacing camera functionality of the ARkit require an X.

[@GeorgeIndustry]

Greetings friend, this must be the thermal type pattern for augmented reality to detect covid 19

[@dilmerv]

That would be awesome, I need to find ways to help with it for sure.

[@dennysvital5033]

This works on Android?

[@dilmerv]

Yes it does, the difference I have heard from people using in Android is that the eyes do not have holes when the mesh gets created.

[@dennysvital5033]

@@dilmerv Thanks. So how we can add the holes on the eyes?

[@KoradiyaAbhay]

@@dilmerv yes that is the issue.

[@Caio-Mendez]

I need help

[@dilmerv]

What do you need help with?

[@Caio-Mendez]

I need to create an app very similar to that of the food game in ar, but I need that the objects when downloading can be captured with the face, I already have created the mask scene, but I don't know how to create the object scene or what scripts to use. I would greatly appreciate your help, as it is a project that I am considering to exercise my neck in the workplace, thanks

[@maximus103]

bro im getting black screen

[@dilmerv]

Are you using URP? also check and make sure your ARCore or ARKit plugins are enabled.

[@maximus103]

@@dilmerv i checked tge output by running the scene in the game page im getting a black scteen instead of face cam pls help

[@UnityWorksIndia]

no use of this...face is not occupying full-face.

[@dilmerv]

It may not work as a solution for your use case, but this is very helpful for other use cases ;)

[@UnityWorksIndia]

@@dilmerv may be..but 3d mesh on face not covering full.its covering till half of forehead. so automatically its show half cut face. not working for glow effect or other beuti mask....other hand traking mechanism like spark ar works accurate.

[@krook5899]

wtf! you already knew how to do it then challenging your self to do with time limit? nonsense

[@dilmerv]

It wasn’t my challenge, it was to let people know how easy it is to do this task and that it would take you less than 10 mins to do.

[@krook5899]

@@dilmerv sorry, im frustrated to those who does something challenging but already expert on it.