Animate MetaHuman Face with your Phone | Unreal Engine 5 Tutorial

[@ParaaShakti]

Can you put the Pt.1 Pt.2 Pt.3 Etc. All in description

[@badxstudio]

All the Metahuman Tutorials are in this Playlist kzbin.info/aero/PLIn-yd4vnXbjwxPNYeHz4Ac3le_zIZc-P

[@samgoldwater]

It's eerie how every time I have a question the bois have answered it in a video published LIKE THAT SAME DAY 😇😎💥

[@badxstudio]

SAMMM!!! ma man thank you for the love

[@JaskaranSingh-ol5er]

Great job guys, I was waiting for this video and now I am waiting for the third too.

[@badxstudio]

Third one is coming soon this week ❤️❤️❤️

[@tastydish7340]

Awesome vid. In case anyone had the issue of "hey, my head movement isn't tracked!?". Don't worry, in the livelink app on your iphone, click the gear in the top left of the screen and enable ' Stream Head Rotation'. Voila babbyyy

[@badxstudio]

Thank you for that extra tip!

[@MrKissmass]

i ctrl+f search 'head', i knew you will be here! cheers bro!

[@abbignale6309]

The "Stream Head Rotation" button wasn't there for me until I activated the "Blendshape Data" in the app and then closed and restarted the app completely. After that, it worked.

[@jonnygrown22]

awesome!!! would love to see more content related to virtual production. especially on how to do it on a budget

[@badxstudio]

That is a great idea! We definitely have that in the pipeline too so don’t worry it’s coming 😍

[@violentpixelation5486]

@@badxstudio maybe you gonna use the VIVE Mars Camtrack System?! #Budget #VirtualProduction

[@lewliteki]

You guys got me addicted to scanning people and turning them into Metahuman, and now I see this??! The journey continues 😂

[@badxstudio]

Hahhahahahaah WE WANNA GET EVERYONE ADDICTED LETS GOOOO! Part 3 coming soon

[@lewliteki]

@@badxstudio part 3?! Can’t wait!

[@badxstudio]

@@lewliteki Lol Part 3: Customise mesh in blender part 4: Customise texture in substance part 5: Custom hair in blender part 6: Attach items to Metahuman (Hat/glasses) Part 7: Animate metahumans Part 8: To be announced :D

[@himanshu1784]

Hey guys you are doing great stuff, making something educational with good sense of humour. I hope you get thousands of views which you deserve! Keep it up and all the best!

[@badxstudio]

Wow thank you so much!! That means a lot we will keep workin to create cool shit for ya

[@wisekhil1005]

I think it would've been a good idea to note Live Link is only available for Apple users with Iphone X and newer or Ipad Pro (3rd Generation or newer)

[@Fauzanarief-n7i]

its pretty sad that there isnt android version of this. Probably because there is no other phone that have a lidar sensor

[@olliegreen2307]

Love the series so far! Will you have a video on creating custom hair not using the metahuman default hair styles?

[@badxstudio]

Eventually yes! probably gonna try MetaHuman animator first and then customising the hair.

[@olliegreen2307]

@@badxstudio Awesome! Yeah excited for you guys to do the animator!

[@a.kromatyk]

great tutorial details about solving the bugs and all. Really Appreciate it.

[@badxstudio]

No worries ❤️❤️ glad you enjoyed it!!

[@danish_blends]

loved it. And subscribed 🤭 because the last sentence sounded like it was an order for me 🤣

[@badxstudio]

Hahahahahah lol yeah we had to force people

[@waqaranayat8083]

I have subscribed you guys to keep it up. Never stop making these types of tutorial.

[@badxstudio]

Brother thank you for your time and trust! We will KEEP MAKING VIDEOS! Thiis is full time for us :) :)

[@louisiannna]

You guys are awesome, you've earned a sub!

[@badxstudio]

Heheheh thank u

[@alisaberi6729]

Hi, I added record in levelsequence but head movements not working,do you know what’s the issue?

[@isaaceddlestone417]

This is really cool what you are doing I roam around in a wheelchair and i have just scanned myself so I'm going to walk around in the virtual space I have a question for animation the app that you use Is it available on android If not can you recommend another app

[@Suzanne06]

Great content. Good job guys 🙌

[@badxstudio]

Suzanneeeeee you know we love you right???

[@Suzanne06]

@badxstudio You sure you don't have me confused with COFFEE? xD haha you guys are soooooo amazing 🩵

[@lordbaloma]

Thank you very simple explaination

[@badxstudio]

You are welcome 😍

[@TheDavidGersch]

Epic! But how do you animate the face and use mocap to animate the body movements at the same time?

[@badxstudio]

Body mocap is coming in the upcoming episodes of this series so don't worry we gotchu

[@tiagomaia.]

@@badxstudio WE CANT WAIT FOR IT!

[@madedigital]

Brilliant guys

[@badxstudio]

Cheers ❤️

[@farukboracatalbas3252]

bro u guys are crazy

[@terezaancheva1]

Yesterday we create our metahuman with your first tutorial and it was great! I can send you some pictures if you want. Thank you a lot! ❤Just want to ask can we use android for this tutorial or it has to be an iPhone?

[@badxstudio]

Ok first of all you are awesomeeee!! thank you for letting us know that the video actually helped. WE WOULD LOVE TO SEE THE RESULTS! yes pls send it in our discord: discord.gg/XZ3tD2Xf Also as for livelink that app is only available for iphone and Ipad with TRUDEPTH camera! For android you probably cant use livelink BUT there were videos of different work arounds to animate the metahuman face. Not sure what they are but we remember we saw videos before. You might wanna search that on youtube :)

[@arjanjua.official840]

Hi! Great tutorial but I have an issue in neck movement facial expression works fine but neck is not moving.

[@badxstudio]

So in your livelink app go to settings and make sure NECK/HEAD Movement and rotation is ENABLED! If that doesnt work I realized just creating a new project in unreal works :)

[@現れる奴]

Thank you for the video. What should I do if the rotation and the direction of the head are not reflected when I play back the recorded animation in the timeline? (Sometimes the neck keeps fixed although the motion of the face is successfully reflected)

[@jafetnoriega8623]

I have an issue like that when export. the head moves on sequencer but not in the export

[@Furiac.]

Ive been wanting to do this but don't have an iPhone. Might try to borrow a friends My current project is low poly though so ill try it on my next one

[@badxstudio]

Heyy so borrowing is a good idea since you can record it and give it back to your friend! Alternatively there are some other android solutions, other youtubers might have covered it so pls check it out

[@Furiac.]

@@badxstudio didn't know about Android solutions. Ill definitely check it out THANK YOU

[@ShreyanshMehta-ov8ze]

hey you guys did what i wanted to learn, Thanks. but can you make a video on how can i make my character move (walk) so that i can create a story. cause character moving only head don't looks realistic. btw really appreciate your work.

[@badxstudio]

Of course we can

[@ShreyanshMehta-ov8ze]

@@badxstudio thanks i'll try this + wait for your updated video as well ❤

[@badxstudio]

@@ShreyanshMehta-ov8ze Comin soon

[@rodszera]

Amazing video guys. I love your chanel. Are you planing to do a video showing how to animate and/or import body animations to the Meta Humans? Is there some stock animations available for MH?

[@badxstudio]

Thanks buddy, for sure will do it in future

[@ThePerceptionParadox]

do you need an iphone to do this?

[@badxstudio]

You need a supported IOS device so we believe some Ipads are supported too. We wished that android phones were supported but unfortunately many of android phones or maybe all (we are unsure) do not have a depth camera which MetaHuman Animator uses to calculate the super realistic performance and bake it into a sequence. But you can always consider how expensive or unattainable the other alternatives for such animation quality is .... any head gear can cost upwards of $5,000 to achieve similar qualities and can be a hurdle. If you really need this level of quality you can always consider buying a second hand iphone juust for this scenario. Just make sure the iphone/ipad you buy is supported by MHA

[@ThePerceptionParadox]

@@badxstudio thank you for the quick reply and the tip about buying a second hand iphone. considering that this is free and the only cost to create these will be the cost of buying a second hand iphone is well worth it. I am still considering if I should wait till it becomes available on android (if it even does) or just buy the iphone. Love your content! Liked and subbed!

[@dovletgeldihojayev]

Thank you very much! Just super, everything is simple and neat!!!👍👍👍

[@badxstudio]

No worries at all ❤️ see you in part 3!!

[@Zanaga2]

Also, enable the Groom plugin, or your metahuman will be completly hairless, not only from distance. And, at least in my case, enablling the groom plugin after downloading the metahuman didn't work, I had to redownload the metahuman from Quixel Bridge after the groom plugin was enabled. That in 5.3.2 UE version. I have no idea about other versions.

[@aminsalehkho]

wow soo cool دمتون گرم خیلی حال می کنم ایرانی های مثل شما رو می بینم

[@badxstudio]

Thanks a lot dadash 😍

[@rahulmahaseth4519]

Hey can you make a full tutorial where you create a short KZbin video using just meta human.. by adding background and scene

[@badxstudio]

yessss thats a dope idea! Will definitely do that in the upcoming days

[@MrMarcelomidaglia]

I can't connect my iPhone to the live link, I put the same IP, submask and router and nothing, nothing appears on the live link! Could you help me?

[@skyelynxmccuien9180]

Cant get the neck joint to move, my mouth eyes and eyebrows move but no face rotation :(

[@Diskokeisari]

same problem

[@lemonad903]

Beautiful, I would like to know if I can create a face, a scenery, or a scene and then sell it as an NFT on a marketplace just like with any digital creation software.

[@mr_yado3214]

Live link is not available for android ! what can I do ?

[@DavesChaoticBrain]

Is there any way to do this with an Android phone?

[@OfficialGundem]

does this work with android phones?

[@shelfrelated]

What if the Angelina metahuman stops following your movements one day and starts acting on its own. Looking forward for day 213 when that happens!

[@farazshababi1]

Hahahaha dude we are gonna fken pin this comment in the video on day 213 when it happens bro

[@7eleven_eo]

Alternative for Android?

[@Abbaajihausatv1]

Wow😂 , please can you create your own character or upload your own character inside the app?

[@badxstudio]

Hey!! We are making our own character. Please check out our PART 1 that we uploaded a few weeks ago :)

[@Abbaajihausatv1]

@@badxstudio please help me with the link

[@guillermomontoya3382]

This is a wonderful job, is it possible to do it with an Ipad?

[@badxstudio]

Thanks a lot. The ipad must have a true depth camera. Only Ipad pro 3rd generation or newer ones currently have this

[@guillermomontoya3382]

@@badxstudio I see, thanks for answering. I believe that feature is ONLY in the front camera for Iphones and Ipads, does that mean we can't scan animations with the rear camera?

[@premchowdarydasari]

Then how do you move the body

[@solomonali7229]

Awesome, good job M F

[@JESSJAMES1886]

Hola, tengo una pregunta para el desarrollo de un videojuego. Primeramente gracias por vuestro vídeo,gracias a vuestro contenido cada día estoy más entusiasmado y trabajo más duro en mi juego. Pero querría saber,cómo podría capturar ese mismo movimiento facial,híper-realista pero en el cuerpo. Unas físicas grabadas del cuerpo real de una persona y transformarlos a unreal,no sé si sabréis alguna forma o aplicación que permita esto. Y en unreal dejan utilizar meta humans para videojuegos siempre que se utilicen en renderizado entero en unreal pero al utilizar blender para limpiar la cara como hacéis vosotros,y luego al pasarlo a unreal, ¿sabéis si eso es suficiente para que no te dejen desarrollar?

[@Taki7o7]

Hmm.... Apple only - grabbing some old iPhone with iOS 15.8 latest installable version: Live Link App needs at least iOS 16 :D Isn't there some alternative to do the same on your pc with a simple webcam?

[@AlexisRivera3D]

I can't import my custom Metahuman to UE5, I just click on Add, creates the folder but there is not mesh

[@badxstudio]

Not sure why we're sorry

[@96ubme]

So to get the voice you have to render out the sequence and add the voice track in post or can you add the voice track inside UE5?

[@Silentiumfilms007]

can we use it by android phone ? can we use mixamo characters?

[@parasol222]

Yo Faraz you look like Adam Jones from TOOL a bit :D

[@badxstudio]

Hahhahaha really? :D

[@parasol222]

@@badxstudio not really, he looks like you! :D I really like yours channel

[@TheWordandI]

I’m having trouble connecting my iPhone. I’m on same network but it’s not working. Is there more plug-ins that I have to check? Thanks in advance

[@badxstudio]

That's weird! It's hard to troubleshoot the problem like this. Since it's been a day already have you found a fix?

[@TheWordandI]

@@badxstudio Yea my iPhone an SE. I need a X or better. Thanks anyway

[@AlexisRivera3D]

When I try to add my Metahuman to the scene it only imports the materials, textures, etc but not the mesh

[@badxstudio]

Hey we checked and dont know why thats happening

[@sheraixy]

is this the new Face-Mocap technique, Epic Games showed at their show a few weeks ago?

[@man4408]

no

[@badxstudio]

No the new Animator update isnt out yet! But you bet we are going to cover the the second its out!!

[@sheraixy]

@@badxstudio cool, therefore i leave a like and follow. Cant wait for it

[@theholybookstoriestelugu9617]

can you make a tutorial on custom body and custom clothes to meta Human

[@badxstudio]

Yessssir! Will do ❤️

[@grimanlabs2345]

What phone model is needed at the lowest price to work?

[@badxstudio]

You need an iphone or ipad that has trudepth! So any of them that come with that ...

[@AHtasam-u1c]

Bro please answer after this animate how to use hand animation i mean hand moving

[@hypherak47]

Is there any way to do this without Iphone? I only hv android.

[@badxstudio]

Unfortunately not as of now

[@hypherak47]

​@@badxstudio ohk thanks. IG I need to start some side projects for marketplace :) RTX 3050 w 4gb vram is also not enough to run UE properly :/

[@astroproductionsllc4917]

head movement works but once i record it and put the animation in the sequencer the head movement doesnt work only eyes and mouth move

[@AnandPrasad6668]

Hey. Does this work on iphone 13 or is it compulsory to get iphone pro

[@jafetnoriega8623]

I was able to do every thing fine, the sequencer plays de facial and head rotations, but, when i trie to render a cinematic, only the facial expressions move, not the head rotations.... What would be the probem. Thanks.

[@unfinishedsente]

Any Android alternatives for 3D scanning and exporting, and for Live Link?

[@021_dhruvkumar9]

Need help, I can't move the metahuman neck but rest is working perfectly.

[@DesignDude952]

The facial tracking works but when I add the BP to sequencer the facial animations stop? Really strange

[@badxstudio]

Can you elaborate more? maybe we can help fix it

[@echeverryaavila521]

Does it works with iPad PRO? (with lidar sensors)

[@Diskokeisari]

my characters head is not turning, what could be the problem?

[@Tibet_official_art]

Cannot able to connect my phone to live link even it’s same wifi and same ip address what to do?

[@arielshpitzer]

arkit has 50+ blendshapes but i know metahuman has more than 700. how do you gain control to the full range of motion locked in the model ?

[@silentwindstudio]

Is there some similar app for android?

[@anantarachuri5068]

Great Tutorial. I tried. But Mouth is not closing. Teeth visible even if i am closing mouth. What is the solution?

[@badxstudio]

Thanks a lot For the 'Teeth' pose, you should make sure that the top and bottom teeth are together, with the back teeth meeting in a 'clench', and (likely) top teeth slightly overlapping the bottom teeth, and opening the lips so that the upper teeth tips are visible. In your pose, there was a small gap between top and bottom teeth, which can lead to slightly less accurate positioning of the teeth in the MetaHuman Identity, and therefore slightly less good quality of animation.

[@anantarachuri5068]

Thank you for reply. 😊

[@nttnrecords5474]

HELLO, i am having an issue where LOD are forced set to 1, but in the sequencer there is no hair showing up, thats on only 1 map , do you know why?

[@yashshinde7963]

In next part tell us to import metahuman in blender please 🥺

[@badxstudio]

That’s coming soon too! This week ❤️

[@keeknation4674]

@@badxstudiopls

[@mrsselftaught]

Hi, so I followed all your steps one by one, double check and I have a problem, when I add the animation to the face on the sequences only the neck moves, but not the eyes, mouth or anything else, do you know why this could be happening?

[@mr._.sarthak212]

Title should be = Animate Metahuman with i Phone 🗿

[@eltwinscodm625]

What the app you use on phone

[@Oceana_3D]

I use live face inside of iclone and use live link to transfer the data into unreal engine 5. When I hit my usual record, the body animations save to sequencer but her face animations will not. Even though it shows everything animating inside of the viewport. She's a metahuman. Any suggestions? No one seems to have the solution lol...

[@daniolteanu9006]

can it be put in a model game created by me?

[@FPChris]

I can’t get pasted Prepare for Performance. It just errors and says failed.

[@forhoror5562]

excuse me.... when i import animation, head is not moving... only face moving. I dont know why.. HELP PLS

[@jafetnoriega8623]

Ok, I've managed to import the face animation to the Metahuman and all plays ok in the sequencer, but when I export a render from it, it won't show the animation, only te Metahuman! What am I missing?

[@louisiannna]

If anyone is having a problem where the expressions + neck movement all work fine in the Take Recorder, but the neck movement stops working once you add the animation in Sequencer - open up the MetaHuman BP, select the 'Face' component on the left-hand side, then in Details, make sure Anim Class is set to ‘none’ for the character BP’s Face component.

[@LoreDeco]

I am, the first time I used this tutorial it worked fine, now nothing works - if you ever find a fix please let me know! I am currently having a snoop so I'll do that same if I find the cause!

[@LoreDeco]

I found the fix - go to the animation properties and make sure 'Force Custom Mode' is enabled.

[@_technomo]

Thank you

[@Ronggerr]

yes!!! I've been stuck here for almost a week, you've saved my life bro!!!!

[@ReacherFN]

Is there a way through Live Link being able to allow your character move its neck so it doesn’t look stiff?

[@badxstudio]

You should have neck movement my man! Make sure in your livelink setting on your iphone turn on neck movement. ALso if that still doesnt work, start a new project in unreal and try it on your metahuman again. Anyways u shud probably check out our METAHUMAN ANIMATOR tutorial which has far better facial animation :)

[@Bombgamiing]

is it possible to make if we only have human photos , HOW?

[@badxstudio]

U can try a blender addon called FACEBUILDER from keentools :)

[@supermattis108]

hi! in 5.3 the hair dosent stick to the face, like beard when animating... Do you have a fix for that? Binding asset dont work , it wont apply and just disappears from the slot.

[@wilismatrix9847]

the head is not moving, only face is. How to fix this in UE5.3 ?

[@stevenhancock3364]

is there an Android version of the live link app, or do i need to go out and by an iphone just to do this?

[@sebastianodibusti]

This app works whit blender ?

[@badxstudio]

Which app my friend?

[@sebastianodibusti]

@@badxstudio livelink 🙂🙌🏻

[@prasadwagh1385]

When I render it I am not getting the head rotation

[@jonos138]

Man I must have done this 50 times and live link still doesnt connect. Ive putinthe ipv4 address exact but my iphone doesnt connect. Why?? All plugins are activated.

[@jonos138]

Found out why. For anyone else who may have followed exactly how to connect but still can't. Go to your Windows network settings and make sure its set to private network and not public. This cured it for me. 😉👍

[@badxstudio]

Glad you found the solution

[@Jordanc87]

I dont have the same settings in Live link on my phone

[@badxstudio]

What?? how come? Whats the difference?

[@Jordanc87]

@@badxstudio I figured it out, just in a different place

[@adithyarajapakshe3791]

can metahuman talk with a script we provide?

[@robertprescott9577]

Does this only work with iPhones??? Is there an Android solution????

[@shivam7156]

hairs??? LET'S GO

[@badxstudio]

Lol hair is juust ONE of the upcoming tutorials :)

[@taset5180]

But i don’t have the version that you have i have the new version of the app in that i can’t do this can you please do it in the new version of live link

[@thomasdunn5211]

Make sure mode is set to "Live Link (ARKit)" or you won't see the live link target in settings.

[@foufoulini]

where is the export animation part

[@rachuriantaratma5945]

One of the super tutorials. But in my case, there are few bugs. 1.Metahuman is not pronouncing as I pronounce. 2.Metahuman's expression slightly does not match my expression. Please help me by suggesting a solution.

[@badxstudio]

Hello hellooo!! Of course! We uploaded a new video called "METAHUMAN ANIMATOR TUTORIAL" That will give you MUCH Better animation! Please check that out :) kzbin.info/www/bejne/nouVnp6ZmZl2ba8&lc=UgwH6FkaqlaK8_h28at4AaABAg

[@rachuriantaratma5945]

Thank you for the reply. I tried that one also but it's not pronouncing as I pronounce. Is there any solution?

[@nexelus]

lol yeah so easy and no single word about detouching head problem and rotatation issue

[@hytalegermany1095]

Sad that live link is only available for apple and not android

[@badxstudio]

I know :(( Listen can you check youtube for android alternatives to animate metahumans? im sure there are ways!

[@joise14]

How do I find people who'd scan me in polycam?!!!

[@letsdance7089]

Make videos using unity also sir

[@badxstudio]

Dudeeee I wish we could right now butttt unfortunately our team is not well versed in Unity yet! I don't want us to come and talk about something we don't know much about. BUT we promise that over the course of our channel as we grow we will definitely be catering to the Unity audience too

[@Lukimuc]

Hi, I did the whole thing but I do have a walking Animation Asset and a Face Animation but the movement of the Face and Body is not synced so the whole body appearance breaks and the face clips out of the body. Any ideas?

[@badxstudio]

In your sequencer can you just move the track for the face animation to sit at the position you want. That should help manually sync it with the body movmeent. Let us know if that helped

[@Lukimuc]

@@badxstudio it didn't help So what I did is that I used the method you described but recorded the body as well Then I changed the Body Movement to the Blueprint asset I recorded and the face movement (two separate animations created by this one recording). They should be synced because I tracked the body and face simultaneously... but it's slightly different (It's a scream animation and the face moves 1-2 seconds faster to the front than the body)

[@gameclub_ir]

عالی

[@badxstudio]