UE5 Live Link Face Motion Capture Tutorial using Metahuman Characters

In this UE5 Tutorial we are going to use the Live Link Face App to do some Facial Motion Capture on a Metahuman Character! Motion Capture Using Your iPhone with Unreal Engine 5 and Live Link Face App!
UE5 Beginner Course ► pinkpockettv.g...
Blink Studio's RPG Assets ► www.humblebund...
Patreon ► / pinkpockettv
Instagram ► / pinkpockettv
Discord ► / discord
About the Live Link Face App ►
Stream high-quality facial expressions to characters and visualize them with live rendering in Unreal Engine. Record facial tracking data that can be further fine-tuned in animation tools to achieve a final performance and assembled in Unreal Engine’s Sequencer. Shoot professional-grade performance capture with an integrated stage workflow.
#ue5
#gamedev
#unrealengine5

[@JamalBakari]

Great video! Almost makes me want to get an iPhone...

[@pinkpocketTV]

😂 thanks for watching!

[@pinkpocketTV]

Yeah.

[@murthy85]

Does this work with an iPad instead of iPhone? Is the app compatible with iPad pro?

[@pinkpocketTV]

Yeah it is but the iPad should have Face ID. I guess the pros have it.

[@afjer]

@@sm71485 Until Apple inevitably bricks it with a forced update because you "need a new phone" even though you're not flipping using it for that purpose.

[@hl236]

Sir! You are a star. Short, sweet and effective tutorial that's not stretched to 20min.

[@watchandproduce]

You did a good job creating a short and to the point video. Thank you.

[@pinkpocketTV]

Thanks for watching. Appreciate the support,

[@guillaumecayer7772]

This was perfect. Exactly what I needed and straightforward. Thank you!

[@pinkpocketTV]

Heyy, thanks for watching! Appreciate the support!

[@dilarazockt]

Finally understand the blueprints thank you 👍

[@anjaligauchan3594]

This is just so great. Thank you so much bro. It's gonna help me so much.

[@pinkpocketTV]

Thanks for watching.

[@sadmansabir3848]

@@pinkpocketTV Android?

[@anjaligauchan3594]

Yes. But it worked for me

[@pinkpocketTV]

@@sadmansabir3848 I don’t think live link is available for android devices as it uses Face ID.

[@arturnilin359]

That's awesome!!! Your channel has really super content of lessons!!

[@pinkpocketTV]

Thanks for watching! Appreciate the support.

[@VLRN_]

Thank you for this straight to the point tutorial, excited to try it out myself !

[@pinkpocketTV]

Thanks for watching.

[@8teapi]

I managed to get this working!

[@pinkpocketTV]

Happy to help!

[@ipadking2.0]

Amazing! Thank you so much!

[@pinkpocketTV]

Thanks for watching. Appreciate the feedback!

[@JDRos]

Straight to the point bro! Subscribed! I hope you make more videos like this! Is there an equivalent tool for full body motion capture?

[@pinkpocketTV]

Thanks for the sub! Really appreciate the support! And yes, I have made a video about it on my channel for the full body mocap. Rokoko and Move AI both have their implementations of video to animation. Hope this helps!

[@JamesCardonatweekaholic]

Awesome, thank you!!

[@fellpower]

only apple...:(

[@GabrielLeite-kd3fd]

Great tutorial friend, my neck doesn't move, could you tell me what it is?

[@esp6248]

Does this just do facial animation or is it also head position coords over live link?

[@leonaraya2149]

Already put my Ip Adress and Unreal Doesn't conect my iphone. 🤔

[@MainCharacter.X]

Cool

[@Mrjononotbono]

This is great. How did you record you iPhone screen in the video?

[@muhammadwasifkhan4516]

how to add mixamo animation on top of the facial recording?

[@onisatori]

I forgot to mention that you should instead retarget the mixamo animations to the metahuman skeleton, it might look funky but thats the price to pay i guess, if you find a better workflow please share when you can.

[@princevasimalla]

​@@onisatori+1

[@jimconner3983]

hey did you ever figure this out just wondering

[@muhammadwasifkhan4516]

@@jimconner3983 lol. No

[@Faizaufannasai]

As far as I know, mixamo and meta human have different Joints, Namespace and different joint orientation. So I guess there's no way to apply mixamo animation to metahuman Joints

[@johnbull5830]

Great video, Thank you. Is it possible to record the audio at the same time and get lip synced performance.

[@pinkpocketTV]

I think it’s possible.

[@vishwasyadav6775]

Hey please a make a tutorial for Android users because livelink is not available in Android what should we do ?

[@Waqar_Naqshbandi]

Hey bro, when do you think you can upload a video about Metahuman DNA and how to create a metahuman from pictures using the new method in UE5.2?

[@Archivist]

This is so unreal

[@pinkpocketTV]

Yup.

[@streamingdev1163]

Can you do a tutorial on how to render with camera? There arent any videos on how to render these talking animations

[@tusharsinha4352]

Did you got any solution for that?

[@Gurie-98]

how to animate other body arms movement ?

[@worldbas3609]

hello brother, if we don't have an i phone can we use android or GoPro camera? plz answer my qst. i really need guid

[@benjaminrivlin771]

Do you happen to know why when I am recording the why characters head isnt moving?

[@gauraphypokerboy]

Can we track hand movements as well ? Or how we can do this?

[@JarppaGuru]

lets forget expensive apple we have 3d scanner lets use them allready

[@afjer]

This is cool, but I would also want to know how to clean it up and smooth some of the edges.

[@kingslayer4080]

These videos should have a disclaimer that an iphone is required instead of just casually mentioning it.

[@emreroisesunbul4888]

can we do this for full body ?

[@neoegonzalez5482]

Awesome, does it recorded the audio of your capturing or do you have to redo it separately and time edit it ?

[@AnandPrasad6668]

Hey. Does this work on iphone 13 or is it compulsory to get iphone pro ?

[@EftekherAhmed-n6l]

please make a tutorial on facial mocap using android device.

[@ChristopherEnoch]

I second that motion

[@zac4rusart]

Any app or software recommended instead of this app i dont have apple

[@wspluta5753]

Nice, how about if I want to do full body?

[@Lazyleo2025]

What’s next? How to save the animation and use in other projects ?

[@7eleven_eo]

How to do this in Android

[@Gaamer-r9b]

not detecting my phone , iphone x . i added the ip ...any idea?

[@phoneindustrydesign]

one question, iPhone send the data from the app to the ip adress of the computer, does this mean I can ask someone who is far away from me like a 10km to connect to my PC and help me out cause I do not have the iPhone? I am android user

[@pinkpocketTV]

No. The iPhone and the PC should be connected to the same network. For example in my case the iPhone and PC are connected to the same Wi-Fi.

[@phoneindustrydesign]

@@pinkpocketTV ahh right, that makes sense Tnx for reply! 😅🖐️

[@milagro2300]

@@pinkpocketTV does it works if the PC is in the same network but the PC is wired and Iphone on wifi?

[@Alborah]

if the future are we going to be able to take random sketchfab models and line up the facebones and use it?

[@rajrajraj746]

Can you please give same tutorial for Android phone ❤

[@psychojetenjoyer4678]

So. I order to start I can use any camera on PC?

[@bryancoleman6817]

Great video! I'm not getting the neck and head turn, just the facial animation. Is there a setting you've turned on to get that to work?

[@pinkpocketTV]

Yeah stream neck rotation I think does that.

[@lefthander3807]

Thanks looks cool, is it possible to add body animation to the face recorded metahuman?

[@icarobezerrasoares5055]

hi @pinkpocketTV, thanks for the video, listen, which version of the iphone is compatible? and only works with IPhone? or also works with Android? Thanks

[@ZEQIOU]

Can anyone tell me why my UE can't find my device, they are on the same network!

[@notgesund]

Can you livestream with it?

[@Amanullah-to6gn]

Which model Iphone ???

[@ApexArtistX]

How about attaching it to body animation

[@dddrogon]

HEY ISRAEL WHAT UP DUDE.

[@pinkpocketTV]

Heyy!

[@kingslayer4080]

Why does everyone here assuming everyone has a f*cking iphone 11?

[@Ryan-khan-y]

Early android use

[@s2skickstarters29]

Hi I am not getting quicksil bridge option... can you guide me why I am not getting that

[@milagro2300]

So the computer has to be connected by wifi (same as the Iphone) or it works with PC on internet cable and Iphone on Wifi?

[@НиколайФеденко-у8о]

What is the minimum version of iPhone that supports this feature?

[@pinkpocketTV]

Any iPhone with Face ID works!

[@lokeshchadha7715]

I really love ur content bro. I need ur help desperately. When i add the downloaded metahuman to my project and open the blueprint, it displays the metahuman as a normal blank model. Like, i also downloaded Cooper, but it displays as a blank model. Pls help me fix this. Grateful to u.

[@SayonBiz]

This is such a helpful tutorial!! Thank you for this, I've followed the entire process and it works like a charm All I wanted to know is if there is a way to export this metahuman face animation as an FBX to be used on Blender. Is that possible?

[@princevasimalla]

why unreal then? there are numerous tutorials for blender users

[@aghori3211]

hi its working in UE5.4???

[@doodleup1765]

i did try ver 5.0 it was very laggy are you using wifi or lan output. do tell me if that lan work better.?

[@IWillYeah]

What IPhone would you recommend for live line facial motion capture?

[@pinkpocketTV]

Every iPhone with Face ID works! I used the iPhone 11 for this.

[@IWillYeah]

@@pinkpocketTV cheers!

[@erenkaya6385]

So, can I find out which iphone model is used?

[@pinkpocketTV]

iPhone 11

[@lakshmanrao6357]

very nice ,can we create our customised model which i like

[@researchDarren]

this is awesome, what view mode are you using to get the metahuman on such a clean background?

[@pinkpocketTV]

I am using the metahuman lighting template.

[@researchDarren]

@@pinkpocketTV thank you so much, I’ll give that a try! It’s so clean!!

[@jacobparker2292]

Are we allowed to use metahuman models for commercial use ?

[@pinkpocketTV]

Yes!

[@reinohvp]

Can you do live link with metahumans imported from Maya?

[@pinkpocketTV]

Yes I am pretty sure you can.

[@DP_Animations]

Can we use metahuman in blender for animation?

[@DP_Animations]

Can we?

[@pinkpocketTV]

Yeah

[@fusion_studios4866]

You didn't show how to open the app in Unreal

[@HD-GAMES]

حسناََ ... لدي سؤال ... هل يمكن استخدام مواد كوكسل في لعبه ... اقصد هل هي مناسبه لالعاب ضخمه ... ام لا ينصح بها للالعاب الضخمه لانها ستحتاج جهاز خارق ... اذا كانت الاجابه نعم لا تنصح بها للمشاريع الضخمه فهل يمكننا خفض جودتها ... اعني اضافتها بدقه 2K ... وهل اذا اضفتها بدقه 2K هل يمكنني بعد الانتهاء منها وتصديرها تشغيلها على دقه 4K ام ان حدودها سيكون 2K ... اتمنى ان تفهمني وان يصل المعنى اليك ...

[@ParikshitBhujbal]

Well its not showing my iphone 15 at all

[@eulersosa6840]

Do you need an iphone to get live link? I have an android phone.

[@pinkpocketTV]

Yeah it’s an ios app.

[@michelguerrerostudios]

is working withUNreal E 5.2? ?

[@amarabdul9459]

Bro please add a video for waterfalls tutorial in unreal engine 5p

[@kristianrabakov8579]

What if my phone is not showing?

[@onemoreform]

bro how much video memory you have my graphics exhausted so big file

[@pinkpocketTV]

I have a RTX 3060 12gb card.

[@onemoreform]

@@pinkpocketTV rtx 3050 here but 4gb, but when I set to LOD to 4 it worked

[@pinkpocketTV]

Yeah 4gb is really low vram.

[@eagleanimation0162]

Hey how to make ravana in makehuman and using blender please make the tutorial 🙏

[@PrilaRis]

Is it possible to change the character with our own made custom characters?

[@chetansurve]

How to use this concept if I want to create a client's talking head ?

[@Gamsti]

does this also work for full body? for making cinematic scenes in games

[@AlphaLuk]

Skurvenej IPhone

[@GhostruktMerchantsCompany]

DOES THIS RECORD THE AUDIO?

[@pinkpocketTV]

I don’t think so 😅

[@burnerdesign]

i have ios 12.5.7 so how i install live link app?😂

[@yashwanth4395]

Is there an app for android

[@pinkpocketTV]

Don’t think so, as LiveLink uses Face ID for the performance capture.

[@milagro2300]

Cant get mu Iphone to appear on UE

[@GetWisdomTV]

Do not say, do this, do that, show everything.Some people like me comes here as fresh beginner.For example, you have not shown which project preset you selected.

[@sadmansabir3848]

What about Android user

[@IWillYeah]

Unfortunately, as far as I know this feature is only for iPhone as android phones lack the special hardware required. Android user here too.

[@raghavsnair1567]

I guess we should pay for faceware or something.

[@benveasey7474]

Is there a recommended Cam that could do this if we don't have an iPhone?

[@sadmansabir3848]

@@benveasey7474 hmm..Faceware

[@CabrioDriving]

@@sadmansabir3848 costs thousanda of USD. iPhone is cheaper.

[@patriciobarrios4602]

como puedo aplicar esto , pero no a un METAHUMAN, sino mas bien a un personaje basico hecho en 3D ?

[@Lucho72139]

mi compa el alucin.

[@simonquoi]

🍉

[@NTgamezZ]

0:51

[@36547]

How do we add audio for this? I"ve rendered it but audio isn't there

[@Blendermodeldeaf-ry5nz]

I don't understand you.

[@3ATPAXEP]

is it english you speaking?

[@avatr7109]

Jesus christ!!!

[@pinkpocketTV]

Yeah. It’s really cool.

[@sushilgul]

I have one feedback, following your videos one cannot even learn 5 percent, it's good if people have prior knowledge Why ru self obsessed with your photo in video, make more easily understood and screen space

[@monkey-do2iv]

scamer

[@LetaoChen]

Hey I am using a Mac, would I need to enable the Metahuman Plug in?

[@jaykunwar3312]

can we track body too with the camera ? i have seen there is live body option too??