UE5 Live Link Face Motion Capture Tutorial using Metahuman Characters

[@JamalBakari]

Great video! Almost makes me want to get an iPhone...

[@pinkpocketTV]

😂 thanks for watching!

[@pinkpocketTV]

Yeah.

[@murthy85]

Does this work with an iPad instead of iPhone? Is the app compatible with iPad pro?

[@pinkpocketTV]

Yeah it is but the iPad should have Face ID. I guess the pros have it.

[@afjer]

@@sm71485 Until Apple inevitably bricks it with a forced update because you "need a new phone" even though you're not flipping using it for that purpose.

[@hl236]

Sir! You are a star. Short, sweet and effective tutorial that's not stretched to 20min.

[@watchandproduce]

You did a good job creating a short and to the point video. Thank you.

[@pinkpocketTV]

Thanks for watching. Appreciate the support,

[@guillaumecayer7772]

This was perfect. Exactly what I needed and straightforward. Thank you!

[@pinkpocketTV]

Heyy, thanks for watching! Appreciate the support!

[@gamergirldilara1]

Finally understand the blueprints thank you 👍

[@anjaligauchan3594]

This is just so great. Thank you so much bro. It's gonna help me so much.

[@pinkpocketTV]

Thanks for watching.

[@sadmansabir3848]

@@pinkpocketTV Android?

[@anjaligauchan3594]

Yes. But it worked for me

[@pinkpocketTV]

@@sadmansabir3848 I don’t think live link is available for android devices as it uses Face ID.

[@fellpower]

only apple...:(

[@VLRN_]

Thank you for this straight to the point tutorial, excited to try it out myself !

[@pinkpocketTV]

Thanks for watching.

[@arturnilin359]

That's awesome!!! Your channel has really super content of lessons!!

[@pinkpocketTV]

Thanks for watching! Appreciate the support.

[@JDRos]

Straight to the point bro! Subscribed! I hope you make more videos like this! Is there an equivalent tool for full body motion capture?

[@pinkpocketTV]

Thanks for the sub! Really appreciate the support! And yes, I have made a video about it on my channel for the full body mocap. Rokoko and Move AI both have their implementations of video to animation. Hope this helps!

[@ipadking2.0]

Amazing! Thank you so much!

[@pinkpocketTV]

Thanks for watching. Appreciate the feedback!

[@Waqar_Naqshbandi]

Hey bro, when do you think you can upload a video about Metahuman DNA and how to create a metahuman from pictures using the new method in UE5.2?

[@leonaraya2149]

Already put my Ip Adress and Unreal Doesn't conect my iphone. 🤔

[@GabrielLeite-kd3fd]

Great tutorial friend, my neck doesn't move, could you tell me what it is?

[@streamingdev1163]

Can you do a tutorial on how to render with camera? There arent any videos on how to render these talking animations

[@tusharsinha4352]

Did you got any solution for that?

[@muhammadwasifkhan4516]

how to add mixamo animation on top of the facial recording?

[@onisatori]

I forgot to mention that you should instead retarget the mixamo animations to the metahuman skeleton, it might look funky but thats the price to pay i guess, if you find a better workflow please share when you can.

[@princevasimalla]

​@@onisatori+1

[@jimconner3983]

hey did you ever figure this out just wondering

[@muhammadwasifkhan4516]

@@jimconner3983 lol. No

[@Faizaufannasai]

As far as I know, mixamo and meta human have different Joints, Namespace and different joint orientation. So I guess there's no way to apply mixamo animation to metahuman Joints

[@esp6248]

Does this just do facial animation or is it also head position coords over live link?

[@JamesCardonatweekaholic]

Awesome, thank you!!

[@Mrjononotbono]

This is great. How did you record you iPhone screen in the video?

[@SayonBiz]

This is such a helpful tutorial!! Thank you for this, I've followed the entire process and it works like a charm All I wanted to know is if there is a way to export this metahuman face animation as an FBX to be used on Blender. Is that possible?

[@princevasimalla]

why unreal then? there are numerous tutorials for blender users

[@8teapi]

I managed to get this working!

[@pinkpocketTV]

Happy to help!

[@afjer]

This is cool, but I would also want to know how to clean it up and smooth some of the edges.

[@johnbull5830]

Great video, Thank you. Is it possible to record the audio at the same time and get lip synced performance.

[@pinkpocketTV]

I think it’s possible.

[@vishwasyadav6775]

Hey please a make a tutorial for Android users because livelink is not available in Android what should we do ?

[@neoegonzalez5482]

Awesome, does it recorded the audio of your capturing or do you have to redo it separately and time edit it ?

[@wspluta5753]

Nice, how about if I want to do full body?

[@EftekherAhmed-n6l]

please make a tutorial on facial mocap using android device.

[@ChristopherEnoch]

I second that motion

[@rajrajraj746]

Can you please give same tutorial for Android phone ❤

[@benjaminrivlin771]

Do you happen to know why when I am recording the why characters head isnt moving?

[@lefthander3807]

Thanks looks cool, is it possible to add body animation to the face recorded metahuman?

[@bryancoleman6817]

Great video! I'm not getting the neck and head turn, just the facial animation. Is there a setting you've turned on to get that to work?

[@pinkpocketTV]

Yeah stream neck rotation I think does that.

[@worldbas3609]

hello brother, if we don't have an i phone can we use android or GoPro camera? plz answer my qst. i really need guid

[@PabloLucio-f1p]

Can't see my iPhone X on Unreal, not detecting it even having written the right IP address. Anybody know why this happen? Yesterday I've exported some Live Link animations and I could use them successfully, but when using the Live mode, is not detecting my iphone X

[@bu3tyfull]

i got the same issue on iphone 14 but also X is supported. So I went into my network i choose my internet connection / details and the i get in TCP/IP and used that IP address (It was different). after that in UE window/Virtual Production enable liveLink. this window should show the device.

[@7eleven_eo]

How to do this in Android

[@HD-GAMES]

حسناََ ... لدي سؤال ... هل يمكن استخدام مواد كوكسل في لعبه ... اقصد هل هي مناسبه لالعاب ضخمه ... ام لا ينصح بها للالعاب الضخمه لانها ستحتاج جهاز خارق ... اذا كانت الاجابه نعم لا تنصح بها للمشاريع الضخمه فهل يمكننا خفض جودتها ... اعني اضافتها بدقه 2K ... وهل اذا اضفتها بدقه 2K هل يمكنني بعد الانتهاء منها وتصديرها تشغيلها على دقه 4K ام ان حدودها سيكون 2K ... اتمنى ان تفهمني وان يصل المعنى اليك ...

[@Alborah]

if the future are we going to be able to take random sketchfab models and line up the facebones and use it?

[@Archivist]

This is so unreal

[@pinkpocketTV]

Yup.

[@icarobezerrasoares5055]

hi @pinkpocketTV, thanks for the video, listen, which version of the iphone is compatible? and only works with IPhone? or also works with Android? Thanks

[@zac4rusart]

Any app or software recommended instead of this app i dont have apple

[@researchDarren]

this is awesome, what view mode are you using to get the metahuman on such a clean background?

[@pinkpocketTV]

I am using the metahuman lighting template.

[@researchDarren]

@@pinkpocketTV thank you so much, I’ll give that a try! It’s so clean!!

[@gauraphypokerboy]

Can we track hand movements as well ? Or how we can do this?

[@MainCharacter.X]

Cool

[@lakshmanrao6357]

very nice ,can we create our customised model which i like

[@AnandPrasad6668]

Hey. Does this work on iphone 13 or is it compulsory to get iphone pro ?

[@milagro2300]

So the computer has to be connected by wifi (same as the Iphone) or it works with PC on internet cable and Iphone on Wifi?

[@s2skickstarters29]

Hi I am not getting quicksil bridge option... can you guide me why I am not getting that

[@kingslayer4080]

These videos should have a disclaimer that an iphone is required instead of just casually mentioning it.

[@notgesund]

Can you livestream with it?

[@doodleup1765]

i did try ver 5.0 it was very laggy are you using wifi or lan output. do tell me if that lan work better.?

[@IWillYeah]

What IPhone would you recommend for live line facial motion capture?

[@pinkpocketTV]

Every iPhone with Face ID works! I used the iPhone 11 for this.

[@IWillYeah]

@@pinkpocketTV cheers!

[@emreroisesunbul4888]

can we do this for full body ?

[@jacobparker2292]

Are we allowed to use metahuman models for commercial use ?

[@pinkpocketTV]

Yes!

[@erenkaya6385]

So, can I find out which iphone model is used?

[@pinkpocketTV]

iPhone 11

[@Gaamer-r9b]

not detecting my phone , iphone x . i added the ip ...any idea?

[@lokeshchadha7715]

I really love ur content bro. I need ur help desperately. When i add the downloaded metahuman to my project and open the blueprint, it displays the metahuman as a normal blank model. Like, i also downloaded Cooper, but it displays as a blank model. Pls help me fix this. Grateful to u.

[@reinohvp]

Can you do live link with metahumans imported from Maya?

[@pinkpocketTV]

Yes I am pretty sure you can.

[@phoneindustrydesign]

one question, iPhone send the data from the app to the ip adress of the computer, does this mean I can ask someone who is far away from me like a 10km to connect to my PC and help me out cause I do not have the iPhone? I am android user

[@pinkpocketTV]

No. The iPhone and the PC should be connected to the same network. For example in my case the iPhone and PC are connected to the same Wi-Fi.

[@phoneindustrydesign]

@@pinkpocketTV ahh right, that makes sense Tnx for reply! 😅🖐️

[@milagro2300]

@@pinkpocketTV does it works if the PC is in the same network but the PC is wired and Iphone on wifi?

[@chetansurve]

How to use this concept if I want to create a client's talking head ?

[@НиколайФеденко-у8о]

What is the minimum version of iPhone that supports this feature?

[@pinkpocketTV]

Any iPhone with Face ID works!

[@psychojetenjoyer4678]

So. I order to start I can use any camera on PC?

[@fusion_studios4866]

You didn't show how to open the app in Unreal

[@DP_Animations]

Can we use metahuman in blender for animation?

[@DP_Animations]

Can we?

[@pinkpocketTV]

Yeah

[@kingslayer4080]

Why does everyone here assuming everyone has a f*cking iphone 11?

[@PrilaRis]

Is it possible to change the character with our own made custom characters?

[@eagleanimation0162]

Hey how to make ravana in makehuman and using blender please make the tutorial 🙏

[@Gamsti]

does this also work for full body? for making cinematic scenes in games

[@aghori3211]

hi its working in UE5.4???

[@ApexArtistX]

How about attaching it to body animation

[@ZEQIOU]

Can anyone tell me why my UE can't find my device, they are on the same network!

[@ryjms2024]

What’s next? How to save the animation and use in other projects ?

[@Amanullah-to6gn]

Which model Iphone ???

[@dddrogon]

HEY ISRAEL WHAT UP DUDE.

[@pinkpocketTV]

Heyy!

[@michelguerrerostudios]

is working withUNreal E 5.2? ?

[@amarabdul9459]

Bro please add a video for waterfalls tutorial in unreal engine 5p

[@eulersosa6840]

Do you need an iphone to get live link? I have an android phone.

[@pinkpocketTV]

Yeah it’s an ios app.

[@kristianrabakov8579]

What if my phone is not showing?

[@onemoreform]

bro how much video memory you have my graphics exhausted so big file

[@pinkpocketTV]

I have a RTX 3060 12gb card.

[@onemoreform]

@@pinkpocketTV rtx 3050 here but 4gb, but when I set to LOD to 4 it worked

[@pinkpocketTV]

Yeah 4gb is really low vram.

[@GetWisdomTV]

Do not say, do this, do that, show everything.Some people like me comes here as fresh beginner.For example, you have not shown which project preset you selected.

[@GhostruktMerchantsCompany]

DOES THIS RECORD THE AUDIO?

[@pinkpocketTV]

I don’t think so 😅

[@burnerdesign]

i have ios 12.5.7 so how i install live link app?😂

[@patriciobarrios4602]

como puedo aplicar esto , pero no a un METAHUMAN, sino mas bien a un personaje basico hecho en 3D ?

[@Lucho72139]

mi compa el alucin.

[@milagro2300]

Cant get mu Iphone to appear on UE

[@yashwanth4395]

Is there an app for android

[@pinkpocketTV]

Don’t think so, as LiveLink uses Face ID for the performance capture.

[@Ryan-khan-y]

Early android use

[@sadmansabir3848]

What about Android user

[@IWillYeah]

Unfortunately, as far as I know this feature is only for iPhone as android phones lack the special hardware required. Android user here too.

[@raghavsnair1567]

I guess we should pay for faceware or something.

[@benveasey7474]

Is there a recommended Cam that could do this if we don't have an iPhone?

[@sadmansabir3848]

@@benveasey7474 hmm..Faceware

[@CabrioDriving]

@@sadmansabir3848 costs thousanda of USD. iPhone is cheaper.

[@36547]

How do we add audio for this? I"ve rendered it but audio isn't there

[@AlphaLuk]

Skurvenej IPhone

[@simonquoi]

🍉

[@3ATPAXEP]

is it english you speaking?

[@NTgamezZ]

0:51

[@avatr7109]

Jesus christ!!!

[@pinkpocketTV]

Yeah. It’s really cool.

[@sushilgul]

I have one feedback, following your videos one cannot even learn 5 percent, it's good if people have prior knowledge Why ru self obsessed with your photo in video, make more easily understood and screen space

[@monkey-do2iv]

scamer

[@LetaoChen]

Hey I am using a Mac, would I need to enable the Metahuman Plug in?

[@jaykunwar3312]

can we track body too with the camera ? i have seen there is live body option too??