Unreal Engine 5.1 Live Link Face Importer Tutorial

Unreal Engine 5.1 Live Link Face Importer Tutorial
Buy my courses to support the Channel!
www.udemy.com/...
jsfilmz.gumroa...
artstn.co/m/Bn8ed
jsfilmz.gumroa...
www.artstation...
www.udemy.com/...
Sign up with Artlist and get two extra months free when using my link below.
Artlist
artlist.io/art...
Artgrid
artgrid.io/Art...
‪@UnrealEngine‬ #ue5 #unrealengine5
Unreal Engine 5.1 Live Link Face Importer Tutorial,ue5.1 live link face importer,unreal engine 5.1 livelink face importer,ue5.1 livelink face importer,whats new in ue5.1,whats new in unreal engine 5.1,livelink face importer,live link face importer,new features in ue5.1,new features in unreal engine 5.1,unreal 5.1 live link face,unreal 5.1 live link face importer,unreal 5.1,unreal 5.1 new features,unreal 5.1 release date,unreal engine 5.1 tutorial,jsfilmz

[@Jsfilmz]

It WORKS!!!!!!

[@agentwhiteblack5869]

Hello, I wanted to ask you something. My phone doesn’t connect with UE5, but I need that in order to get Live Link working. Do you have a piece of advice for me? I already checked the WiFi but it is the same WiFi like on my iPhone. Please help!

[@psychoticgiraffe]

have you found a way to rig an IK for a character to match the metahuman or default mannequin while retaining live link face functionality on a custom model?

[@MarioBusch]

Amazing! Instead to use Take Record to record the facial capture, you can right click the Face track and choose "Bake animation sequence" to save the facial capture as an animation asset.

[@Jsfilmz]

yes i know ive been using metas since prerelease mate

[@MarioBusch]

@@Jsfilmz well that step was missing in your video tutorial, I just think someone could be interested. Sorry if seems I was talking the obvious. Peace!

[@michelesaporito7035]

Hi there! I've a problem... The facial animation works great in timeline when scrubbing... but if I add camera ad Camera Cuts I cannot export animation rendering... the metahuman face still without facial moviment! Have you got solution? Thanks

[@CaseyChristopher]

@@michelesaporito7035 I wonder if you can bake it to the facerig after you get the clip in the timeline? Right Click the "face" labled portion of the Skeleton under the character and then you make see a bake anim to menu item. Then you could select the face anim panel rig and it should transfer the anim to the facepanel controls it is driving as keyframe data.

[@streamingdev1163]

@@michelesaporito7035 I have the same issue

[@blacklord3212]

wow this is a massive improvement for any solo dev

[@tristaneliud]

Best soft soft Introduction Ever!!

[@alekjwrgnwekfgn]

What about the audio? This is a game changer for me. Now we can get VO talent to download the app and record themselves, then share the files. That’s a lot less production, better result.

[@Jsfilmz]

yup exactly!!!!! sync audio in post bro work with anyone around the world with an iphone

[@raghavsnair1567]

@@Jsfilmz I there any way to face mocap with an android phone?

[@abdullahtm.2135]

Man!!! This is huge! Thanks a lot for helping us figure it out.

[@cedricusmann2300]

Amazing! I can feel the vibe.. really great addition to UE5. I wonder if it can also take- in audio for speech at the same time, that would be a great package for facial animation workflow.

[@Jsfilmz]

the app records a video as well along with the take

[@ArgoBeats]

So cool, man! Do you have a full walkthrough of the process? 3D model creation > facial animation applied > exporting the full animation to third-party software as OBJs or FBXs? Thanks!

[@boukm3n]

Need this!!

[@coolchen2139]

Guys it really works, I checked.

[@Brand.on18]

Christmas comes early! Like you said, probably something simple. Thanks for this!

[@Jsfilmz]

hahaha yea i was overthinking it

[@joannakobierska6739]

Great video. A tutorial on clean up would be really helpful.

[@maryanntalavera4678]

I'm having trouble getting the Take show up in the Face Subject. Only my phone shows up. Any advice?

[@CinematographyDatabase]

Nooice!

[@kallkallkall]

Thanks man for the update! - really appreciate the tips as I'm going through the same problems! will try this out later tonight

[@popfuture]

Very nice work! I tried to ask AI if this was possible (offline) and it failed miserably. AI is too much A and not enough I. Hahaha! Humans rock! Especially this human (in the video). All the other tutorials took way longer to get to the point, but still get points for trying. Keep this up. We dig you. ❤

[@sibinaayagam1838]

Pretty sure none of the VP tools require simulation or play mode. They should all work in editor. Try checking if 'Update Animation in Editor' property on the skeletal mesh is turned on. That's what enables any AnimBP data or livelink data to show up in Editor.

[@Jsfilmz]

i tried enabling it no dice like i said in the video

[@Romeo615Videos]

i forgot how to do this shit.... this video saved my ass

[@Jsfilmz]

hahahaha welcome back mang hope all is good wit ya

[@Romeo615Videos]

@@Jsfilmz had a few heart attacks and surgeries just made it back home... Got into the avalanche beta so bout to dig into that... no rest for the wicked

[@apixel.content]

nice! thank you for sharing looking forward to 5.1!

[@BaseOptimal]

This is absolutely amazing keep going!

[@kairu_b]

This is cool even though I'm not a creator, it's nice...very nice😆🙌

[@gocho1210]

Awesomesauce !!!

[@ghostinhell666]

Thanx man, this is really awesome!

[@anthonyhayes6981]

Hey man. What do I choose in the data table row options when importing the csv? WOn't let me proceed without choosing an option

[@kirkr]

Thanks, great video, well laid out and easy to follow :)

[@limitlessinmind]

Yeah man, you got it👍 now hopefully iphone wont have heating issue by doing this method 😉

[@Jsfilmz]

yeaaa dude it might still do i might upgrade to iphone 12 pro

[@limitlessinmind]

@@Jsfilmz heating probably cause by live data transfer but i might still be wrong.

[@Jsfilmz]

@@limitlessinmind yea was thinkin the same

[@tonylejuez9288]

Very useful as usual :)

[@ngenzialvin7090]

I love u bro thank youu

[@newchallengers9420]

Great stuff bro

[@artisticblog1098]

worked thanks man

[@TapMyButtons]

Thank you 👏🏽

[@JavierGonzalez-qg5el]

On the back of this If you try to render on path tracing mode I found that the imported keys alone won't work even if playing when running the sequencer. This gets resolved by baking the animation into a clip from the face clip in the sequencer. This will probably make you life easier through out the importing process. Happy to elaborate further though other channels.

[@dialusdudas]

Well done! You're da man!

[@Jsfilmz]

You da woman!

[@zachoons]

Very Awesome! When I did it though my chararacter had the upper lip issue :D not sure if its 5.1 or the importer method but sorted it out, I like this method of not having to live link to record the mocap :) Thank you

[@Jsfilmz]

Glad it helped!

[@Monoville]

Great tutorial, although you actually need to choose the CSV file that ends with "cal", as the "raw" one is uncalibrated.

[@Jsfilmz]

yup i made update to this on my course :)

[@Andre10257]

Você simplesmente salvou a minha vida. Obrigado por essa dica!

[@JavierGonzalez-qg5el]

This is a game changer my guy. Subscribed and liked. Your content is super helpful.

[@Jsfilmz]

Welcome aboard!

[@supremebeme]

Did you read my comment on last video? You can save the data as animation sequence too

[@Jsfilmz]

wym like take recorder? yea u pretty much same as online u can record the animation as well

[@rosuckmedia]

HI JSFILMZ , Great Tutorial👍👍 , Greetings rosuckmedia

[@Jsfilmz]

thanks rosuck! glad to see u here

[@airkidproductions2848]

thanks for trying out buddy

[@Jsfilmz]

You got it man you saw it here first whoop whoop

[@airkidproductions2848]

@@Jsfilmz jeah man, sometimes you have to bite into the "make it work" kind of thing. in the end , if you dont give up, its working and the whole thing comes together. no matter if its blueprint stuff, or even tweak an animation till it looks good. gratulatione, that you figgert that out, cause there is no real documentation. its like package a game or project to android.try and error, sometimes! love ya channel, you are trying cool stuff , mate. respect from northern alps, bavaria.

[@Jsfilmz]

@@airkidproductions2848 loved and miss bavaria mate!

[@airkidproductions2848]

@@Jsfilmz when you are here next time, you will be welcome, you know you just have to send a message and you get your bed in my house!

[@music_creator_capable]

Hey!

[@jonathanwennstromm1578]

Never used either before, what is the advantage and disadvantage to using it with wifi (same network) or the method you are showing now? Is it only that you dont need internet?

[@Jsfilmz]

exactly meaning i can record offsite

[@MFedorovV]

Yes, cool, it works! Thank you

[@enrix00]

so cool

[@Jsfilmz]

agreed

[@Radwalls]

This is perfect.

[@Jsfilmz]

indded

[@ZAKarchitects]

Great hit buddy.. Salut

[@elgrekko9634]

You have the Justin Timberlake' voice bro ! excellent ! By the way, do you have a video about scanning your own face and import it in Unreal ? thanks...

[@Jsfilmz]

old one kzbin.info/www/bejne/qKi4haivbttnjc0

[@drluiji6720]

Thanks for sharing!!!

[@Jsfilmz]

No problem 😊

[@michelesaporito7035]

Hi there! I've a problem... The facial animation works great in timeline when scrubbing... but if I add camera ad Camera Cuts I cannot export animation rendering... the metahuman face still without facial moviment! Have you got solution? Thanks

[@jamescherry9564]

Same issue

[@maxpayne4118]

Thanks man this is huge this is huge!!, but How to do this with ready player me avatar??

[@kekeke7815]

"inconvenient' would describe your previous comnt better then

[@chBd01]

Hello, thank you for the video. But I wonder why my ARkit is active but my ARkit face subject there's no iphone detected. Do you have solution? Thank you

[@damithdhanasekara3190]

I have followed all the steps but somehow it’s not allowing to run the CSV file Can anyone here sort this matter out?

[@Kozlov_Production]

I understood how to bake face animation, but how to bake head (neck) movement?

[@rodrigohostup]

Very very cool!

[@danielmojojohnson1169]

Tha is again for another good one brutha. Can you send me a link to 5.1, I am having a hard time finding it. I wanna try the decal joint out. I watched you video on it the other day, and it’s exactly what Im needing right now.

[@Jsfilmz]

unfortunately you will have to compile it from scratch but hopefully 5.1 will come out soon

[@danielmojojohnson1169]

@@Jsfilmz that’s not a problem, I just can’t find it. Email me. Would love to talk about some ideas with you. [e-mail] thanks again brutha. Keep up the dope work.

[@nourhassoun7099]

If we render with the MRQ would the facial animation show in the rendered frames? Hoping simulate isn't just an in-game solution.

[@Jsfilmz]

yes also u can record with take recorder if u want

[@akanshsaluja9069]

have you tried it now my live link face app is creating a frame log csv file instead of raw csv and frame log is considered as a data table file in unreal instead of level sequence please help

[@responsivepigeons9908]

So how much does it cost to have a studio for mocap stuff since you own one already

[@Jsfilmz]

not sure problem is u prolly wont have customers depending on your location its stil fairly new to a lot of people

[@streamingdev1163]

Can you do a render with this import Live Link feature? Sometimes it works for me using Render Queue and then othertimes it doesn't track the animations in the render. Love the channel!

[@Jsfilmz]

yes I saw this amazing course on artstation about this if you want to check it out its gotten pretty good reviews www.artstation.com/a/22299532

[@anastasiamakinmagic]

This is another awesome one!! Everything works up until I get to the drop down. I only see my phone and not the added animation. I noticed it already said your animation was in the live link. Did it automatically show up for you or did you have to do anything extra to get it to show up in that list?

[@jayarajvin3404]

Broo.. I got the animation in editor.. but Head rotations are not exporting.. What can I do ?

[@syifootv7908]

When I am importing Data table option open .. what do at this?

[@alan112223]

Same. Did you find any solution?

[@MiniCasaBrasileira]

Thanks, that works in android?

[@Jsfilmz]

no cos android dont innovate

[@braedongarner]

Is anybody else having the issue where their Metahuman just stares blankly forward? All other animations are there, but the eye animations are not working.

[@kristianrabakov8579]

for some reason it is not finding me iphone in the LLink Face Sibj tab... any ideas ?

[@AlexanderBosman]

Hey anyone getting a weird error where not the entire animation is imported to the level sequence? Im getting the first 10 or so seconds then nothing.

[@Franky4795]

Bro I’ve gotta question, for example I turned on some plugins and how to check what plugins I turned on in UE5 ? Would be perfect to know about it ?

[@CG_MIGHTY]

This is amazing, It works! Btw do you know "how to set unreal to stop gpu when in background" - When i watch youtube, i want my Unreal Project to stop using GPU, because the PC is so hot. Thank you

[@Jsfilmz]

no i think it only has cpu

[@CG_MIGHTY]

@@Jsfilmz I find out the answer that type in cmd: t.MaxFPS 1 (which mean 1 fps). It's solve my problem. But it's not the convenience way! If you have another way, please rely.

[@runningbymoonlight4589]

Well done for working it out!

[@runningbymoonlight4589]

Can’t find the “raw” file in my folder? Is there a setting to enable?

[@GavinTruong]

Is this a free plugin? As it’s not free from iclone

[@Jsfilmz]

yea free

[@agnishmukherjee7935]

please can you any share alternative application for android.

[@REALVIBESTV]

Waiting on the tutorial on how to do it

[@Jsfilmz]

this is a tutorial broski

[@REALVIBESTV]

@@Jsfilmz lol 😂 you know what my bad because I realize it is thank when I did it I didn’t had to simulate I just press the play button and it work, with this who needs iclone this is even better than iclone live link

[@ShaunWilliamsMAGStudios]

Thanks for vid, liked and subscribed. On mine, there is no csv file in the folder, i have 4 files. Missing raw and csv for every take i do. Any ideas?

[@rudy552]

hi i really like your video, i have a question i have an iphone x, if i buy an iphone 12 will the motion capture performance be better?

[@sinanarts]

Hi JS, thank you for your comprehensive tutorials. I have a specific question. I have a mocap suit and a Custom 3dCharacter in my scene. I want to recrd my mocap body and import it in unreal. And then I wish to retarget my face capture data as fbx into unreal and retarget it to my character.. Can you say how I may do this.?

[@michaelb1099]

I get the animation but not the voice part

[@epicofthewitch9360]

Hi thanks for sharing, looks amazing. When will this plugin be available for anyone to download? Is it from the Epic Unreal Marketplace?

[@Pejo-Bun]

For some reason the CSV file doesn't contain any shape key data, or at least the sequencer doesn't display any, what could be wrong?

[@timdoubleday4627]

Very cool, we had a similar issue where sub clips weren't getting created but the LiveLink data was there. Did you then manage to re-recorder in Sequencer and get the facial animation onto the MH Face controls?

[@Jsfilmz]

i havent yet but it should work

[@tnwlsdlseh262]

Thank you so much!! I really need this! But I can't find raw file in my ipad. There are only .csv, thumbnail, video, take.json these 4 files. Do you know how to set to save raw file?

[@jonathanperpich5676]

JDog, I did everything that you presented in this video step-by-step. I couldn’t get it to work. No animation on my character’s face at all. I have been trying very hard to get metahuman animator to work with no luck. Then, I tried the live link face app, and couldn’t get it to recognize my iPhone. I went to the drop-down menu and the ARKit face subject and couldn’t get anything in the drop-down menu. Then, I followed this video and found my take (which I transferred to my Google drive from my iPhone, And still no luck. Is there anyway you can help me identify what I might be doing wrong? Thank you so much. As always, J.P.

[@caioolivieri1005]

waiting for the day they will release the live link for Android

[@Jsfilmz]

bro android effin sleepin ive been long android user

[@lolthisnerdsaidmemes]

Us

[@adrianwyer8382]

did you figure out anyway of editing the animation after hooking it up in a sequence... for example when you are doing live capture using the iphone, you can edit the graph and over crank face shapes (like jaw/lip closing etc) working on something that was captured on set, so i have a face live recording, but when applied to the metahuman, the mouth is a bit slack, wondered if you knew of anyway of modifying the data stream to add animation/adjustments ON TOP of the recorded data? thanks for all your vids by the way, really elping me get to grips with unreal/metahuman!

[@skynet1970]

Hello friend, do you have a tutorial to use the Live Link and control the scene with the cell phone and record a video? I see that it exists for iphone, but I don't know if it exists for android.

[@Jsfilmz]

nah android apk is behind man they lazy

[@tayam92]

Would it work with marketplace characters with blendshapes? Or is it strictly Metahumans?

[@willyginx]

Hello JSFILMZ . I watch a lot of your informative videos they are great . But unfortunately I tried this method a few times it does not work for me . Each time I import the CSV file into Unreal the sequence time range is shorter than the original video in my Iphone . The time range is shorter than the video . Is this bug in my Iphone x or maybe unreal ?

[@bifium2177]

Hi! I have a question: How do I record the simulation? Is it possible to use keyframes in the sequencer?

[@REALVIBESTV]

So wait how did you get 5.1 don't even see it for the update

[@Jsfilmz]

github broski

[@REALVIBESTV]

@@Jsfilmz github broski what is that?

[@pstwr]

@@REALVIBESTV ceo of unreal engine, his name is Github Broski, pronounced "Gee Thub Brow Skee"

[@StyleMarshall]

@@pstwr 😂

[@FAITHBASEDGAMES]

Very cool...I think....what I mean, and forgive me if I'm asking a stupid question, I don't have a smartphone; a cell phone yes, but it's text and talk only....NO DATA service (I don't really need a service other than T and T, I'm at home on my computer all day so I don't see a need for one) So if I purchase an iPhone, can I just use it as a Wi-Fi phone (to get the app) and not have a phone service? If I don't need a service then YES this will be exactly what I need!

[@Jsfilmz]

yes exactly. just wifi to download the app and thats it

[@FAITHBASEDGAMES]

@@Jsfilmz Ok GREAT.....guess I better save up to get one one of these days...soon I hope! 😉

[@Jsfilmz]

i phone x are cheap now mate

[@FAITHBASEDGAMES]

@@Jsfilmz Great thanks for the tip...I'll look into it soon...THANKS bro!

[@AL3DStudio]

where is the plug in? thanks

[@juanvancleave1908]

Hey J, I have a question for you, How can I have multiple MetaHumans in one Level Sequence using this system? I tried importing one MetaHuman with another but I crashed the session. Any thoughts?

[@woffkeen7573]

Where to find Link Face Importer ?

[@theunofficialofficial9571]

can an i pad be used for this or for live link in general?

[@Jsfilmz]

long as it has truedepth

[@lvnablak537]

Hey Jae, im trying to get this to work in 5.1 but it’s not connecting. When I drag the CSV file into the project and open the sequencer, I go to select the sequence from the ARKit face subj drop down but it’s no longer showing up there. The name of my phone shows up but not the sequence name(i.e csv file name). Would appreciate any help you can provide to troubleshoot.

[@caseycbenn]

Same problem. I had this all working in 5.0.3 in general but nothing seems to work in 5.1

[@tommydell9191]

First!

[@loux6153]

I fuckin love you

[@sudaismuhammad2235]

How did you accessed UE 5.1

[@khaledbouzaiene3959]

can you plz share yr csv file to test it

[@sybexstudio]

Is this better over your helmet capture?

[@Jsfilmz]

yea metahuman animator is nuts

[@sybexstudio]

Damn

[@thelostsoul9497]

I looked it up on Marketplace in Epic Games and I couldn't find it. What's the name of the plugin again?

[@Jsfilmz]

its built in 5.1 dudes

[@thelostsoul9497]

Okay Thank You!

[@thelostsoul9497]

@@Jsfilmz Can this be done with an Android?