Unreal Engine Metahuman Facial Motion Workflow with Faceware

A glimpse into my Unreal Engine Metahuman facial motion workflow with Faceware.
Link to my Discord: / discord
Link to Faceware Webinar: lnkd.in/dyyBd8Yc
Metahumans from Epic Games & 3Lateral doo Novi Sad
Thank you, to an incredible community of collaborations for being a part of my journey and creative process!
Special Thanks
-------------------------
The team at Faceware - Pete Busch, Catarina Rodrigues, Joshua Beaudry, Tatjana Vejnovic and Brandon Suyemoto.
Norman Wang - CEO & Co-Founder Glassbox Technologies
Katie Jo - Senior Product Specialist of Xsens Products at Movella
MANUS™ - Arsène van de Bilt
Puget Systems and NVIDIA
VR Division / Yahiya Jasem - Unreal Environment
Gabriel Paiva - Metahuman Whisperer
Diana Diriwaechter & Emanuele Salvucci - Rendering & Materials
Jonathan Winbush - Unreal Educator
Jobutsu - UE5 Metahuman Tutorials
Artist Credits
----------------------
Michael Weisheim - Original Character Artist
Pixel Urge - Character Body & Face Modification
Daniel Cadena - Character Body Textures
Konstantin D’Lakrua - Character Hand Rigging
Bernhard Rieder - Lighting & Cinematics
Gear I Use:
Faceware Mark IV HMC: facewaretech.c...
Faceware Studio: facewaretech.c...
GlassboxTech Live Client Plugin: glassboxtech.c....
Xsens Link Suit & MVN Animate Pro: www.xsens.com/...
Manus Prime II Gloves: www.manus-meta...
Puget Systems Workstation & Nvidia RTX A6000: www.pugetsyste....
#unrealengine #metahumans #virtualproduction #facemocap #mocap #facialmotioncapture #motioncapture #faceware #xsens #faceware #liveclient #glassboxtech #nvidiartx #pugetsystems #epicgames #metaverse

[@TheDavidTurk]

"During the process of creating, that is when you learn the most. You find solutions to problems and create new pipelines" - this is so so true! Great video!

[@KO-gu6wp]

I've been working with unreal engine and 3d applications for 15 years, its really great to see how elements of the engine have become very intuitive for people like yourself to just jump in and create awesome work without years of experience under your belt. Very talented work and I'm glad you are able to express your creativity without a problem using ue5

[@FeedingWolves]

Thank you so much for your kind words!

[@bharatdharma3820]

Is Blender + UE5 a good choice, from the career standpoint, for somebody starting out in this space?

[@EliasLeo6]

Just to put this in perspective: she is using at least 47 168$ of hardware, not even including software licenses. So the result is really nice, but it's also very proffesional gear. Not for your average 3D Artist 🥲 Faceware Mark IV $ 28,749 Xsens MVN Link $ 13,630 Manus prime II $4,789

[@shaddyopb]

Exactly! haha, I was like shit you quit bartending and bought 50k worth of the highest end gear to make a short for yourself? -- That must have been some seriously nice bar:)

[@nanopixel.studio]

This is by far the best mocap result I've seen so far. There were no jerky movements and the mouth didn't half way open like other videos I've seen. This is perfect.

[@fledgeking]

Mocap always looks better if you have tens of thousands of dollars to work with

[@Mangotropolis]

This is the best model I have ever seen. Good for you for giving the proper credits to your contributors :)

[@carloguayaba]

The uncanny valley is slowly disappearing. This is gorgeous. Can’t wait to see it in video games, imagine the drama the characters will convey with those realistic expressions.

[@nickgettino5865]

Talented and beautiful, willing to share her experiences to make others better.

[@reverse_shell.asm.sh.exe1]

felt like a lone wolf geeting fed, thanks!

[@samgoldwater]

Setting the example for the rest of us, just amazing

[@thesahel7218]

The riggers on this are gods. This blows my mind.

[@riotechmod]

Having a team just for a dedicated work flow is very helpful. As a solo artist, I struggle alot due to lack of limited online information, funds and time. You all r great and doing 100000x great job than mine 🙂. I m steel limited to use manual key framing for animations.

[@ianriccillo3806]

Technology is insane dude,

[@carloguayaba]

I can’t wait to see this in actual video games

[@IndependentOnlineCinema]

Incredible work Feeding Wolves!

[@samianpacing]

Wowww.... Superb.... 😍 😍

[@salmanramezani4784]

it was the best motivation for me as a demotivated artist these days. thanks.

[@coma13794]

Not even sure what to say. You are amazing. I'm slowly getting into UE5, focusing on lumen and nanite, however it's hard to ignore how incredible this platform is in so many other aspects. Thank you for sharing this.

[@pietrosvelto1434]

Outstanding

[@seanspitzer5537]

Dats my Girl!!! GET SOME!!!

[@GhostruktMerchantsCompany]

3:24 in you answer my question thasnk you very much you are the very very best

[@time4changenow]

Fantastic!

[@StephenCharlesBaker]

Most excellent ... WOW

[@GrimGearheart]

I would be so happy to invest in these products, as soon as they do away with the ridiculous subscription costs. ^_^

[@vizstudio_MWalsh]

Amazing! Thank you so much for documenting this process and sharing with all of us.

[@godned74]

This is the go to benchmark.

[@ExviaStudio]

Awesome!

[@crazzylee]

Ziva looks more true to life to me. I think you should try it.

[@freebitcoingiveaway119]

your a bluddy legend

[@cinematic_monkey]

What a wonderful person you are!

[@hanswurst3811]

so amazing

[@original9vp]

The eyes wide open as a sync point is a gem! 👍👏

[@viceroy7792]

Brilliant

[@whoguy4231]

This is what the Metaverse should have been!

[@MDalton10]

Amazing tech. Little bit of sticker shock when I seen the 30k pricetag (For just the Mark IV Wireless Headcam System). You can't deny the results though. Look fantastic.

[@davimak4671]

awesome talking animation

[@simpsonelli]

Saw you mentioned in an Epic Games metahumans talk at SIGGRAPH in Vancouver today- had to look you up. Incredible work! Especially for a newly self-taught person, this is inspiring!

[@FeedingWolves]

Thank you so much!!!!

[@xingzhexin8843]

Just went on their website to check the pricing and the system (Mark IV) you're using right now is 30 grand usd? Bananas

[@dumebinkata]

this is so good!

[@Eppideem]

Brilliant video thank you - I am starting out with performace capture, with the emphasis on performance. Your character's aminmation is so nuanced! Inspired.

[@bobhawkey3783]

Wow, you made an amazing leap. Very cool. Congratulations.

[@StephanStreuber]

amazing

[@avtpro]

Congrats! Looks Awesome. This level of tech is ahead of what artist have been trying to do for decades. Totally Next Gen.

[@visualdrip.official]

fantastic! will sub! Im just starting my journey into unreal and i couldnt be more thrilled! this is great! keep it up!

[@alwaysyouramanda]

Whoa!

[@myxsys]

Thanks so much for showing us the process. Looking forward to learning more.

[@weses2]

damn this is amazing

[@alashchanneltv3387]

Gabriel, its very very cool👍 Thank you for studying this awesome job and sharing your experiences and knowledge with us. Develop further and share with us. We will support you by getting inspiration from you. I hope that transferring your project to UE5 will be a big bang, in the field of animation, graphics, motion capture and much more. Your 3D model is as beautiful as you are🤩 Greetings from sunny Kazakhstan🖐

[@Soluchi-InfiniteCoCreatorGod]

Incredible. 😊💯

[@redratpetrax]

30 yers exp.. Thats amezing ... its wold take me some month or 2 to make this from scratch in some 3D soft.. With 1 year exp.. Thats Crazy.. Modern Stuff..

[@JorgeRodiles]

awesom

[@MistereXMachina]

By far the most interesting, valuable, insightful look at this world which I have only recently begun to seriously learn. I really appreciate you making this, instantly subbed.

[@AnnisNaeemOfficial]

Very well explained. Great work on documenting this and explaining it so succinctly.

[@metafuel]

Beautiful work. Thank you for explaining your process. Subscribed.

[@kalubandali2241]

like you i am trying to change my life using unreal. Thank you for the inspiration.

[@FeedingWolves]

Its going to happen sooner than you think! Keep at it!

[@kalubandali2241]

@@FeedingWolves your so kind, thank you for the nice words!

[@mzie25]

Bravo. I love this!! Well done!! Inspiration for me to up my game.

[@AlexSMontgomery]

Stunning amount of information, great video, thank you!

[@gmtoutdoorsindiana2785]

just beautiful

[@toldme3d]

Κάνεις φανταστική δουλειά !!! Συγχαρητήρια !!!

[@James_McLane]

Thanks for this! Amazing work 💥💥. Can’t wait to see what’s next, Feeding Wolves :)

[@enriquemontero74]

excelent video your work is cool, I hope you can execute all your ideas and projects with great success. Blessings.

[@marvinvogtde]

just amazing, really impressive work

[@feels.9304]

This is truly inspiringggg!!Keep going Gabz

[@jonathanmazibuko6726]

amazing feeding woles

[@OfirGardy]

Thank you for this! keep up your amazing work and sharing 😍

[@lubruz7164]

By far the best MetaHuman character in the community. I'm very excited to see the evolution of this project in the future.

[@RikkTheGaijin]

For the people who think this is accessible, all of that is over $40k worth of equipment. Just saying...

[@criscanto7040]

You can now do it with a camera or 2

[@TheFunDimension]

@@criscanto7040 lol I we all wish.

[@criscanto7040]

@@TheFunDimension not kidding I work with AI I can translate movement in my camera to UE

[@theokrisna]

@@criscanto7040 can u share ur workflow?

[@SteveSmith-ze5mw]

@@criscanto7040 you know it doesn't fucking look anything close to as good as this lmao the hand rigs are insane.

[@Joeherman]

Mind blowing!

[@supremebeme]

really insightful thank you

[@alexzanderthegeek]

This is crazy awesome!

[@cerulessa]

I really admire you!

[@Native_Creation]

Most impressive, a consistent inspiration!

[@occultpriestess]

I really enjoyed this video. I am proud of you! So, does anyone you know use their Metahuman to livestream? I am having a hard time finding real time content. Thank you!

[@thedesignertoydragon6807]

interesting video you are super talented and a inspiration!

[@yanpengguo9154]

I love your channel. That's great.

[@tris73]

Amazing job! Thank You!!!

[@weeliano]

Awesome work! Can't wait to see what you can do in Unreal 5!

[@MikeliousXD]

Amazing, excited to see more!

[@richd9655]

Amazing videos.very inspiring.

[@jacksonbridges8108]

This is awesome!

[@81Nemessis]

I think this new type of camera technology is excellent, unfortunately there are a lot of people, including myself, who don't have $15,000 on the table.But don't worry, it's just envy that speaks out.👍😁

[@FeedingWolves]

I started out using my DSLR camera and tested out various types of lenses. I took the sample data Faceware had captured with the MarkIV and tried to replicate it. I found that you can get great data with prerecorded video. Pixel Prof has a great tutorial showing how you can stream in iPhone video feed of your face into faceware studio. There are definitely options out there for people wanting to create something ;)

[@onethingeverything]

Great work!

[@dioib]

Hi! Your video and workflow is amazing! Really open my eys to a new virtual world! I am a blender user and very interested in learning blender / metahuman / Unreal. I am very new to Unreal 5 and very much hope that you can make a in-depth tutorial to help show the steps! It really helps newbie like me try to enter this fun world like you! Also, I love the presentation of your avatar, she looks very pretty! Great work and hope to see more videos from you!

[@FeedingWolves]

Thank you so much! Wish I knew blender a little better so I know what it is like using a new software. I will be releasing a full course soon for this metahuman motion capture workflow, so stay tuned!

[@dioib]

@@FeedingWolves Thanks and looking forward for your tutorial! Have a nice day!

[@AntonioParisi1968]

AMAZING!

[@virtualfilmer]

This is so so helpful, as always Gabriella. You make such clear, awesome videos. Faceware is so great - I just wish they employed someone like you to fix their “how to” videos and help resources. They are outdated and don’t help with common bugs and issues. Btw Faceware studio is heavily dependent on having major contrast between lips and skin, and strong eyebrows. I have pale skin and pale-ish lips, sparse-ish eyebrows, plus a beard/mustache. Faceware Studio doesn’t work unless I wear heavy makeup. :) I have FW studio and also own analyzer/Retargeter which is much more accurate but harder to use. And is buggy with metahumans and maya - crash city! 😂

[@FeedingWolves]

Thank you! I personally do not have a beard lol so I haven't experienced this issue. I know the beard might confuse the tracker because you really want your mouth visible for it to get good tracking. I also recommend trying the different tracking methods - stationary vs professional head cam options. I have not used the Maya pipeline so I am missing out ;)

[@Thunk3DScanner]

Amazing!!!!!❤👍

[@AwesomeSauceShow]

Awesome stuff! You must have been a genius level bartender 😅😉

[@FeedingWolves]

hahaha well I was a bartender for the last decade, I would hope so!

[@vicosdivicos]

Would be nice if the fine lines in the face of the robot lighten up with colors together with emotions..Nice work!!! i like it

[@FeedingWolves]

Thank you! And yes, now that you mention it, that would be cool if they lit up!!!

[@vicosdivicos]

@@FeedingWolves 👌🤜🤛❤️

[@DesignsbyElement]

Why are the lip animation so much better here than with an iphone and live link?

[@vincev4630]

The jitter smoothing looks good, you make UE look real good. I think the reason it still looks stiff at some parts of the face is the rig. Most sliders on the rig is a 2 way axis. So this looks like a great previz but i wonder if it'd be possible to fully utilize the axis on each bone for the final shot somehow.

[@FeedingWolves]

Thank you so much! I am not sure if it is possible to fully utilize the axis on each bone.

[@memnok9980]

Rad.

[@user-uk9er5vw4c]

whoah, you're awesome and gorgeous

[@davidbohorquez]

[@mycloudvip]

Awesome work. I'd love to work on a project together one day! Kudos!

[@PassportGaming]

Inspiring af

[@ValeGoG]

10/10

[@thejetshowlive]

This is VERY interesting. How do you do you do such things? Can you make an in depth tutorial?? (Great work Feeding_Wolves, blown away as usual.)

[@josephdalessandro6360]

This looks amazing but you are portraying that you are getting this quality in real-time but looks as though you did a lot of clean up work in face ware studio and then edited the video together to make it look like it was done in real time. Am I wrong? Also, you mention that you had no experience in this a year ago but you bought $30k in equipment? How much did everything really cost you? Did you invest all that money so you could turn it into a business as a freelance virtual production artist?

[@marcin6386]

Imagine tech with quality like these in the VR world...

[@FeedingWolves]

It's coming!!

[@marcin6386]

@@FeedingWolves So we will meet in VR and it will feel like we are meeting in reality? can't wait to see ya!

[@Q36BN]

5:36 and onward that looks photoreal, if you dont count some imperfections... at first i thought that the face on right "modified curves" is real...

[@themidstream]

The future.