Breakdown | "Lip Sync" Metahuman Creator + UE5 film by Han Yang

A quick breakdown + behind the scene of my latest short film Lip Sync
• "Lip Sync" | Unreal En...
www.artstation.com/artwork/B1...
Made in UE 5 with Lumen for lighting, Metahuman Creator for characters. Xsens + Iphone AR kit for mocap and key frames on top.
Leave a comment what you wish to see in the next breakdown+tutorial. I'd love to share with you what i know about Unreal filmmaking.
Credit:
Han Yang: Director + Creator
David Jiang: Character lead
Eugene Flormata: UE Consultation
Chengshuo Hou: Sound Design + Mixer
Andrea Bellucci: Music Composing
Twitter: / hanyang_vfx
Insta: / hanyangcanada
KZbin: HanYang CG
Artstaion: www.artstation.com/hanyang

[@UnrealCinema]

This is absolutely amazing. One of the best uses of UE5 and virtual production I have ever seen.

[@timohelmers]

Even if you had a blend of AR Kit performance capture, the amount of manual keyframe animation to get those models to interact this nicely must have been huge. Fantastic work!

[@klovver]

Thanks for sharing behind the scene. Fantastic work.

[@AlexanderPogrebetsky]

I can't describe how cool is that! This kinda new level of content creation.

[@xenohive9115]

crazy work man - you guys are so talented ! - amazing work

[@lubomiratan]

Amazeballs! Bravo!

[@MatthewRumble]

At first I was like what am I watching since I didn't see the actual film yet but coming back now it looks incredible and tons of effort put into it

[@forestfilms7914]

Amazing just seen all of your stuff, this is very inspirational.

[@berkilter4556]

AMAZINNGGG!!!

[@DeAndreJohnson212]

This is so dope!

[@Delli88Burn1]

Oh wow, discovered this channel by accident. Enjoyed your breakdown of the lander on Yihuu. Got it back in the day :)

[@VFXCentral]

My hero! the best stuff made in UE5

[@IndyNavy_]

Amazing!

[@MrKlayVFX]

So dope!

[@edstoica]

awesome work

[@Soluchi-InfiniteCoCreatorGod]

Incredible job. 😊💯⭐

[@Chillfolio]

So good

[@Displant]

amazing

[@marcmordelet]

great work !

[@FXitinPost]

Wow, incredible work! These breakdowns are fanstic.

[@MerisProsic]

Great work! Could you maybe do a detailed breakdown for your Unreal Engine Workflow? Similar to the tutorial you did for "The Lander"?

[@SIMON_CHUKOV]

Wooooooooooooooow!!!!!!!!!!!!!!!

[@maxmartinson319]

Please make tutorial about your new forkflow in Unreal Engine. Many people will buy it (me too). I saw your Lander tutorial. But there are a lot of different programs, and beginners are more interested in the “all in Unreal with Metahuman" format.

[@Ben-mb4ft]

0:31 is just gold

[@viewee22]

Coool

[@matthewisikhuemen8907]

Wow, this is amazing. Please what format did you use in sending the simulations out of MD. was it Alembic or what please? and if it was alembic, what type of alembic? Thanks

[@ANRO_ANRO]

Very nicely done…love the color and mood of the scene and the characters…thanx for sharing…🔥👍🔥 Ok so i got a question i atumbled onto this because obviously wanted to do the same except i wanted this same idea with a cgi character kissing a real person for a music video….is it possible to blend a real green screen footage with a cgi character to do this very same kissing scene…ive been searching online but i came up with nothing..i want this to happen inside Unreal to bring my footage i will be shooting on my Sony Fx3 4k S-log3 file and color grade it to match my scene inside Unreal. Any tips how to make this scene between a real person and a cgi woman believable would be greatly appreciated…

[@shaddouida3447]

want to see the Wayne Mansion environment in Unreal Engine please

[@gu9838]

nice. are we gonna be seeing ue5 girl on girl scenes more in the future lol

[@ravenxrgaming4672]

Can you make a tutorial on how to do this with one hand. Much appreciated 😊

[@mrtobycook]

You're amazing, Han. Hey how did you get Maya Live Link working with a Metahuman in Unreal? I can't get it to work! :-( There seems to be no way to make the metahuman face control rig in Maya "drive" the Metahuman's face inside Unreal. Am I supposed to somehow do an ARkit conversion or something? :-) I'm super confused

[@virtualfilmer]

I don’t think he’s driving the face via Maya LiveLink at all. I think he is maybe doing body only? Then somehow transferring face via FBX?

[@HeLIEl]

Hey i want to ask what are the specs of your pc and how long was the render time process for this short film? I'm asking because i'm building a new pc 3d film and animations

[@user-yf1ir9vx1n]

AWESOME!!!!!!!!! How long did u take for making this movie. bro. Seriously I really wonder and have curiousity! plz tell me!!!!

[@shaddouida3447]

please tell us about Gotham City on Unreal Engine 5

[@WangleLine]

They're doing a little smoochie

[@Schroeder3000]

Great Job?! That looks absolutley amazing. Are you working for StarAtlas?

[@shaddouida3447]

I wonder if there will be DC characters on Bruce Wayne Selina Kyle Commissioner Gordon the Joker Clayface Two-face Victor Hugo Strange on Metahuman

[@lxi5464]

Fckng amazing! Is it rendered in UE5 or Maya?

[@aestgav]

how do you retargeting face?

[@victorma3595]

一帮牛人！

[@DarrinNoNAME]

The animation is done in Maya it looks like so how do you bring those animations into UE5? Do you have to bring the rig into the engine or transfer the animation onto the Rig in Unreal? I'm curious about this workflow in more detail.

[@Unrealhan]

Yes. The face is metahuman rig do you should be able to have an identical rig in both maya and unreal. You can rig the customized body to the metahuman Skelton. So for face animation you can export the controller keys only. Epic has official documentation about that as well. But in general yes it’s a round trip.

[@DarrinNoNAME]

@@Unrealhan thanks for the reply can I also ask what are your PC specs ( processor, Ram, graphics card)?

[@furynotes]

For the sake of argument. This took two weeks to make. Maybe a month. This is just a guess.

[@spectrohypernova8890]

I thought you made animation by Motion Capture

[@rysone3173]

I was wondering that too.

[@LVR999]

脸部是用插件绑定的吗

[@creativeframe6471]

How do you make this animations?.. you do this all in maya?

[@cybershellrev7083]

That's clearly what he used maya for. The real question is, can everything he did in Maya be done in Unreal5 or do the animation features in Unreal feel messy or limited?

[@creativeframe6471]

@@cybershellrev7083 can you import all animations from maya to unreal.. sry I just try to learn :D

[@cybershellrev7083]

@@creativeframe6471 - You can export everything you need from Unreal except for the metahuman textures. Metahuman comes with a maya compatible rig ready to go. Animations you make outside of Unreal will always work as long as they contain corresponding socket names.

[@Zs00zsa]

@@cybershellrev7083 I'd like to know that too (the can everything he did in Maya be done in UE5 bit that is)

[@Clydiie]

this is insane man but i just dont understand what im seeing

[@Romeo615Videos]

I dont understand art, i mean it looked fire def top notch work...but the concept was uhhhh weird. Almost feels like a waste of opportunity. Shrugs... cool tech work tho

[@kidsown3136]

Let the 3D be for Kids, These Cheap habits

[@SuperlativeCG]

Superb!