Unreal Metahuman + Rokoko VTuber Workflow - Animation Hour

[@Bagira33]

ohhh boy! I can't wait to test this out when my suit arrives!

[@bugrabulut4391]

That's great! A small tip: you can lock your camera positions by right-clicking on camera actor, choosing Transform and then enabling Lock Actor Movement :)

[@imsatoboi]

I know this is an older video but rokoko as a whole should make a video on how to make a simple short like where a character meets another character , using just one suit , because most of the people who are using rokoko either have one or no suits , it would be a gamechanger for people to utilize just one suit to embody a wide range of characters.

[@Syafire]

This is super cool, thanks for sharing Rokoko!

[@dogmadude3d812]

Very well done, best video yet. very cool.

[@RokokoMotion]

We're happy you like it!!

[@enpremi]

Instead of using a physical greenscreen, you could use a postprocess material with depth rendering and have a green background. That way you will avoid any bleeding and reflections

[@archi539]

Would love a tutorial if one exists, if at all possible.

[@MonkeyHero]

Im curious how to do that

[@PHATTrocadopelus]

Holy Crap! That's great!!

[@KRGraphicsCG]

This is very good, especially the facial animation...

[@matthewisikhuemen8907]

This is amazing...

[@GarfieldSnow]

Oh, Amazing!

[@pzez2781]

Super Cool!!

[@WakingUniverseTV]

I just noticed you put pose assets for t poses for both positions. I’ve spent hours and hours trying to get a t pose to work at run time for live mocap with your suit. Maybe it is too simple to mention, but mentioning something about pose assets and the need to have t pose at run time would have saved me a ton of time. I and I believe others hear t pose and see your other vid about unreal manniquin and think you just have to change it up in the editor. Now I’m finally realizing that you need the t pose in blueprint or you get horrible deformation of the arm bones. I love your videos Sam, you’re doing great and super helpful and clear. I am new and it’s always the simple and easy to misunderstand things that get me. Please if possible do a little something discussing the need for pose assets, what they are and why they’re needed if you want to do live mocap. I watched your custom Metahuman video a ton of times, and couldn’t get it right because I couldn’t get the t pose at run time. That said, thanks man! You really are a great help,

[@snakeeyesdeclassified]

very cool!

[@matthewisikhuemen8907]

How is the facial animation so good, the lip movement is really good

[@centuryblocks]

Awesome run through! Thank you very much for sharing this info

[@RokokoMotion]

Glad you find it useful! 😉

[@centuryblocks]

@@RokokoMotion Was more than useful. You got me 1 step further and more motivated into leveling up the quality of my vTube presence. It's all so new and there is so much to learn and master.

[@RokokoMotion]

That sounds fantastic! 🤩

[@WorkbrandAssets]

Nice! Twin Blast's body works really well with Rokoko retarget.

[@RokokoMotion]

It really does - all the Paragon characters seem to retarget really well, I'm not exactly sure why - I think maybe just because they aren't as "human" with the armor / robotic arms etc... so you give them more slack when looking at them... maybe? They're just built really well!

[@DarkBarBarian]

Great tutorial

[@RokokoMotion]

We appreciate the feedback! 😉

[@virusaik7]

Thank you dude for shering, this all for free is so amazing"

[@RokokoMotion]

Glad you enjoy it!

[@zentimtrades3470]

Hey Sam thanks for awe3some vid! Why would I be getting facial expressions but not head rotation?

[@user-nh6nk8sr1e]

Thank you for the video. My question is how do I make my own sitting pose asset? I am trying to customize my own Metahuman into a sitting position.

[@WakingUniverseTV]

I notice this and the other custom Metahuman project files are no longer up at the links. Can I still get these projects somehow? Thanks!

[@WakingUniverseTV]

Also are you using the straight out of the box Rokoko face capture? It seems very good compared to some other live Metahuman face cap that hasn’t been adjusted.

[@RokokoMotion]

I am! I find our facial capture works really well with the Metahumans, you can be super expressive - and this is with the phone a few feet away! It looks even better if you have a head mounted rig or you are just closer to the phone.

[@mobileunhelpy3454]

Nice se

[@MikkoRantalainen]

Is it possible to get rendered output with an actual alpha channel from the Unreal to OBS?

[@jennifercoughlin8356]

I just want a character that moves it’s face/mouth/from shoulders up…is it possible to do that without a suit?

[@onireels]

Do you have a similar project with iclone 7 optimization?

[@WakingUniverseTV]

Can I use a Vive tracker to keep the character stuck to the floor so any variable position can be achieved without special blueprints?

[@RokokoMotion]

I believe you can, although I'm not exactly sure - I think you'll still need to get into the blueprints in order to keep the legs from misbehaving :)

[@FlamyREC]

I see a little bit of Jiterrines on the model, or skipping some frames of animation. Is that normal? :O

[@mrkshh]

Sam, what iPhone do you have? And is it wire or wireless connection with phone?

[@nu-beings]

Sam are you still using the first release of Early Access? The plugin doesn't work for the version I have.

[@ongtranquang9466]

I’m waiting for your next tutorial with Maya

[@ongtranquang9466]

Hello Dear thanks for sharing me tutorials, how can I learn more about this because I’m from another country how can we stay in touch? If i have any question

[@nu-beings]

The project link is dead!

[@oravlakbelando5465]

This is fine, but would be so much more if you find the way to set it up being able to walk or stay in the stage no floating out if you dont block the body, I think is the issue rokoko should work to fix.

[@MonkeyHero]

Please see this. So currently I have most steps running, but I cant fully connect the Twinblast body blueprint to livestreaming Rokoko because there is a compiling error. I did manage to change the user name to my Rokoko one- I did the same for the face and i have the face animation working. But when I tried to do the body nothing happens due to a compiling error. It's some sort of retargeting error, which i dont know how to fix. Im not sure if the project file needs to be updated to this newer version of Unreal 5, but I really need help with retargetting the twinblast body.

[@RokokoMotion]

Hi - unfortunately this project file is most likely out of date for UE 5.1 and the new Rokoko plugin workflow. You can find an updated workflow here - hope that helps! kzbin.info/www/bejne/Zou2nXilpdBosM0

[@MonkeyHero]

@@RokokoMotion It does help. But it flies by a little too fast to follow along, and its exceedingly hard to import a character model from Daz3D into Unreal Engine 5 for many reasons. And that is not covered in your video. I still think it would be REALLY important for you guys to make an updated guide on how to get a character rigged up for Rokoko for V-Tubing in the NEW edition of Unreal. This guide is over a year old and we are on UE5 now. This is so hard Im hiring an engineer for a thousand or more dollars to try and get this going. I bought your suit specifically to do V-Tubing and im still quite dead in the water trying to follow your guides.

[@MikkoRantalainen]

Maybe Rokoko should sell just a shirt + gloves for sitting streamers?

[@Scultore3D]

Hey there, I can create 52 blendshapes on a custom character, like the ones on the metahuman. Hit me up if you need any.

[@Mad-Flix666]

Is one big jiggering here, its not commercial!

[@nemedvedevs]

guys, don't spend your time this only for windows, not for mac users((((