Rokoko Guide: Updated Unreal Engine Workflow UE4.26 + UE4.27

[@WoofWoofWolffe]

Thank you so much, Sam! Was really looking forward to this!

[@AnimatorsJourney]

The downloadable bone maps appear not to be working, so I made my own after reading a comment below. But I get an bone map override not set error, even though I created it (for a paragon body) and chose it from the dropdown menu in the blueprint and compiled. I posted on discord and haven't found a solution, there are several other people on the discord with the same/similar issue regarding bonemaps. Thanks for any help you can provide, kind of stuck, unable to use the suit now.

[@danielfallshaw1410]

Having a similar issue with a Metahuman bone map, doesn't apppear to be loading despite being in the content folder.

[@IstyManame]

Is there any progress with the issue?

[@kiukle]

Can you share the bone map you made? Was it for MetaHumans? Did you get it working?

[@chrisg7663]

The Rokoko_MetaHuman_T_Pose doesn't show up in the content browser in UE5 or 4.27 no matter how I copy or migrate it over.

[@PixelBokeh]

Please consider zooming in on the blueprint sections. It's nearly impoosible to see some of the nodes you are working with when the video is only 720P.

[@MonkeyHero]

Edit: I managed to get Felton in, two different occasions- but the process is really busted. My issue now is with the matching of the bone map to the rokoko bone map list. I need the full completed list to complete my felton. Im not sure how Im suppposed to figure out where the Rokoko mapping and the Daz one do or dont overalap. I still think this guide goes a little too fast and plays really loose. Especially since its so old now. Figuring out how to get a V-tubing character going in all this is pretty hard.

[@patrickosborne6856]

Sam, when you added the Rokoko studio source in live link settings, I noticed you have to trash it once befor both body and face show up. Is that a bug? or some sort of voodoo? When I go to load mine, the body doesn't show up, but pressing that little trash button to try again freezes unreal engine. Any ideas on how to get it working properly?

[@davidcameron5308]

Been following this so far in preparation for buying a suit and it's been very informative! But I've noticed in my Basic Plan for Rokoko Studio, the Live Streaming option is grayed out with a lock icon, does that mean I need a paid license for the studio? I'm hoping to test this workflow before purchase, but maybe I can just pay for a month to try it out?

[@kaym2913]

Thank you for this tutorial. Is it possible to use Rokoko UE plugin in a build? The rokoko livelink stuff seem to only work in uncooked versions.

[@RokokoMotion]

There's currently a bug when compiling to a standalone build, but we're looking into it!

[@paz_e_amor_xo]

@@RokokoMotion Has this issue been resolved yet?

[@mjaegerj]

Brilliant! thank you! Great update! got it up and running in no time!

[@RokokoMotion]

That's awesome!

[@michellepoinpoin5659]

I can't open BonneMaps assets, UE4 say "failed to load asset" when I clic right on one of this. An idea to fix it ?

[@yjoe332]

May I ask why rokoko arrived at UE in real time according to the process, but the model in UE does not move now

[@孙思超]

hello, how can I use smartsuit to make metahuman move in unreal packaged game of Windows exe?

[@Sepfy]

Thanks Sam, this is super helpful as always!

[@bogartwilley]

Roughly how old of an iPhone can be used for this? Just so I know how cheap I can hopefully go here.

[@damianturkieh9580]

What is the ideal workflow for real time streaming with the Metahumans for UE5 (not mesh to metahuman)?

[@bizaTeam]

Can I start the Rokoko plugin in unreal engine 5 ??

[@TriSutrisnowapu]

Finally the tutorial.. Btw What's the background music of this video? It sounds nice in my ear..

[@karl6609]

I having the same question as Kay M. Is it possible to use Rokoko UE plugin in a build? The rokoko livelink stuff seem to only work in uncooked versions.

[@RokokoMotion]

As mentioned on Kay's comment, it is intended to be used in standalone builds but is currently bugged - should be fixed soon though!

[@96ubme]

Just followed this up till the 18 min mark. Not streaming at all. My character doesn't move. I am getting a compile error message saying Bone map override not set. How do I set it?

[@AnimatorsJourney]

I'm getting the same problem

[@96ubme]

@@AnimatorsJourney I went through this 2x yesterday and didn't get it working. I tried it once streaming live into Blender and it worked in 2 min, very frustrating.

[@96ubme]

@@AnimatorsJourney for some reason I never got it working 4.26 but when I this process in 4.27 it did work. Have you tried it in 4.27?

[@patrickosborne6856]

I get this same message in 2.7 - Bone map override not set. Anyone have any ideas? Dead in the water for me. Works perfectly in blender.

[@AnimatorsJourney]

@@patrickosborne6856 I get the same message. I've posted on their discord without any clear solution so far, so I'm stuck as well. Love your work btw, loved Feast :)

[@jrios3d]

Hi, Im interested in realtime mocap in unreal 5 using mixamo autorigg tool. Do you have a tutorial or maybe a retarget list bones for doing it? thanks

[@elrossi96]

When I select the bonemap after compiling it doesnt work

[@nickystudio]

THANK YOU My brother Sam!!!

[@piotr475]

My bonemap doesn't open.... I can't compile and fix the disappearence.

[@noahguthier6615]

Thank you so much! For some reason my characters nose and eyebrows get left behind once I start the animation. Anyone know how to fix this?

[@RokokoMotion]

No problem! But it sounds like the nose and eyebrows might have unconnected bones or aren't weight-painted correctly. If you want more hands-on help with this in a live setting, I recommend checking out our Discord server at discord.gg/rokoko - we have an Unreal Engine channel with a lot of super helpful people 🤓

[@kirkzhg598]

in ue4.27 version, it works. but in ue4.26, can't set the Rokoko Bone map to Metahuman_BoneMap

[@lagbit1789]

same problem here lol so just switch to 4.27?

[@tommywright]

This is the Legacy Studio software. Is there an updated version of this video with your new Studio app? ...oh and for Unreal 5.1 (the latest). New video please. :)

[@RokokoMotion]

Hey Thomas! We hear you and will make sure to pass your feedback onto the team :)

[@georges8408]

Nice tutorial ! ..I m waiting to see tests for the new Rokoko pro 2 suit... But I would appreciate an answer about this. Till now, none of the suites or mocap files available out there from various sources gives a really realistic motion..Not sure why.. the mocap files are nice but eventually everyone can understand that they are computer generated... Only very few mocap files gives that feeling of realism in motion (especially for metahuman) and I guess they are already cleaned up.. Either they come from Iclone, Rokoko, Faceware studio, xsens, mocap files, whatever source, you can clearly feel that "something" is missing.. do we have to make manual clean up every time ? I guess yes.. So that would be an interesting tutorial of how to clean up for realism.

[@ianhudson1810]

After updating the plugin to v1.11.1 UE4 4.26.2 will not allow me to use a Maya bone mapping file that I have been using with v1.10.0 of the plugin successfully. When double clicking the bone mapping file in the content area the editor window fails to open - Asset failed to load

[@RokokoMotion]

Unfortunately, I think you may need to recreate the Bone Map using the new Rokoko Bone Map Asset blueprint class to work with the new version of the plugin, as well as changing up the blueprint to reflect the new workflow.

[@ianhudson1810]

@@RokokoMotion Yes I see now that the bone mapping file is not a txt, csv or json file but is a SmartsuitBodyMapData class which will have been updated in the new plugin. Thanks for your reply to confirm that. ;-)

[@LucasRidleyAdventures]

@@ianhudson1810 Did you get it working? I'm having the same issue. After making my own body map data it's saying an error that the 'bone map override is not set' when it appears to be it is, I've chosen the one I made in the Rokoko Bone Map dropdown. I've posted on the discord but no one's responded yet, someone else has the same problem there too.

[@mrkshh]

When i record the Take, then bake control rigs of Metahuman, Body become different (ugly) and i dont know how to remove it

[@RokokoMotion]

Heyo! I recall someone else running into this on our Discord server, you can probably get help with this if you ask in our Unreal Engine channel there 🤓 Discord.gg/rokoko

[@odysseus93]

Very good. Question. Is the workflow going to be the same for UE5? or is that going to be different.

[@RokokoMotion]

The same! If you download the plugin folder from our github you can get it working right now - we just need to rebuild parts of the bone maps folder and then we'll be releasing a UE5 specific tutorial github.com/Rokoko/rokoko-studio-live-unreal-engine/releases

[@odysseus93]

@@RokokoMotion Awesome. Thank you.

[@artist8972]

@@RokokoMotion 언제쯤 공개되나요?

[@jonothan]

What would you say is the most effective way to scale the metahuman setup across 20+ metahumans- hopefully without doing the whole setup 20+ times? Thank you so much for this great tutorial!

[@RokokoMotion]

Oof - this is a tough question but I think something that a lot of people run into and frankly, I'm not sure. I just wrote out a whole long word-vomit response to this and then deleted it because it made no sense haha :) I think at the very least you need to group them by height and weight - so you could scale the set up between several metahumans who were all, for instance, f_med_nrw (female_mediumheight_normalweight) skeletons, but as soon as you start introducing metahumans who use different skeletons you get a whole host of other issues. Given the issues I think you'll start to run into using multiple metahumans, it may just be more efficient to re-create the set up 20+ times. I would maybe check out Citizen Meta One or JFilmz channels and see if they've found any solutions - I also think some of this mess will get cleaned up when Metahumans exit Alpha. Sorry that I don't have a better answer!

[@jonothan]

@@RokokoMotion thanks so much for your answer! Really appreciate it.

[@CharlesDonatelloXVIII]

I have followed this tutorial multiple times, however once i hit "play" after hooking up the livelink, my character seemed to dissappear. I eventually found the character high up in the sky, and any time i move the suit, the character jitters around and moves away (I cannot always find the character in the sky). I assume this has something to do with collisions, however even after removing all collision pills from my character, the issue still presists... anyone with a suggestion? Another thing to note is this is a custom character that i made in 3DS MAX, and the character is multiple meteres tall since whenever i imported the character into unreal at a normal (6foot) size, the materials looked weird and glowy. could the scale be an issue?

[@RokokoMotion]

Hey @wondroids! Thanks so much for the comment. This does indeed sound strange. I'd recommend reaching out to our support ([e-mail]) or head over to our Discord (discord.com/invite/YEvtvbAuvB) where our community of Unreal/Rokoko experts would be happy to help. Good luck!

[@tongli1741]

Bone map override not set! It happened when I use Rokoko Body Map Data. Anyone knows how to fix this? It is weird because I succeeded in the first time, but failed in the following three times

[@RokokoMotion]

It is difficult to troubleshoot without a bit more context provided for exactly what problem you are having. I recommend checking out our Discord community server and asking in the game-engines channel for more hands-on help: discord.gg/rokoko

[@alexbaumann3759]

Thanks for the video, Sam ! Any chance you have a HumanIK bodymap uasset stashed away somewhere too haha, would love to not have to manually configure all those bones.

[@alexbaumann3759]

I assumed since you can export from Rokoko Studio as a HumanIK skeleton, you guys would have those in your folder, but i get you can't please everyone

[@RokokoMotion]

Heyo! Dave here - I'm not quite sure where he has stashed these, but you are welcome to drop by our Discord server and ask him directly there ;) discord.gg/rokoko

[@alexbaumann3759]

@@RokokoMotion getting an invalid invite error to the discord. I made the retarget asset myself anyway, but now I have a question about blending between rokoko live streaming and a pose or animation asset, it seems to break the stream if the alpha of the blend ever fully set to the other pose or animation. meaning its not possible to transition from a static pose to the live rokoko stream. Which means doing something like having a statue come to life at runtime with live mocap is not possible. Was wondering if this is a known bug-- My current workaround is to never let the blend alpha ever fully get to 0, instead its lowest value is set to 0.0001 and that seems to do the trick but is definitely not ideal.

[@artist8972]

언리얼 5.1 가이드 영상도 제작해주시나요

[@paz_e_amor_xo]

When is the tutorial for doing this in unreal engine 5 coming out?

[@RokokoMotion]

Soon™! 🤓 (Don't worry, it's on the way). We do have the official UE5 plugin on Marketplace, it should work pretty much the same! I'd say give it a whirl and drop by our Discord server if you need help, they're super helpful and quick to answer: Discord.gg/rokoko

[@esd9058]

Thank you!

[@mrkshh]

Sam, could you share project with Felton?

[@RokokoMotion]

I can't, unfortunately - we can't redistribute models we buy :(

[@MikeGemi]

How do I do this on Unreal Engine 5?

[@RokokoMotion]

We have an experimental version of our plugin for UE5, but one of our Discord community users actually wrote a version that works for 5.0 preview 2, which you can grab here: github.com/imXify/rokoko-studio-live-unreal-engine Feel free to check out the community at discord.gg/rokoko as well! Lot's of people using Unreal in there 🤓

[@MikeGemi]

@@RokokoMotion Thank you! So far not having any luck getting it to work are there any tutorials on getting it up and running?

[@RokokoMotion]

Not yet, but we have had an official release that works on 5.0 since then, that should help you out! www.unrealengine.com/marketplace/en-US/product/rokoko-studio-live

[@hell_sparrow]

nice video tank you

[@RokokoMotion]

You're very welcome!

[@刘鸿翔-b2m]

Cool！

[@anurag5479]

when i do bake animation to control rig the metahuman becomes bigger. I am facing this problem for all the metahumans except for the medium female metahuman. does anybody have solution for this problem ?

[@RokokoMotion]

I haven't quite run into this before, but I recommend asking the folks on our Discord server (we have an Unreal Engine channel with a lot of folks using metahuman - super helpful people!). You can find it here: discord.gg/rokoko 🤓

[@mrkshh]

Have you solve this problem? Have same, dot get how to solve