[SIGGRAPH 2024] Categorical Codebook Matching for Embodied Character Controllers

[@ForexLearnerAI]

I'm literally speechless. No joke. I don't know what to say. This is amazing. I'll look into the repo for more info but I have a use case in mind where this would be so valuable when trained on a custom dataset. Thanks Starke and everyone involved for brining us one step closer to a thriving future.

[@mattanimation]

been such a joy to watch how this work has evovled and be applied to so many areas

[@tomhalpin8]

Absolutely fantastic as always!

[@importon]

Very nice! How can we try your "mirror demo" in our headsets? Is there a demo available?

[@BaseRealityVR]

This is What I want for my own UE VR system that I'm developing, instead of having to A mix OF animation & procedural foot placement which can look robotic. The bending of the Knees in the correct directions here is very impressive because dynamic crouching can be a challenge

[@fanshengmeng6102]

Looking forward to the code/demo/dataset! Great work!

[@paul-starke]

We are working on the polishing and will upload them soon, thanks!

[@TerraUnityCo]

This is amazing Sebastian, great job as always 👏

[@r.m8146]

You were featured in 3 minutes papers. Congrats!

[@mbit5818]

if you implement this technology as a plugin for ue5 vr, I will definitely buy it!

[@r.m8146]

Absolutely amazing.

[@bause6182]

Good intersting paper + Code implementation = pur hapiness.

[@bahshas]

how come we don't see these implemented in videogames?

[@skavenqblight]

Impressive.

[@Something-lcl]

Sorry to bother you. I replaced the 27-bone model you provided with the 22-bone Smplh model and Mixamo model. After setting up the Actor script, GenericIK script, Motion Controller, and Blueman script, the upper body became immobile, while the lower body bones could move, but the skin did not align with the bones. Then, when I increased the bones back to 27, the whole skeleton moved correctly, but the skin still didn't align with the bones. Could you please explain what might be causing this?

[@ZadakLeader]

Sweet!

[@ThaLiveKing]

Is this just for VR?

[@bause6182]

You can customize the code in order to make a mocap for animations maybe

[@leoako7775]

this is what's lacking in vrchat ! ugly movement really kills the experience so implementing this tech in game would be such a welcomed upgrade !

[@honglinchen4681]

Does anyone else also like the dance at the end of the video? lol