Sorry to bother you. I replaced the 27-bone model you provided with the 22-bone Smplh model and Mixamo model. After setting up the Actor script, GenericIK script, Motion Controller, and Blueman script, the upper body became immobile, while the lower body bones could move, but the skin did not align with the bones. Then, when I increased the bones back to 27, the whole skeleton moved correctly, but the skin still didn't align with the bones. Could you please explain what might be causing this?
@bahshas5 ай бұрын
how come we don't see these implemented in videogames?
@bause61825 ай бұрын
Good intersting paper + Code implementation = pur hapiness.
@leoako77756 ай бұрын
this is what's lacking in vrchat ! ugly movement really kills the experience so implementing this tech in game would be such a welcomed upgrade !
@TerraUnityCo6 ай бұрын
This is amazing Sebastian, great job as always 👏
@honglinchen46816 ай бұрын
Does anyone else also like the dance at the end of the video? lol
@BaseRealityVR6 ай бұрын
This is What I want for my own UE VR system that I'm developing, instead of having to A mix OF animation & procedural foot placement which can look robotic. The bending of the Knees in the correct directions here is very impressive because dynamic crouching can be a challenge
@r.m81466 ай бұрын
You were featured in 3 minutes papers. Congrats!
@r.m81466 ай бұрын
Absolutely amazing.
@ForexLearnerAI6 ай бұрын
I'm literally speechless. No joke. I don't know what to say. This is amazing. I'll look into the repo for more info but I have a use case in mind where this would be so valuable when trained on a custom dataset. Thanks Starke and everyone involved for brining us one step closer to a thriving future.
@mbit58186 ай бұрын
if you implement this technology as a plugin for ue5 vr, I will definitely buy it!
@importon6 ай бұрын
Very nice! How can we try your "mirror demo" in our headsets? Is there a demo available?
@mattanimation6 ай бұрын
been such a joy to watch how this work has evovled and be applied to so many areas
@ThaLiveKing6 ай бұрын
Is this just for VR?
@bause61825 ай бұрын
You can customize the code in order to make a mocap for animations maybe
@ZadakLeader6 ай бұрын
Sweet!
@skavenqblight6 ай бұрын
Impressive.
@tomhalpin86 ай бұрын
Absolutely fantastic as always!
@fanshengmeng61026 ай бұрын
Looking forward to the code/demo/dataset! Great work!
@paul-starke6 ай бұрын
We are working on the polishing and will upload them soon, thanks!
@loveadeola8 ай бұрын
Can these be integrated into a game engine? If yes, which ones?
@zk-mc9 ай бұрын
Hi! Great work. Is there any documentation, papers on this example, or information we can read for the method of this particular implementation? Cheers.
@vladjurat9 ай бұрын
This is so awesome!
@zeblanoue264210 ай бұрын
This goes so hard
@zeon3d75511 ай бұрын
Could it be done using unreal engine 5?
@reaperdev9857 Жыл бұрын
No plans for a comercial product? As an indie dev the idea of cutting down the budget and producing higher quality content faster is VERY attractive.
@Hello_352-v1h Жыл бұрын
does it still have the features from 2019 and 2021 because i need all 3 of them?
@Hello_352-v1h Жыл бұрын
Is there a way to controle the charecter like we used to use a xbox controller before
@oldleaf3755 Жыл бұрын
amazing
@thomashalpin2251 Жыл бұрын
Many 3D characters come in a range of shapes and sizes, with different lengths for limbs. I wonder if there is a path that could train one set of motions then correctly apply it to all the different characters with no loss in fidelity. Hopefully a future paper :)
@Tenenx69 Жыл бұрын
What the dog doin
@PapaMama-dm9nl Жыл бұрын
Wow
@The_Pugilist Жыл бұрын
Amazing stuff!
@JayYeasmin Жыл бұрын
has this been utilized in a game yet?
@jacekfr3252 Жыл бұрын
this is what modern art really is. Applause!
@TheSeiris2 жыл бұрын
Will test it my own and will be sharing the results if I find anything interesting. Thanks!!
@TheSeiris2 жыл бұрын
Great! I think your work’s direction is valuable should deserve more attention. Seems like periodical modeling or idea of using fft worked really good. I think it makes sense, since bone positions naturally repositions to origin, it’s very reasonable to model it periodically. Very good xD.
@dihuang98492 жыл бұрын
Pretty cool!
@nictanghe982 жыл бұрын
I prefer transflower dancing skills.
@manollobango2 жыл бұрын
This is so awesome! 😍 Is there any chance that indie developers like me will be able/allowed to use this technique and animation data set for commercial to an affordable price some day?
@EpicPianoArrangements2 жыл бұрын
Is it just me or is the only stiff part about these AI animations... is the ankles? The ankles just seem a little stiff in their movement as if they only bend to half the flexibility they can really achieve. Other than that however, this technology is brilliant.
@marcostorres44162 жыл бұрын
Excellent! How can I recreate this with a feline quadruped in Unreal Engine 5?
@LuciousKage Жыл бұрын
i would love to do that too, did you found out how to do that ?
@sinanrobillard28192 жыл бұрын
Amazing paper! Great progress over the years! Do you think Phase embeddings could be applied to another dataset format such as audio inputs? Also, the ball has physics but what about the character? The question is: Would this simulated motion be applicable to robotic humanoids?
@Super-id7bq2 жыл бұрын
This is all incredibly impressive but I still can't stop staring at the red trunk dude's junk. He's got a whole gonzo nose situation. You can see it from behind!
@gricchastain65062 жыл бұрын
Awesome. Crazy I just hear about this.
@mattanimation2 жыл бұрын
been fun watching the progress since 2017, awesome work!
@NycroLP2 жыл бұрын
Amazing stuff. I wonder if this can also be applied to more specific animation like a small man doing a heavy axe swing.
@RyMann882 жыл бұрын
I know this is old. But hopefully this could become a plug with animation data (separately), to help indie studios achieve the same effects.
@clinkclink78142 жыл бұрын
Hello Mr Starke, I am really fascinated with applying AI and game engines together. I am far from your skill level and knowledge, but I was wondering If you could guide me on what I need to do to get into this field. I would assume I would have to take courses in Numerical Analysis, Computer Vision, and Computer Graphics. But I feel like these might not be enough. Would you be able to recommend other courses that I should take to get even an "inch" closer to your abilities/knowledge?
@Detril20002 жыл бұрын
Machine Learning knowledge would also be needed, and in turn you would need a decent understanding of Linear Algebra and some basic calculus. Ideally you would enroll in a complete Computer Science program with some focus on AI! But of course this is state-of-the-art stuff, post-doc level, so you'd be expected to first take on some Masters and Doctorate level research.
@eduard_soul2 жыл бұрын
Incredible !
@jokwon73432 жыл бұрын
and just like that....thousands of animators screamed out interror