Dyna: A Model of Dynamic Human Shape in Motion (SIGGRAPH 2015)

[@ShaneMcGrath.]

Looks amazing, Another step closer to realism. Would love to see this in next gen games!

[@anthony_leckie]

This is such impressive work. The tissue dynamics and general feel of the physicality is a core aspect of what is limiting modern CGI. This was very inspiring to watch.

[@WhiteDragon103]

Michael Black, you have an interesting obsession with jiggle physics.

[@SteveMicAndTheHoldTights]

I am a 3D apparel designer that designs tight fitting body wear. To have soft body avatars would be an amazing breakthrough!

[@MichaelBlackMPI]

FYI, the AMASS dataset has hours of SMPL avatars in motion with DMPL soft tissue motions. Maybe this is useful. Because the soft tissue motion is computed from standard mocap marker sets, it is not as realistic as when one uses markers to explicitly capture soft tissue. amass.is.tue.mpg.de/

[@SteveMicAndTheHoldTights]

​@@MichaelBlackMPI, Thank you for the website. What my industry needs is 3D apparel software that includes dynamic soft body avatars that can squish when say a tight swimsuit is simulated on the body. This would be a major breakthrough when trying to do virtual fittings of a garment. Right now the current avatars available in the 3 major applications (Clo3D, Browzwear and Optitex) are rigid. Keep up the great work!

[@MichaelBlackMPI]

@@SteveMicAndTheHoldTights I agree that this is an important problem. We have done some other work that extracts physical soft tissue parameters from motion sequences like these and then one can do physics simulation with the resulting model. We defined a volumetric SMPL model for this purpose but have not pushed it to a point of application. More info here: ps.is.tuebingen.mpg.de/publications/meekyoung-siggraph

[@Rallion1]

Did you end up releasing this as a plugin for any mainstream 3D software? I'd be very interested in it.

[@3Daver]

Amazing work! I would buy this!

[@RikkTheGaijin]

Impressive! But I'm more interested in how you guys retargeted the 3d scan with your retopologized mesh. Is that a proprietary software?

[@MichaelBlackMPI]

RikkTheGaijin Given a new mesh, we manually click a few points that are in correspondence between our template and the new mesh. We then run a fairly standard mesh alignment method that transforms our template to fit the new mesh. It is our own software but there are commercial alignment methods that work similarly.

[@RikkTheGaijin]

Michael Black thank you for the reply. I have used R3DS Wrap, but often the results are not good, while your software looks really good.

[@MichaelBlackMPI]

RikkTheGaijin Thanks. We are thinking about making some sort of web service available where you can upload a mesh, click some points, and we align it. It will only work for fairly human meshes though. Stay tuned.

[@WaitButHow]

Sorry, I couldn't focus on the narration, all I was thinking is how unfit those people are. EDIT: rewatched it, it's actually pretty awesome

[@obidapogi]

Wow, amazing work, some kinda revolutionary methinks. People will pay good money to have this and MOSH in unreal engine. Also, do you have something similar for faces? or even quadrupeds? How do you suppose this can be blended with physics/IK/collisions??

[@MichaelBlackMPI]

Oliver Baldenero. We are working on compatibility with Unreal, Unity, Maya, and Blender. We have not yet worked on faces but plan to combine face and body movement soon. We'd love to leverage this data to learn a physics model but our initial efforts failed. We still think it is a good way to go. So stay tuned for more!

[@32BitJunkie]

Hi there, it's been a year, any progress on releasing this as a usable plugin? And can it run fast enough for real time VR?

[@EnterReality]

Very interesting! I guess that something like that could be achieved inside Maya/Max using some of the tools available ( ncloth, syflex & co ) but this custom solution looks very promising and efficient... Quick question: I read one of your comment which mention the possibility of having this "skinning feature" inside UE4/Unity...well, it would be interesting to know how the dynamics will work inside them ( extra helper joints or a combinations of blend/corrective shapes, custom tool )? Also, I'm thinking that the same "behaviour" could be inherit by clothes as well given the material of the cloth itself... Looking forward more news, really great job!

[@roidroid]

i can't wait to see Shrek's giggles ogredone.

[@jonatassantos2799]

Can't wait for Fat Girl Simulator Early Access on Steam.

[@trousersnake81]

how is this still not a thing

[@pro_rookie_gamedev]

@Lapid Palid this work seems fairly obscure

[@mmnissanzroadster9]

Next up, a plugin for Blender! XD

[@MichaelBlackMPI]

Marcus_Mravik In fact, yes. Stay tuned.

[@mmnissanzroadster9]

Michael Black You'd better not be just teasing me! lol

[@plavix221]

+Michael Black Yes! It would be awesome to see this code implemented in Veiviev's VR erotica simulator. XD They have currently soft tissue deformations working in UNity. vine.co/v/eZewOJV5h65 SFW ;)

[@harunDMC]

@@MichaelBlackMPI liar

[@EVAUnit4A]

(not an animator) Looks good to me! Next up: changing lighting and texture to _not_ have models look like plastic when animated. EDIT: "Young boys everywhere- you're welcome." (director David Twohy, _Pitch Black_ audio commentary)

[@dxhanse9163]

0:30 oh god

[@marcinbbox]

I dont get it. Muscle tissue and fat tissue have known elasticity. Why not make it once for good, by computing or predefine both rather than making thousands of scans? Why bother if math already got this?

[@trousersnake81]

I think its cause math don't got this. i think that is endgame, but then every pixel has to be treated as a multi-d tensor with non-linear relationships to every other pixel. sorry for the necro

[@karlhilton6641]

I'm sorry did you say something?

[@AntonBarcelona]

amazing... future is here =)

[@dejayrezme8617]

Wow that's amazing

[@SevanaS]

Animated human flesh is starting to look real

[@rogribas]

a 3d twerking revolution is coming..

[@madmuffinz]

Get ready for those lewd games

[@jonathanxdoe]

I created a new plug-in to make a 3D mesh feel ashamed of itself. We should work together.

[@FloMoonYeah]

ok that's cool but... I mean, it seems there are more and more research on how to render jiggling flesh but we're still struggling to make characters move in a really natural and adaptive way...

[@do0myk]

tech to simulate americans. Have this ever been used in videogames? I cant remember any examples (they probably prefer wasting processing power on 4K models of random garbage everywhere).

[@confuseatronica]

Now CRANK ME OFF