Fusion4D: Real-time Performance Capture of Challenging Scenes

[@RuofeiDu]

This is awesome work! Congratulations to the MSR I3D / Holoportation team!

[@dr-maybe]

You guys are doing astonishing work!

[@ScientificGentlemen]

The future of Cinema, theatre, T.v., Video Games...you name it

[@KraitoKrombongus]

the potential of what you can create from this is sky high.

[@sl4gg]

this is gonna revolutionize motion-capture

[@dbcomix]

Especially with independent film makers/ game designers.

[@do__ob]

This must require one hell of a setup to work in real time with minimum lag.

[@oBCHANo]

This captures depth and uses it to morph a volume that is then converted into polygons. As far as it's concerned each frame is just a static mesh. There is no information that can be applied to a rig. This is good for capturing big events for VR, so that you can allow people to move around and maintain true perspective, imagine hundreds of these set up at a football stadium and then have it rendered with lightfields for VR, that is what this kind of tech is for, it doesn't really benefit motion capture at all.

[@3Daver]

Absolutely brilliant tech! Not so much for film or games because the money is not in the capture, but in the retargeting. This, however, could get you a VR seat at a show on Broadway or The Superbowl. Amazing.

[@Spieluhr009]

Excellent performance!

[@creeperlamoureux]

4:25 oh uh goodbye then

[@SuperTubeAndi]

Awesome - hope this will be made available publicly to use/license/implement. Do you include approaches to deal with reflective/refractive/transparent surfaces or absorption? How about reconstructing from RGB(without D) cameras?

[@zhangxaochen]

How is the "Qualitative Comparison" carried out? the source code of "DynamicFusion" seems not publicly available till now, did you priviately acquired the sourcecode or implemented it on your own? Thx for reply~ :-)

[@TheGamingMackV]

If this revolutionizes motion capture, does this mean less work to put into making a 3D model? Such as designing the head, facial movements, mounting the 3D modeled head onto a motion captured body, ect?

[@os3ujziC]

Amazing stuff.

[@aldomotion]

when we can test it? i've some kinects and oculus wating for test it!

[@computrik]

Wow

[@FuzzyWobble]

Very cool! Please just add this code to Kinect so we don't have to buy four more cameras :)

[@aporma2297]

i want this + live sports + vr headset pls.. first quarter 2017?

[@herp_derpingson]

Nope, but VR can show you da wae.

[@VijayNirmal]

great

[@Fludboy]

how about more cams? all around

[@Krasniysharigg]

And this still not a thing? Just prototype and thats all?

[@Bot_Shredingera]

Почему не сделают игру с этим?

[@ylu796]

how to get ground truth

[@SuperOranBerry]

I think ground truth here is basically a green screen, so it will always be more accurate than a 3d estimation