Real Time Tracking & Projection Mapping (Full ver.)

[@blomproductions]

This is the best projector demo i ever seen

[@shaneburke7274]

That was the most amazing thing I’ve seen!!!!!

[@ZacharyAghaizu]

This is spectacular!

[@JacobMerrill]

my only critique is you need to demo that you are tracking the hands / feet etc. and show your skeleton in a corner somewhere, so we know the tracking is tracking a full rig.

[@KyleNally]

Question: During the last thirty seconds or so of the video, the dancer appears to be rotating the large box around him in real time. Was this the case, or did the dancer learn the motion beforehand, and synced his movements to the animation of the box? Put another way: how far is this tech away from an actor using it being able to arbitrarily control the movements of the projected images absent any prior calculation of the objects' motions in the animation?

[@Nekenbeker]

"Real Time Tracking". So yeah, they're tracking his body and mapping the projections accordingly.

[@meeran3769]

i think it's tracking The circle on his chest

[@OneisneO]

Definitely looks like tracking. You can do that kind of pose estimation with a Kinect and its libraries. But when you try to do what is on the video, the problem is loop delay, coming from both Kinect's and projector's processing time. It will lag behind your movements. Loop delay on this setup is pretty low, but definitely check Ishikawa Senoo Laboratory channel to see the state of the art on this technology.

[@cynricng]

Its the reflective circles on his vest. Its similar to how kinect works, you blast it with Infrared light and it bounces off anything thats there, and you get a white blob as an image and the software calculates it. There's a high chance its not kinects body recognition library due to how fast it reacts, calculating a few points is a lot quicker than calculating an entire body shape and much more accurate with a lot less noise. You can actually tell @3:45 when one of his hand moves up and the other is down that the box doesn't move, that the rotation of the box is based on his chest rather than his hands.

[@DanceCode-World]

If I buy a project I show now, can it be implemented like a video?

[@ChritsianBucic]

Superbe conceptualisation !

[@auliaheningdarmasti1899]

Hi! Great job there :) I have a question, how do you set up kinect and projector? Since kinect needs enough light to detect while projector needs minimum light so it will clearly projects. Thank you before for your answer :)

[@CHIRAGPACHAURI]

i think they are tracing shirt. look at time 3:17 there is small circle reflecting in between chest and shoulder and see he wearied some strips under shirt may be some laser tracing technology with pro level C++ code hope so... i don't think they're going to reply...

[@CHIRAGPACHAURI]

I thought the same. Can't done so exact with kinect.

[@auliaheningdarmasti1899]

Hi chirag, I'd finally answered my own question. They use skeleton tracking which is using IR camera so they weren't facing any trouble in detecting the body movement. But the project I'm currently working on is face tracking, which is required RGB that needs light. So.. yeah.. kinda confused 😂

[@CHIRAGPACHAURI]

Aulia Hening Darmasti can we talk my whatsapp num [phone]

[@manvendrachauhan7238]

This appears to be neither kinect (that is consumer grade, with lots of latency and limited range and Field-of-View), nor standard IR Cameras (that requires Makers, either passive, IR reflecting spherical markers or Active IR LED markers). Whatever the motion tracking technology, it should be drift-free, low latency, accurate and should output computed pose (position and orientation) of torso and hands at a very high rate. Also, projector should also be working at matching frame rates. And this seems to be doing that perfectly. What is truly remarkable though is dynamic projection on deformable surface. That means tracking technology also tracks surface deformation, not just rigid bodies. Well, here is the technology kzbin.info/www/bejne/Y5PLYoB-qqZooLc .

[@JesusCarlosRomeroTorres]

En donde se puede comprar en mexico

[@giannhs1977]

hello what model of projector you use please for make this amazing job please ?

[@Amajesticbob]

U gonna need more than just a projector, u gonna need a 3D scanner or something like the Kinect and knowledge on video editing, not day that the video is edited it’s a method used for real time projector mapping

[@musicray57]

❤❤❤

[@ivansantos7643]

Show! 👌

[@GlitchyAnimationsYT]

That's great!

[@jijoto-it7nb]

😍😍😍

[@amaliaikas3067]

awesome

[@antbvideo]

subbed

[@mouritius]

buena kikky

[@АртемийКалинин-ж2ф]

very good tracking, but very borring content(

[@americandevil]

Sochin