Dynamic projection mapping onto deforming non-rigid surface

We realize dynamic projection mapping onto deforming non-rigid surface based on two original technologies. The first technology is a high-speed projector "DynaFlash" that can project 8-bit images up to 1,000 fps with 3 ms delay. The second technology is a high-speed non-rigid surface tracking at 1,000 fps. Since the projection and sensing are operated at a speed of 1,000 fps, a human cannot perceive any misalignment between the dynamically-deforming target and the projected images. Especially, focusing on new paradigms in the field of user interface and fashion, we have demonstrated dynamic projection mapping onto a deformed sheet of paper and T-shirt. Also we show that projection to multiple targets can be controlled flexibly by using our recognition technique.
ishikawa-vision.org/vision/DPM/

[@JoelTGM]

That's pretty neat

[@JorgeGamaliel]

Amazing!! Congratulations for this excellent work. I send you greetings at the speed of light.

[@JonnyMoto]

so in the future, instead of phone poles they'll have T shirt projectors. Hackers writing "kick me" on peoples backs.

[@Rock-el6xm]

that was the first thing I thought lmao

[@MichaelGaidamaka]

Wow effect has been reached. Simply Amazing!

[@Prosbjerg]

Amazing work! Can't wait for a commercial version - this has much potential!

[@RazsterTW]

I see so much potential. Mind is going nuts thinking about it. Well designed.

[@FabrizioBogado]

Congratulations people, you are awesome. Fantastic projects! Greeting from Uruguay.

[@ajnode]

Incredible. This is some futuristic stuff - surely you'll end up rich from this!

[@BrandonTylerGoogle]

Wow, incredible tech guys!

[@jones1618]

Some applications come to mind: Clothing/fashion: Step into a retail / at-home "fitting room" wearing a blank outfit. Preview in 3D available patterns and designs projected onto clothes. I imagine wedding dress fitters would love this. Their clients could preview dozens of different neck, waist and back lines in a few minutes, saving time and wear and tear on dress inventory. Advertising: Dynamic ads on real/cloth banners, flags and curtains. Glass-less AR gaming: Project faces, costumes and body damage on people in a play space. Medical simulation / augmented surgery: Project MRI/x-rays (in stereo) on dummies/patients that adjust when they move.

[@RincewindMage]

now muggles can read newspapers from hogwarts

[@hitendram]

Can anybody see the future, this will change the world of projecting media.

[@DrussNL]

Amazing, don't know if projecting stuff onto clothing is going to be the best application for this, but this is a great technology and many useful applications will undoubtedly surface.

[@unregisteredhypercam2142]

I'm shookt!! This is so cool... I love technology. Just seeing this makes me curious about what this world will look like in 30 years. That is, if we don't get nuked or global warming makes the temperature of the earth into an oven.

[@manloonpun6497]

I can imagine this technology being used for future stage performance

[@chaoticlogic588]

This is pretty amazing

[@aTROLLwithBlades]

thats pretty swanky great work guys!

[@Vyseblues]

I would love to see this being used for AR gaming.

[@ThatAznJeff]

THE POSSIBILITIES

[@moosecanoes]

Gio M that's an incredibly vague statement that doesn't apply to any technology accessible today.

[@daniellopes8376]

If you are not familiar check out CastAR.

[@Jonaasti]

That would be really neat. You can definitely use something like this to fill in between the normal 60 frames to bump it up to 1000 frames just so the placement stays and looks right. Though I think the main hurdle is having something react fast enough to what its seeing, which happens at a delayed 60 fps. not sure how we will ever get rid of the delay without crazy powerful hardware.

[@moosecanoes]

This isn't AR, it's a projection.

[@nemraps]

Damn son

[@LeeCarlson1]

Amazing!

[@angolin9352]

This is amazing. Fuck the NX, this should be #1 on trending.

Very impressive.

[@cybergproductions589]

That's really cool.

[@scottdawda5772]

nice work

[@EnlistedReb]

Fantastic.

[@bearriver685]

Astonishing

[@civicsr2cool]

ever since seeing this paired with an Xbox I've been impatiently waiting for this to boom in the market

[@Radianable]

welcome to the future folks

[@artist.srikanth]

Great..Futuristic tech.!

[@stcrussman]

This would be best marketed to stage productions I think. They could project anything on to any surface, and while it's moving.

[@k.c.sealey3223]

Oh wow! I'm imagining a throbbing dance scene with the dancers wearing coordinating designs to create some crazy display. I'm sure there are more noble uses, but that'd be cool to see

[@TheMaxmust]

This is one of those cool things that none will buy. Like who would buy a shirt and then put up those lights everywhere so they can shine on your shirt wherever you go?

[@marone0324]

it's not for individuals. it will be used for commercial purposes and will be worth billions of dollars.

[@Kapparillo]

This is cool af

[@18MyMind]

I came up with this idea from the influence of Prezi where the same thing you can do on the presentation screen you can light it in for a normal T-shirt

[@TTGxCROTTY]

SCIENCE!

[@75zoran]

mapping on next level

[@angiej.4372]

75zoran

[@georgebaggy]

Can't wait to see how Bangbros implements this

[@ryuhitsuya21]

so harry potter moving pictures on newpapers. what a time to be alive

[@satzcasio]

This could make a pretty sweet invisibility cloak if arranged properly.

[@jfriesne]

Hallelujah, the future of "kick me" sign technology has arrived!

[@NoJusticeNoPeace]

When they start projecting ads onto me is the day I start carrying a baseball bat with me everywhere I go.

[@spiznas]

Just be prepared to have ads dynamically projected onto your bat as well

[@sixdsix5028]

The irony

[@czikkanhardt4750]

Awesome

[@puderrick8634]

So that's it huh? It's some kind of Dynamic projection mapping onto deforming non-rigid surface?

[@scottkronmiller3746]

yup

[@noahpafford4938]

Pu Derrick i think he is mocking will smith in the suicide squad movie when he says, "so thats it huh? We some kinda suicide squad?" But maybe it is a coincidence.

[@BitQuests]

Damn dual wielding those papers.

[@alezad57121]

what be this dark sorcery?

[@mohitthapa7064]

Heyyy, that's pretty good

[@sersoft_corp]

In the future we will have spray paint cans full of OLED pixels that we can spray onto anything to make a display, just like that spray-on camo in Futurama

[@SuperWiiBros08]

The future is here.

[@woabeatz9717]

SuperWiiBros08 not yet ,hover boards

[@donyainman3621]

Projection mapping is like Snapchat on steroids.

[@angiej.4372]

Donya Inman

[@Mofriese]

Not sure how to use this, but certainly interesting.

[@mikeparker8242]

I realise its a real basic use case (its not deforming) but can you make presentation screens use this so when people walk in front of it they don't get blinded

[@Avitaser]

Awesome tech...what's your stock ticker?

[@guop59]

awsome

[@lesabri]

whoa!

[@user-iq5xw2xh4z]

Neat.

[@bigbubba6935]

That sounds cool but impractical my gonna have to buy the damn camera just so my shirt can have the effect. also would it be worth carrying the cam around?

[@boohoomarcus]

In about 100 years this will become call of duty active camo.

[@cylosgarage]

Bruh that's dope as shit

[@evankpop]

Perfeito

[@Luckysquirrel1256]

The FitnessGram Pacer Test is a multistage aerobic capacity test that progressively gets more difficult as it continues. The 20 meter pacer test will begin in 30 seconds. Line up at the start. The running speed starts slowly but gets faster each minute after you hear this signal bodeboop. A sing lap should be completed every time you hear this sound. ding Remember to run in a straight line and run as long as possible. The second time you fail to complete a lap before the sound, your test is over. The test will begin on the word start. On your mark. Get ready!… Start. ding

[@aniksolaris]

sweet

[@jalmir1182]

holy shit, this is the fucking future right there

[@ryansteffer]

That is fucking dope.

[@stcrussman]

Awesome, but interactive clothing design? That sounds like a bad kickstarter. There must be better applications.

[@AnthonyPilcher]

iPaper - The interactive display you can roll up like a newspaper

[@PixelCortex]

That's not how projection mapping works

[@stcrussman]

How would that work with this tech?

[@AnthonyPilcher]

PixelCortex PixelCortex, do you even know what mapped means? Put a sensor on a stylus, and a sensor on the grid and you've just created something interactive. What I think people are confused about is that it wouldn't be practical to have a projector follow your surface around... but they don't have to, I'm guessing they will be on the floors or ceilings in practical settings. As long as they are evenly spaces on a Cartesian grid, they should always be connect somewhere. iPaper was just a joke, but an interactive display on a device that can bend, move, drop, twist and not break is a logical next step in technological evolution.

[@citrusblast4372]

invisibility cloaks maybe?

[@Cookies4Wookiees]

The FUTURE!

[@Axe1524]

Billion dollar tech right here

[@woabeatz9717]

xItzAxe yeah ,which stock will this be under.....chi ching

[@StillPattywack]

Good job University of Tokyo

[@FlyingOverTr0ut]

Now I can finally project video onto my shirt of an illegal immigrant driving an ice cream truck and crashing it into a guy riding a unicycle while juggling three tennis balls. Thanks, Ishikawa Watanabe Laboratory!

[@xxxx85]

WOWOWOWOOWOWOW THIS IS SO COOL AND I WANT IT BUT I DON'T KNOW WHAT I WOULD USE IT FOR WOWWOWOOW

[@MrGoodKill_FR]

HOLY SHIT

[@kamalakrsna]

"taihen kyoomiiga aadiimasu" ! probably aiming @ miniaturizing those projectors till can put in2 cellphone. military use camouflage?

[@OVERTLYCLANDESTINE]

invisibility cloak here we come

[@sheikhsheese9353]

great!! batman's bat-signal is ready!!

[@JetLandis]

Any plans to release this to the public?

[@samw8599]

cool

[@jackporkins41]

I have an outdoor theatre in my garden, sort of. It's just a white sheet and a projector, this would be so nice to use instead of my projector and i wouldn't have to hassle with the sheet so much. It is the most painful part of the procedure to make sure the sheet is taut.

[@Fuchsia_tude]

So instead of projecting rectangularly/trapezoidally on to a nonsmooth surface, you'd rather warp the *image* to conform to the irregularities of the projection surface?

[@jackporkins41]

What? I'd rather not have a wave ripple across the projected image every time there is a breeze.

[@Neccoguy21]

Jack Porkins I'm not sure you understand what's going on in this video... They make it look as though something that isn't on the shirt, is on the shirt. Very different from standard image projection. Imagine your movie if your movie were actually printed onto your outdoor screen. If your screen isn't taught, your image will absolutely ripple and fold with it.

[@jackporkins41]

Brian Parchman I'm talking about the technology, not what it is being used for in this video. If they can use markers to dynamically change the image to conform to the background then it shouldn't be to hard to do the opposite. I can see what's going on in the video. I was just thinking out loud that a smart projector would be nice.

[@Neccoguy21]

Jack Porkins gotcha

[@maxbernstein6608]

Is there someone I can get in touch with to discuss your work further?

[@tilduer]

But can the projection do a fully colored image? Or at least passably colored?

[@Astrogon30]

whoa...

[@MrBlaq]

Shit just got real.

[@GeneralNachos]

Pretty cool but the need for ink makes it a little more eh. This would be good for turning stadium fields and courts into 3D screens.

[@TestSubject2000]

Do you think it would be feasible to project a IR grid and use your dynamic projection mapping technique?

[@angiej.4372]

Big B Boro

[@PrintThatThing]

holy SHIT

[@natebillings147]

is 1000 frames per second necessary? it seems like 60 would be all you'd need plus or minus how many frames for the flexibility component.. I want my shirt.

[@rdecredico]

Silicon Valley .... Moustaches.

[@wallis_sin-yu]

ary potr

[@MrSirBossmanChief]

schoolchildren of the future are gonna have so much fun projecting cockroaches onto their teacher and friends to scare the shite outta them

[@TheMoleski]

Is this the ceramic knives guy?

[@evan51298]

I bet all of you guys are having dirty minds right now of what can go on a projection shirt :3

[@EqualToBen]

Is there some invisible infrared ink going on here or something? The stretching doesn't seem possible to detect with a blank sheet of paper.

[@dneuwir]

Yes, the video notes that an infrared ink grid has been previously printed on each object receiving the projection. It's how the system tracks movement, distance, focus, deformation, etc.

[@7teen238]

we are living in the future

[@ToneBacas]

project the background onto the shirt (more impressive effect on a more complex background)

[@martinmessi192]

i want to put a specific intro on the shirt

[@RogerC12]

Disney? where you at? Imagine Fantasmic with this!

[@SimarpalKalsi]

software magic

[@user-rs6qf2pm5l]

オリンピックが 凄いことになりそう‼

[@whoisjukes]

holy shit

[@Rambroo92]

I wish it had colors

[@brycerichert]

God I love japan!

[@XTZTwinTurbo]

When can I buy this software?