Multitouch with hacked Kinect (HD)

[@marcan42]

VERY cool! That was much faster than I anticipated. Great work, I am always amazed by these multi-touch and computer vision algorithms. They're way over my head :)

[@firemoon]

WooHoo, can't wait to set this up with one of the media center projects out there.

[@Ultimoore]

Amazing job guys, You are helping the Ubuntu community !

[@sacumblousi]

Idea win! I wish I could control my entire computer with Kinect by next year. Technology does grow up fast.

[@denvera1g1]

@RX8dragon there are methods that support regular web cams or can be modified so that regular webcams will support multi touch, cam space from a few years ago comes to mind

[@juicebowl]

the kinect and the following technology based off of Microsoft's work is going to blow up. IExciting advancement in technology coming and there are so many applications for this.

[@SethSandler]

Love it! I'd call it gestural interaction over multi-touch as you're not actually touching anything, but fantastic!

[@cruxphotography]

This is excellent! I think a great improvement on this concept would be to do some head tracking along with this, so that you can align where the user views their fingers in front of a screen and make the touches match up. Currently it's like flying blind, you wouldn't know where you are touching.

[@wasantube]

you guys are amazing!

[@SoPiPz]

Seeing so much of these videos of them hacking or doing other stuff to the kinect rather than just playing it how it suppose to.

[@lngun4311]

@MastaSquidge I was talking about the idea, and he is probably the first person to actually have a working representation.

[@cmwatford]

@Dalun I would say that the potential is there. It'll be a long while before something like that becomes widely available for the general consumer and will most likely be a basement project for years.

[@BamYazi]

@Mikerty391 - No they didn't - if you look at the libfreenect code there is no encryption or obfuscation from the device, the code simply initializes the kinect and grabs the video streams pretty much like a standard webcam!

[@MaximePerret]

Yeah, soon like in Minority Report ! Great job ! Really impressive =)

[@markcocjin]

You need to make the sensor detect when you open and close your fingers similar to a fan to signify if you're holding, clicking something as opposed to moving it around to go over an object. You can go do stuff faster that way. Also, for easier usability, have the Kinect be able to read only the hand gestures instead of arm movements. Subtle gestures save up on energy and people can work with it for longer periods of time.

[@floemuc]

@Kyl3o yes - check tisch.sf.net, get the source from the SVN repo

[@JimmyStrident]

@winvistainfo They already had a PS3 based supercomputer. The 2200 was to expand it. And it was the US airforce btw.

[@kanfor]

The future of mouse!

[@AngeloDau]

wow creativity is the only limits!!! great!!

[@zeldaparty8]

The first thing I thought of when I saw this was Iron Man. I guess we're not too far from having houses like Tony Stark as I once thought. Nice job :)

[@floemuc]

@ELCASTIGADOR99 no, i'm from germany - hector (the guy who wrote the driver) is from spain.

[@persevere67]

@Dalun that would be awesome and yes it is most likely possible, but i have not figured out, but what you say i believe is the future

[@Cadey]

this is soooo cool!

[@Onijin1]

For brand new (probably still hacky) code, this looks like it's working pretty damned well. Implementing some sort of onscreen (dual) pointer might be worthwhile for the added accuracy.

[@trsohmers]

Awesome work! Buying a Kinect soon to do some more hacking!

[@cruxphotography]

@fouini91 The Naturalpoint tracking system is good but still uses a head set vs 100% vision based tracking

[@SebSorano]

Well done sir!

[@TGAW]

I think I just saw John Anderton. But why are the Precogs predicting a torrent of pink flowers?

[@Sneaklemming]

@IMcoil No. The data spontaneously creates itself on the PC from the kinect. It's like magic but more sci-fi

[@ReneIsSoCool101Yes]

@Ghazkul666 Dude thank you for trying to explain this to people out there! Microsoft isn't even forcing 360 users to buy the Kinect but so many people complain about the price for stupid reasons. Yes it IS a little pricey, but its not like you HAVE to buy it......just ignorant people out there...

[@floemuc]

@Inversions51 hmm, you'd also need a projection screen and the kinect wouldn't be able to see through that...

[@floemuc]

In theory, yes. But indivdual fingers are very close to the Kinect's resolution limit, so it won't be very reliable.

[@ChristopherHorton]

Looks awesome! Let me know as soon as I can do mouseclicks, move windows, and maybe even type somehow using this.

[@koobbbiiii]

looks like "Minor Report" is closer than ever...

[@dudemanjac]

Good job guy!

[@RX8dragon]

@herculese1 Requires the Kenict camera, a simple webcam will not do.

[@thesir27]

u should have had schubert's unfinished symphony playing over this too

[@ajsm83]

hmmm....last i checked you could do the exact same thing with the move on the xmv with photos ,music and the videos

[@rebelkide]

This is future

[@carmatic]

nicely done it looks like at some points in the video you had trouble holding the pictures, how easy is it to tweak it to be easier to use?

[@robvh2]

I think it's helpful to superimpose a ghost image of the person on top of the screen image so that the user can orient themselves and essentially control this set of virtual arms. I have another method that would be brilliant but I'm considering getting a patent. Or I might cave...

[@ViggyNash]

@AndreyGolub My opinion, the best part of the movie. Although the movie as a whole was amazing too.

[@mantid83]

Awesome!

[@Syrinx69]

@koobbbiiii In a way this is more advanced than the system in Minority Report. They had to use input gloves :)

[@abottoir]

this is extremely impressive. I would like to know more about how you did this.

[@ryanspooner092]

@rvng169 He hasn't "hacked" Kinect. As far as I know, no modification of the Kinect sensor is required.

[@kar-unboxed]

@razorhanny i agree!!

[@SGTHartsock]

this is AMAZING, and it SHOULD have had the ability to do this. think you can make a video as to how?

[@kevoo224]

SO! if you paired this with a 3D tv...what would you get?

[@longislandicetea1983]

Awesome!!!

[@shgshgshgshg]

hold crap You. Are. A. Jedi. !!!

[@RX8dragon]

Looks Minority Report style interface systems are well on their way.

[@sink257]

@Mikerty391 Or can they? Have you considered Linux?

[@Sweep7000]

This video has made me more interested in Kinect than any of the official Junk Microsoft is pumping out :/

[@eredy]

you can use the virtual key board to

[@DanielRemains]

Ubuntu FTW.

[@aznfamous]

How are you signaling the selection of an object? Are you clenching your fist for it to recognize? I'd hate to scratch my head and everything go flying out of the work area.

[@dinocro111]

When you perfect it will we be able to play games with it?

[@TheZarion007]

does this have the ability to sense the depth of your finger press or pen press? Like in a graphics tablet that senses thousands of degrees of pressure?

[@ATLphotographer]

LKB kind of lets you use surfaces in such a manner.

[@Ma77riK]

@HBlakeH cuz its free and pretty customizable if you know what your doing

[@gamersafterglow]

@Ghazkul666 I agree but the 200% added to the fabrication price is just overkill

[@dougiep123]

i NEED to invest in a kinect JUST so i can use my computer like this , at themoment im using 2 a 2 mouse setup on ubuntu with 2 cursors , one cursor for each hand .... SO not as efficient as this , this is exactly hat iv been looking for , if someone else has done it , atleast i know its doable thanks man (Y) keep up the good work (Y)

[@samn100]

UBUNTU FTW

[@treedemax]

ok, it's only up to precogs now.

[@Dalun]

Hey is it possible to use kinect to replace the mouse and act like a touchscreen but without touching the computer? Instead of just moving pictures around, could you be able to open files, play games and work with your computer just by using kinect?

[@jimijackson]

awesome

[@sthazeb]

@Ghazkul666 Actually Microsoft didn't invent or research this, they expanded upon technology purchased from PrimeSense (an israeli military technology firm). PrimeSense is in fact, as we speak developing their own "Kinect" for PC use, in collaboration with Asus (i believe). But sure, it probably cost them a pretty penny (considering the kinect was meant for military application to start with - but hey, so was the internet... right?)

[@F.r.e.a.k.e.n.s.t.e.i.n]

@QUINTIX256 its on an open source driver

[@floemuc]

@creubend close, but not quite - my living room, in fact :-)

[@cibiri313]

The future is now.

[@smacky420]

how long till you release a program for the rest of us ubuntu users with kinects

[@HBlakeH]

why does it seem like only hackers use ubuntu?

[@gitorla13]

Whats hacked? I only see an alien with red crosses at his hands, makig weird moves, while pictures ont he screen move O_O?

[@Fouine91]

@cruxphotography Naturalpoint already made a head tracking system with TrackIR ;)

[@Ma77riK]

kinect is going to run native on windows soon anyways right? any idea if it will support multitouch?

[@cumanzor]

This the motherfucking future.

[@nanakeyks]

This is very cool. now I can control smplayer from my bed using this I'm guessing?

[@SethSandler]

@D4RKFiB3R Sure :D I'm down with that ;)

[@sthazeb]

@okton6 eeeh - nope - u could do this in windows too :)

[@abhishk]

This might be a stupid question, but do you do you actually connect the kinect cameras to your computer?

[@cattouf]

Pffff no one is giving props to Heavy Rain D:

[@nnaaaaaa]

link is broken by the way, has extra token '(' appended to it

[@ImTheBhattman]

MIT?

[@creepinshadow247]

this is the direction microsoft probably is planning to go to with this technology anyways

[@qwantime]

@ELCASTIGADOR99 why he is from spain?)

[@Mycha31]

@veyronman What's the point then?

[@korllark1]

Now all they need to do is invent a hologram projecting device. :-)

[@jimmysgameclips]

This will be way cheaper than a microsoft surface table :D

[@ClubbersNL]

1:02 Saturday Night Fever

[@tgcephalopoid]

Heh, and I thought the wiimote hack was good. Now to find a secondhand kinect on the cheap...

[@satya.bodapati]

He is using UBUNTU... WOW! I thought these kinda hacks are easy to program on windows..

[@3Dollars50Cents]

gentlmen! you can now,,, HALO

[@MathieuBosi]

cool!

[@plokko1]

@rvng169 microsoft is already making you pay a LOT of money for that piece of hardware,after you buy it it's yours,you can use it like micrsoft says or you can trash it or hack it. It's like if you buy a car but the car company doesen't allow you to repaint it with a different color because they don't like that color.

[@denvera1g1]

@RX8dragon good job by the way

[@Thet3]

yes!!!!

[@koobiss]

We have own solution for Gesture Recognition Interface with Stereo Camera. We don't use prime sense solution as laser sensor. Our New solution doesn't have Calibration step and Skeleton that mean it is easy to apply any general purpose usage. Get in my place!!

[@TheRealFrostie]

@Ghazkul666 Every video game console sells at a loss because the company makes their money back through selling the games. That they sold kinect at a profit shows complete lack of faith in kinect games selling well.

[@kris9670]

Ubuntu?