Pointing to the future of UI | John Underkoffler

www.ted.com Minority Report science adviser and inventor John Underkoffler demos g-speak -- the real-life version of the film's eye-popping, tai chi-meets-cyberspace computer interface. Is this how tomorrow's computers will be controlled?
TEDTalks is a daily video podcast of the best talks and performances from the TED Conference, where the world's leading thinkers and doers give the talk of their lives in 18 minutes. TED stands for Technology, Entertainment, Design, and TEDTalks cover these topics as well as science, business, development and the arts. Closed captions and translated subtitles in a variety of languages are now available on TED.com, at www.ted.com/translate.
Follow us on Twitter
tednews

Checkout our Facebook page for TED exclusives
TED

[@yasirsaheed]

6 years, I haven't got it yet

[@Ouroboross22]

+YASIR SAHEED Maan... All liers ! :P

[@etcherr871]

9 years and nothing?

[@kinngrimm]

so its now 5 years later, where do i get it?

[@WisamAlRawi]

Impressive work ! I can see the medical applications, design ...etc for navigating into 3D medical scans, building with ergonomics in mind.

[@ShinkaTV]

huzzah. Not only is it cool, and innovative, but think of the shoulder muscles that nerds of the future will have! Great stuff

[@jdunk2145]

Fascinating!

[@Simon_The_Human]

Mr. Underkoffler and his company needs to get on making this work with the Kinct and/or Leap motion controllers.

[@adam.phelps]

Fantastic.

[@LanteanKnight]

I need that! It's amazing!

[@RollsRoyceFanatics]

Love the way the whole development by Xerox - Research at Palo Alto of the first GUI, TCP/IP and Object Orientated Languages was not mentioned and the subsequent underlying code being given to Steve Jobs. Funny how time changes history

[@jameswalker199]

Its a shame we didn't get exactly this, I could see there being a use for organising large walls of files to pick out a pattern that may not be as evident otherwise, for example. For better or for worse, we now have user interfaces that require learning a large number of gestures (looking at you, iPadOS)

[@davidkongart3373]

Some of the things are here. Hand tracking on VR headsets, Leap Motion, it's just not as commonplace as it should be. Why are we still using those damn TV remotes?

[@thegiantpigeon]

does no one else find this fascinating? it shows how far technology has come forward. I love it.

[@felipealmeida5880]

Couple this with the Oculus Rift and think of the possibilities.

[@crokobos]

Now you can be tired in vr!

[@2bsirius]

Eerie and wonderful

[@915davidg]

It's cool because I've seen this before. Just a few days ago the people who are working on this went to my school and demoed it for us.

[@jahrleriksen]

Good for these researchers, I find these new interfaces very impressive and I'll be excited when they come to market at a reasonable price...many, many ways to benefit from these technologies when you sit down and think about it!

[@tdreamgmail]

On a more serious note, the entry poing of these kind of systems are already on the market. The wii remote is doing some amazing things. The ps3 hand controller could be moulded into a glove and the xbox does away with all peripherals and only uses your body movements as input.

[@pjpinc123]

This is amazing

[@lilperv]

great last message

[@47f0]

The future of UI? "Okay, Google..."

[@SIGNIFYING_NOTHING]

The Minority Report system is awesome, as people complain these days that computing is restricted to a single space, this system allows us to operate ANY WAY WE WANT. I can cook when Im computing, I can compute when I'm taking a shower, and I dont have to press any buttons!

[@drorjs]

pretty neat stuff.

[@Silhouette93]

Brilliant talker

[@neonboy22]

For Symbolics machine - OS called Genera - exactly agrees with this. The OS is the interface

[@holdmybeer]

remixing will be amazing!

[@JustJobeMY]

This interface, or a similar variant for the Motion Leap would be excellent! I hope they are already on the drawing board! :)

[@zelvadrian]

Google Translate: On these interfaces have already talked about 10 years ago, and even, as we remember, in the "first" movie about it (Lawnmower Man) all it was. Then there was still a lot of films - Minority Report, where it is a (!) Interface, and hundreds of others. But, IMHO, these gloves and such an interface at all - will never popular and never will replace the existing, familiar. For, because waving lot harder than moving a finger

[@ChristaLovesDrama]

Progress made, with the dued improvement in the future. We were waiting for something like this, right people? So lets root this on!

[@praveen25]

Year 2014. Waiting for year 2015 when this is going to be made available commercially, and something tells me I am going to be disappointed.

[@joaodecarvalho7012]

Indeed.

[@themindminder]

This technology replaces the mouse and keypad, but the user is still waving their arms around while looking at a monitor. Touch screens and 3D holograms are far more natural and interactive. I will make a note in my diary to watch this video again in 5 years.

[@InnerCityMuscle]

I agree with "unsteac", but imagine if this becomes mainstream. Can you imagine the potential this would have in the education field. How much more exciting and powerful learning will become.

[@clothearednincompoop]

@VitriolicAC Wasn't the mouse and the graphical UI developed in Xerox's Palo Alto research center way before the introduction of the Macintosh?

[@rootless69]

look up leap motion, he was so right when he said "in 5 years". revolutionary stuff

[@bodie8]

@zoneykid He was referring to the earlier System operating systems in the eighties.

[@poopynonsense]

i wish they had more close-ups of his hand gestures

[@caseygtr]

@billyshake I know, just in my short life of 20 years the world has left so much behind. It boggles my mind when I take a look at the many technologies that have taken shape just in the last decade. So exciting, good thing I'm majoring in computer science :D

[@Dargakis]

@HowTosandTips why u still use windoze then?

[@ross817]

Anyone got a link to the minority report hand gestures?

[@inurb4se]

I think most people understand that, I mean they at least are interested enough to watch TED talks in the first place, I don't really hear too many people saying it isn't worth researching, rather I hear people mention that for long term use it could perhaps be impractical for say "office" work. I'm still waiting for the UI where I can control a computer by plugging a cord into my skull.

[@DanDelos]

I think the big issue will be for software design to embrace the technology. If the hardware for a '3D interface' adds, say, $300 to a computer's cost but only a few applications or games can take advantage of it, those systems won't sell and consequently, new programs will not be designed for that technology. There is a big gap between being a novelty with a few obscure uses and becoming a universal standard for personal computers. But I hope it does become mainstream in the near future.

[@john_go]

9 years, I haven't got it yet

[@dustmouse]

@TacticusPrime Haha! But that's probably the best way to get it to really take off.

[@webgpu]

3:10 iBoys always ready to clap at any announcement of feats

[@KevinShockey]

My daughter was just asking me if these types of interfaces were "real." Well, I've seen the future, so now I can confidently say, yes Ana, they are real. In fact, this how we'll all be eventually interact with the ubiquitous computing that will surround us. A fascinating look at the future of user interface that every parent should watch.

[@jaccubin]

@renesis317 Right, cause there's no issue at all with accidentally turning on your stove and unlocking your doors. What kind of interface does your fridge have? I pretty much just open and close it.

[@os3ujziC]

Looks cool, but seems to be less efficient than mouse and keyboard.

[@swinewarrior]

Amassing hope i see it

[@BootcampfxNet]

WOW!

[@Reubenintexas]

2013 checking in here....he's got 2 more years and this stuff is in our mobile phones....

[@kinsmed]

Are you kidding me? The future of computers, and for nearly a minute, the video editor is fixated on the goddamned POWER POINT! I love TEDtalks- I am a daily subscriber. But I suspect one of the reasons it is not yet mainstream is that the editors (or real-time directors) haven't a friggin' clue or care about what they're doing! TED is amazing. It needs video coverage (and by extension, proponency and archiving) that conveys its impact. Bottom line? When in doubt, go to the wide shot. Please.

[@gamesmaster35v2]

Oh man this will be great!Sorry if I'm simply impressed those with more experienced in these kinds of things might not be.But I haven't seen that many people actually trying to innovate and make those ideas thought science fiction reality.It's nice to know that drive has survived.I think he's optimistic with the time frame though.I expected by now that computers would come standard with your house but...

[@novantha1]

Though to be absolutely fair, it would be a pretty damned fun thirty minutes.

[@clothearednincompoop]

@VitriolicAC Well, I think the story goes that Xerox's research job was introduced to Steve Jobs who saw that it will be the future (unlike the decision makers at Xerox). So Xerox didn't ever actually sell any computers and Apple may have been the first to actually sell a computer with a graphical UI. Just like they didn't invent the mobile phone or touch UI but are now doing very well with the iPhone(s).

[@KevinShockey]

@lanmancz - Yeah that seems so much crazier then pushing a little hunk of plastic around your desk and clicking on it.

[@pjedinn]

I can see how this might be used (army, NASA, teaching in schools, city planning, future of Warhammer, gaming arcades) but I don't think that this is the future of the personal computer.

[@hughtub]

@jathgnos Why sit? There's a growing trend to standing while using a computer, and it's healthier. This goes in line with the trend to a healthier minimalist future. A few hand motions means less exercise you have to do later. The key is that the hand movements will be more productive than even the small hand movements of using a mouse right now.

[@pkerry12]

@zoneykid he is talking about the overlay was build from scratch its core is unix yes but the rest of it is not.

[@kokofan50]

@whatnameisavailablee yes it is. its the way we talk to the computer as in the computer getting data not just information it knows nothing to do with

[@youtubing27]

Awesome :0

[@DaryoushNekooi]

well i was blown away with the "sixth sense" unit featured on TED earlier in the year (or late last year). But, this! I think the ultimate goal would be for the 2 technologies to coencide and create a truely "organic" fusion. Lets face it, we want gestures not hardware to control what we do. I remember 5 years ago, Virtual Reality seemed like only fantasy within a room specifically built, costing a lot to do the very basics. Now, we are looking at VR in every home! We should congratulate scienc

[@PrasadJachak]

It will really requires different OS design and hardware compared to we use now...Its also can change programming software and websites.

[@Truthiness231]

I watched this yesterday and have had some time to think about it... maybe in certain applications (like at stores, museums, theme parks) this technology will be useful, but if it comes down to me having to choose between walking over to various shelves to grab containers instead of using my mouse and clicking on a folder ("virtually" the same thing (pun intended ^.^)), then I'm opting for the mouse...

[@MarkOates2]

The first killer app? Probably a music player, e.g. flip through your record collection, sort by artist, style, etc.

[@2Critical4You]

I think that this could be used by 3D-artists, gamers, Graphics artists and many more. I don't believe that this technology will be something that "anyone" can buy within 5years but I can see why this would get popular when it does come out on the public market.

[@ExclusiveManual]

this would probably revolutionize construction.

[@suchAnoob]

@untseac did you watch 'til the end? he said they're working towards getting rid of the gloves

[@zelvadrian]

The irony is that I've been working on TONS of not only new applications that would demand this interface and even MORE elaborate body gear and 3D minded devices, but even steering elements in the software industry that the very DENOMINATOR of information handling and OS interaction would make a 2D monitor with a mouse/keyboard, not only counter-productive but IMPOSSIBLE! Even with all that being said, *I* myself even feel that it'll STILL take a few DECADES for this UI to be mainstream!!

[@tekhiun]

this is really interesting , but is it more efficient to work like that or to work with a mouse and keyboard , or even a touch screen ? workflow efficiency is something that it should always be considered

[@mikewachowski]

commercial computers that perceive the real world? yes please!!

[@otivaeey]

I think Chris has asked a very important question, indeed, "When?" We want it on our computers, not in TED.

[@danno1111]

If only we were all urban planners that needed to play around with shadows of structures, or doing whatever work needs to flip photographs around all day, or generally doing work without requiring the simple precision and ease of a wireless mouse.

[@ryanehrler]

kinect didn't come out till november 2010 .. this was uploaded in june 2010

[@Zoza15]

This is fucking awesome!..

[@Suertsje]

5 years!!!

[@indertat93]

Nope

[@alecrisser12]

If we knew every detail of the universe so far, everything down to the decimals, we could mathematically enter the data in an INSANELY powerful computer, like something requiring the fusion of a medium sized star or more, we could precisely calculate the future, know if it will end or not, and know when the earth will be uninhabitable for animals like us, and life as we know it.

[@brianchin2227]

Heisenberg would like to have a word with you.

[@bighands69]

Brian Chin Heisenberg does not prove that this cannot happen it only shows us as present how unpredictable our universe actually is.

[@sergeiromanoff]

How many transistors (or some other information holding units) do you need to store the position of every atom in the universe? There just won't be enough material to build your computer.

[@DafranchYze]

I think it will be more of an extension than a replacement

[@1337pianoman]

well coming to the end of 2014, and it doesn't look like there is much hope of this vision being here by next year. However, significant progress has been made. Everyone has heard of Microsoft Kinect, which for some reason people weren't really interested in with the Xbox One. But that enables proper 3D interaction. Leap Motion does the same sort of thing, and was actually built in to a bunch of laptops. So we're part of the way there. People just don't care enough about this sort of thing yet it would seem. All it will take is one killer app though ...

[@memeboooiiii]

i thought the first things where already impressive!! xD godda luv technology

[@prashantkv]

30 months Mr. Underkoffler, you've got 30 months

[@fauxman]

I WANT ONE!

[@OBI0131]

@CarbonatedCube I think it was similar when they first came out with a mouse and a light pen in the 60s.. it took decades for these UI to become useful. I agree with you that this UI won't be of any use except for a toy, let alone entering the market in 5 years. It is interesting to see something new in action though.

[@RandyBful1]

@jathgnos: I have an ocz neural impulse actuator that works on those principles. It's also way cool. I can make alpha, beta and theta graphs rise and lower, just by thinking about it.

[@Fisherdec]

these types of technologies take years to become practical. give it time and and the mouse and keyboard will look like antiques eventually.

[@suchAnoob]

@untseac the power glove was advertised as a gaming accessory, and the technology featured in the video is designed to be another way of manipulating a computer's UI. It's also soon to be glove-less, so it's pointless comparing it to the power glove. I don't see it being used by every person, but schools, businesses, and the military could definitely benefit from it. Just 'cause the 'average joe' won't use it doesn't mean it's going to fail.

[@7paco730]

12:20 "Great art is always a gift" - annoyingly John doesn't reference the quote - anyone know who said this?

[@mrphowarth]

now that is the kind of imagination we need, if you can imagine it, it can happen.

[@thetruespin]

SO wait... what I could previously do with a mouse sitting down I can now do standing up wearing gloves. Great!

[@AlanDavisNeptunius]

Leap Motion will let you have this system, all in one tiny box on your desk for $70, next year. The future in within reach.

[@skndn60]

@zoneykid It was written from the ground up / started from nothing. He's referring to the old Mac operating system, written in the 80's. Not the current version which is OS X and is indeed built on top of a Unix flavour. Check out Andy Herzfeld website Folklore for some great stories on the development process of the original Mac operating system.

[@inurb4se]

I like the concept and I think it will be very useful for large data centers and places that he mentioned, however practical every day use might be a harder sell. Say you work at a job where you use a computer 8 hours a day, you wouldn't wanna be moving around like an orchestra conductor that entire time, it would be a workout. I'm not talking shit, I love the idea and I can totally see it use. I'd just rather use a mouse and keyboard instead for extended periods.

[@urehlav]

@lanmancz imagine ur case linked up to a projector and a wall in ur house as your interface... i could certainly imagine myself sitting on the couch tossing documents around the wall....theres nothing more useful than having multiple images infront of you to see the whole picture. imagine creating mind maps on your wall, with such space comes more visible detail

[@jinmane3361]

To those of you saying that you'd rather use a mouse and keyboard for use with office software, I don't think this technology is intended to replace conventional input devices for all applications.

[@DruidEsme]

I love his Strawberry Notepad. LOL

[@minieggg1]

@sesoma0 well considering a huge number of people are already using a system very similar to this in the form of the Nintendo wii 5 years may well be possible.

[@godbennett]

every action generates a reaction. A gesture based system though intrusive, will indubitably engender calorie consumption. Need I say more?

[@crixxxxxxxxx]

Why would I continue using slight movements of the hand with a mouse when I could flail my arms around like an idiot to control my computer like some character from a movie?

[@Anticleric]

Slightly better than the Nintendo Power Glove.... but only slightly.

[@zelvadrian]

Yeah, dude, I know! I completely rejected that when I first saw this video! I thought that a guy this smart was SO wrong because he is entrenched in a mindset that THIS is the future, and all of his premises that he used in this presentation, I feel to be 100% TRUE. The problem is that the interface will NOT replace the mouse/keyboard until they become 100% UNBEARABLE, meaning that ALL programs would have to *demand* this interface, as opposed to just being a cool toy.

[@1schwererziehbar1]

the macintosh was the greatest invention of the 20th century. but this is the greatest invention of the 21th century.

[@RedHorseRainbows]

@zoneykid Uh.. he was talking about the original Macintosh home computers, and the old (pre-OS X) versions of Apple's OS. Apple didn't switch to a Unix-based OS until the advent of OS X. All the previous versions, are, as he says, based solely on Apple code. Considering the Macintosh home computer came out in 1984 and OS X was released in 2001, his claim is correct...

[@forlornreaper6389]

HOW, has this video gotten ONLY360k views??!?