Google DeepMind AI Does Parkour - Producing flexible behaviours in simulated environments

[@forestpepper3621]

This might be why the simulated person runs around waving its arms over its head. In the simulations, DeepMind was probably given unlimited energy to expend to get the person to its destination. The simulated person was probably not programmed to experience fatigue, as would a real person. When we walk or run, we keep our arms down by our sides, because we would quickly get tired if we kept holding them up. However, it may be that holding the arms up in the air actually does provide better balance, which is why DeepMind settled on this motion. If you think about it, when we try to walk over a tricky surface, or along a narrow platform, we naturally raise our arms up in the air to help balance.

[@jasonalen7459]

SHYENSE

[@humanmusic4929]

I see you watch rick and morty as well.

[@sharp14x]

No, because he's actually smart, not a pseudo-intellectual. That's not a relevant comment.

[@SpinachDaily]

SharpOB Twas a joke.

[@sharp14x]

Not a very good one.

[@savannah8192]

2:50 Dabbing on those obstacles

[@turingsghost]

I like that it assumes fist-pumping as a viable form of locomotion.

[@deBurrows]

I need more of this. Could spend hours watching this, it's hilarious.

[@RaveScratch]

In all seriousness, the way it uses its arms for balance, to increase it's rotation at times such as 1:36, and increase its linear velocity, such as at time 2:00, is fucking amazing. Google is putting in work.

[@markward4738]

Rave Scratch Not Google, but a deep learning progress itself.

[@sukmadek8626]

Watch me whip, now watch me nae nae...

[@crunchybro123]

But let’s remember it’s also cheering itself on constantly

[@amegatron07]

True, but it still looks incredibly funny and silly )))

[@FateJHedgehog]

I like how enthusiastic its humanoid agents are. Look at that arm pump.

[@smoothordinator9529]

Imagine a game where all NPCs are run by this AI.

[@hxzee3679]

That would be sweet

[@bibanan02]

TABS.

[@boyarvalishin9565]

SmoothOrdinator playthrough 1: LOL I beat the game in 30 minutes! playthrough 150: HELP! THE NPC’S HAVE TAKEN OVER MY COMPUTER HELPDBCSSJJBCSA

[@crunchybro123]

SmoothOrdinator we’d be dead

[@silvertakana3932]

Running at full speed while spinning their arm in the air like crazy, charging at you? Yea that’s scary!

[@jeromew21]

1:44 is crippling depression

[@imthelovestamp]

Can you imagine if the terminator ran at you like that

[@JustWatchingVideo56]

I'd like to see an actual person actually perform these moves.

[@Dashman100]

That is actual reality. We r in the underdeveloped simulation. So soon we will scan and upload our brain to Quantum computer using Quatum scanner. Then you see the real person, friends, world and the Path to reach the God. You become immortal. But also You can simulate 1 second equals to 1 terra trillion years!!!!

[@PINGPONGROCKSBRAH]

1:28 Pumping my arm like this is the most efficient way to run

[@Kya10]

You killed me xDD

[@jasonalen7459]

It's also the most efficient way to weird people out

[@namelastname4077]

he overdid it though

[@globin3477]

If that were true, we would do it. As is discussed elsewhere in the comment section, this AI probably never feels exhaustion.

[@PabloEmanuel96]

Hahahahaha I'm cackling

[@jeromew21]

One day the Al will read these comments making fun of its approach then it decides to end humanity

[@Choinkus]

That's what it gets for repeatedly dabbing without alternating direction. We deserve to be destroyed

[@toasterusedfly]

i just noticed this comment was copy and pasted from another video

[@Yetipfote]

I think the AI will, after reading all those mean comments, boohoo in the hot shower for two hours.... Maybe THEN it decides to end humanity

[@Dashman100]

Yes. So I will buy Neuralink and become one of them to end this fucking weak biology brian humans!!!

[@jeromew21]

@@toasterusedfly no it wasnt

[@neur0n1x]

1:35 when u are drunk and trying escape from police

[@MeAndCola]

... and getting tasered at the end

[@dentatusdentatus1592]

Looks like a senior citizen trying to make it to the bathroom.

[@facelessman9224]

"Termination!"

[@rosmarinux5742]

ahahauhhuahuahua omg same

[@Rouxgarou96]

When you accidentally open the door to special ed and one of the tards escapes

[@UCfvFxl5fVfTuA9DH353dJzQ]

3:18 Ninja running

[@facelessman9224]

It looks like he is being chased by Slender man

[@2gaspoo237]

LMAO

[@LermaBean]

Иван Иванов *Naruto Shippuden OP plays in the background*

[@andreyformozov9227]

Jack Sparrow running xD

[@Dream-oi3nt]

Nyoom

[@beetemup1642]

I love how, after dying on the Wall Slalom, the human clutches its throat and extends its other arm upwards as if it’s drowning.

[@CarlosPacheco]

this is so satisfying to watch...

[@lukatesseract]

I love how he's moving his arms as if he's telling the walls to get out of the way at 1:36

[@GuilhermeSantos-xq6qq]

qwop is now 3d and has a lot of new characters, that's realy cool

[@LeoTM]

1:28 mankind's poudest achievement... The streaker bot.

[@OceanMan_Nico]

Thats propably the most excited stickman I've ever seen.

[@StefanTabit]

1:28 When her parents aren't home

[@JerichoUno]

Stefan Tabit *FALLS OVER*

[@Kya10]

8)

[@WhoForgot2Flush]

Nice.

[@Sirenynx]

3:18 When you're a Titan but the walls are already broken.

[@Fx_Explains]

FeildMarshall Wolf attacks on titan

[@Alice3456able]

Omg so true 😂

[@tatusaalasti2150]

1:28 Me every saturday

[@alexjgilpin]

This research funded by the ministry of funny walks.

[@egnato1165]

*does his best* T E R M I N A T I O N *dies from depression*

[@jeromew21]

1:49 fighting a imaginary monster when drunk

[@remusomega]

THIS IS HOW YOU S'PPOSED TO WALK, ITSWHAT I BEEN SAYINNN!!

[@terenx5]

1:40 The Wall poisoned him

[@jasonalen7459]

The walls are lava

[@Noname-om3pp]

The walls are coated in dart frog poison.

[@__173__]

2:45 MOVE OUT OF MY WAY! I GOTTA POOP

[@Yetipfote]

2:00 I see the air guitar memes coming

[@lifescience2050]

this is the next Mars rover should be.

[@Brainbuster]

Needs to be footsteps sounds with this.

[@mysticalyeet1800]

When monday hits u like 1:42

[@Kavukamari]

honestly the arm movement makes it look like they're havin a great time, good for them

[@crunchybro123]

*Humanoid has learned to cheer itself on! Level up!*

[@tatwo_]

Is that headcrab? HL3 confirmed!

[@abuzzedwhaler7949]

My man is hitting that dab every three steps.

[@bellsnowgrehg3501]

How long until someone puts that "deja Vu" song to this?

[@LermaBean]

bellsnow grehg You mean Eurobeat?

[@morganwilliams5591]

I know that this is extremely fascinating from a scientific perspective and that the AI is making very complex decisions to navigate these obstacle courses but honestly the humanoid's frantic arm-flailing running motions made me skip over laughing and go straight to crying and wheezing I cannot remember the last time I watched something so indescribably funny

[@P_Fighter893]

This is the ideal running form. You may not like it but this is what peak performance looks like.

[@fiore4379]

In 1:59 he's sorta just an angry chicken running from a farmer.

[@SayaAensland]

1:42-1:45 is me when I encounter the slightest inconvenience in my life.

[@TheOwlMan8850]

You should show a video of exactly what the bot sees

[@cindyespindola4946]

Yeah that would be cool

[@zackOOO-nz9rh]

they way it describes what the models are feels like a futuristic pet commercial describing the different animals they made, especially on the 4 legged one

[@josephd.4615]

Make him fragile, to see how he overcomes that.

[@mutatedburger4836]

0:13 The Agent Agent smith? O shit The Machines are going to kill us for this.

[@c0unterph0bia]

I'm going to have nightmares that robots are chasing me like this.

[@Tman_Hall]

Even the AI throws its arms out as if in victory towards the end. Perhaps it is a universal symbol of pride.

[@ZandarKoad]

I'm going to run like this from now on. AI has taught me so much.

[@easternwind4435]

I wonder if, when it uses a strategy to overcome an obsticle and it works, it just starts improving the strategy or still trys different ones, to see if they work better.

[@HiperTrax]

The Last European There's only improvement until the strategy fulfils the reward criteria, in this example the reward was simply to keep forward, that's why the humanoid was terminated when in fell back but not when its was just standing there

[@AB-ew3fd]

If it uses Q-learning, which it probably does, then it focuses on the strategy that's been working best, but still try out other strategies from time to time. It's called the exploration vs exploitation dilemma.

[@БорисЕвтимов-м1у]

1:43 when you have no battery left...

[@tahakaleem1783]

2:05 oppa gangnam style!

[@roningehring406]

A great idea for a game is setting up these kinds of ai but they are rewarded for how much damage they do to the person in general. Maybe this would make the perfect shooter game ai or an ai that is great at hand to hand combat

[@period5304]

we need to take serious measures before AI gets out of control and actually start producing robots IRL or else it will be our turn to learn Parkour... Eventually that would be a amazing sight...

[@AdriceMC]

Trow them water on their body !

[@dudearlo]

I am so gonna play with this"genetic algorithm based locomotion" concept when I get done with my current project :)

[@sir_duckington1245]

1:53 dance moves to impress a gurl

[@hungrypikachu135]

Watching the video: oh cool that's interesting! Watching the video clips along with the comments: hYSTERICAL LAUGHTER

[@jasonalen7459]

This entire video (at least the part with the humanoid) is me when i'm making a music video with parkour and dancing in it

[@Silver-Rexy]

Dude, great sound editing.

[@frankmaka2763]

this guy has an amazing core, what an athlete

[@itisALWAYSR.A.]

when your supervisor says you can finish early today if you want

[@Kabitu1]

1:53 He's just so excited to be jumping over gaps, he's like "weee, life is amazing, weee, gaps are the shit, weeeFuck!"

[@forestpepper3621]

It's possible this was one reason that Google recently sold the robotics company "Boston Dynamics", which it had acquired only 2 or 3 years previously. This shows the potential of Google's "Deep Mind" AI algorithm. In just a few hours of simulation, Deep Mind was able to achieve (and perhaps surpass) the walking ability that took years of research and testing for Boston Dynamics to reach. If you simply plug Deep Mind into an actual robot with legs, it would no doubt be able to get the physical robot to walk just like the simulated person; the training process would take longer, of course.

[@xpirate16]

I really wanted that last run to have some 3 stooges "woops" and "nyucks" lol

[@HowlingWolf518]

First chess, then Jeopardy, now Wipeout. We're screwed.

[@supplechap5429]

Most peoples parkour idols are David Bell, Damien Walters or Pasha Petkuns. Not me. Those right there are examples of what a peak parkourist should look like in my opinion.

[@DizzyDJW]

1:36... I nearly died of laughter. I had to remember how to breathe...

[@markzaikov456]

I wanna see someone doing that human running part, that was so hilarious

[@moosha1]

1:35 When you turn off the lights to go to sleep and try to find your way back to your bed

[@That3th3]

This is cool and I know this isn't exactly what the test is about but it would be nice to add more parameters like vision and head movement to see where it is going, as well as teaching it with actual people so it can learn how to run and balance and climb and pick itself up. It would be cool to see how it learns from that. Like would it be better or would it revert to how we see it here

[@ddnava96]

3:04 That victory pose!!

[@dailymail]

Hi there, we would like to use your video in an article on DailyMail.com. Please get in touch. Paul.

[@BryceHunter]

Daily Mail Hey Paul! Please refer to arxiv.org/abs/1707.02286 for legal. As for embedding this video, I'm sure that would be fine!

[@SyberianLynx]

Best viewed with Bill Conti - Gonna Fly Now from Rocky movies

[@Ponlets]

can we get this as a silly type of game where we can make our own course and robot to negotiate

[@squarerooto1771]

3:18 when you realize you forgot something in another room

[@Dron008]

Уже можно посылать за пивом бегать.

[@1JackTorS]

The only thing I could think of when I saw the guy running at 01:28 was "Mai-ia-hii! mai-ia-huu! mai-ia-haa! mai-ia-ha ha!!!"

[@potaterjim]

You know what would be fun? If google ran a perpetual simulation and streamed it, with random levels. You could hop in and see it's progress and the bizarre locmotion forms it discovers over a week or three

[@gukonni]

1:53... listening to Stayin' Alive.

[@michaelmilburn3094]

I wonder why so many solutions involve the arms being held outstretched and in very odd angles?

[@sciebrotech6618]

Hi, what part of DeepMind AI used for this? Is open source part?

[@stephaniejoobern1001]

Actual footage of me in gym class.

[@alexwales8914]

2:00 Gotta push the air out of the way

[@dosvedonyaimsonya4471]

This is what running in your dreams feels like

[@AustinArtypants]

This video needs an 80s training montage theme song.

[@gwbublitz]

when the humanoid model was on the jumping coarse, it looked like he was playing a guitar XD

[@gddub]

when you wait til the last 24 hours to start your term paper

[@someedgysnipermain5318]

1:40 - I hate when the wall gives you a heart attack.

[@sameasnow]

deeply troubling

[@enightc]

The day of Judgement is not long now, where is John Connor?

[@MP-gd4lq]

we are fucked up

[@sqworm5397]

That humanoid looks like me when I have to go to the nearest restroom

[@xl000]

RIP Matt Hoss Zone... He's been replaced by a machine.

[@MichaelSartore]

if one holds their arms like that when they run will it mathematically improve their balance and chances of success? Asking for a friend.

[@TimSlee1]

This actually really works well with the song 'Rasputing by Boney M'.

[@survivingmoon7635]

This is why I love A.I.

[@sonyatheforestgaurdian3152]

The Humanoid mobile was funny because we all know humans actually know what to do with their lims

[@SycipsGD]

New Roblox R30 looks awesome

[@evosubject3307]

I'm listening to WOP while watching this because of my brother put it on the radio. And it's just so dang funny watching this stuff listening to that XD

[@SebastianGarcia-lt7xv]

What software???

[@otttis]

1:36 - Me trying to get away from socializing