This AI Stuntman Just Keeps Getting Better! 🏃

❤️ Train a neural network and track your experiments with Weights & Biases here: wandb.me/paperi...
📝 The paper "Learning a family of motor skills from a single motion clip" is available here:
mrl.snu.ac.kr/r...
🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible:
Aleksandr Mashrabov, Alex Haro, Andrew Melnychuk, Angelos Evripiotis, Benji Rabhan, Bryan Learn, Christian Ahlin, Eric Haddad, Eric Martel, Gordon Child, Ivo Galic, Jace O'Brien, Javier Bustamante, John Le, Jonas, Kenneth Davis, Klaus Busse, Lorin Atzberger, Lukas Biewald, Matthew Allen Fisher, Mark Oates, Michael Albrecht, Nikhil Velpanur, Owen Campbell-Moore, Owen Skarpness, Ramsey Elbasheer, Steef, Taras Bobrovytsky, Thomas Krcmar, Timothy Sum Hon Mun, Torsten Reil, Tybie Fitzhugh, Ueli Gallizzi.
If you wish to appear here or pick up other perks, click here: / twominutepapers
Thumbnail background design: Felícia Zsolnai-Fehér - felicia.hu
Meet and discuss your ideas with other Fellow Scholars on the Two Minute Papers Discord: discordapp.com...
Károly Zsolnai-Fehér's links:
Instagram: / twominutepapers
Twitter: / twominutepapers
Web: cg.tuwien.ac.a...
#gamedev

[@looksintolasers]

Two Minute Papers has taught me that when humanoid robots come for us, they won't be clunky C-3POs with stiff movements, they'll be terrifying masters of parkour.

[@stevetennispro]

@Train of Taught Great idea! I even have a name for it... ParkourMON

[@champion3433]

Boston dynamics has made me genuinely fear robots

[@flashstick]

@Train of Taught m.kzbin.info/www/bejne/l2STfGlvnbp9r9E

[@blissweb]

And there will be nowhere for us to hide (open ai hide & seek)

[@96dragonhunter]

Just like Elon Musk said "AI is the true threat of humanity".

[@b3nsu]

Something like this implemented in a game engine would be insane. Completely procedural animations for characters and nps would take immersion to whole new level

[@R2Bl3nd]

I'm imagining a fully physics based game where your character can actually trip over stuff like pebbles, or slip on things, and it would use completely realistic physics to simulate that. Might be annoying sometimes, but certainly more realistic.

[@ArunNairOne]

@@R2Bl3nd Or perhaps even allow users to set the degree of physics realism if it gets annoying

[@nerobernardino88]

Imagine that but in Mount & Blade.

[@PolishProgrammer]

@@R2Bl3nd exanima

[@JoRoBoYo]

@@R2Bl3nd death stranding

[@kappasphere]

It's hard to believe that this is an actual physics simulation and not a motion-capture animation

[@cw9249]

Yeah seriously, what physics simulator is this? I’ve never seen it before. This is definitely not open source I would assume

[@kappasphere]

@@cw9249 I don't think the physics simulation itself is that extraordinary, the reason why I think it's incredible that they put it in a physics sim is that modeling and controlling a human in a way that looks like realistic human movement becomes much harder when you're constrained by the laws of physics, and can't just record a movement that is just played back without being integrated into the world.

[@bitbraindev]

Imagine, Boston Dynamics roboters with this technology. What a time to be alive (for now)

[@雪鷹魚英語培訓的領航]

I think it is the same technology. It's machine learning right? Neural network based training?

[@xxbatman69xx98]

@@雪鷹魚英語培訓的領航 yea it’s the same thing. They also use machine learning, so they will do something like show them how to do a course and it will do it. But it needs to learn how to keep its balance and everything else which it will learn through trial and error.

[@huracanrdgz3956]

(For now) XD

[@TheHeavenman88]

Tesla bot will try this before them .

[@maestro3676]

@@xxbatman69xx98 I've heard that they mostly don't use machine learning, and not much is known at all Although they may be working on that at the moment

[@Nawmps]

I absolutely love how confidently the agent fails, full commitment to breaking their spine on the ground!

[@scproinc]

Can't believe how Freeza got beaten so easily. WOW!

[@雪鷹魚英語培訓的領航]

Video games with next gen AI are gonna be fire!

[@badjano]

That’s because they took off his tail

[@Wakish0069]

You must have missed Trunks' intro in the Cell Saga

[@MasterVertex]

This is taunting me as I learn body mechanics in animation. By the time I can do it well, we'll have the 'animate' button

[@jfk_the_second]

Switch "well" for "we'll" so that you don't confuse even people who don't care about grammar.

[@jfk_the_second]

If you want to level it up again, put a comma right after "it". That will be even less confusing.

[@akaakaakaak5779]

i suspect you said this as a joke but i think it should be a genuine concern tbh. make sure youre not investing your efforts into an industry thats going to vanish in a decade

[@Ogaitnas900]

There's no replacement for personal expression! :) no machine can animate like you personally animate, or even you in a particular mood or day. I'm sure you know that, just wanted to say it, keep it up animation is awesome, it's really cool that you're doing it.

[@senritsujumpsuit6021]

P3ople have said that stuff years ago sooo

[@DoodleChaos]

3:07 I wish I was cursed with that crazy configuration 😏

[@7Dimensi0ns]

Haha hey there DoodleChaos! Love your vids =D

[@decodedbunny101]

god

[@PhillipAmthor]

乇乂ㄒ尺卂ㄒ卄丨匚匚 configuration

[@Grocel512]

I had that long leg / long arm configuration too. But my motor skills were buggy as hell and it had strength issues too. Fortunately there was a patch that increased the thickness of legs / arms too. That fixed the strength issues and my body runs much better now. But my motor skills are still shitting the bed during sports. 😂

[@sackboy1665]

pixar moms

[@LNYuiko]

Holy crap, I've never seen such an explosive punch animated before. Not even motion capture can quite get to that level because the animation often does not translate to the physics of the game.

[@yugen3968]

Trivia - The first sport to be incorporated into the AI-lympics was the high jump.

[@DEEPANJANBISWAS]

😄👍👍

[@emperorsascharoni9577]

The day it figures out the Fosbury Flop by itself is the day I believe AI can do anything.

[@yugen3968]

​@@emperorsascharoni9577 That was the first thing that came to my mind when the wall was raised! Either it hasn't figured it out yet, which is kind of weird as there have been papers earlier where virtual agents adjust their limb & joint configurations to most efficiently tread a terrain - OR - it's possible there's some sort of rule in place for it to preserve the vertical orientation throughout the movement. But, yeah, figuring out the fosbury flop will make it a lot easier for it! That'd be so dope!

[@ArunNairOne]

Amazing! I won't be surprised if in a few years we will have AI-based workout apps that suggest highly customized exercises based on your body type and body mechanics. Indeed, what a time to be alive!

[@kanekaiiishoyo3378]

Yes

[@shipwreck9146]

Woahhh, this would be an incredible use for it. I was also thinking it could be used as a way for Olympic athletes to hone their techniques.

[@troooooper100]

Makes no sense

[@Nobddy]

Machine: “jump higher” You: “how?” Machine: *plays video of sim jumping over a sky scraper “It is possible” You: *weak, sad, shuddering yes, master.

[@Nobddy]

I would love to have a video game where the character’s movement was determined by this AI so that as you progressed through the game the AI would slowly get better at the characters move set. By the end of the game you would be able to pull off moves that would have been unthinkable at the start of the game.

[@Z0MBUSTER]

This paper keeps jumping all over the place, lovin' it !

[@Robert_McGarry_Poems]

😋 Narf!

[@stevetennispro]

Too true! I would have to classify the paper as a "technological leap". ;)

[@pokemasterJAH]

I’m loving the pace of AI! I’m just starting off at college and with some influence from your videos I have decided to pursue a career in machine learning! You make such excellent work and I feel so inspired every time you post!

[@NirousPlayers]

*(Watching two minute papers fills you with determination)

[@foxmamer]

Is no one going to comment about the fact that it looks like the model broke one of its ankles after every running jump?

[@historyZZ]

I think that’s it’s “rebalancing” after the jump but it just does it very poorly.

[@oblivion_2852]

It's because the before and after movement isn't being optimized simply the jump is. If the walking/running action were optimized it would probably get rid of that

[@historyZZ]

@@mnomadvfx honestly I don’t know much about ai. But after seeing ai made in mine craft more complex then this it kinda degrades the fascination. And people’s are comparing this to boston dynamics is hilarious. Boston dynamics, besides for industrial use and military is the best quality you can compare to. And it’s not even there.

[@bukpuki]

@@historyZZ you should've stopped after the first sentence lol

[@historyZZ]

@@bukpuki please explain how ai on a software is more fascinating then the software on real life robotics?

[@doomakarn]

I feel that in the future, this is how characters will be animated.

[@JorgetePanete]

Exploration like this is what could help AIs play games too, refining independent tasks and not just trying to achieve a high score in a long run

[@davidwuhrer6704]

Not all games even have scores. And the AI that plays old Atari games can finish those, too.

[@JorgetePanete]

@@davidwuhrer6704 I was referring to the fitness function in neural networks for playing

[@JordanClark82]

Do you notice the walking motion after the jump is very awkward? It seems to be dragging its legs forward with stiff ankles

[@JoachimSauer1]

Notably that awkward walking motion was already in the reference! So it probably learned that and had no reason to "unlearn" it (i.e. its presence didn't affect the fitness function).

[@JeyPeyy]

I got sad for the AI hurting its ankle each jump

[@randomthoughtism]

Yup, to me, the biomechanics seems wrong for humans but adequate for manikins being simulated by AI.

[@TheJonathankang]

Probably because the bot is devoid of pain sensors and it's bones and joints are indestructible, so there's no need to improve landing posture to minimize negative impact on bone and joint integrity.

[@koko969w]

I love the humor! keep up the amazing work, I've been following for years and I still click on every video!

[@MushookieMan]

I thought it was going to spontaneously re-invent the Fosbury flop. No such luck.

[@andrasbiro3007]

I think here was a previous AI that did it. This one was specifically told to use the same move.

[@idontknow8898]

Is there a channel dedicated just for this content? It's incredible watching this evolve!

[@kenosabi]

Sometimes the world is too much but this channel always makes me happy to be on the planet regardless of what's falling apart.

[@C_Corpze]

I can imagine this being used for movies, animations and even games where characters learn new moves while playing! That sounds like such a amazing thing. I'm excited for the future.

[@davidwuhrer6704]

A game in which the player character improves movement over time would be amazing. In Assasins' Creed, the player avatar adjusts movement to the environment, but it is pre-captured motions stitched together. In GTA San Andreas, the player avatar can change its body shape depending on food and exercise. This then changes jump height, running speed, lung capacity, and how many hit points a punch subtracts from the target. I'm thinking a game in which the player avatar acquires new ways to adjust movement to the environment and to changing body shape would be quire exciting. A completely different thing would be AI agents learning movements from each other. There are many possible gaits, for example, which could propagate as memes through a population. I'm not sure how to make a game idea out of it, and it would be a lot more computation intensive, but I think the concept has potential.

[@nou4898]

2:04 including phasing through solid blocks

[@imjody]

This is honestly so incredible. Very useful for video game devs! Imagine, each pixel used to have to be colored in, per frame, then we got into 3D, but every single move had to be precision placed by an animator, and now and into the future, the AI will just do it all for us. We say do X, AI will do X in 1 trillion different ways. I love it. I absolutely love it all. Thank you yet again for an awesome presentation of what's going on in these fields, Two Minute Papers. :)

[@dionyzus2909]

that jump on 0.3 gravity looks so happy.

[@AICoffeeBreak]

Is this impressive? Yes. Yes, it is.

[@shipwreck9146]

It'd be so cool if everything on this channel was somehow implemented into 1 game. Like, a full game with realistic physics, ai optimized graphics, ai character movement. This is a very interesting future we're moving into.

[@TobbyTukaywan]

I wanna see 2 AIs fighting each other. That would be insane.

[@mahadevovnl]

It would be very cool if a model would also predict its own risk of failure, and decide "I'm not going to make this jump, so I'm not going to try".

[@shilohv]

Interesting how the model character slows down before each obstacle. A human would use his/her momentum with anticipation for the next hurdle as soon as the previous one was complete.. The AI bot seems to rely on her muscular structure and close-up evaluation of each block. I would suggest adding to her programming the ability to analyze from more of a distance or to analyze the entire course before she begins her movements.

[@Stafford674]

Would it be possible to develop a bot that boxes like Tyson at his peak, another that boxes like Ali at his peak, and set them against each other to see who would win?

[@USBEN.]

I can imagine people actually having boxing matches with different trained AI. Maybe WWE AI as well. Would be dope.

[@yosha_ykt]

Yeah

[@agsystems8220]

I guess, but you wouldn't know the specific preparation and strategy each would apply, or the plans each would have. There simply isn't enough data to understand that, particularly if you are trying to hit a specific moment in their career.

[@arvindwee4634]

Today I learned that Professor's name is spelled - Károly Zsolnai-Fehér .

[@LanceThumping]

I'm gonna have to read about this. Hopefully it's good enough to run in real time because I'd love to see this stuff put to work in making a video game where the main character moves much more fluidly.

[@ToonedMinecraft]

I think it is, they control it with a controller at some point.

[@kubenjoy3888]

this is what the game Indurstry needs and not fancy graphics! I love these kind of paper!

[@geli95us]

IMO, it needs neither, games are about entertainment, not realism, it's not like we can't do smarter AI for games, we just decide not to because it wouldn't be fun

[@MaestroTunes]

@@geli95us games like gta would 100% be improved by having this because it wouldnt constrain u to just a few ways of hitting and breaking cars you could choose 1000s of different animations or even train the thing yourself you would have more climbing things like that

[@jcoludar]

This is the best thing I've seen in my life! This AI opens so many possibilities!

[@None_NoneType]

I love your channel so much, I’ve been watching your videos for months and haven’t even started college yet

[@RichardCraig]

2:22 - I would absolutely LOVE to see an AI fail video! It's always so hilarious to see these little failures, pure physical comedy gold!

[@雪鷹魚英語培訓的領航]

3:19 "Baby Legs, here we go!" [Baby Legs makes whirring noises] "That’s the sound I make when I’m trying to run fast." ― Baby Legs Detective (Rick and Morty)

[@josephhansen1598]

...or go full Mike Tyson on the opponent 😂

[@davidwuhrer6704]

Bite off an ear?

[@max4644]

That's very similar to what Mike Tyson does actually, look at what it does with its legs and compare it with Mike. Crazy!

[@bigdaddy5303]

Poor guy looks like he did a hammy after the first jump

[@phpn99]

Next step : Put this class of algorithms in the brain of Boston Dynamics' robots

[@ronwhitehouse23]

I just love this man's voice he is so cool!

[@hoptanglishalive4156]

Move over, Boston Dynamics Atlas. There's a new kid on the blocks.

[@UtraVioletDreams]

Once I played PONG on our TV back in the 70's or so. Who would ever believe back then we could get to this level....................... Supper COOL.

[@davidwuhrer6704]

Isaac Asimov, that's who. Of course hardly anyone believe him back then.

[@yash1152]

0:42 1:07 oh gosh, the left leg's limping though 2:17 geez, it's suppper prominent and beyond the scope that i can ignore it

[@canoafurada1105]

i like how in the first video after the jump it walks like if it had hurted

[@zeekjones1]

Now stick this into Disney's robot aerialist.

[@Marsnarchy]

Imagine a game similar to this, and with your skill level raises the pa(Procedural animation)'s capabilities. like without a level you can do basic jumps, climb things, etc.. but with a higher level you can do all kinds of different jumps, vaults, and swings.

[@ApontyArt]

Dear fellow scholars, This is Too Many Humans, with Károly Zsolnai-Fehér. Wow! What a time to be simulated! What a time to be AI!

[@davidwuhrer6704]

Mind backups, when?

[@GoodBaleadaMusic]

The perfect quintessential 2 minute paper video I love this channel so muuiuacacajajja!!!!!

[@rafaxsworld]

as a 3D artist and animator this papers amaze me so much, what a time to be alive!

[@chewycornell]

This would be great for npcs in games that don’t have a predetermined path to follow

[@taureanwooley]

Hopefully they'll be able to compute the failure consequence in the movements to hopefully offshoot some of the damaging effects, but then again that could limit some of the requirements suggested to make a successful climb indefinitely beyond certain generations.

[@scene6289]

Ah i always love machine learning and seeing them adapt to different situations

[@BsktImp]

00:54 When he said "hold on to your papers" I was expecting the figure to have demonstrated convergent evolution and used the Fosbury flop!

[@gokuldas027]

"..but, do you know what else it can deal with?" obviously our sponsor... oh ohh.. "hold on to the paper, squeeze it"

first time me attending your video uploaded 1 minute ago, cheer up Doc!

[@NyelleUnbroken]

I really love how u present these papers man; idk- don't ask me to describe it u are just amazing sir...in the most geeky (in a good way) one can possibly say ty for capturing the excitement in the most appropriate way- bravo

[@bobsbbcards]

The bot sort of has a zombie shuffle after hopping over the wall.

[@lucas3820]

thanks for putting subtitles so i can watch your videos.

[@johngarcia4139]

It's learns like a human with no physical limits

[@rootyroot]

You can imagine in the future - boxing AI vs AI or maybe AI (in a physical form) vs humans.. We are going to learn so much from AI

[@eaaeeeea]

This is seriously next level for gaming! And T-1000s. Kidding aside, it's so strange of a notion that character movement won't soon be "hard coded", but only a single DL model.

[@davidwuhrer6704]

Don't you mean T-800s? Huh, now I wonder how a T-1000 or a T-X would fare against a Transformer from Cybertron. Second Variety has nothing on them.

[@landanhoward7208]

this reminds me of the baymax movie where the kid teaches his robot to do things

[@briankirkpatrick8888]

Did you guys catch that low gravity jump at 4:26? You could use this to predict realistic motions for people on the Moon or Mars. I'd love to see a sci fi that does this. You could do their everyday motions, sports, ballet, martial arts, really conveying that "this isn't earth anymore" feeling.

[@surajvkothari]

Let's just hope this technology is used for good in video games rather than the real world. What a time to be alive, for now!

[@davidwuhrer6704]

Why shouldn't it be used in the real world? Parkour robots would be amazing. Boston Dynamisc is already doing something similar with robots intended for elderly care, which in an aging demographic is desperately needed.

[@Vennotius]

It's all very entertaining until robocop chases you down and punches a tunnel through your ribcage.

[@tehquiper6796]

After getting defeated by Goku for the Nth time, Freiza was sentenced to become a training dummy in this paper

[@CE-ov7of]

Does this mean that once we have 'perfect' simulations of our environments and robots, the AI robotic coordination problem can be sufficiently solved, and then transferred to the real-world robots? Image self-play for hand-to-hand combat....

[@egdm1235]

"Image self-play for hand-to-hand combat...." Imagine the viruses and hacks in that scenario...

[@CE-ov7of]

@@egdm1235 Lol I would have figured the humanoids would have been constrained to their emulated environment, but never considered the possibility to 'break out' of their bounds haha that would be a mess!

[@VarenRoth]

Ngl between "self-play" and "hand-to-hand" my mind went far from combat. ..Still, same issues with uh.. viruses, yes.

[@davidwuhrer6704]

@@egdm1235 What if we just don't install a web browser on those things? Remote code injection is considered a bug in every piece of software except in web browsers, where it is a feature somehow.

[@LNYuiko]

This is pretty much what they're doing with self-driving in Tesla and it is working extremely well. So yes, eventually you will have a humanoid robot that will learn through simulations and be almost perfect in execution in real life.

[@Aanthanur]

The best statistics channel on YT :D

[@eragon_argetlam]

Absolutely incredible! What a time to be alive!

[@pukarkhatri]

It just keeps Getting Better!

[@garronfish8227]

Two papers down the line and we will be hooked to AI MMA

[@hobonickel840]

if they can do this in a virtual landscape ...doesn't seem like much of a leap to transfer to a physical one

[@StephenRayner]

This is really cool, well done guys who made this! Well done!!!

[@PandicMan]

Really interesting to see its applications in the future

[@mapetlv]

by celebrating the amazing work you mean profiting from it? you do you...

[@ModBros8434]

It would be very fun to put the AI in a superhuman body and watch it do insane moves

[@fortisjann]

What a time to be alive.

[@ShimonD]

I'm addicted to your voice. Absolutly amazing.

[@Y2Kvids]

Boston Dynamics wants to know your location with Bags of CAsh .

[@emanuel3617]

Boston Dynamics: 📝👀 mmmmm interesting "AI punch"

[@swawssfm9760]

imagine a game where there are zombies chasing after you like this

[@davidwuhrer6704]

Like that old game _Robots_ where you have to trick the machines rushing at you into crashing into each other?

[@Exilum]

This paper might actually fix how some people underestimate AI. It shows that it could be possible a few more papers down the line for an AI to learn live at a workplace and do it way better than a human. So rather than thinking there won't be a replacement of factory workers in the next 50 years, it'd be better to assume there will be one and prepare for it.

[@tommybazar]

You mean in 15 years, right?

[@Exilum]

@@tommybazar I said 50 because there are actually people who believe it would be that long. Personally, I think it'll happen at least partially within 15 years, yeah.

[@numero7mojeangering]

Now i'm dreaming to 3d print a full body robot in real life and have the IA takes the control of the body ! 👌😆

[@Daniel_WR_Hart]

1:16 I was expecting it to switch to the actual high jump technique used in track

[@jakebennett4307]

It walks away after like it pulled its hamstring

[@apebabel]

Please turn this AI to a game where the characters are like pawns and players can do battles with objectives. Aye look, they gotta have power-ups too, but it comes straight from the players one-time use stock. Betting on that game would be crazy!

[@drodsou]

After chess, go and starcraft I'm seeing the first human-robot mma fight approaching.

[@TAREEBITHETERRIBLE]

YAH I LOVE THE DOCTOR I AM HOLDING ONTO MY PAPERS.

[@phoenixshade3]

If this technique can be applied to a body with realistic human limitations, I predict that we will see a big jump in several athletic records in coming years as athletes learn and practice techniques developed by AI within the next decade.

[@electronresonator8882]

let's see if we can finally achieve a virtual sport event, which is virtual boxing match between AI athletes

[@Asterra2]

I guess if you had unlimited strength in your ankles, you could pull this off also.

[@Nicoyutub]

Thanks for the disclaimer. That is ethical. As always awesome videos.

[@_____alyptic]

Changing body proportion is interesting, but how about just one arm longer or one leg slightly shorter instead of both? ...Would it still be able to cartwheel or do the other tasks?

[@andremarques3317]

probably yes, each one has its movements calculated individually, just like the legs. This categorization of arms and legs for an AI is more a human concept than an actual code thing

[@Napert]

for me it looks like it's trying to imitate how a body would move without any regard for mass, muscle strength or joints

[@RichardCraig]

4:24 - I love that WHEEEEEEEE pose, lol!

[@andrewscott7728]

Teaching robots to fight and do parkour. I have a really good feeling about this.

[@davidwuhrer6704]

I have a 3D printer and an FTDI cable. Let's do this!

[@ghaznavipc]

assassin's creed tekken and much more. what a time to be alive :)