NVIDIA’s New AI Trained For 10 Years! But How? 🤺

❤️ Check out Weights & Biases and sign up for a free demo here: wandb.com/papers
❤️ Their mentioned post is available here (thank you Soumik!): wandb.me/ASE
📝 The paper "ASE: Large-Scale Reusable Adversarial Skill Embeddings for Physically Simulated Characters" is available here:
nv-tlabs.github.io/ASE/
📝 Our material synthesis paper with the latent space is available here:
users.cg.tuwien.ac.at/zsolnai...
❤️ Watch these videos in early access on our Patreon page or join us here on KZbin:
- / twominutepapers
- / @twominutepapers
🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible:
Aleksandr Mashrabov, Alex Balfanz, Alex Haro, Andrew Melnychuk, Benji Rabhan, Bryan Learn, B Shang, Christian Ahlin, Eric Martel, Geronimo Moralez, Gordon Child, Ivo Galic, Jace O'Brien, Jack Lukic, John Le, Jonas, Jonathan, Kenneth Davis, Klaus Busse, Kyle Davis, Lorin Atzberger, Lukas Biewald, Matthew Allen Fisher, Michael Albrecht, Michael Tedder, Nevin Spoljaric, Nikhil Velpanur, Owen Campbell-Moore, Owen Skarpness, Rajarshi Nigam, Ramsey Elbasheer, Steef, Taras Bobrovytsky, Ted Johnson, Thomas Krcmar, Timothy Sum Hon Mun, Torsten Reil, Tybie Fitzhugh, Ueli Gallizzi.
If you wish to appear here or pick up other perks, click here: / twominutepapers
Chapters:
0:00 10 Years of training?
0:42 After 1 week
1:23 After 4 months
1:31 After 2 years
1:55 After 10 years!
2:25 How did they train for 10 years?
3:01 1. Latent spaces
3:52 2. Robust recovery
4:35 3. The controls are 👌
5:01 4. Adversaries
5:57 A great life lesson
6:15 The Third Law of Papers
Thumbnail background design: Felícia Zsolnai-Fehér - felicia.hu
Károly Zsolnai-Fehér's links:
Instagram: / twominutepapers
Twitter: / twominutepapers
Web: cg.tuwien.ac.at/~zsolnai/

[@sunilaryan]

Well explained. Thanks 👍

[@furiousvibes1]

​@Karl with a K ah that doesn't matter friendo.. all you need is a gun attached to a quadcopter and the ability to hack the power grid, both of which have been possible for ages. if things ever get overwhelming just remind yourself "none of this matters anyways". it sincerely helps for me :)

[@masternobody1896]

More ai is what I like

[@Dr.Kay_R]

Hold your papers

[@daveogfans413]

So nobody gonna talk about how we are training the robots fighting skills so they can overtake human society some day?

[@daveogfans413]

robot's*

[@Mouxeware]

I'm a little upset they didnt have them fight each other. I would have loved a large scale fight.

[@imveryangryitsnotbutter]

You have to put them in a ballroom to make them do that.

[@shukrantpatil]

maybe they kept that one for the next week lol

[@FelanLP]

I guess this one was just about moving around and swinging the sword in a convincing way. Have them fighting would require them to learn a sword style or even train them to invent and master their own techniques.

[@Galaxia53]

@@FelanLP Which could be the next step

[@datpudding5338]

@@Galaxia53 Which hopefully is the next step

[@johnclark926]

Like Ray Kurtzweil recently said, “In the next 10 years, we will see 175 years”. This isn’t in relation to AI progress, we’re just going to shove 175 years into 10.

[@Corbald]

Well, I think it goes deeper than that, since 175 years of training on their system is only 5.75 months!

[@onpjP9238HJOhudiezuhD]

It sucks, everybody is unprepared. Many people might die in the process due to sync or distribution issues.

[@joeygarza9550]

That's the best way yet to describe the confusion of the present world.

[@Holypa_Ladino]

Just imagine if we could do this with humans? One year of Study and Research in one day, if something like this was possible, studying the whole universe would be easy.

[@AlexanderMorou]

At the rate they were going, they would train for 3652.425 years in ten years. Most likely more than that, since the hardware and software would likely improve during that time-frame.

[@DiffYT]

Imagine using this system in a gladiator simulation game where the gladiators are randomly generated with different movement and combat "styles" with a skill level that changes how smooth and refined the gladiator is. Seeing millions of unique potential combinations battle it out in various arenas with various environments in duels and team battles, different weapons and an ai that makes use of the environment well could be a next level video game for sure.

[@Smokedouttasian]

add a dash of gambling to that and i guarantee it will be big

[@not_some_random]

Like TABS, but more customisable and harder to render

[@morfeo3188]

Your pc would explode like a c4

[@dongo6988]

@@Smokedouttasian oh man, gambling on gladiators like the olden days.

[@ruffianeo3418]

Chinese "Fake Martial Arts" masters do that since thousands of years :) But... could it not be used to find the really perfect martial art? That would be interesting.

[@Atrazeal]

So basically you just need to put this trained AI into the Atlus Boston Dynamics robot and the matrix is no longer a work of fiction. damn.

[@cagxplays9602]

There are different variables to account for in a virtual simulation, compared to the real world, but that doesn't mean it's impossible.

[@delmanpronto9374]

the virtual space in which the AI operates will be very different and simplistic compared to the BD robot which functions in the real world. If the Virtual space can be made more realistic, your prediction may well be correct.

[@nickalveberg3364]

and so basically with the advancement of ai and assuming the robot can interact with the physical world as it would a simulated one, you essentially created artificial life.. ?

[@delmanpronto9374]

@@nickalveberg3364 yep... the last child of humanity more or less.

[@-_Nuke_-]

Combine this with chatgpt and we are screwed...

[@williamhanna3113]

Player animations has always been the most immersion-breaking part of 3rd person games for me, and I’m really hopeful we will see massive improvements in big games soon!

[@arthurlefevre7706]

even out of the gaming realm, imagine this training applied to biped robots in real life.

[@MEATHEADBooYA]

Its not that hard now days, as the suits for doing animations have come a long way.

[@williamhanna3113]

@@MEATHEADBooYAI’m talking about janky transitions in between animations, like if you’ve ever tried wiggling back and forth quickly or jumping and landing in a run

[@jasonduffy7677]

Please fix Skyrim. Thanks.

[@shukrantpatil]

@@arthurlefevre7706 even the best robots that we have today can't move that fluidly , its just not possible for them to move like we do , our muscles , joints and tendons are not even remotely comparable to any robot out there in terms of ease of movement , hopefully tesla bot does prove this wrong . We could have remote controlled robot battles for fun in the future then lol

[@franticsledder]

I see them clipping the swords through their skulls sometimes. If the researchers added damage zones to the heads and other parts, I bet the AI would learn to be more careful how they swung those weapons.

[@FriedChairs]

It depends on how they feel about those other ai’s. 😁

[@haraldtopfer5732]

I don't know, maybe it's just an artifact from the visualization. The stick figure in the simulation is smaller in general and has also a smaller head.

[@tsunertoo9149]

A cool next step would be training the AI further, and then including the armor in the sims and giving it weight and collision. This would make the AI have to change its motion depending on how much armor it’s wearing and that would be the phenomenal to see purely from an investigative stand point.

[@w.d.gaster9893]

I'd love to see learning enemies in a mmo type videogame so both players and the game would adapt to have a constant challenge

[@Aiphares]

that would be amazing, with some limits ofcourse. we would have to slow down learning drastically and also limit the amount of learning the enemies could do. otherwise the game would be unplayable within a few weeks because the enemies know every single possible action someone could take and be unstoppable :D

[@TiSnDd]

@@Aiphares I would guess it works if the character which is played has a lot of moves to do and the AI would forgot some once in a while.

[@mrmarciniak9992]

Imagine fighting one in a blade and sorcery vr game

[@gamerstrice4731]

I've had a similar idea couple of years ago... enemies in certain area share the same AI which learns after each fight with a player to provide more challenge over the course of months or years

[@ipassingthrough]

I remember oblivion doing something similar. Enemies would level up gears and stats as the player leveled up. Was such an annoying feature haha

[@octopus8659]

5:55 the cursed movement on the left 😂

[@OperationDarkside]

I wish, they'd put a kind of scanning or vision element into the network, so it can evade the boxes from the researchers and after 5 more years, we'll see generated matrix style fight scenes.

[@westingtyler2]

yeah I bet that's the next step. I suspect we'll see this stuff ramp up until it's just a "human animation" character, that can do practically anything. then once there is an open source, we won't ever need to animate characters again, because the 'actor' will just act and react accordingly. that's the end point of this; being able to direct these guys with spoken words, just like directors with real actors.

[@OperationDarkside]

@@westingtyler2 And then I will edit The Mask into the Matrix movie.

[@TheMostGreedyAlgorithm]

They won't do it. I mean... We won't see it. Military development isn't something for public, you know...

[@peter9477]

@@westingtyler2 I think the end point is at least doing that with a direct neural interface, not spoken words. But probably something beyond even that...

[@IN-pr3lw]

@@westingtyler2 Google's general purpose deep mind may be able to be trained much quicker than these and may even produce a better result in half the real world time

[@BevansDesign]

It'd be interesting to see them model things like realistic reaction times and muscle strength/fatigue, so the characters don't have perfect recoveries when they get knocked over.

[@ensrceler]

yeah, the most immersion breaking thing was that they were too *good* at getting up from falls or the ground. its great if you were building a robot to have it never really fall, but for a game avatar like these its gotta go down and stay down from a big hit or it wont look human at all.

[@rockyroadmagic4152]

@@ensrceler your point about building a robot is really interesting, cuz it shows theoretically how agile combat robots that don't feel pain or surprise could be. the speed and smoothness with which they recovered is super impressive

[@bobdemtrich5162]

This would be really cool for open world games. Imagine your character starts with a set basic movements, through playing it develops it’s own unique style of combat based of your movements and style. Mixed with multiplayer to create a truly unique combat style, where everyone’s movement and combat is different and optimized to their play style.

[@fulomtheavali]

This sounds extremely fun and painfully hard to program. Especially since you'd have to consider what all the player controls and what the ai controls. Not to mention all characters would need at least a base level of training to ensure they can move otherwise you'd be sitting around for hours waiting. Although seeing an ai adapt to different weapons you pick up and armour could be interesting. Especially once you start factoring in stats like strength and agility. Seeing an ai struggle to walk in heavy armour, but adapting as time goes on or as you put more points into strength. Maybe agility is the fastest an ai could move a muscle meaning high levels of agility will result in fast dodging and being extremely hard to hit as the ai adapts to the skill boosts. Also the skill points wouldn't be as instant as other games since the ai would have to adapt to the changed variables before it can get the most out of it. All in all. I really want to get my hands on whatever system they are using to train these ais and learn how to code with them.

[@Andimax11]

This would be amazing if you could put physically simulated characters like this into VR games like Bonelab. They would make some of the most incredible and dynamic enemies in video games

[@justaguy5151]

This idea underated as heck, and it would stop ford from getting up when im grabbing him

[@konignickerchen7265]

I notice it is using flat terrain with the same variables every time, I wonder how well it generalized for different terrain, gravity and character proportions.

[@haraldtopfer5732]

just a few papers down the line

[@batman3698]

They probably need to stumble down a very gentle incline for a few million iterations before they get the hang of that

[@andrewchang7194]

Late comment, but any sloped or non-straight terrains, as long as they’re sufficiently smooth (not too jagged) are always able to be approximated by a flat plane in small patches (look up smooth manifolds). What developers could probably do is just piece together the whole terrain using a bunch of small little flat portions for which the model knows how to behave. This might be the easiest way to do it. Other things like character proportions/gravity, etc are likely all dependent on the actual physics engine of the game and the animators. You can’t micromanage the types of things AI does, you just hope it learns a general pattern of appropriate, realistic behaviors to “stimuli” (in quotes because there’s no real stimuli behind the scenes, it’s just a shit ton of matrices and calculus formulas that are constantly throwing out numbers).

[@mackenziestorey620]

The way the sword works with latent space is really interesting. Can't wait to see where this research ends up after a few more papers!

[@LKDesign]

I hope they implement awareness for self-collision soon because the time of unwanted intersections must end somewhere.

[@elliotmarks06]

I love how, with this video especially, you add humor to these paper demonstrations! It truly makes the field of AI research seem more fun and approachable.

[@battycrease2005]

I think it would make an interesting game where the ai enemies learn how the player moves and how the player fights and throughout the game they learn to imitate and counter you as the game progresses and the final boss is basically like fighting against yourself.

[@anteconfig5391]

That might be fun, but sometimes it's more fun to fight against someone better than yourself.

[@AICoffeeBreak]

Does anyone know how soon this will be used in games? 😅 This is really amazing! Great work from NVIDIA, can't wait to see this technology in the next games I play! Thanks Two Minute Papers for covering this! 🙌

[@AICoffeeBreak]

@Martin Kryl Good point. But I do not blame the kids these days when looking at the GPU prices over the last year(s).

[@SubjektDelta]

@Martin Kryl You're getting it wrong here. Currently there is a switch happening. We had the x86 processors for decades and now we are slowly switching to ARM. With those chips we will have way more power and way less energy consumption. Future prediction is: Small powerful phone always with you and at home or whatever you plug it into a dock with extra computing and more energy. So you will always have your data with you and can still experience games or whatever at maximum potential if you have the proper hardware.

[@pneumonoultramicroscopicsi4065]

@Martin Kryl i don't think the AAA game category will die, there are plenty every year, but i feel that ambitious projects are less frequent than before because most developers focus more on established IPs, and want to make their game available for as many ppl as possible (rare next gen only games)

[@muresanandrei7565]

@@pneumonoultramicroscopicsi4065 Wtf are you talking about have you seen what sony lately released and are still working on. Triple AAA games industry is bigger than the cheap ass movies that release these days.

[@pneumonoultramicroscopicsi4065]

@@muresanandrei7565 Sony is yet to release a next gen only game

[@tizianonatali8209]

Looking forward to see them in non-levelled terrain

[@ghoulzexz5135]

😂

[@vesaruntti]

Another 10 years😉

[@sasscouse]

Already done check a company called embark studios and what they have done with there in game AI

[@erindonnelly8283]

@@vesaruntti I see what you did there

[@Jared-e]

This channel is the sole reason that I’m so interested in AI and ML. Thank you for all your hard work!

[@Jojooooooo]

Imagine if you could simulate battles with this, giving units different equipment and pitching 2 teams against each other where the ai is able to fight for itself instead of having it based off of a percentage like the total war games

[@samcharles1166]

Totally accurate battle simulator already does this

[@johnson1010YT]

5:50 The from scratch simulation has so much unused potential. Imagine if you used an animation like that for Halo's Flood parasite combatants. So creepy. Just needs the right model, and environment.

[@KaylonR]

yo actually true

[@highflix91]

Yes, but only if they are in the right place at the right time which is probably pretty unlikely. Otherwise here they make me cry laughing, which is fine, too, I guess. :)

[@4P5MC]

It'd be great for a "realistic" version of a robot takeover! They wouldn't make the same mistakes as humans, but rather learn to move as efficiently as possible!

[@last8exile]

​@@4P5MC Humans already moving pretty efficient. So efficient they beat at long distance every mammal on planet.

[@fabienherry6690]

@@4P5MC I think the issue is they didn't calculate the impact force, penetration , recovery time and all sort of data that make a swing better than the creepy walk. Still can't stop laughing

[@sphygo]

Those recoveries were very impressive. They clearly have a lot more strength and stiffness than humans, but the time it took them to respond to the disturbance and correct their position is just.. wow

[@stacia6678]

It's the result of an optimized algorithm and 100% dedication to their training ;)

[@kriena4190]

That's cool. Learning to chain together movements and making it look realistic. I wonder how it would "feel" in a game

[@servantofthelord8147]

Thank you so much for delivering research in a way that is understandable to the general public. Also, I love your inspirational messages interspersed throughout your video.

[@chewycornell]

It would be awesome to put a bunch of these agents in a fight, with them losing health after a hit, the damage scaling with how hard the hit was. It would be interesting to see how they use the shield, and if they develop their own fighting strategies. Maybe eventually this could be used to make a game like TABS.

[@michaelbarret4610]

I want see these guys fighting a boss with Skull reaper or gleam eyes texture from sword art online

[@Likemea]

im glad someone knows tabs

[@maoy149]

TABS that is actually a TABS

[@crwelch12]

to much data is bad for ai training, doubt it would yield the quality of results you are hoping for

[@Likemea]

@@crwelch12 oh

[@trevorhook5677]

I'd love to see the AI trained on reactions to hostiles with the characters having their own "fields of view" and reacting realistically to what is thrown at them. Rather than them just flipping back up onto their feet and getting thrown around again, I want to see them dodging, flipping, and blocking before they get hit. That would blow my mind and could lead to a world of better immersion in games.

[@flinkstiff]

I agree, and thats just the start. Imagine 3 more papers down the line when we could have this AI applied to real robots, making them absolute murder machines! What a time to have been alive!

[@trevorhook5677]

@@flinkstiff Sound like suicide with extra steps XD

[@shiggermetimbers]

@@trevorhook5677 would be if you made them sapient

[@NukNukka]

@@shiggermetimbers sentient?

[@kevinswords7248]

This would be an amazing way to provide player commands ie. movements/abilities/attacks. Let's say you're a low-level character, your movements are going to be standard albeit clumsy/slow. The more you train at things, the better and more advanced you get, and depending on the type of training, can make your character animations faster/stronger/weird depending on the training

[@Jon-jt9fy]

Clearly this would be a great way to scale the combat difficulty in video games. instead of pumping up the amount of health/dmg an enemy does..you scale the enemy to have more "experience" so to speak. Put it on super easy..and its like "1 week of training" difficulty Put it on very hard and it's like "25 years of training" difficulty. You plug the AI into the type of enemy..and they learn to use the locomotive parts to create a "smart" A.I. for video game npcs.

[@kichmadev]

AI training physics characters are my favorite thing to watch. In the future it will be used by robots to move around in the real world, but for now its pretty cool for videogames. For the next paper on this I want to see gameplay implementation or I am not holding on to my papers.

[@nickskywalker2568]

Let's just hope we get clean governments in the meantime...

[@ET-yc4wb]

@@nickskywalker2568 True. There is also a possibility that AI like this will be used by governments. In the future, if robots become cheap enough to mass produce, technology like this can even be used in wars.

[@nickskywalker2568]

@@ET-yc4wb It's a 99% chances possibility

[@lingred975]

@@ET-yc4wb only wars? it can be used by ANY law enforcement agency AND private companies with enough money, but I'm sure it will be ok...

[@ET-yc4wb]

@@lingred975 ofc not only wars. I just used wars as a worst case scenario.

[@ThePersonNetwork]

2:27 that one in the left corner spinning around, when he dodged and did the shield bash it actually looked so realistic like it was an actual person in the suit doing it. Crazy.

[@sebbasbaoz8314]

at 4:00 the second from the right in the bottom standing up is really cool!

[@cossiomusic]

Can't wait to play video games with this model trained on stunt actors and martial arts masters. Just imagine what it'd look like on a game like Yakuza

[@Vaeldarg]

There's is a game, "Absolver" I think was the name, that was all about fighting using martial arts styles. This could reduce the time needed to develop the styles and instead put that time toward fleshing out the game surrounding the combat (the issue Absolver had, too focused on the combat and not enough content to do it among).

[@rubyy.7374]

I do hope they keep the funni ragdolling though.

[@cossiomusic]

​@@rubyy.7374 The weakness of these games is the combat system which, despite of being really fun at start, tends to be repetitive and not very challenging. My point is by merging real martial arts with motion-captured supid heat actions, it could turn into a game which is both challenging and fun to play. Every knocked out punk should switch to a ragdoll algorithm tho, I fully agree.

[@faithnfire4769]

Seems like a wonderful first application would be for generating background animations for NPCs. If nvidia made several trained sets available, or if large companies had the tools to train more, trading compute for art is a no brainer. I like the idea of every random training NPC at the first encampment in a game having an individualized and generated animation set. Or even a single very high quality one that didn't need to be hand animated or mocapped. Could be very good for indies someday

[@nicreven]

it looks like it'd be amazing for Swords and Sorcery lol

[@OrcinusDrake]

Or crowd simulation in movies/tv

[@andrewmurphy5403]

I've gotta say I love how enthusiastic you are, it's contagious

[@empdisaster10]

This would be really cool to start incorporating, especially if you can add scripted Ai and modify their movements and skill sets. Once you know what you want you could set up the program at the start of whatever project you're on and then let it run until you're close to finishing it so maybe even like 2 irl years or so

[@stevenm7538]

I'm afraid training an ai for 2 irl years would violate the first law of papers.

[@ItsWarFilms]

This reminds me of messing around in Natural Motion's Endorphin back in the day. Incredible that this is now possible in real time while being more flexible as well. I really hope we get an interactive demo of some sort.

[@2k7u]

I always wanted to use euphoria but now the technology is so outdated XD

[@ItsWarFilms]

@@2k7u the program is still really fun to play with actually.

[@2k7u]

@@ItsWarFilms hm yes, i had endorphin, but naturalmotion also featured a lot their Euphoria ragdoll engine at the time that worked very well with GTA 4, that however required special access along with Morpheme kzbin.info/www/bejne/ZoHQYXasopWtmqs

[@Wright00000]

Careful what you wish for...

[@Sirflyingmustache]

It's terrifying to see them practicing combat in a life-like simulation.

[@adamcsillag6058]

Yes imagine they will get a robot body and actual weapons, with say like 1000 years of training. Terrifying.

[@anhthai7005]

@@adamcsillag6058 if it does get to that point they’ll probably simulate several millennia worth of time before putting the ai in its body

[@robbieaulia6462]

@@adamcsillag6058 They'll still have one major limitation, they can't tell what is an enemy and what isn't. So they'll likely to still have human commanders.

[@adamcsillag6058]

@@robbieaulia6462 Oh that's not a limitation rather an advantage. They will kill anyone.

[@iMaxBlazer]

As I understood, there wasn't physics simulation of character body itself (muscles etc). You can see that looking on how they get up very quickly, almost flying.

[@xabelardusx5330]

I could listen to you say and all day. besides that I love your research and thankyou for these studies. Awesome!

[@Grymyrk]

Holy crap the output looks so realistic. They must have had all the anatomy and physics of the subject correct before they started the simulation. Like the stance and the way it moves its weight around when performing an attack looks as if it was mocapped from a pro athlete. And exactly how I was trained in Muay Thai IRL.

[@cameronhunt5967]

I also liked the way they encouraged the AI to explore different movements in the latent space while training.

[@HasanBabasi]

The steering gave me a lot of hype. I remember watching the E3 when the PS3 was being shown. When they were showing NBA 2k steering demo, I thought "wow the movement is so natural" and seeing this brings back those same thoughts.

[@venividicredi4993]

Brilliant! - Any chance you can do a similar simulation to make them play the bagpipes?

[@ArmaanSuhail]

Can’t wait for the sort immersion this opens in interactive media. Being able to give voice commands to AI squads would be so amazing

[@Paulo_Dirac]

Can't wait for games to have your character with a learning curve (based on XP) for their movements. And actually see a difference not only in hitpoint but in technic and movement also.

[@sorinswonderland]

This just gave me a dope idea. Someone should make a game where each time you unlock an upgrade, your character gains a new move. Every core upgrade [make hard to get and only a few], the core upgrades dramatically improves chracter fluidity and movement with no change to the UI. That would be dope to start off with a clunky character but by the end game you have a super mobile, agile, powerhouse.

[@brennanperry8001]

4:15 this is my favorite section, because they hold up their sword like they're ready to go right after getting up. I know I'm anthropomorphising them, and it's probably just easier to gain balance that way, but it's still cool how ai can still have a warrior's spirit.

[@sam0621]

Probably noy, they are trained to move like real warrior. So this move was probably in the dataset.

[@TheMuffsmum]

It's interesting to note how often they cross their legs as they step, this is something you work very hard to avoid in combat sports. I wonder if they would change when you introduce opponents or an artificial cost to falling.

[@michaelwerkov3438]

Oh... duh... thats why all these sword fight videos look kind of goofy to me. I just thought the people were unathletic nerds, and probably alot are... but that explains a lot

[@kahvaimuri2824]

@@michaelwerkov3438 It's not an easy concept but keep digging, you might eventually understand why it looks goofy and why everyone is so exited.

[@juliandarley]

another exciting step on the road to realistic animated characters. in the paper abstract, this sentence stands out: "Our system also allows users to specify tasks through simple reward functions, and the skill embedding then enables the character to automatically synthesize complex and naturalistic strategies in order to achieve the task objectives." hopefully nvidia will soon allow ordinary users to specify those simple reward functions - perhaps including some less pugilistic moves!

[@mackenziestorey620]

How did you comment 3 days ago, when this video was posted like 1 minute ago?

[@alexanderosinubi5154]

@@mackenziestorey620 channel member

[@Bo-kq8tn]

imagine putting one of those little goal targets on the model's mouth and giving them a mug, we could FINALLY have NPCs that can actually drink things properly instead of clipping cups through their chins 😂 the possibility for other realistic little idle movements is really exciting though! I desperately want to get my hands on more of this new AI tech and play with it, I hope it will have good interfaces that are accessible to people that don't code much

[@juliandarley]

​@@Bo-kq8tn i think there is a reasonable chance of good interfaces. most things have a python API and a lot of 3D people know python. you may one day be able to able to instruct the AI in who drinks what without having to put targets on things. same will go for much else. then we shall be able to direct the avatars as if they were actors. i am hoping that we shall be able to use actors and AI together and increase speed of production, reduce cost and thus allow for much better, more interesting, more intelligent and more unusual stories - which the market otherwise filters out of existence on the grounds of cost for too small an audience. it is even possible - and certainly desirable - that there would be more work for actors not less, and more interesting work too. perhaps fewer megstars, but maybe that would be no bad thing for ordinary, talented but generally unknown actors and performers.

[@NorwegianKnifeDude]

The ways they get up are insanely cool! Like the best break dance moves I've seen in my life

[@killermartian_3923]

the falling and the get back up animation looks so cool. really feels like a trained warrior recovering from an unexpected blow.

[@ShibbyRL]

for a scifi version yes, i feel like if the recovery wasnt as fast it would be truly realistic. But super cool none the less

[@vrpnblstr3441]

@@ShibbyRL yes the physics for the recovery doesnt look humane, when a human gets up the motion involves momentum balance and muscular tension throughout the body, here it looks like they can get up only using the strenght of only the part of their body that is in contact with the ground, negating momentum, which implies super human strenght

[@PSiOO2]

@@vrpnblstr3441 considering the programm doesn't render millions of muscle fibres, but like 10 bones instead, yeah

[@deadplthebadass21]

@@vrpnblstr3441 for video game standards I don't think that matters

[@SimonTheDankOne]

I do not have the words to be able to fully express how absolutely amazing this paper is.

[@kin98100]

at 4:26 he even tried to kick away the incoming box. not sure if it was intentional or if we was doing the move anyway regardless of the box but it looked cool.

[@jonnie_tyler]

it would be really cool to have an open world RPG with different types of Ai, all learning to do combat with players. Over time, the developers can write in goals and ambitions for the Ai, making them good or evil. The idea would be to have a community based RPG where the story basically writes itself and is constantly changing based on super powerful Ai combatants that can fight with you, for you, betray you, or be loyal to you based onb how the community treats them. A neat twist might be to station these Ai in static locations for a little while they are in weaker phases. If a player kills them, they get a bit of loot. But if they die, the Ai gets the loot and can only be reclaimed once the player defeats the constantly evolving Ai combatant. Imagine going on a full scale raid to reclaim the loot that an Ai literally stole from you--with hundreds of players struggling against this mega powerful, world bending presence.

[@jacobjones5716]

10 years into 10 days!??!? Imagine what Ai could do if 10 centuries was compressed into one year!?!?!😵‍💫😵‍💫

[@ben-hn2ek]

Imagine the speed of AI when quantum computers are being made 😫🥶

[@Syuvinya]

I feel like this would be great in VR games, either as NPC's or player-controlled characters.

[@helopilotr]

Damn, I wish to see video games that use this in the future. Actual dynamic movements and fights with no preset motions, but actual procedurally generated movements, attacks and defences ^^

[@ophelia6044]

4:00 This is truly interesting! It teaches us moves that weren't even thought before! This is were I fall in love with AI.

[@MrBoubource]

For a lot of AI papers it would be great to mention what is the input of the AI, what it controls (its output), and what is its objective. We would better understand why some of these papers are such game changers.

[@noiseworks]

i believe the input is mocap data provided by reallusion

[@DragongeekAndCo]

AI: "While you were taking a five-minute coffee break, I spent decades mastering the blade"

[@RiverReeves23]

Enjoying your sense of humour man. Really made the intro funny! Cheers.

[@frankwhite1816]

Love it . . . . . and I learned something . . . . and it was entertaining . . . . . and AI is amazing . . . . and conjunctions should be used judiciously, especially in a technical presentation. ;-) Seriously though, I really enjoyed this video . . . . . and thanks for taking the time to create it and . . . . dang it!!

[@strafeeto]

This could be really good for background characters in movies, and anime when you have a lot of fighters in the scene. For example, this could be used to animate an army, making the animated soldiers perform differing movements.

[@stacia6678]

Very interesting! As always, thank you for your time and effort into shortening these lengthy documents into bite-size chunks even a normal person can understand. This is called "time acceleration", which would have been the work of science fiction, but here we see it actually put into place. Although for training purposes here, imagine if we created a similar simulation of sorts, combined with an extensive language model, possibly even more advanced than the LamDA model, we could create our own AI city! it's just a thought, one can only imagine the implications this will have on training these AI. With such a simulation, however, we cannot emulate the "consciousness" of a human, as that's not the point of language models. So i can only hope for the day when the final piece of the puzzle locks into place, the "emotion" part, then we will have a true AGI that can walk like a normal human, talk like a normal human, yet do so much more. Thank you for reading - a bored 15 year old kid

[@emiliak439]

hi there visveee. this is not called time acceleration, this is just a clickbait title discussing computational times. this is as much time acceleration as a computer computing 55*111 takes only a tiny fraction of the time a human would take to compute it - in essence, if this physics simulation would be run at 30 fps to make something visually comprehensible to a human viewer, they're instead running it at 10,950fps. impressive, but the only neat technology at work here is optimizations made to the engine when not visually rendering anything and taking shortcuts with an allotment of imprecision. best of luck

[@jorocinak1238]

I want to see them battle each other! It would be interesting to see the different techniques the ai could come up with. Also it would be realy interesting o see how they line up against real life sword techniques.

[@gameseveryday908]

This video is very informative 👌👏👍, it deserves 10k +.. Good job bro

[@onedeadsaint]

the closest I've seen to real looking ai movement was The Last of Us II, and with that they spent years honing the movement system. that is until now. this looks incredible! can't wait to see this be implemented in games and movies. slowly getting rid of key framing.

[@BrownCookieBoy]

Would love to see such movements in games such as Sifu and Absolver.

[@Jazzy--]

Imagine this used in game productions, where you can make realistic animations and interactions with the environment which will look realistic and work properly! (Obviously to make it look almost human like there has to be some tweaking, but damn this is so good!)

[@maortredknight3925]

fighting each other would require techniques(block an attack, attack on open, run away when sword was thrown by enemy and etc.) base on a situation.

[@TomHarrisP]

This is what I imagined the game Clumsy Ninja to be like before I actually played it

[@TehNetherlands]

5:50 When the mosquito gets inside your helmet.

[@kingeling]

kek

[@Pleplerhep]

@5:51 No dude that is legit AF! Imagine going in a ring with a competent fighter and he attacks you like that. xD

[@I_am_evil.]

4:02 the one on the bottom left had possibly the coolest recovery of all time.

[@dhonantarogundul1737]

Apply the model to a humanoid robot with the same DoF. That would be crazy!

[@metalmanexetreme]

So does this mean in the future games will have combatants that act independently and adapt to the conditions their put in? This seems like it would really benefit VR where the players actions are basically unlimited,

[@jimsmith8434]

Bugger all gamers.

[@MikePouch]

4:26 - I love his kick and then BAM!

[@freshtowels3917]

They look like more modern versions of storm troopers. I love those illuminated shields and swords. They look so cool.

[@jessiejanson1528]

its interesting, but its still only transitioning between a few animations, so while it looks really really good, its motions are limited. Id really like to see some combat where it picks moves based on the opponents moves, like an actual fight. But seeing nvidia choose combat robots is a bit scary, are they planning to make police bots based on these with shields and swords?

[@nicholas6186]

The falling characters remind me of another paper where the AI learned that falling over and doing nothing was the surest way to win.

[@bbbbbbb51]

That's why you don't use French AIs smh

[@zyanidwarfare5634]

It took a bit for it to click in my head, but this is a infant combat AI If you simulate it in a realistic environment those AI could be put into a robotic chassis similar to their simulated one and they would continue to learn Badass but also kinda scary considering 10 days makes them somewhat competent, imagine one learning for a whole year while having a physical body for half of it

[@couththememer]

I hate how addicting this channel can be. I mean like, I've watched his videos for the past 3 hours and still aren't tired yet

[@serta5727]

I just bought a RTX 3090 GPU. Looking forward to try these mind blowing things out :)

[@DiselSun]

How much

[@ZoofyZoof]

@@DiselSun at least a dollar

[@jon1913]

I would love to see them train the data for 100 days (years) and see how the maneuvers advance.

[@theaveragepro1749]

Probably not much better, AI training tends to level off after a while, and they're already matching the dataset moves so there's no more improvement to go really.

[@ET-yc4wb]

@@theaveragepro1749 They have gone beyond the dataset, as all AI do. But I do agree that skills such as this do tend to cap at some point in time.

[@AceSeptre]

Just had one of those really satisfying "well, than answered my question" situations.

[@TyrannosaurusSex]

Seeing them recover so efficiently from the thrown boxes gave me a glimpse into the future of our robotic usurpers.

[@chrisranson2619]

Exactly my thought.

[@derpyderp6719]

From other's comments, I just had an amazing idea for a game. So, it's a VR rpg game where.. Instead of you being to your character, you are their "fighting spirit guide" so to speak. All they know how to do off the bat is walk and run away from enemies. But you can drop your own ethereal motion captured avatar to do moves for them. And put them on any button or keyboard key you wish to. The game processes your motion capture data, and as you use it, simulates it for your student to learn to do in game on real enemies. They start off horribly with anything new you teach them, but use the simulations to appear to learn it way quicker in game. Because you can do almost anything in vr, you can teach them any moves you can do in person, then get them to use them like a normal game. Until they become the ultimate warrior.

[@malikhallsmith]

really cool but i wanna see damage and degradation values on joints to see more realistic robust recovery

[@brucehaslitt35]

I would love to see this used to create the perfect perhuman fighting style. Imagine taking simulation of ill the worlds fighting styles and having the AI’s practice and mix them together with a neural network and creating a new fighting styles. It might even create new stances that maximizes the human body. The simulation with score points passed on how it harms it's opponents and how quickly it get there. Maybe it could have the models use biological human models to get accurate damage and joint restrictions

[@chakibboumaraf3127]

this wouldnt work because these simulations are pretty basics , there are millions of factors in real life that arent being taken account for in these simulations

[@brucehaslitt35]

@@chakibboumaraf3127 totally understandable I used to wrestle and many moves are very situational and these same moves wouldn't work in something like boxing. I was mostly thinking of having different body types and heights randomized and starting from different distances and postures and completing specific fighting styles this would give the system a baseline of what works best in what situation from there using that data the system could determine what martial art are best used when. this is where you would start the serious number crunching when making various changes in the style and are moves are used where. it would be as interesting as a complete martial arts made from scratch by AI but it would allow a more fluid transition to best known styles and when you use them no matter the body type.

[@mmorenopampin]

I'd love to see something like this but with an adjustable skeleton rig that scales and adapts to different planet atmospheres, gravity, radiation etc and see how the humanoid characters adapt and evolve to the different settings. An alien creature generator that evolves would be fun too!

[@shashankgaikwad1043]

5:00 Yeah, I have never seen a more evil Pillar😮

[@syzore2]

Can't wait to fight these after the AI uprising

[@richard_d_bird]

i hope these layabout scientists are *finally* working on improving video games, the only field of study that matters

[@zanderb9646]

Really cool, the NPCs in the game Warframe have incredible physx aswell. Massive ragdoll effects, recovery, knockdown and knockup effects, patrol formations and hiding behind random objects for cover during gunfights and more.

[@MrLoneGames]

At this rate employers are actually gonna get the 18-25 year olds with 50 years qualified work experience that they want so badly

[@stuff3862]

Does anyone realize how insane this is going to be for VR games? Imagine a game where you are just a greek soldier and you get dropped into a battle with 1000 of these guys.

[@anywallsocket]

Can anyone elaborate on the 10 years part? The paper only says "The low-level policy is trained with over 10 billion samples, which is approximately 10 years in simulated time, requiring about 10 days on a single GPU" By which they mean how long it would take if it weren't parallelized ?? I have no idea where they got 10 years and am curious to find out

[@SeventhSolar]

I think it just means they ran the physics at about 400x speed.

[@Scyth3z]

Did you give it accurate weight? Like the weight of different pieces of armor and the weapon? It might make their movement less floaty and give it a real vibe, maybe change it as a whole.

[@khaansulu5695]

4:01 the one in the center left does an awesome flip to get up lol

[@tomshepard9050]

So it is quite possible after all, to build such a life like T-800 cyborg, and it can actually act like a wise old man given a lifetime living among human. Amazing.

[@vladdyslavut]

And two papers down the line it could transform himself to T-1000 🤣