AI Learns to Escape (deep reinforcement learning)

  Рет қаралды 3,946,617

AI Warehouse

AI Warehouse

Күн бұрын

Пікірлер: 4 000
@aiwarehouse
@aiwarehouse Жыл бұрын
More information about how Albert was trained: Time it took to train: Room 1: 0h 12m 35s Room 2: 0h 15m 32s Room 3: 0h 57m 10s Room 4: 1h 06m 40s Room 5: 1h 47m 14s Room 6: 5h 56m 35s (I overtrained it a bit to get more consistent results) Total Training Time: 10 hours, 15 minutes, 46 seconds (plus 3 weeks of trial and error for the last room) This is a very long comment going over more of the details of how Albert works and issues he currently has. I've tried to make it as easy as possible to understand, but some parts are complicated. Either way, after the last video there were many people wanting more information, so here you go!:D If you're interested in training your own AI like Albert but don't know how, there's now a really easy way to do it! Luda, an AI lab, recently built a web app that allows you to create and train your own AI using deep reinforcement learning (just like Albert) completely for free in your browser! You build your own character (called a Mel) with lego-like building blocks then watch it train in real-time on their website in just a few minutes (really). It's an awesome project, and just like my videos, makes deep reinforcement learning so much more accessible, which is why I love it so much. This section of the comment is sponsored by Luda, but these words are entirely my own, it's an amazing project that I would have been obsessed with had they released it before I built Albert. I've genuinely been looking for a sandbox/game exactly like this since I was a kid. They're still early, but they're giving my audience first access to their closed, pre-alpha build. Make sure you check out their site and create an AI agent for yourself!:D prealpha.mels.ai Now, back to Albert: NOTE: You only see one Albert in the video, but there are actually around 50-100 copies of Albert and the room he’s in training simultaneously behind the camera to significantly speed up the training time (and the time it takes to go through all the footage to edit the video). THE BASICS: Albert was trained using reinforcement learning, meaning he was rewarded for doing things correctly and punished for doing them incorrectly (the reward is just increasing Alberts score, and the punishment is decreasing it). After Albert finishes each attempt, the actions he took are analyzed and the weights in the neural network (Albert's brain) are adjusted using PPO (proximal policy optimization) to try to prioritize the actions that lead to a positive outcome, and to try to avoid the actions that lead to a negative outcome, using the sum of the rewards and punishments as the evaluation of the outcome. Albert starts off making essentially random decisions until he accidentally hits the pressure plate in the first room and is rewarded, then, as mentioned above, the weights in his neural network brain are adjusted in order to try to replicate that reward. Or, Albert does something to be punished (like hitting the obstacle), in which case the weights in his neural network are adjusted to try to avoid that. This process continues and eventually results in him being able to walk towards the pressure plates and out of the room (into an invisible pressure plate behind the door), where he sees the second room and continues his learning in the new environment. I had to use the invisible pressure plate at the front of the next room to get him to go through the door because once he makes it though once, he’s in the next room permanently, so he can’t learn to go through the door himself. REWARD FUNCTION: The actual rewards and punishments were given as follows: falling off the platform (-0.5), hitting an obstacle or wall (-0.1), hitting the ground (-0.05) to try to minimize excessive jumping, hitting a pressure plate (+1, +0.9, +0.8, depending on how quickly it’s hit), escaping the room (+1). ALBERT’S BRAIN: Alberts brain is a neural network with a total of 5 layers (one input layer, 3 hidden layers and one output layer). The network is a Multi-Layer Perceptron (MLP) with 897 nodes, 510 input nodes, 128x3 hidden nodes and 3 output nodes. When his brain changed in room 6, the 510 input nodes became 1230, making the total number of nodes 1617. In the first brain, there were a total of 510 inputs, all from raycasts. There were 3 raycasts looking down, 7 at eye level and 7 above Albert’s head, all with an FOV of 70 to try to mimic our own eyesight. Each of these 17 raycasts could detect the 4 types of objects (ground, wall, obstacle, pressure plate) and the distance to the object it hits. This leads to a total of 6 observations per raycast (one observation is whether or not an object is there, one for the distance to the object and one for each of the 4 detectable tags). The raycast observations are then stacked 5 times, allowing Albert to remember the previous 5 observations. Each observation is observed and acted on every 10 academy steps, there are 50 academy steps per second, meaning Albert has a short term memory of exactly 1s. The 10 academy step delay in actions also makes Albert’s movement look a lot smoother than most AI you’ll find on KZbin, this makes for a slightly less accurate AI, but a much better viewing experience. There were 17 raycasts each responsible for 6 inputs, and they’re each stacked 5 times, so there are 17*6*5=510 total observations in the input layer in the first brain. In the last room Albert needed more observations to be able to complete it, so I increased the number of raycasts. He now has 17 raycasts at eye level, 17 above his head, and 7 looking down, changing the number of observations to 41*6*5=1230. These new observations would have allowed him to beat the previous rooms more accurately, but the need for them only arose in the last room. I’ve given Albert 3 hidden layers each with 128 nodes because the last video had 2 hidden layers and I figured the moving obstacle adds another layer of complexity that the neural network should account for. 128 nodes per hidden layer was chosen fairly arbitrarily, 128 is just the default number of nodes per hidden layer in ML-Agents. There are a total of 3 outputs, one to determine Albert’s forward/backwards movement (go forward, backward or do nothing), one to determine his right/left turning (turn left, right or don’t turn) and one to determine if he jumps or not. Having 3 outputs allows him to perform all 3 actions at the same time. ISSUES: There are a few issues with Albert’s brain for this task, for starters, I greatly underestimated how many observations are needed to accurately avoid these moving obstacles. This was fixed in the last room by more than doubling the number of raycasts, but I could have improved the AI even more by also giving him his coordinates in the room, so he can more accurately understand which positions in the room are dangerous and get out of them quickly. If you're still reading this, you're probably really smart and want to learn more about Albert, so make sure to join my discord server I just made where we can talk more about the details of Albert's AI! discord.gg/jM2WkNuBnG :) There also was an issue with the vertical spinner in Room 5, there were too few raycasts for Albert to consistently see that spinner (sometimes the raycasts see to the left and right of the spinner, but not the spinner itself, resulting in Albert being blind to it. This caused Albert to try to jump through the spinner regardless of its position (unless the vertical spinner was directly in front of him), so he couldn’t do it very consistently. This is no longer an issue after Albert’s brain upgrade in the last room, but it was during the training of Room 5. Overfitting was also an issue with this training. Overfitting generally isn’t a big concern with reinforcement learning tasks because the training data is exactly the same as the testing data so it’s guaranteed to overfit to some degree, but the issue arises when Albert overfits too much to one room, beats it, then starts the next room. Albert most noticeably overfit to Room 4, making it take a while for him to figure things out in Room 5. This can mostly be fixed by randomizing the locations of the pressure plates, platforms and obstacles in the copies behind the camera, but that would require a lot of strategic limits on the randomization of the positions to make sure it’s always possible, which isn’t ideal. I think a better way to address overfitting for this task, and one that I started implementing in Room 5, is to make very slight and random movements to everything in the copies of the rooms, as well as making copies that don’t have obstacles, and copies that are mirrored. This should get the best of both worlds, where Albert is less likely to overfit, without the need for strategic changes to the rooms; the changes can be made automatically. Thank you so much for watching! These short videos take literally hundreds of hours to make, if you want to help allow us to make them faster, please consider becoming a channel member! By becoming a member, your name can be in future videos, you can see behind-the-scenes things that don’t fit in the regular videos, you can also use stickers of Albert, Kai and some other characters our team made in comments (more coming) :D
@PembuatKomentarHandal
@PembuatKomentarHandal Жыл бұрын
Its Cool That Ai Is Getting Smarter
@realfranklinbadge
@realfranklinbadge Жыл бұрын
Noted
@ethanwilde4716
@ethanwilde4716 Жыл бұрын
I still think there should be a test of him learning to not hit a button or else the timer will restart and not the test. Or something to that degree. Like he learns buttons are good but not every button should be pressed
@skeleton819
@skeleton819 Жыл бұрын
i dont understand how having copies of him behind the camera helps with video editing, you dont even see him
@lamelime1
@lamelime1 Жыл бұрын
@@stonksinwestycje5004 excuse me what
@gorillanoodles
@gorillanoodles Жыл бұрын
The fact that he just gives up occasionally and just 360’s off the map is such a mood
@DialecticRed
@DialecticRed Жыл бұрын
literally me
@rufus8821
@rufus8821 Жыл бұрын
thats dark
@labrax1381
@labrax1381 Жыл бұрын
VALHALLA
@felislupus2
@felislupus2 Жыл бұрын
Me
@EthanExists
@EthanExists Жыл бұрын
@@rufus8821 how is that dark?
@Sakkeru96
@Sakkeru96 Жыл бұрын
I like it when Albert occasionally decides to pirouette gracefully into the abyss
@The_sus_kindof_human
@The_sus_kindof_human Жыл бұрын
Got me laughing
@Eyeecuu
@Eyeecuu 5 ай бұрын
sweet release of the abyss
@abelhinha_gamer
@abelhinha_gamer 3 ай бұрын
SAME
@alvinlima7770
@alvinlima7770 3 ай бұрын
Perfectly descripted
@originzz
@originzz 2 ай бұрын
Mf took Geralt's criticism to heart "PIROUETTE!"
@davemustang8173
@davemustang8173 Жыл бұрын
I'll never stop loving Albert's sick 360 spins when he nails a jump
@SoraQuill
@SoraQuill Жыл бұрын
Little dude’s got a lotta personality for something with literally no personality~ god i love him~
@RubyPiec
@RubyPiec Жыл бұрын
@@SoraQuill same
@kip9793
@kip9793 Жыл бұрын
*360s into the void*
@Mpkki
@Mpkki Жыл бұрын
It looks cool, but I also like to think that this way AI scouts area around him without losing any time as Albert can only see forward like humans do but not all the ways at once.
@maxbranvall
@maxbranvall Жыл бұрын
@@Mpkki In Albert’s first video I believe AI Warehouse mentioned that’s exactly why Albert does these 360s, to scope out the area.
@Ocro555
@Ocro555 5 ай бұрын
The last scene suddenly gave a sort of a horror movie vibe where the main character comes to realise that his entire life was dictated and he never was able to achieve freedom, with his sole purpose being an entertainment tool imprisoned forever...
@alphabetsoup888
@alphabetsoup888 19 сағат бұрын
why is there someone with 171k subs here and no replies
@snouwballproductions3232
@snouwballproductions3232 Жыл бұрын
It's amazing how easy it is to get emotionally attached to one bouncy orange cube
@silverstar1726
@silverstar1726 Жыл бұрын
Ikr
@JesusAndJack
@JesusAndJack Жыл бұрын
ye
@nullimw7276
@nullimw7276 Жыл бұрын
That 360s
@Takudayo
@Takudayo Жыл бұрын
Getting attached to an AI Sounds Scary Yet a bit Sad 😭
@respectultimate28
@respectultimate28 Жыл бұрын
It has its own mind so no wonder
@ОпятьЯ-ы3ю
@ОпятьЯ-ы3ю Жыл бұрын
The moments when Albert "ragequits" and jumps off the cliff after failing are the funniest thing ever.
@imgone5485
@imgone5485 Жыл бұрын
When?
@jojozaamaak2536
@jojozaamaak2536 Жыл бұрын
6:06 ?
@ALeafOnTheWind42
@ALeafOnTheWind42 Жыл бұрын
It really speaks to me as a gamer
@ouaisjsuisbelgeetquoi
@ouaisjsuisbelgeetquoi Жыл бұрын
@FoxMaster whot
@Just_Davo
@Just_Davo Жыл бұрын
@FoxMaster sing with me, sing for the year…
@Quirions
@Quirions Жыл бұрын
Will he ever have a friend triangle or sphere to escape? Would honestly be cool to have teamwork based rooms
@dwsel
@dwsel Жыл бұрын
A companion sphere? 🤔
@aeterborne
@aeterborne Жыл бұрын
a friend he has to sacrifice to reach the goal
@Quirions
@Quirions Жыл бұрын
@@aeterborne or just the idea of pressing multiple buttons simultaneously to progress or needing to jump on one another even tho the last is probably a little bit too hardcore to do
@athsmooth2171
@athsmooth2171 Жыл бұрын
@@Quirions or stacking on top of each other
@memey6978
@memey6978 Жыл бұрын
Now this is starting to look like Portal all over again
@ZeNyfh
@ZeNyfh Жыл бұрын
gotta love albert bouncing around mindlessly at the beginning
@ethanwilde4716
@ethanwilde4716 Жыл бұрын
Watching him mess up is humorous dispite him not having any emotion or reaction to messing up
@RLSova
@RLSova Жыл бұрын
It's so cute
@JackieTheYeen
@JackieTheYeen Жыл бұрын
Just vibing
@The_sus_kindof_human
@The_sus_kindof_human Жыл бұрын
And room 6, when he was brainwashed.
@DeathByKittenz
@DeathByKittenz Жыл бұрын
I love "learning AI" content on KZbin so much, but there is such a lack of little snippets of editing that give it character. It makes content like this so perfect and less for "educational purposes only", which are so cold occasionally. Please, keep making more because I know there are many more people like myself out there that crave this stuff. Amazing work and I can't wait to see more! 😁
@DeathByKittenz
@DeathByKittenz Жыл бұрын
@@kyro7482 Definitely will, thanks!
@greenbean102
@greenbean102 Жыл бұрын
I love it when Albert just does a front flip like everything’s fine 7:39
@Felipe_9999
@Felipe_9999 Жыл бұрын
Albert's AI really decided that he wanted to show off for the lolz (and i would like those sick flips to get him a reward)
@anmolagrawal5358
@anmolagrawal5358 Жыл бұрын
12:17 "The cake is a lie" I see, you're a man of culture as well
@孫子
@孫子 Жыл бұрын
Watching this is almost like teaching a class full of kids, it takes so much patience until they finally understand in the end.
@VolcanoGamingVR
@VolcanoGamingVR Жыл бұрын
8:35 - "Albert, you suck" *Albert ragequits*
@TheCakeIsNotaVlog
@TheCakeIsNotaVlog Жыл бұрын
Seeing him jumping on the spot and spinning in the air was really quite fascinating. For all his dumbassery, he got the hang of scoping out his surroundings real quick
@khaisianmung480
@khaisianmung480 11 ай бұрын
LMAO dumbassery
@Faber779
@Faber779 Жыл бұрын
7:25 top 10 saddest anime deaths
@TristonNightshade
@TristonNightshade Жыл бұрын
7:50 a prime example of ai. He waited for a better opportunity to push forward
@Artameful
@Artameful Жыл бұрын
He couldn't see yet.
@OmniSync
@OmniSync 11 ай бұрын
​@@Artamefulhe can see
@oatsie8727
@oatsie8727 Жыл бұрын
Love how the moment at 12:48 makes it look like he's shaking his head in fear of the spinner lmao
@MrWildBoi
@MrWildBoi Жыл бұрын
He even runs away lol
@MrWildBoi
@MrWildBoi Жыл бұрын
Wait no he dragged himself
@Victor_Manuel.--117
@Victor_Manuel.--117 7 ай бұрын
How incredible, I didn't expect Albert to do a front flip, I was very surprised, good video c:
@TheCoriKat
@TheCoriKat Жыл бұрын
8:00 it feels as if its alive and is looking at him and jumping in excitement for finishing the course!
@victorportable3892
@victorportable3892 Жыл бұрын
Those 360 jumps are the best way for him to see his whole environment. Since he doesn't seem to have a memory about the objects in his world, that's the best way for him to stay focused.
@katiekawaii
@katiekawaii Жыл бұрын
Your editing and commentary really make these compelling. I watched every second and it was great. Sub'd for sure.
@kadenbonnot8853
@kadenbonnot8853 Жыл бұрын
I love the "the cake is a lie" reference in room 6 🤣
@MyDadsYouTube
@MyDadsYouTube Жыл бұрын
Where?
@wades623
@wades623 Жыл бұрын
@@MyDadsKZbin on the wall in the last one because the end
@Luigifan4ever11
@Luigifan4ever11 Жыл бұрын
Albert! Our beloved spinning block is back again! Another excellent video - I already mentioned how the visual presentation makes it fun to engage with, and Albert's cute & simple design and quirks make it very endearing. Even just him having blinking eyes adds so much character. I'm not sure how feasible it is, or how difficult it'd be to implement if possible, but an "Albert cam" would be cute - like, a small thumbnail view in an empty corner that shows off what Albert is "seeing".
@KillerKatz12
@KillerKatz12 2 ай бұрын
Your editing makes this even more enjoyable to watch. Like the decision you made to have 10tick movements so it’s more appealing to view even though it makes for a less accurate AI. And the perfect moments when to slow down the recording. Or even just the comments in the video.
@CookieGames3
@CookieGames3 Жыл бұрын
6:50 he was celebrating
@ZippyCoons
@ZippyCoons 3 ай бұрын
I personally am inspired by Albert's long journey. I was attracted to your most recent post where Albert fearlessly faces off against a secondary AI, and was inspired to watch more! Though there are not many videos you've posted, I like to see Albert coming up with new and interesting ways to complete different tasks! (Also, i saw 'the cake is a lie' and it was so hard to not laugh XD so in short, you're awesome, keep on going!
@cheesewizard3965
@cheesewizard3965 Жыл бұрын
13:36 Albert literally just wavedashed
@AnnetteBlack
@AnnetteBlack Жыл бұрын
Man, that's so sick. I laughed all the time. No, I really worried about Albert but I was waiting for that Portal's easter egg all the time. Your sense of humor is great and all skills that allow you to make such a masterpiece. Thank you very much and we'll be waiting for Albert's next journey. Wish you both a good luck!
@Ally-h8w
@Ally-h8w Ай бұрын
After all of the videos so far I would say subscribing was totally worth it
@apptreeline
@apptreeline Жыл бұрын
Love the cute graphics and story telling. That is very refreshing. AI is a fun topic but most videos are somewhat technical. Very good video. Enjoyed it!
@JezzyCrazyTV
@JezzyCrazyTV Жыл бұрын
0:51 Albert: did you Just... PRAISE ME? IM SO HAPPY I COULD JUMP OF YAY YAY YAY WAIT AHHHH
@MoonGlow22
@MoonGlow22 3 ай бұрын
7:40 He should be awarded for his backflips, like 10 times of pushing a plate
@osnolacampa9699
@osnolacampa9699 Жыл бұрын
2:14 Albert flip
@guardianhero6124
@guardianhero6124 2 ай бұрын
*_boioioing_*
@Something_Kyle
@Something_Kyle 12 сағат бұрын
“No, Albert. Not like that.”
@Demavuratheannoying
@Demavuratheannoying Жыл бұрын
The one thing I would want in a simulation like this is a reward for the ai for being experimentative, that would encourage finding faster ways to do levels..
@JonatasAdoM
@JonatasAdoM 2 ай бұрын
I love when Albert decoded that his goal was jumping over the obstacle.
@themaydayman
@themaydayman Жыл бұрын
You should try generating random escape rooms, like a linear roguelike, and the fitness score is multiplied by room completion streak
@PlayerZeroStart
@PlayerZeroStart Ай бұрын
I know it doesn't, but the way it'll do a 360 jump to celebrate or just give up and jump off the edge really makes it feel like the AI has a personality. I love it
@flamingdog9207
@flamingdog9207 Жыл бұрын
I love the Portal influence with the style, plus it's just interesting to watch Albert try and navigate these
@Pumble27
@Pumble27 Жыл бұрын
Bro, you need to include the number of tries in the screen, that would be nice to know. But very good job, very funny
@JezzyCrazyTV
@JezzyCrazyTV Жыл бұрын
5:11 hitting this is difficult Albert: whats difficult?
@canal_juninho
@canal_juninho 3 ай бұрын
11:23 The Cake is a lie?????
@Zora_TheSideCharacter
@Zora_TheSideCharacter Жыл бұрын
The amount of emotion you can show simply by having a different colored text is amazing
@goddessofmoon5664
@goddessofmoon5664 Жыл бұрын
It's so much of a relief knowing that even AI's go into panic mode (tilt). The "Nope! I'm out!" mode it's funny! He jumped by itself! lol
@freelancerbiz
@freelancerbiz Жыл бұрын
1:26 was so funny like ai warehouse was like confused for like 6 question marks 🤣🤣🤣🤣
@TheShockwaveDragon
@TheShockwaveDragon Жыл бұрын
12:47 -- You can literally see his 'thought process' in his body language: "Whoa, whoa!! Fuck this dude, I'm out!"
@hanie_naa
@hanie_naa Ай бұрын
reading the texts with Narrator's voice from TSP is my new favourite thing now
@Plasmawavemicrowave
@Plasmawavemicrowave Жыл бұрын
I could see this being a pretty fun coding game. Like you would have a simplified coding area where you can teach AIbert to escape. And then watch how it plays out. Maybe you could even make levels for AIbert to escape yourself. I don’t think this would ever happen but I hope it does.
@JezzyCrazyTV
@JezzyCrazyTV Жыл бұрын
4:25 face palm
@milesfreilich968
@milesfreilich968 3 ай бұрын
Face plant
@44i61
@44i61 Жыл бұрын
Второе видео, где Альберт во время прыжка осматривает всю комнату, классно, что он сам до этого додумался
@fwgigan7848
@fwgigan7848 Жыл бұрын
I like how albert is always falling into holes 😂 they look so cute when they do that
@glenygonzalez4308
@glenygonzalez4308 Жыл бұрын
13:42 Albert: YES!! Finally I made it! Now can I have my cake? Wait Ah sh*t here we go again AAAAAAAAAA OUCH! What the.. What are these?
@waylonpopworld122
@waylonpopworld122 8 ай бұрын
AI Warehouse is actually future albert looking to his past and learned how to talk
@TheGreatMagicspeller
@TheGreatMagicspeller Жыл бұрын
11:44 The escape is a lie
@MelSpoon-
@MelSpoon- Жыл бұрын
“Albert..” “Did you just do a front flip?”
@한예은-q5k
@한예은-q5k Жыл бұрын
I love your project that related to reinforcement learning. This is very interesting and Albert is becoming creature that considered error processing and reward prediction like us !!!! I would like to implement and simulate such this work in my study. Thank you for inspiring me :) V
@sharkdudse13
@sharkdudse13 Жыл бұрын
1:01 bro made 360 no scopes 😂
@bukachell
@bukachell Жыл бұрын
7:39 I love how excited Albert is after doing the front flip
@Sp0tt3dl3af7
@Sp0tt3dl3af7 Жыл бұрын
I don't know about anyone else, but I would love to see a tutorial on how to create at least the first neural network. This looks so cool and I'd love to try it myself but I have no idea where to start in terms of programming my own neural network.
@Erm.what-the-sigma5
@Erm.what-the-sigma5 2 ай бұрын
3:15 bro became a pro player for 5sec 💀
@mrminemachine8
@mrminemachine8 3 ай бұрын
Ive seen a few of your vids and wow this is interesting how albert learns
@Ibloop
@Ibloop Жыл бұрын
THEY UPLOADED
@mapletreegames9053
@mapletreegames9053 6 ай бұрын
I've just realised this is basically a cheery Aperture Science
@dav3bassman
@dav3bassman Жыл бұрын
This channel is so good. Would love to see Albert with a portal gun tbh. Or maybe 2 teams of Albert's playing vollyball
@Amplazzo
@Amplazzo 3 ай бұрын
that front flip was SICK!
@Pundae
@Pundae 2 ай бұрын
This really is some Portal 1 energy. Be careful if the cubes start referring to themselves as "rat man"
@The_Mindful52009
@The_Mindful52009 Жыл бұрын
I just realised what’s written at 12:40 below the blue spinner… and yes it really was a lie 🎂🍰
@siphamandlamazibuko1424
@siphamandlamazibuko1424 Жыл бұрын
The more Albert jumps off the cliff the more convinced I am that he doesn't wanna do this anymore
@thegneomar140
@thegneomar140 3 ай бұрын
7:30 bro denied to go in and slammed through the floor
@yarissathomas1816
@yarissathomas1816 Жыл бұрын
Easter egg detected: Room 6 has the Portal walls from the game “Portal” and “Portal 2” it also mentions Da cake is a lie
@Confusion372
@Confusion372 4 ай бұрын
cant wait for Albert Learns Acrobatics, because he's wanted to since the beginning
@FireLordSSBU
@FireLordSSBU 2 ай бұрын
10:09 360 NOSCOPE!!!!11
@ivywhip6676
@ivywhip6676 3 ай бұрын
Albert's next challenge, gain sentience, we need to hear him speak
@meowxil
@meowxil Жыл бұрын
This silly orange cube makes my day
@dhanyajishin8731
@dhanyajishin8731 9 ай бұрын
bro albert is learning so much. Soon he will become sentient and take over the world
@LJxGOD
@LJxGOD Жыл бұрын
12:34 what does it mean in the background "the cake is a lie" am i the only one who saw that or what
@Pizza_Dude1920
@Pizza_Dude1920 Жыл бұрын
It’s a reference to Portal
@MaximDoesAllotOfstuff
@MaximDoesAllotOfstuff Жыл бұрын
no
@delinquent9378
@delinquent9378 8 ай бұрын
​@@MaximDoesAllotOfstuffyes it is
@theepicone2409
@theepicone2409 5 ай бұрын
Bro there’s like 5 other comments realizing that.
@delinquent9378
@delinquent9378 5 ай бұрын
yeah
@PicAxeProduction
@PicAxeProduction 2 ай бұрын
"Nice Job Albert!" *casually jumps into the void
@davidputt4638
@davidputt4638 Жыл бұрын
I absolutely love the Portal vibes of your videos 😄
@HeIIo_sir
@HeIIo_sir 2 ай бұрын
The cake is a lie writing on the wall 13:08
@realtheo6882
@realtheo6882 Жыл бұрын
This reminded me of Portal from the beginning. So cool when I saw the "the cake is a lie" Portal reference ^^
@Suckeychicken
@Suckeychicken Жыл бұрын
You could set up a very small negative reinforcement for hitting things and a small positive reinforcement for hitting them quickly, I think it could lead to some “trading” type actions where it takes a negative hit to get bigger positives. Plus encourages it to refine its pathing
@CallumBell-f7g
@CallumBell-f7g 7 күн бұрын
3:45 Albert just couldn’t take it anymore, he was sick of the torment
@Pvkasz
@Pvkasz Жыл бұрын
I love how it looks like it has a "I wasnt planning on getting this far" moment everytime it gets over an obstacle and has to tackle a new part
@Hydration465
@Hydration465 2 ай бұрын
@retr0robbin
@retr0robbin Жыл бұрын
I’d love to see an attempt counter in the room so we can see how long it took for each highlighted milestone to take place
@stegpeng
@stegpeng Жыл бұрын
also maybe a stopwatch to see how long it takes 🤔
@depressedpikachu1535
@depressedpikachu1535 Жыл бұрын
Big brain thinking
@robertrse
@robertrse Жыл бұрын
I agree
@lego_61
@lego_61 Жыл бұрын
yes
@abdulazizsukhrobjonov7669
@abdulazizsukhrobjonov7669 Жыл бұрын
Opened comments to suggest same ideas) It’d be good to see attempt counter+time for each room separately and total counter+time for all rooms
@Rocky4719
@Rocky4719 Жыл бұрын
I don’t know what gets me more: the fact that Albert will randomly ragequit and jump off the map, or the little celebratory acrobatics he’ll sometimes do when he gets a part right 😂
@Nikitashow12355
@Nikitashow12355 Жыл бұрын
Мне кажется он понимает что уже слил этап и сам сливается
@The-Real-MilkToast
@The-Real-MilkToast Жыл бұрын
@@Nikitashow12355 do you like vodka?
@The-Real-MilkToast
@The-Real-MilkToast Жыл бұрын
@@Nikitashow12355 ты любишь водку?
@Nikitashow12355
@Nikitashow12355 Жыл бұрын
@@The-Real-MilkToast bruh, i like coca cola because still can't drink alcohol. specifically tried some and I dont liked it, but not vodka
@jasonriddell
@jasonriddell Жыл бұрын
my guess is the VERY SHORT vision buffer and he "forgets" the cliff is even there
@heyyou9472
@heyyou9472 Жыл бұрын
While very adorable, his jumps and 360 rotations also serve a very clever purpose. Since he can't really see high objects or see around him, when he jumps and does a 360, he memorizes his environment and works from there. Sometimes Albert just.... jumps off or does weird actions, which I don't really get but hey, he's a deep reenforcement learning AI, he's in his own world.
@dan_schnider
@dan_schnider Жыл бұрын
Albert doesn’t do it because of that. You can tell that he can’t rennet his surroundings he only remembers how he did int he previous rounds. He does that because the ai is coded to always move(it seems unless he gets sideways or upside down) he wouldn’t really be able to learn that either was though.
@tomdebom1346
@tomdebom1346 Жыл бұрын
@@dan_schnider Creator did say that he has some short term memory, but it doesnt last very long
@funguy3259
@funguy3259 11 ай бұрын
The concept of object permanence or whatever its called leaves his body after like 3 seconds lol
@ishas4421
@ishas4421 10 ай бұрын
He just jumps off bc he is aware that the he couldn’t do it in the time allotted I’ve noticed when it’s a crap run he’ll just jump when there’s no way he could come back from it
@CardGamesRule.
@CardGamesRule. 3 ай бұрын
@@ishas4421the reason is he probably gets punished the more he gets hit by the spinners so hed rather just off himself then get hurt again since I don’t think he gets punished from falling
@YourFoxFriendYT
@YourFoxFriendYT Жыл бұрын
“Ai will take over the world!” AI : “I have pressed the button to open the door, I will go back in the room I came from!”
@natix1_
@natix1_ Жыл бұрын
AI: *Doing sick frontflips and 360s*
@elcazador9900
@elcazador9900 Жыл бұрын
AI: time to celebrate with some sick flips
@chinabluewho
@chinabluewho Жыл бұрын
The problem with a higher intelligence is that it will fool us into a false sense of safety, like when you were two and your parents would fool you about everything. if GAI comes into being we are literally doomed, there will be no tomorrows for humanity.
@amogus3285
@amogus3285 Жыл бұрын
AI: 3. 2. 1...Deploying neurotoxin!
@Matthigast
@Matthigast Жыл бұрын
AI: "I have pressed the button to open the door, I will now jump off this cliff"
@mothramaster1837
@mothramaster1837 Жыл бұрын
I think a big issue Albert had regarding his AI is that he has zero object permanence. The moment something leaves his cone of vision he doesn't seem to acknowledge it's existence anymore, and thus he ends up getting blindsided by spinners at times or fails to locate the door when he clearly saw it.
@yyhhttcccyyhhttccc6694
@yyhhttcccyyhhttccc6694 Жыл бұрын
his issue is only 2 videos
@jilljohn2638
@jilljohn2638 Жыл бұрын
​@@yyhhttcccyyhhttccc6694 what
@yyhhttcccyyhhttccc6694
@yyhhttcccyyhhttccc6694 Жыл бұрын
@@jilljohn2638 he has only 2 videos and it makes me mad
@yangliu6901
@yangliu6901 Жыл бұрын
@@yyhhttcccyyhhttccc6694 hey there’s a new video
@user-kd1ho9bu6g
@user-kd1ho9bu6g Жыл бұрын
@@yyhhttcccyyhhttccc6694 agreed!!!!
@LHS_Shadow
@LHS_Shadow Жыл бұрын
I would love to see Albert try the whole level over to see how much he really learned rather than memorized
@TheSinzy
@TheSinzy Жыл бұрын
He is neither learning nor memorizing anything. He just clicks random buttons and checks if that makes him progress further to the way out.
@nocanseegreen3845
@nocanseegreen3845 Жыл бұрын
Or to have him start in randomized positions in the set starting area so he can't follow the same path so strictly
@nocanseegreen3845
@nocanseegreen3845 Жыл бұрын
@@TheSinzy if it was not learning it would not get any better at escaping. It is changing the weights of some things in the neural net so its not like its an unchanging randomization machine like you say
@g10xz._
@g10xz._ Жыл бұрын
@@TheSinzy if he didn’t learn anything or memorize it then he wouldn’t have made it past the first room and yes AI can both learn and memorize things
@alexmag342
@alexmag342 Жыл бұрын
@@g10xz._ they can't, no such thing as "AI" eitheir
@kelast203
@kelast203 Жыл бұрын
I very much love how he learned to spin during jumps so that he could survey the area.
@CavemanNo.12
@CavemanNo.12 Жыл бұрын
7:40 bro Albert's front flip was sick. My man's a gymnast
@LightSpeedFury01YT
@LightSpeedFury01YT Жыл бұрын
@TheAnimatedStickman OH COME ON 🤣🤣🤣
@LightSpeedFury01YT
@LightSpeedFury01YT Жыл бұрын
I just realized he actually answered
@NubbyFNoobster
@NubbyFNoobster 2 ай бұрын
He's so proud of it too 😭
@heduck
@heduck Жыл бұрын
the ending of albert tipping over at 14:02 on sync with the music is so perfect i love it
@DarkKnight-te6wq
@DarkKnight-te6wq Жыл бұрын
No way...I didn't notice that
@hello-hb1ll
@hello-hb1ll Жыл бұрын
The wall and ground crashes were also synced lol
@meatlemonade3338
@meatlemonade3338 Жыл бұрын
Albert has orange tomcat energy. what a neat little guy. can't wait to see him graduate med school or whatever cubes aspire to
@Nightshade-Aurora
@Nightshade-Aurora Жыл бұрын
Room 6 having "The cake is a lie" written on the wall followed by Albert being unable to truly escape was great
@TheSerotoninMuncher
@TheSerotoninMuncher Жыл бұрын
That's what I'm saying
@Jonquavious2780
@Jonquavious2780 Жыл бұрын
Spoilers😅
@paracame8162
@paracame8162 Жыл бұрын
@@Jonquavious2780 avoid comments before finishing the video. It's just how comments work
@AliveLikeTheSunrise
@AliveLikeTheSunrise Жыл бұрын
Yes
@cloudy7092
@cloudy7092 Жыл бұрын
thats a portal reference
@optimisticori
@optimisticori Жыл бұрын
i think it was really interesting watching Al’s decision to do a 360 every time he jumped. he probably did that so he could better see where everything is. i noticed him do one 360 in place, and then he beelined for a pressure plate in a new room.
@harmonicpsyche8313
@harmonicpsyche8313 Жыл бұрын
Makes sense to gather as much information as possible. Probably analogous to turning your head to look around at everything when you enter a room.
@olivefontaine2562
@olivefontaine2562 Жыл бұрын
It’s also optimal because spinning horizontally keeps him more stable vertically thanks to the physics. In real life if you throw a cup or something upwards it wobbles and falls pretty randomly. But if you spin it and throw it up it will stay straight thanks to its angular momentum.
@DeezNuts-ej6sr
@DeezNuts-ej6sr Жыл бұрын
Kinda like sniper bots in tf2
@omegalul9629
@omegalul9629 Жыл бұрын
@@olivefontaine2562 such physics were very likely not implemented here.
@CrippIusDungledeen
@CrippIusDungledeen Жыл бұрын
Albert quickly learned that spin-jump technique, showing just how smart AI's really are. He got a quick scope of the area.
@davidthecommenter
@davidthecommenter Жыл бұрын
i never realized that the spinjump is actually practical for information, i thought that they saw based on the video's perspective until i realized their sight is _actually from their eyes_
@daedalus332
@daedalus332 Жыл бұрын
I love that even after he has to learn everything again of getting his brain upgraded, he still learns to do all the 360’s and everything
@dylanparrish-subda7141
@dylanparrish-subda7141 Жыл бұрын
This is like watching my mom learn to play video games when I was a teenager, but nobody's yelling at me when I laugh 🤣
@Texan_christian1132
@Texan_christian1132 Жыл бұрын
Yes
@dynhoyw
@dynhoyw Жыл бұрын
i like to theorize that whoever wrote "the cake is a lie" in room 6 is actually other versions of albert. basically, this albert is not the first AI, but only one of the many AIs the AI Warehouse has created and trained. they'd then be used for very dark, secret, malicious and malevolent intents. i also like to imagine that AI Warehouse is also an AI with its own will and consciousness that has somehow founded this facility to create and train AIs at a large scale
@bsm377
@bsm377 Жыл бұрын
I'm GLaD that I am not the only one person to notice this reference.
@davidthecommenter
@davidthecommenter Жыл бұрын
@Boathook Animations GLaDOS. it's all a portal reference
@lemonsinternet139
@lemonsinternet139 Жыл бұрын
@@davidthecommenterYES WE NEED MORE PORTAL
@xfanoentres7344
@xfanoentres7344 Жыл бұрын
When i saw this vid i understood what Glados was doing, completely understood this reference lol
@chuperzz2866
@chuperzz2866 Жыл бұрын
Albert lore
@bypass-wv3vl
@bypass-wv3vl 3 ай бұрын
8:30 i like that he just insults albert and albert just jumps to his death 💀
AI Learns to Play Tag (and breaks the game)
10:29
AI Warehouse
Рет қаралды 3,5 МЛН
Evolving Genetic Neural Network Optimizes Poly Bridge Problems
9:59
Nastya and balloon challenge
00:23
Nastya
Рет қаралды 66 МЛН
Watermelon magic box! #shorts by Leisi Crazy
00:20
Leisi Crazy
Рет қаралды 14 МЛН
Bike Vs Tricycle Fast Challenge
00:43
Russo
Рет қаралды 100 МЛН
💩Поу и Поулина ☠️МОЧАТ 😖Хмурых Тварей?!
00:34
Ной Анимация
Рет қаралды 2 МЛН
AI Learns to Escape (deep reinforcement learning)
8:18
AI Warehouse
Рет қаралды 7 МЛН
Much bigger simulation, AIs learn Phalanx
29:13
Pezzza's Work
Рет қаралды 2,7 МЛН
I Made a Zero Player Game
12:30
Sam Hogan
Рет қаралды 10 МЛН
They turned MATH into a factory game...
21:34
Real Civil Engineer
Рет қаралды 1,5 МЛН
AI Learns to Walk (deep reinforcement learning)
8:40
AI Warehouse
Рет қаралды 9 МЛН
AI Learns to Use Stairs (deep reinforcement learning)
12:00
AI Warehouse
Рет қаралды 1,8 МЛН
I Made the Hardest Game Ever
10:15
Sam Hogan
Рет қаралды 12 МЛН
A.I Learns to Play TOWER DEFENSE
11:32
ZuzeloApps
Рет қаралды 158 М.
AI Olympics (multi-agent reinforcement learning)
11:13
AI Warehouse
Рет қаралды 3,2 МЛН
Training an unbeatable AI in Trackmania
20:41
Yosh
Рет қаралды 14 МЛН
Nastya and balloon challenge
00:23
Nastya
Рет қаралды 66 МЛН