AI Learns to Escape (deep reinforcement learning)

[@aiwarehouse]

More information about how Albert was trained: Time it took to train: Room 1: 0h 12m 35s Room 2: 0h 15m 32s Room 3: 0h 57m 10s Room 4: 1h 06m 40s Room 5: 1h 47m 14s Room 6: 5h 56m 35s (I overtrained it a bit to get more consistent results) Total Training Time: 10 hours, 15 minutes, 46 seconds (plus 3 weeks of trial and error for the last room) This is a very long comment going over more of the details of how Albert works and issues he currently has. I've tried to make it as easy as possible to understand, but some parts are complicated. Either way, after the last video there were many people wanting more information, so here you go!:D If you're interested in training your own AI like Albert but don't know how, there's now a really easy way to do it! Luda, an AI lab, recently built a web app that allows you to create and train your own AI using deep reinforcement learning (just like Albert) completely for free in your browser! You build your own character (called a Mel) with lego-like building blocks then watch it train in real-time on their website in just a few minutes (really). It's an awesome project, and just like my videos, makes deep reinforcement learning so much more accessible, which is why I love it so much. This section of the comment is sponsored by Luda, but these words are entirely my own, it's an amazing project that I would have been obsessed with had they released it before I built Albert. I've genuinely been looking for a sandbox/game exactly like this since I was a kid. They're still early, but they're giving my audience first access to their closed, pre-alpha build. Make sure you check out their site and create an AI agent for yourself!:D prealpha.mels.ai Now, back to Albert: NOTE: You only see one Albert in the video, but there are actually around 50-100 copies of Albert and the room he’s in training simultaneously behind the camera to significantly speed up the training time (and the time it takes to go through all the footage to edit the video). THE BASICS: Albert was trained using reinforcement learning, meaning he was rewarded for doing things correctly and punished for doing them incorrectly (the reward is just increasing Alberts score, and the punishment is decreasing it). After Albert finishes each attempt, the actions he took are analyzed and the weights in the neural network (Albert's brain) are adjusted using PPO (proximal policy optimization) to try to prioritize the actions that lead to a positive outcome, and to try to avoid the actions that lead to a negative outcome, using the sum of the rewards and punishments as the evaluation of the outcome. Albert starts off making essentially random decisions until he accidentally hits the pressure plate in the first room and is rewarded, then, as mentioned above, the weights in his neural network brain are adjusted in order to try to replicate that reward. Or, Albert does something to be punished (like hitting the obstacle), in which case the weights in his neural network are adjusted to try to avoid that. This process continues and eventually results in him being able to walk towards the pressure plates and out of the room (into an invisible pressure plate behind the door), where he sees the second room and continues his learning in the new environment. I had to use the invisible pressure plate at the front of the next room to get him to go through the door because once he makes it though once, he’s in the next room permanently, so he can’t learn to go through the door himself. REWARD FUNCTION: The actual rewards and punishments were given as follows: falling off the platform (-0.5), hitting an obstacle or wall (-0.1), hitting the ground (-0.05) to try to minimize excessive jumping, hitting a pressure plate (+1, +0.9, +0.8, depending on how quickly it’s hit), escaping the room (+1). ALBERT’S BRAIN: Alberts brain is a neural network with a total of 5 layers (one input layer, 3 hidden layers and one output layer). The network is a Multi-Layer Perceptron (MLP) with 897 nodes, 510 input nodes, 128x3 hidden nodes and 3 output nodes. When his brain changed in room 6, the 510 input nodes became 1230, making the total number of nodes 1617. In the first brain, there were a total of 510 inputs, all from raycasts. There were 3 raycasts looking down, 7 at eye level and 7 above Albert’s head, all with an FOV of 70 to try to mimic our own eyesight. Each of these 17 raycasts could detect the 4 types of objects (ground, wall, obstacle, pressure plate) and the distance to the object it hits. This leads to a total of 6 observations per raycast (one observation is whether or not an object is there, one for the distance to the object and one for each of the 4 detectable tags). The raycast observations are then stacked 5 times, allowing Albert to remember the previous 5 observations. Each observation is observed and acted on every 10 academy steps, there are 50 academy steps per second, meaning Albert has a short term memory of exactly 1s. The 10 academy step delay in actions also makes Albert’s movement look a lot smoother than most AI you’ll find on KZbin, this makes for a slightly less accurate AI, but a much better viewing experience. There were 17 raycasts each responsible for 6 inputs, and they’re each stacked 5 times, so there are 17*6*5=510 total observations in the input layer in the first brain. In the last room Albert needed more observations to be able to complete it, so I increased the number of raycasts. He now has 17 raycasts at eye level, 17 above his head, and 7 looking down, changing the number of observations to 41*6*5=1230. These new observations would have allowed him to beat the previous rooms more accurately, but the need for them only arose in the last room. I’ve given Albert 3 hidden layers each with 128 nodes because the last video had 2 hidden layers and I figured the moving obstacle adds another layer of complexity that the neural network should account for. 128 nodes per hidden layer was chosen fairly arbitrarily, 128 is just the default number of nodes per hidden layer in ML-Agents. There are a total of 3 outputs, one to determine Albert’s forward/backwards movement (go forward, backward or do nothing), one to determine his right/left turning (turn left, right or don’t turn) and one to determine if he jumps or not. Having 3 outputs allows him to perform all 3 actions at the same time. ISSUES: There are a few issues with Albert’s brain for this task, for starters, I greatly underestimated how many observations are needed to accurately avoid these moving obstacles. This was fixed in the last room by more than doubling the number of raycasts, but I could have improved the AI even more by also giving him his coordinates in the room, so he can more accurately understand which positions in the room are dangerous and get out of them quickly. If you're still reading this, you're probably really smart and want to learn more about Albert, so make sure to join my discord server I just made where we can talk more about the details of Albert's AI! discord.gg/jM2WkNuBnG :) There also was an issue with the vertical spinner in Room 5, there were too few raycasts for Albert to consistently see that spinner (sometimes the raycasts see to the left and right of the spinner, but not the spinner itself, resulting in Albert being blind to it. This caused Albert to try to jump through the spinner regardless of its position (unless the vertical spinner was directly in front of him), so he couldn’t do it very consistently. This is no longer an issue after Albert’s brain upgrade in the last room, but it was during the training of Room 5. Overfitting was also an issue with this training. Overfitting generally isn’t a big concern with reinforcement learning tasks because the training data is exactly the same as the testing data so it’s guaranteed to overfit to some degree, but the issue arises when Albert overfits too much to one room, beats it, then starts the next room. Albert most noticeably overfit to Room 4, making it take a while for him to figure things out in Room 5. This can mostly be fixed by randomizing the locations of the pressure plates, platforms and obstacles in the copies behind the camera, but that would require a lot of strategic limits on the randomization of the positions to make sure it’s always possible, which isn’t ideal. I think a better way to address overfitting for this task, and one that I started implementing in Room 5, is to make very slight and random movements to everything in the copies of the rooms, as well as making copies that don’t have obstacles, and copies that are mirrored. This should get the best of both worlds, where Albert is less likely to overfit, without the need for strategic changes to the rooms; the changes can be made automatically. Thank you so much for watching! These short videos take literally hundreds of hours to make, if you want to help allow us to make them faster, please consider becoming a channel member! By becoming a member, your name can be in future videos, you can see behind-the-scenes things that don’t fit in the regular videos, you can also use stickers of Albert, Kai and some other characters our team made in comments (more coming) :D

[@PembuatKomentarHandal]

Its Cool That Ai Is Getting Smarter

[@realfranklinbadge]

Noted

[@ethanwilde4716]

I still think there should be a test of him learning to not hit a button or else the timer will restart and not the test. Or something to that degree. Like he learns buttons are good but not every button should be pressed

[@skeleton819]

i dont understand how having copies of him behind the camera helps with video editing, you dont even see him

[@lamelime1]

@@stonksinwestycje5004 excuse me what

[@gorillanoodles]

The fact that he just gives up occasionally and just 360’s off the map is such a mood

[@DialecticRed]

literally me

[@rufus8821]

thats dark

[@labrax1381]

VALHALLA

[@felislupus2]

Me

[@EthanExists]

@@rufus8821 how is that dark?

[@davemustang8173]

I'll never stop loving Albert's sick 360 spins when he nails a jump

[@SoraQuill]

Little dude’s got a lotta personality for something with literally no personality~ god i love him~

[@RubyPiec]

@@SoraQuill same

[@kip9793]

*360s into the void*

[@Mpkki]

It looks cool, but I also like to think that this way AI scouts area around him without losing any time as Albert can only see forward like humans do but not all the ways at once.

[@maxbranvall]

@@Mpkki In Albert’s first video I believe AI Warehouse mentioned that’s exactly why Albert does these 360s, to scope out the area.

[@Sakkeru96]

I like it when Albert occasionally decides to pirouette gracefully into the abyss

[@The_sus_kindof_human]

Got me laughing

[@Eyeecuu]

sweet release of the abyss

[@abelhinha_gamer]

SAME

[@alvinlima7770]

Perfectly descripted

[@originzz]

Mf took Geralt's criticism to heart "PIROUETTE!"

[@heyyou9472]

While very adorable, his jumps and 360 rotations also serve a very clever purpose. Since he can't really see high objects or see around him, when he jumps and does a 360, he memorizes his environment and works from there. Sometimes Albert just.... jumps off or does weird actions, which I don't really get but hey, he's a deep reenforcement learning AI, he's in his own world.

[@dan_schnider]

Albert doesn’t do it because of that. You can tell that he can’t rennet his surroundings he only remembers how he did int he previous rounds. He does that because the ai is coded to always move(it seems unless he gets sideways or upside down) he wouldn’t really be able to learn that either was though.

[@tomdebom1346]

@@dan_schnider Creator did say that he has some short term memory, but it doesnt last very long

[@funguy3259]

The concept of object permanence or whatever its called leaves his body after like 3 seconds lol

[@ishas4421]

He just jumps off bc he is aware that the he couldn’t do it in the time allotted I’ve noticed when it’s a crap run he’ll just jump when there’s no way he could come back from it

[@CardGamesRule.]

@@ishas4421the reason is he probably gets punished the more he gets hit by the spinners so hed rather just off himself then get hurt again since I don’t think he gets punished from falling

[@ОпятьЯ-ы3ю]

The moments when Albert "ragequits" and jumps off the cliff after failing are the funniest thing ever.

[@imgone5485]

When?

[@jojozaamaak2536]

6:06 ?

[@ALeafOnTheWind42]

It really speaks to me as a gamer

[@ouaisjsuisbelgeetquoi]

@FoxMaster whot

[@Just_Davo]

@FoxMaster sing with me, sing for the year…

[@retr0robbin]

I’d love to see an attempt counter in the room so we can see how long it took for each highlighted milestone to take place

[@stegpeng]

also maybe a stopwatch to see how long it takes 🤔

[@depressedpikachu1535]

Big brain thinking

[@robertrse]

I agree

[@lego_61]

yes

[@abdulazizsukhrobjonov7669]

Opened comments to suggest same ideas) It’d be good to see attempt counter+time for each room separately and total counter+time for all rooms

[@mothramaster1837]

I think a big issue Albert had regarding his AI is that he has zero object permanence. The moment something leaves his cone of vision he doesn't seem to acknowledge it's existence anymore, and thus he ends up getting blindsided by spinners at times or fails to locate the door when he clearly saw it.

[@yyhhttcccyyhhttccc6694]

his issue is only 2 videos

[@jilljohn2638]

​@@yyhhttcccyyhhttccc6694 what

[@yyhhttcccyyhhttccc6694]

@@jilljohn2638 he has only 2 videos and it makes me mad

[@yangliu6901]

@@yyhhttcccyyhhttccc6694 hey there’s a new video

[@user-kd1ho9bu6g]

@@yyhhttcccyyhhttccc6694 agreed!!!!

[@heduck]

the ending of albert tipping over at 14:02 on sync with the music is so perfect i love it

[@DarkKnight-te6wq]

No way...I didn't notice that

[@hello-hb1ll]

The wall and ground crashes were also synced lol

[@CavemanNo.12]

7:40 bro Albert's front flip was sick. My man's a gymnast

[@LightSpeedFury01YT]

@TheAnimatedStickman OH COME ON 🤣🤣🤣

[@LightSpeedFury01YT]

I just realized he actually answered

[@NubbyFNoobster]

He's so proud of it too 😭

[@Rocky4719]

I don’t know what gets me more: the fact that Albert will randomly ragequit and jump off the map, or the little celebratory acrobatics he’ll sometimes do when he gets a part right 😂

[@Nikitashow12355]

Мне кажется он понимает что уже слил этап и сам сливается

[@standby_for_titanfall]

@@Nikitashow12355 do you like vodka?

[@standby_for_titanfall]

@@Nikitashow12355 ты любишь водку?

[@Nikitashow12355]

@@standby_for_titanfall bruh, i like coca cola because still can't drink alcohol. specifically tried some and I dont liked it, but not vodka

[@jasonriddell]

my guess is the VERY SHORT vision buffer and he "forgets" the cliff is even there

[@Pvkasz]

I love how it looks like it has a "I wasnt planning on getting this far" moment everytime it gets over an obstacle and has to tackle a new part

[@Hydration465]

❎

[@Nightshade-Aurora]

Room 6 having "The cake is a lie" written on the wall followed by Albert being unable to truly escape was great

[@TheSerotoninMuncher]

That's what I'm saying

[@swim808s]

Spoilers😅

[@paracame8162]

@@swim808s avoid comments before finishing the video. It's just how comments work

[@AliveLikeTheSunrise]

Yes

[@cloudy7092]

thats a portal reference

[@CrippIusDungledeen]

Albert quickly learned that spin-jump technique, showing just how smart AI's really are. He got a quick scope of the area.

[@davidthecommenter]

i never realized that the spinjump is actually practical for information, i thought that they saw based on the video's perspective until i realized their sight is _actually from their eyes_

[@LHS_Shadow]

I would love to see Albert try the whole level over to see how much he really learned rather than memorized

[@TheSinzy]

He is neither learning nor memorizing anything. He just clicks random buttons and checks if that makes him progress further to the way out.

[@nocanseegreen3845]

Or to have him start in randomized positions in the set starting area so he can't follow the same path so strictly

[@nocanseegreen3845]

@@TheSinzy if it was not learning it would not get any better at escaping. It is changing the weights of some things in the neural net so its not like its an unchanging randomization machine like you say

[@g10xz._]

@@TheSinzy if he didn’t learn anything or memorize it then he wouldn’t have made it past the first room and yes AI can both learn and memorize things

[@alexmag342]

@@g10xz._ they can't, no such thing as "AI" eitheir

[@kelast203]

I very much love how he learned to spin during jumps so that he could survey the area.

[@YourFoxFriendYT]

“Ai will take over the world!” AI : “I have pressed the button to open the door, I will go back in the room I came from!”

[@natix1_]

AI: *Doing sick frontflips and 360s*

[@elcazador9900]

AI: time to celebrate with some sick flips

[@chinabluewho]

The problem with a higher intelligence is that it will fool us into a false sense of safety, like when you were two and your parents would fool you about everything. if GAI comes into being we are literally doomed, there will be no tomorrows for humanity.

[@amogus3285]

AI: 3. 2. 1...Deploying neurotoxin!

[@Matthigast]

AI: "I have pressed the button to open the door, I will now jump off this cliff"

[@snouwballproductions3232]

It's amazing how easy it is to get emotionally attached to one bouncy orange cube

[@silverstar1726]

Ikr

[@JesusAndJack]

ye

[@nullimw7276]

That 360s

[@Takudayo]

Getting attached to an AI Sounds Scary Yet a bit Sad 😭

[@respectultimate28]

It has its own mind so no wonder

[@optimisticori]

i think it was really interesting watching Al’s decision to do a 360 every time he jumped. he probably did that so he could better see where everything is. i noticed him do one 360 in place, and then he beelined for a pressure plate in a new room.

[@harmonicpsyche8313]

Makes sense to gather as much information as possible. Probably analogous to turning your head to look around at everything when you enter a room.

[@olivefontaine2562]

It’s also optimal because spinning horizontally keeps him more stable vertically thanks to the physics. In real life if you throw a cup or something upwards it wobbles and falls pretty randomly. But if you spin it and throw it up it will stay straight thanks to its angular momentum.

[@DeezNuts-ej6sr]

Kinda like sniper bots in tf2

[@omegalul9629]

@@olivefontaine2562 such physics were very likely not implemented here.

[@Ocro555]

The last scene suddenly gave a sort of a horror movie vibe where the main character comes to realise that his entire life was dictated and he never was able to achieve freedom, with his sole purpose being an entertainment tool imprisoned forever...

[@chickeneggsinmyarea]

why is there someone with 171k subs here and no replies

[@C3xMan1999]

​@@chickeneggsinmyarea because they are probably paid

[@duckyboy8169]

My favorite part is 7:20 in room 3, where he lands perfectly, but he can't figure out how to get through the door, so he just falls over from the spinner

[@TotallyTaRz]

Nah he just didn’t wanna go through, he even shook his head at the door

[@ErraticPulse]

Classic indecision moment

[@The_Magical_Cat__]

He knows if he goes in he has to do another puzzle

[@ITS_SAMUEL101]

*room 4

[@kali.flowers]

@@ITS_SAMUEL101 you put the * at the end, so would it would actually be

[@ZeNyfh]

gotta love albert bouncing around mindlessly at the beginning

[@ethanwilde4716]

Watching him mess up is humorous dispite him not having any emotion or reaction to messing up

[@RLSova]

It's so cute

[@JackieTheYeen]

Just vibing

[@The_sus_kindof_human]

And room 6, when he was brainwashed.

[@dynhoyw]

i like to theorize that whoever wrote "the cake is a lie" in room 6 is actually other versions of albert. basically, this albert is not the first AI, but only one of the many AIs the AI Warehouse has created and trained. they'd then be used for very dark, secret, malicious and malevolent intents. i also like to imagine that AI Warehouse is also an AI with its own will and consciousness that has somehow founded this facility to create and train AIs at a large scale

[@bsm377]

I'm GLaD that I am not the only one person to notice this reference.

[@davidthecommenter]

@Boathook Animations GLaDOS. it's all a portal reference

[@lemonsinternet139]

@@davidthecommenterYES WE NEED MORE PORTAL

[@xfanoentres7344]

When i saw this vid i understood what Glados was doing, completely understood this reference lol

[@chuperzz2866]

Albert lore

[@daedalus332]

I love that even after he has to learn everything again of getting his brain upgraded, he still learns to do all the 360’s and everything

[@mothgyaru3158]

Dude, this is insane! Blows me away, I don’t know how you even BEGIN to make Albert. I always cheer whenever he completes something LOL

[@IloveHildasfeet]

Sonic

[@Logic-ys7rw]

@@IloveHildasfeet Triplets born, the throne awaits

[@EveCitrus]

It's like 4 o clock on the morning but to me there's something absolutely beautiful about this all. Like we as humans just have such an innate need to give everything a personality. All the comments cheering Albert on, calling the spin he does to check his surroundings "celebratory acrobatics", the commentary throughout the video, even down to the physics and the way Albert moves gives him this loveable aloofness to him, making you cheer him on more as he tries and fails and does his sick tricks. And christ, he has googly eyes. It's just. Such a wonderful thing how much personality we give an AI cube.

[@waluigihentailover6926]

Well said!

[@dorol6375]

Did not expect to see you here

[@RonnieMcNutt_Mindblowing]

Nut

[@funkyfranx]

Yes it’s weird how we give an unsentient AI so much of our emotions, yet we treat cows, pigs, chickens and other animals like inanimate objects.

[@inkognito105]

Ааа

[@paperpauperplayer]

I would love to see after he completes all the chambers, if he's able to do all of them back to back without a mistake. As in, when he completes the last chamber, you save file his memory, reset the coding to where any room he's in, if he fails, he starts back in the first room. Doesn't matter if he's in room 2 or room 6. I want to see if he is able to retain the patterns and methods to get through all the rooms in one run!

[@JanMaynz]

That would be AWESOME

[@salttolerant2690]

I originally thought that was gonna happen. I would also like to see that

[@dogsushienjoyer]

Yes please I thought that on the first video already, would be exciting

[@DABiDo.O]

This would essentially mean the obstacle is one big room rather than seven, so given enough chances he should be able to get it.

[@kyllfurries]

8:30 i like that he just insults albert and albert just jumps to his death 💀

[@Quirions]

Will he ever have a friend triangle or sphere to escape? Would honestly be cool to have teamwork based rooms

[@dwsel]

A companion sphere? 🤔

[@aeterborne]

a friend he has to sacrifice to reach the goal

[@Quirions]

@@aeterborne or just the idea of pressing multiple buttons simultaneously to progress or needing to jump on one another even tho the last is probably a little bit too hardcore to do

[@athsmooth2171]

@@Quirions or stacking on top of each other

[@memey6978]

Now this is starting to look like Portal all over again

[@elemental_ofmusic390]

I love how at certain points, like 3:59, Albert just decides to do a sick 360 and hit the button in style. He may be a learning AI, but he still has style!

[@neofalz7643]

Professionals have standards

[@lukabrasi001]

he's actually scouting the area when doing those so there's a reason he does them

[@renskedunnewold1995]

I love that he still does his little jump spins after hitting a pressure plate, it's his little celebration

[@technofreak39]

The love to the details is sooooo good. The coloring of different things makes this so relatable. Whenever there is "Albert" in orange, I see a half meanless half dumb face which doesnt understand the problem. Green is when something is good and Red pure frustration. And the music stopping (followed by red text).. Love it! :D

[@ywatcher2106]

Yes! more Albert! love these videos. so interesting from a computer perspective but also just as much from the "Albert is adorable and I love watching him try and eventually succeed on these challenges with the text commentating" the *sigh* at the door was perfect. everything was perfect :)

[@obhwg]

I think it could be more perfect if Albert got himself some kind of object permanence? Kind of unusual to see him spin around on each jump. Is it because the AI has figured out this is a good way to see things? Or is that itself proof it has memory? EDIT: Got time to (skim) read the pinned comment. I think I'm pretty wrong now, but I'm still curious about why he spins so much. Hope I didn't miss that explanation.

[@adoplayzz9725]

@@obhwg I think he spins Like that so he has a straight line to the next part

[@JohnSmith-gj6md]

Do you think the reason he's constantly jumping and doing 360s is so he can see the room? That way he's able to survey more of the area around him and figure out where the pressure plates are etc.

[@morrowmorrow4811]

this is precisely it.

[@BrandonWillWin]

Has to with maintaining stability as well. Helps him remain upright, sort of like a frisbee, so that he can minimize the chance of tumbling around when he lands

[@blakksheep736]

@@BrandonWillWin I doubt this physics sim bothered to account for gyroscopic stability.

[@1nfinite464]

STOP RUINING THE JOKE NOOO YOU MONSTER

[@The_Guatermelon]

Bro does a 360 no scope

[@dylanparrish-subda7141]

This is like watching my mom learn to play video games when I was a teenager, but nobody's yelling at me when I laugh 🤣

[@Texan_christian1132]

Yes

[@frogdoglover]

6:42 I love how he gets so excited that he pushed the button he completely forgot what to do next 😂

[@namjoonmoonchild9273]

He's just jumping😂

[@greenbean102]

I love it when Albert just does a front flip like everything’s fine 7:39

[@Felipe_9999]

Albert's AI really decided that he wanted to show off for the lolz (and i would like those sick flips to get him a reward)

[@meatlover33]

There was something about Albert emotionlessly casting himself into the void that I found very inspiring

[@dappah302]

Your videos have been extremely well made so far! Can't wait to see what awaits Albert in the future!

[@aiwarehouse]

Thank you so much!

[@dappah302]

@@aiwarehouseOf course! :D

[@meatlemonade3338]

Albert has orange tomcat energy. what a neat little guy. can't wait to see him graduate med school or whatever cubes aspire to

[@anmolagrawal5358]

12:17 "The cake is a lie" I see, you're a man of culture as well

[@hattyhat261]

What really makes me impressed is that Albert is kind of like us, as he makes mistakes and doesn’t understand anything at first, but eventually learns what to do.

[@_isabxlla]

that's the definition of learning 🤦‍♂️

[@Nelber509]

Yeh but we would just give up eventually

[@hattyhat261]

@@Nelber509 yeah Albert is a legend he never gives up bro got the best mindset (definitely not because he is an AI)

[@xenai.]

​@@hattyhat261 6:10

[@VolcanoGamingVR]

8:35 - "Albert, you suck" *Albert ragequits*

[@everesthines2228]

7:45 I love how Albert jumps up and down after doing a frontflip. He even looked at the camera.

[@helizteil2625]

This honestly reminds me of a player who has absolutely zero idea what is happening and is just trying to learn by failing. Like, ramp up the difficulty by 10 and I can see myself making these same mistakes. It's honestly quite impressive how far we've come.

[@guy_roh]

Albert caving in due to pressure at 3:47

[@LowBudgetBoi]

"I don't wanna do this no more :("

[@darkacadpresenceinblood]

it's so interesting how we all get emotionally attached to an ai cube if it has eyes, a name and gets treated as a living thing... we're all here calling him cute (and i mean he is, look at the lil celebration bounces when he gets something!)

[@JustLetMeUseNPC]

If this was turned into a game, with the premise that you're an advanced AI learning to do things with an AI narrator that either communicates with text popups or using some TTS (or maybe both), I would instantly buy that game the moment I could.

[@catface5144]

Basically The Stanley Parable xD

[@HalfDecentDucc]

6:16 Albert got so annoyed from the locked door and wall spinner, he killed himself.

[@polonorte818nose7]

With style

[@孫子]

Watching this is almost like teaching a class full of kids, it takes so much patience until they finally understand in the end.

[@DamonTorro]

There's a sense of dread and depression whenever Albert just...jumped off...into the abyss.

[@bannanaz__]

3:46 Albert was like: Oh, i ran out of time. Guess i'll die!

[@DeathByKittenz]

I love "learning AI" content on KZbin so much, but there is such a lack of little snippets of editing that give it character. It makes content like this so perfect and less for "educational purposes only", which are so cold occasionally. Please, keep making more because I know there are many more people like myself out there that crave this stuff. Amazing work and I can't wait to see more! 😁

[@DeathByKittenz]

@@kyro7482 Definitely will, thanks!

[@bacondude420]

10:58 the cake is a lie

[@LowBudgetBoi]

*P O R T A L*

[@AnakinLucero]

Trueee

[@Fishybabyqw]

@@AnakinLuceroTHE CAKE IS A LIE 11:23

[@Fishybabyqw]

@@LowBudgetBoiWHAT

[@vrman6955]

🔷🔫🏃🏻‍♀️🔶

[@giddygoon73]

I love how this channel has so many subscribers but just two videos and a short. They totally deserve it.

[@nardalis4832]

We be waiting on the good stuff... patiently xD

[@PieletPi]

I can't tell if youre sarcastic there with them deserving it.

[@RiingMsn]

Didnt they have more before

[@giddygoon73]

@@PieletPi I'm not, I was gonna point it out but I just decided not to.

[@adil0028]

Plot twist, they're all bots

[@NaiveCat45446zeroSEVEN]

6:12 relatable

[@insertedfailed3586]

Interesting way of teaching AI to more people!

[@wheezeardjack]

I love him. I need more of him- please. I didn’t know watching AI learn would be so funny (especially with your comments and notes) and entertaining.

[@Kalaggu2020]

Dude, these series are so fun to watch. There's nothing like this on yt, sure there's the rare chance that you find 1 or 2 vids but this is magic, gold, true comedy and an actual series, not just 1 vid. Keep it up!

[@aiwarehouse]

Thank you so much!:D

[@CaitlynCappello]

"Thats not the way your supposed to go" Albert: "but i pressed button papa"

[@murphthasmurf5923]

I wish we could see a post-learning run after he finishes the gauntlet to see if he actually retains the knowledge and can do it in a reasonable amount of time

[@TristonNightshade]

7:50 a prime example of ai. He waited for a better opportunity to push forward

[@Artameful]

He couldn't see yet.

[@OmniSync]

​@@Artamefulhe can see

[@Faber779]

7:25 top 10 saddest anime deaths

[@SusDoctor]

7:40 he looks so proud of himself.

[@andrewhunt9808]

Completely random fact you didn't need to know: At 3:44 the bassoon melody of the background music extends to the highest note in it's range, an E4. Great video as always btw.

[@Wallemations]

It'd be cool to see an extra screen under the timer that tells you what iteration is currently being shown! I'd love to see how many attempts he takes to complete a room.

[@TheCakeIsNotaVlog]

Seeing him jumping on the spot and spinning in the air was really quite fascinating. For all his dumbassery, he got the hang of scoping out his surroundings real quick

[@khaisianmung480]

LMAO dumbassery

[@enolp]

I’m at a point halfway between laughing and crying because I see myself so much in this little ai cube dude, as if all my attempts at learning how to live life as a human are being monitored and judged by some alternate higher version of myself

[@chaoticgood1977]

We're getting out of the psycho house with this one🗣🗣🗣

[@jellyfish0311]

I'm so glad this was recommended to me. I'm now so excited about Albert's progress with each new challenge

[@AlbySilly]

I'd love to see the ai go back to earlier stages to see if it still knows how to solve it. Or have it solve rooms with the same concept but different layout to see if it's overtrained or if it knows the assignment

[@user-ts1up0ko72]

1:27 he got depressed

[@SpeShieelStaRFiSh]

2:37 “360 no-scope“

[@tomorquotes]

180°

[@CookieGames3]

6:50 he was celebrating

[@isaiahrosner3780]

This is tremendous content. I can tell you spent tons of time on the video editing, not to mention the whole process. I like the added explanations and timer on this video. If I could add one thing to the next one, I’d like an attempt counter for each room.

[@Neko.091]

I just love these videos! You pour so much time into training Albert and editing these videos, plus you gave him an upgrade during it, which I can’t even fathom the effort behind. Amazing job, I really hope we see more of you and him!

[@TheShockwaveDragon]

12:47 -- You can literally see his 'thought process' in his body language: "Whoa, whoa!! Fuck this dude, I'm out!"

[@oatsie8727]

Love how the moment at 12:48 makes it look like he's shaking his head in fear of the spinner lmao

[@MrWildBoi]

He even runs away lol

[@MrWildBoi]

Wait no he dragged himself

[@TheCoriKat]

8:00 it feels as if its alive and is looking at him and jumping in excitement for finishing the course!

[@samdiaz5073]

6:44 dude thought he was Mario

[@ethanwilde4716]

Question: does Albert remember these tests for every new experiment run? Or does he get a memory wipe and has to start at square 1?

[@aiwarehouse]

He keeps the same brain throughout the video (except for Room 6), but between videos his brain is wiped clean. It can sometimes look like he has a new brain when he enters new rooms, that happens when he overfits to the previous room too much, that makes him perform very poorly with anything even slightly different from the room he just left. A series that would be really interesting though is keeping the same brain and just constantly training on top of it, I might do that in the future:)

[@silverstar1726]

@@aiwarehouse you should try out that series! I wonder how smart he would get if his memory wasn’t wiped.

[@brackencloud]

i think it would also be cool to do runs through the whole system, so he has to train for everything. though im sure that would increase the simulation time exponentially

[@YourBoss_CORP]

@@silverstar1726 Heh, imagine Albert becoming sentient and start to develop a hate towards its own creator...

[@korettopun1203]

@@aiwarehouse please do it! Would love to see the same brain develops

[@vassycc]

It's amazing how Albert learns as he explores the environment he finds himself in trying all the possibilities.

[@Ender_Onryo]

It would be interesting if after they manage to consistently clear a room you add a reward for a faster time then let it run for awhile longer to see how fast they can clear each room.

[@gec101]

12:21 the cake was always a lie, Albert.

[@funkey6737]

These videos are very entertaining to watch. There is so much potential for things you can give Albert like a grapling or a double jump or a dash. I imagine it would be very entertaining to watch him figure these new mechanics out. Great job

[@david83597]

same

[@JezzyCrazyTV]

4:34 when the cool kid Breaks His legs: Albert: Look this 720° jump. *Falls*

[@Sandwhxih]

Albert got combo'd by the spinners

[@kadenbonnot8853]

I love the "the cake is a lie" reference in room 6 🤣

[@wades623]

@Foxxo Gaming on the wall in the last one because the end

[@MrrTrash]

I like how Albert has a dance party when he hits a button and completely forgets about the door

[@Juanelidiota]

Nice front flip albert Edit 1: you ok albert? 10:37

[@armsofzeus]

I'm curious what it'd look like if you looped him through the rooms for another 10 or so hours. How many runs could he complete, how clean would the runs look, etc.

[@exodusthanatos286]

Same.

[@Luigifan4ever11]

Albert! Our beloved spinning block is back again! Another excellent video - I already mentioned how the visual presentation makes it fun to engage with, and Albert's cute & simple design and quirks make it very endearing. Even just him having blinking eyes adds so much character. I'm not sure how feasible it is, or how difficult it'd be to implement if possible, but an "Albert cam" would be cute - like, a small thumbnail view in an empty corner that shows off what Albert is "seeing".

[@yunghype8568]

7:59 bro said “Yippe!” Albert (the artificial intelligence) is goated

[@Ronbonco_Studios]

This series is amazing it's so fascinating what in ai can do after so many attempts. I'm so hyped for the next video

[@loop15920]

2:35 Albert: *do 360 no scope* Also Albert: "brah..."

[@cheesewizard3965]

13:36 Albert literally just wavedashed

[@Cocomelonthepotato]

The “Albert… did you just do a front flip” is so funny

[@apptreeline]

Love the cute graphics and story telling. That is very refreshing. AI is a fun topic but most videos are somewhat technical. Very good video. Enjoyed it!

[@exLightningg]

Do you ever run the trained AI back through the levels from the start to see how much it has actually improved? I'd like to see that personally.

[@ZipClipChannel]

From experience, these AIs are used to show deep reinforcement theorems and papers on specific problems (levels). The cube in our case keeps seeing different types of levels, it might ace the first level or mess it up cos it's calibrated to the difficult ones. As a different type of example, you can take image recognition AI trained with reinforcement. You train it to detect apples by their colour and shape,but if you bring one of those yellow apples it might not work cos it doesn't apply to previous scenarios

[@thegraycolour5327]

@@ZipClipChannel what do you mean by yellow apples?

[@gg4rin630]

@@thegraycolour5327 apples but yellow, you know.

[@acalebm]

I already have a feeling this series has an underlining plot that has yet to be revealed.

[@robbybobbyhobbies]

I think you're really just training KZbin viewers to provide you with likes and subscribes. Albert's adventures fill a gaping hole in our miserable existences and we have to come back for more training. Dastardly.

[@grav7616]

8:33 didnt have to be rude against my man albert 😔

[@LowBudgetBoi]

He got so depressed he khs