AI Learns to Use Stairs (deep reinforcement learning)

[@aiwarehouse]

Everyone seemed to really love the video of Albert learning to walk, so I thought I would make a video improving that walk! In this video Albert starts with the brain he developed in the walking video, and he uses that knowledge to learn how to climb up and down stairs, walk on uneven terrain, drop off ledges and even climb up a backwards escalator! Albert is getting better and better:D If you’re interested in learning more about exactly how Albert works, I’ll do my best to explain it here in a simple (but correct) way, but this explanation is nothing compared to what you would learn going through the “Introduction to Neural Networks” course on Brilliant. Despite them sponsoring the video, they’re not paying me to write this comment, I’m writing this because the course is genuinely the best introduction to neural networks (like Albert) I’ve seen, and access to all their courses is completely free for 30-days if you use my link Brilliant.org/AIWarehouse to sign up for a free trial. The 30-day free trial would give you plenty of time to get through the relevant courses “Introduction to Neural Networks”, “Reinforcement Learning” and “Artificial Neural Networks” completely for free:) It's also a great way to support the channel, as you know it takes months to make these videos, and just starting a free trial using Brilliant.org/AIWarehouse would help me out so much! Anyway, onto how Albert works! If you're interested in training your own AI like Albert but don't know how, there's now a really easy way to do it! Luda, an AI lab, recently built a web app that allows you to create and train your own AI using deep reinforcement learning (just like Albert) completely for free in your browser! You build your own character (called a Mel) with lego-like building blocks then watch it train in real-time on their website in just a few minutes (really). It's an awesome project, and just like my videos, makes deep reinforcement learning so much more accessible, which is why I love it so much. This section of the comment is sponsored by Luda, but these words are entirely my own, it's an amazing project that I would have been obsessed with had they released it before I built Albert. I've genuinely been looking for a sandbox/game exactly like this since I was a kid. They're still early, but they're giving my audience first access to their closed dev build. Make sure you check out their site and create an AI agent for yourself!:D prealpha.mels.ai NOTE: It may look like there’s only one Albert training, but there are actually an additional 280 Alberts training simultaneously behind the camera to speed up the training time (and also reduce the amount of footage we need to sift through). HOW THE BRAIN WORKS I’ve explained this in previous videos, but Albert is controlled by an artificial brain called a neural network. His brain has 5 layers, the first layer consists of the inputs (the information Albert is given before taking action, like his limb positions and velocities), the last layer tells him what actions to take and the middle 3 layers, called hidden layers, are where the calculations are performed to convert the inputs into actions. Albert starts off using his brain we trained in the walking video, and we use reinforcement learning to further train his brain for this new task of climbing stairs. The only things that matter when it comes to deep reinforcement learning (reinforcement learning with a multi-layered neural network) are figuring out what information to give the agent (the observations/inputs), and when and how much to reward and punish it (the reward function). Almost all of Albert’s inputs are exactly the same as the inputs we gave him for the walking video (like the position, rotation, velocity, angular velocity, strength and contacts for each limb, plus some sensor observations), in this video however, we also have a sensor sticking out in front of each foot which tells Albert the distance between his feet and the stair in front of him, if there is one. These sensors are the only way Albert can ‘see’, and they only detect stairs, so Albert is essentially blind! Just like in the last videos, Albert was trained using reinforcement learning. For each of Albert's attempts, we calculate a score for how 'good' he performed and use an algorithm called proximal policy optimization (PPO) to make small, calculated adjustments to his brain to try to encourage the behaviors that led to a higher score and avoid those that led to a lower score. You can think of increasing Albert’s score as rewarding him and decreasing his score as punishing him, or you can think about it like natural selection where the best-performing Alberts are most likely to reproduce, so the genes that lead to better behavior will get more prevalent with each generation. As long as the reward function (how we reward/punish Albert) is set up robustly, these small adjustments to Albert’s brain over (sometimes) hundreds of millions of attempts leads to Albert getting very good at completing the goal defined by the reward function (climbing up and down stairs). REWARD FUNCTION Climbing up and down stairs is very comparable to walking so most of the heavy lifting for the reward function was done in the video where Albert learns to walk. In that video, I had to deduce exactly how and when to reward/punish Albert to get him to take steps, so for this video, I used that same reward function to encourage Albert to continue taking steps, just with one additional punishment; punishing Albert when he stands too still. I’ll get into why I had to add this reward in a couple of paragraphs. The reason we have levels for Albert that increase in difficulty is because if we were to throw Albert onto the escalator with only his knowledge of walking, he would have no hope of coming even close to getting through the course since he would need to learn many very complex motions to make even a little bit of progress. Also, I just made a community discord server! If you want more updates on Albert and learn more about exactly how he works (and just talk AI in general), make sure to join! discord.gg/jM2WkNuBnG :) The first level is as simple as we can make it; just a few single steps. These steps are designed specifically to make Albert trip, that way he’ll eventually learn to associate detecting the step with a new environment that needs a different behavior. Albert (and reinforcement learning agents in general) tend to learn to do whatever is easiest while still improving their scores. In this case, Albert originally realized it’s easy to just stop walking and stand still when he detects a stair, and when he does that he no longer trips and falls over the stairs, so just standing still is the easiest way for him to get a higher score. That’s why we added the additional punishment for standing still, we pushed him so he stops getting stuck in that local maximum reward. After doing that he was much more willing to try to step over the stairs and sure enough, after a bit of time, was able to do it consistently. OBSERVATIONS As mentioned above, we give Albert the same information we gave him in the walking video (limb positions, rotations, velocities etc.), except this time we give him 2 additional observations in the form of sensors coming out of his feet to detect stairs in front of him. Giving him these 2 new observations means I had to retrain Albert’s walking from scratch with 2 additional null inputs, then continue the training on this new brain, since otherwise there wouldn’t be any room on the input layer to give him the sensor data. Thankfully, since the walking behavior had a very carefully modeled reward function and I didn't need to record the training, it didn't take long for my computer to train it again from scratch (about 45 minutes). Adding new observations to this stair-climbing brain would be much more laborious since I would need to train each room at a time. While the walking AI didn’t actually need all the rooms to train properly, this one did. FINAL CHALLENGE The final room was very hard for Albert and unfortunately I ran into a big issue I didn't anticipate. I realized too late that since Albert is only given the distance to the ground under his feet and the distance from his feet to the stairs in front of him (if there are any), he isn't able to differentiate normal stairs and the escalator, but the motion required is very different, so it makes it impossible for him to only use one brain. I didn't plan on making him go up an escalator, that was an idea I had later on in the development, and because of that, in the final run he actually uses 2 different brains, he uses his main stair brain until he hits the escalator, then uses the escalator brain, then when he reaches the top of the escalator, I swapped it back to his main brain. There is definitely a way to have one brain work for the entirety of the final room, all that's needed is to give him an extra observation of whether or not the stair in front of him is moving, that would have trained the escalator behaviour into the main brain, unfortunately I just didn't have time to re-train everything to make this work, since it already took 3 months to make the video lol. We're looking to hire people to help make these videos! If you're a talented Unity game developer you can apply for a full time position here forms.gle/ko54z1LQmZNUT9Vp8 And if you're a talented AI developer (ML-Agents), you can apply here! forms.gle/Uou1Vwb5Q9VccaAY7 We're looking for full time employees, but part time works too, what we're really looking for are skilled and passionate people, so feel free to apply if you're interested! :D Thanks so much for reading and watching!

[@lukeydude15]

I think more sports with multiple contestants would be cool

[@WHLSHRK]

Nice

[@nexolu973]

Hi😊 How are you

[@ljushastighet]

im unda the water

[@nexolu973]

@@ljushastighet nice👀

[@WerstoftheWorst]

I'm so invested in Albert's development Also i like the idea of a person just casually doing a backflip to not fall on the stairs

[@genericuser984]

it feels like something that would happen in Grappler Baki

[@molten2010Again]

That happened as I was reading this comment. Wow.

[@asterlofts1565]

That reminds me of the Boston Dynamics robot called Atlas.

[@gabrielv.4358]

yesss

[@mewhe]

​@@genericuser984its missing the absurdly long explanation for the backflip from the narrator

[@Franwow]

Can we get a "Albert learns to backflip"? That is clearly his dream, we would love to see it as (virtual) reality.

[@frostcoldtechguides]

Here it is 3:25 4:15 8:44

[@neilnan.45]

Albert needs to learn how to jump first

[@isrealieditz445]

He needs to study 2+2 first

[@Swagpion]

I also want this

[@mavrikgaming970]

I really want that

[@wackjallace]

I cannot wait til we get to the point where Albert is put in an open world and is given a list of quests and adventures

[@AnimationsAndOtherStuff]

What if his friends from the racing video go with him

[@chocolates_muffin]

I want his life to be like a shounen anime....goddamn that sounds cool

[@SquareBlock5]

He needs to learn how to fight in the next, next video

[@AnimationsAndOtherStuff]

@@SquareBlock5 true

[@AnimationsAndOtherStuff]

They could fight monsters and meet new friends, maybe craft some new tools

[@beepboprobotsnot3748]

I'm fascinated by the learned helplessness that Albert displays. In the previous video, when Albert fell, he'd start flailing around, trying to get back up. But now, he just freezes up entirely, because, after 1000s of runs, he's learned that there's nothing he can do to recover. At this point, even if you altered how his joints work to give him a way to stand back up, I doubt he'd be able to figure it out. He just wouldn't try.

[@unlonsee]

like elephants tied to a rope?

[@yoloboogie3674]

@@unlonseelike my skinned cats in the house

[@rdtyphon6684]

Like the kids "locked up" in my basement, it's been unlocked for 245 days, the fools have yet to figure it iut

[@satishkumar419]

That won't happen the ai is based on random alternations so eventually it would learn to stand up again

[@willguggn2]

@@satishkumar419 Albert has no incentive to stand back up; only to not fall and to conserve energy (or get punished). Just giving up probably rewards more points than even trying to wiggle on.

[@dr.criston9489]

Fun fact, the binary code graffiti on the wall of the second stage spells out "help" Very humane AI living conditions, I see

[@sixeleven637]

Knew i wasnt the only one that noticed it

[@sirjeff2396]

its seven lines so i think it might be h/e/l/p/ /u/s

[@wolfsyncc]

albert arg when?

[@GigiBranconi]

I wish I could help Dx Maybe Albert will one day save them all

[@fireball787b]

It says 'help us'. Im glad to see that im not the only one who checked it❤

[@heartisles]

Is no one going to talk about the simplicity and beauty of that sponsor placement? From the way it starts with the map of Albert's brain to make you think "What am I looking at?" right into the placement (with the lesson examples) of "You can learn this and more with Brilliant. Here's my code." Well done

[@heartisles]

Also I've used Brilliant (free and premium versions) before. It's really neat and a wonderful service. I can personally vouch for it

[@SphereBoxCube]

And it's not intrusive at all

[@squadbroken962]

Agreed, take note KZbinrs 'cause that's how you do a sponsor RIGHT

[@Chicken_o7]

I think it's very smart placement. It's in the background of Albert walking, so people have the incentive to watch the whole thing instead of just skipping it

[@X-pqiryiwqo]

This is an absolutely brilliant way of showing you can do sponsor/ad in a non intrusive way! High respect for channel owner.

[@noatmealcookie02]

I love how Albert discovered his love for backflips in the process... also this is the best AD integration I seen for my twelve years of being addicted to youtube

[@bendubz9000]

Doing the worm when learning to crawl, and loving backflips, AIbert is a thrillseeker!

[@FelixEvers06]

I'm really impressed with the fact that I could *see* the different ways he was walking. First, on the uneven terrain, I noticed his steps getting much more forceful. Then, on the escalator, his steps got a lot faster! It shows how he can tell what kind of terrain he's working with, and how to best tackle each of then.

[@blazryvlogs2535]

This man did what no one else could He made a sponsored segment actually enjoyable to sit through

[@DefinitelySpirit]

I'm not gonna lie more sponsors should be formatted this way. The subway surfers mentality isn't always too bad.

[@enzogabrielmoraes3660]

​@@DefinitelySpiritWHAT DO YOU MEAN, I FUCKING HATE SPONSORSHIPS WITH ALL MY FUCKING BURNING FUCKING PASSION

[@_sola1re_]

@@enzogabrielmoraes3660 lol?

[@Delibro]

Jay Foreman: Am I a lie to you? 😀

[@LiamLivesOn]

You guys have obviously never heard of the ADstronaut

[@Phroghetti]

Us: Robots won't take over because we haven't given them a reason to Also us: *Alberts in a lot of pain right now*

[@GigiBranconi]

Poor Albert :(

[@4_rol4]

he's learning the HARD way

[@AnimePlace-FR]

Also us: Training Albert to be perfect

[@mosessinanta8005]

No pain no gain

[@ScuttleBugReal]

Once Albert gets a physical body we’re all dead

[@TangoCharlieWhiskey96]

I’m a simple man. I see AI warehouse posted a new video of Albert learning, I click like.

[@ljushastighet]

im gonna massage my keyboard iofjgiojgiotiotihtrjboibtrhjiyhotskpafoghyekotgpyknpomnim,gpågkjhoitp,gjihokboihowpjgkothlår,vgotykhjy,vktohyktpkhptkgoåk,opfjg9065jh9å635jtrl kotn kt lkfmote,repltp5iy0965iu69ujkbopetkyhoeyjhopetmbioåetypjmhboptkbnopyrkj0+ptlhotåji0kr+tkhn0956ei6kh0´+tyk0+etjknh0ytk,hb0ytoknopytkhäoyxnptgjyphnåkytk0ojunykoåkojyijomynjimonkonkoyn,onyok,nk0rnk,rngmopnomiojm

[@LittleSealPupper]

Smae

[@saturn_th_silly]

sameee

[@Axoy2024]

am a simpler man

[@lolgoodbye8197]

Oh so where does that magical like button appear from? You gotta be a bit more complex like me, I click the video to be able to click the like button

[@annojance]

The ad integration in these videos is next level. It's relevant to the theme of the channel, and a lot of the viewers must want to know how to do something as cool as this themselves.

[@nyeeeeeee9346]

also it doesnt completely throw you out of the flow of the video, i hate watching a video and enjoying it and then it cuts to *THIS VIDEO IS SPONSORED BY SQUARESPACE*

[@sherm2572]

@@nyeeeeeee9346*ARE YOUR BALLS HAIRY?? THIS VIDEO IS SPONSORED BY MANSCAPED*

[@SpookyTimestamps]

It's really good

[@HelloTurbo]

I’m so proud of Albert! Figuratively, he’s gone very far. But in a much more literal sense he’s still that same little back-flipping orange box with vacant eyes. :)

[@asterlofts1565]

And doing backflips and frontflips. XD

[@Pingviinimursu]

That's probably one of the most effective sponsorships I've seen on youtube. Had I not already taken university courses on the topic, I might be tempted to check them out myself. Very rare that Brilliant sponsorships do that to me.

[@phoenix402]

i guess you could say it was a.. *brilliant move*

[@yangliu6901]

@@phoenix402chess moment

[@Mo_2077]

@@phoenix402great one

[@thatoneactualdude]

​@@phoenix402triple entendre huh?

[@stickmandosedoanimation]

7:21 i love how excalator is going up when its going down

[@bormisha]

I guess it's the effect of aliasing. It's like wheels on a car in a video seemingly rotating backwards.

[@JeSuisMrCraft]

This channel rarely uploads and it takes alot of time and resources to get them done. Thank you for making these wonderful AI videos!

[@ljushastighet]

yes but i think my keyboard needs a massage i haven't given it a massage in like 6 minutes so yes im gonna massage it gtisbniningrvirginbeetnnegtodrngiortngbirnbhiotgrjnmbhiotrjbitrjbitjmitohmbjtihbtiohmbtiomgrbihyjiyjhmobgmpoyhoko,lbmgthyjioml,föbmäihjyootbgmfbhmtoi,bmhotmb, lkgdijnmoipgö,nkitymnbpogfmjiodtrlsf, bmöhtrkmf,lvöägkhopbdmrtfhioglvzdsöfnhjmfxodklbmdlgkbm oöfadjnbmopägmjhbioköldfbn+0p,ujposerjmhblötdkmhnölykoögxcmnbiödkgmn okbpyk,npå+gokn,påfg,bpogfknohnmgopijnkåpgdhojnk09kothjiut09pofjuh5åojh0åoypkjh0+kponopdtykjhobfgokjgowrpjigbk+opm,g+0trojbkpgtkhb0+dgrpkogvpotkhpetrs-al,bvpko

[@ljushastighet]

hm i think i need to massage my keyboard mmmmmmmmmmm jijgvitbtytjnyuytntbintngitenitnbneeingbgtiojtgiotgsiotntrijotriotrniot wenemenciosama nfviejbijbiojbietjbjjvijvrejgiejgijgijgorejgojbgoejbiotjbhitboitjbtibtinrijntjhbotkboptkbotjotrjnorjotrjorthmotj turip rjgiojhbotrjbiotjbmiojmbiorgjbmotibotgjboirjbiogjnoitrjojiojotrjbojtbiotrijmobtrkobtrobjmtrob

[@jackwright2012]

It takes about 300 hours for each video due to learn bots just as being dumb as newborn babies. The only difference is that learn bots remember. Not hating on anyone. Just the truth

[@JeSuisMrCraft]

​@@jackwright2012I do remember that this requires super strong CPUs, it's got to be really expensive

[@chapteronefrog]

I love how the narrator began this series so nice and compassionate to Albert and as time went on, they got progressively more critical and sadistic. It's a really interesting and clever kind of subtle storytelling, and I'm excited to see where it goes from here

[@FailRaceFan]

I would really enjoy like a five hour video of just training footage. With barely any editing, just the stuff you recorded for the montage anyway. Would be great for studying or gaming. Everytime there's a break, you can look over at how far the AI has come. Anyway, quality over quantity. Great work from you!

[@KriiKurii-b6i]

Would also be funny just to see Albert continually suffer

[@vixboi]

"If you beat everything, I'll let you out" DUDE YOU’RE GLADOS

[@baronmerchandise]

fr

[@fenyx4372]

I’ve read all the text in her voice

[@BIuePotatoGames]

But reverse the robot is the one doing it and the human is telling him what to do

[@Skybreaker1337]

The cake was a lie in the previous video, so the parallels are pretty clear.

[@vixboi]

@@Skybreaker1337 maybe this channel is glados after the end of portal 2, just testing on ai

[@BioticBlitz]

I've been here since the very beginning of albert's journey and it makes me SO PROUD TO SEE HIM IMPROVE! I think a really cool thing for him to try now would be learning to grab, push, pull and carry things! Maybe he has like a key he needs to take somewhere else or pull on a rope to open the door. No matter what he learns next I can't wait to watch!

[@stanisawkrzyzaniaktheoviraptor]

Oh that gives me another idea! Albert and his friends learn teamwork!

[@shortndeadly9977]

I was thinking it could be cool seeing him carry a glass of water and trying to not spill it while walking through obstacles.

[@muscasgames7143]

I hold my breath every time Albert gets close to his goal. This is more suspenseful than TV drama.

[@SpathiCaptainFwiffo]

Imagine piloting a mech, but you dont know the controls, and your 'vision' is just 48 evenly spaced dots that change color based on what would be seen. You also get an electric zap if you do something wrong, but it would take a lot of trial and error to figure out what is 'wrong' and how to avoid it. Similar thing with rewards.Thats what it's like to be Albert. Be nice to Albert.

[@JustShotsForMeh]

Albert is like a competitive gamer. The moment he feels any adversity, he just sends it and griefs all the way.

[@daxitron]

The fact "help" is written on the wall by the stairs is hysterical to me. Someone is sending Albert a message!

[@thishandleisavaible]

The binary code in the beginning (Stage 2) 01101000 01100101 01101100 01110000 00100000 01110101 01110011 Means "help us" And in the end 01010011 01010100 01001111 01010000 Means literally "STOP" like the real sign lmao

[@stevensonjr]

I'M Happy I wasn't alone having fun decipher it ;)

[@PaytonBartscher]

@@stevensonjr same

[@genemutant]

@@stevensonjr same

[@solidturtle6910]

some nerd stuff

[@Spasmission]

Albert inspires me to learn artificial intelligence so I can make a family for him.

[@Pingviinimursu]

Do it! You'll be so glad you did when you're done! :)

[@CeoMacNCheese]

@@Pingviinimursudecades later and an electrical bill in the thousands every month:

[@ue337]

@@Pingviinimursubecause now albert removed him from his human sh#t list

[@Everything-l6t]

0:12 when you miss that one step on stairs

[@Sergantnoob]

fr tho

[@krnt13]

Can we teach Albert to get up?

[@FrozenWater-real]

I said that 3 months ago

[@zzexd]

Yessssssss

[@KovickLee]

your in to o to free?

[@musicgraze]

But its a punishment, if he gets up then he wouldnt learn.

[@unorthodoxpickle7014]

​@@musicgraze You can still make it punishable but not as much as not getting up. Just like in real life, getting up is important after falling.

[@Mr.Stizblee]

I just want to say that I appreciate that you didn't interrupt the video with the ad. Keep up the good work and congratulations on the sponsorship!

[@Tubeytime]

I'm so impressed at this little guy's ability to fall down and remain upright! Seeing him walk from a first person perspective would be very interesting.

[@squidward120]

Honestly its fun to watch him grow his own little strategies For going up, he lifts his feet Esculators, he lifts his feet and slowly scoots to the next stair Dropping, he points one of his legs down like a spring while another one pushes him up if he falls Messy terrain, he lifts his feet and stomps them into the ground

[@leighkenneally7969]

2:19 "It's only up from here!" They say, as a set of downward stairs are literally on the screen lmao. Anyways I'm such a huge fan of this channel, keep doing what you're doing.

[@mr.whimsic6902]

Nice sponsor integration, I wish more youtubers had theirs involved with the video itself, like how you did it.

[@Kram1032]

First of all, that's one of the best sponsor message integrations I've seen: Just keep going with the content that just so happens to take place in the message Second, Albert is getting really good these days! Albert is walking really nicely in this one by the end. Still hoping to see some of the suggestions I've given in the past, like slippery floors. I think walking downstairs is generally harder than walking upstairs, so a downwards backwards escalator would also be a great addition. And slopes. Some randomization would also be good: It looks like Albert learned a more or less specific path over the rough terrain, rather than learning to deal with any rough terrain in general. So randomizing that terrain each time would presumably make him far more robust with that

[@sirshagglesworth6740]

I can't explain it, but I am unbelievably proud of Albert rn

[@Znetsixe]

livestreaming this would be really cool! just 24/7 streams with albert learning skills like jumping over gaps/obstacles, actually getting up if fallen, running, crawling, even picking up things and eventually evolving to making tasks in a little world and questing like someone said.

[@fusionneoseeker]

Congrats on the sponsorship with Brilliant! This seems like a perfect partnership for your content so I'm happy to see your channel getting recognition for the amazing high quality content you provide. That sponsorship segment was incredibly well done and made me want to sign up for a free trial. Thanks for inspiring learning and curiosity :)

[@blakewhite3131]

Awesome way to integrate sponsors in a way that doesn't interrupt or impede the video in any way!! While also being prominent, visible and relating to the video. I love Albert, but I'm also impressed with how creatively you think.

[@aquaphoenix-mt2iv]

I find the fact that he learned to backflip, almost as a self-destructive stress response very interesting. The same way one might get anxious and revert to old habits that are bad for them. Because once he's in a bad enough position, he reverts to backflipping to minimize the pain, because a long time ago it helped him get hurt less a few times, and occasionally is does reduce the pain. Even though he could be learning to recover from those bad positions, and statistically the backflips are overall reducing a success rate compared to if he didnt, since a backflip never caused success. Alberts backflips are essentially a trauma response to his early struggles, and can actually be a good dumbed-down way of explaining "illogical" (usually trauma enforced) behavior to people who dont entirely understand psychology.

[@unknowed5048]

Man I wanna learn how to do a backflip to deal with my stress.

[@Arthur19-v3y]

Two great things about this.... No annoying voice over. And good grammar. Both of those are overlooked these days imo. Amazing content! New subscriber here

[@tritonis54]

How is voiceover a bad thing again ?

[@pancakedev6]

@@tritonis54 because most voiceover nowadays is just MAKE SURE TO LIKE AND SUBSCRIBE AND SMASH THAT LIKE BUTTON!!!!! and then 900 hours of sponsorship and begging for subs

[@tritonis54]

@@pancakedev6 How dare they try to rentablise their activity. It also bring more humanity, help with the rythm, make it easier to explain and add details.

[@pancakedev6]

@@tritonis54 i am having a stroke while trying to understand what this means

[@tritonis54]

@@pancakedev6English is not my mother tongue but come one, I perfectly know it was not *that* obscure.

[@scorpioftw]

I loved the hidden "help us" message at 3:50 hahaha Nice easter egg!

[@gaychinloong462]

Wait, that's "help us" in binary code? That's a cool detail

[@The_Dr_Fate]

the floor?

[@Byzz2077]

@@The_Dr_Fate no, the binary on the wall

[@amemeadaykeepsthedepressio9761]

I could be going insane but I think the floor also says help us

[@Byzz2077]

​@@amemeadaykeepsthedepressio9761I think you are going insane /j

[@cheesecake4204]

We should be more supportive of this fella (Albert) he’s been through a lot and learned so much.

[@herodoesstuff]

wow, i was really surprised and impressed to see him get through that whole end sequence! good job albert!

[@WumpusAlpaca]

I have been doing some research on reinforcement learning models for my AI classes and this video is a great excuse for me to enjoy the shenanighans of Albert in the name of research. I love AI warehouse ❤❤.

[@havenkeeper6400]

That could be the most well-put together sponsor section i have ever witnessed. I was engaged the whole time. Well done

[@goodguyguy5022]

That sponsorship was brilliant putting it in the middle so it doesn’t interfere with the video

[@HAGCY]

11:30 Albert is learning our childhood habits of skipping stairs 🥲 he’s grown up so fast ❤

[@UnrealStingray]

0:25 beat was perfectly timed with his collision

[@AllExistence]

That final walk was really impressive.

[@gheee317]

When he started hopping 2 stairs at a time at 11:22 I actually went "oh my god he's insane"

[@naiahnunns5917]

he really is a mad lad

[@cewla3348]

he just like me.. HE JUST LIKE ME FR!!!

[@xenu4life]

Man, he EARNED that cocky strut.

[@RussianSpy4632]

I really hope albert gets friend, rivals, and has a whole series with him as the main character. The Training arc goes crazy

[@brownfrogfromyournightmare]

His rival is now a thing...

[@Dummy-idk]

Kai

[@La_Jupo_REAL]

Ok I can't get over how frantic and excited it looked like he got at 7:00 lol

[@andresolbach]

That music is fitting perfectly at 9:09 love it!

[@wolfpearl2734]

I really love how you can see the difference between his walking skills at the start of the video compared to the end. He's doing great!

[@gabrielmoreno7112]

"So Albert is in a lot of pain" Albert: *proceeds to die while flopped once again*

[@CoreVR-strongcore]

3:47 he skipped steps like an angel then he jumped of them did a front flip and into the splits. Wow already a master of it

[@Kappq]

Your channel destined for success. The video quality, Albert's engaging journey, clever easter eggs, entertaining music, and polished editing are the reason why I'm able to sit through a 10 minute video of an AI walking. Not to mention the brilliant (I'm sorry) sponsor placement. Kudos on the great work - keep it up!

[@schleepy6362]

8:44 when in doubt, backflip out

[@wisawaboc5999]

When in pain fuck a wein

[@danielnaumov1241]

Yes

[@UltimateGamer-bm6yt]

XD except I can’t do a backflip

[@arfinshahadat4599]

Lol 8:45

[@frostfar]

i still remember when little albert doed the worm break dance step, trying to walk... now hes chosing his hobbies... they grow so fast 🥰

[@austinaustin737]

11:25 Albert skipping happily down the stairs is so cute

[@un-event-ful]

I KNEW IT! This series had potential for some secrets and the binary on the wall in level 2 was perfect! I didn’t even catch it until watching it back a second time. Plus the ending was great too!

[@samariumproductions5287]

the only sponsor that doesn't ruin the video

[@reeceshugrue6167]

9:42 - 11:37 Albert doesn't need to hear all this, he's a highly trained professional!

[@Dipshit298]

this comment is too underrated

[@marvinarellano3087]

*Residence cascade*

[@asterlofts1565]

​@@marvinarellano3087 Half-Life reference. :) No, seriously, seeing how video games evolved, A.I. and many more things related to electronics and the virtual is amazing... in almost 30 years, these things have grown so much... and soon we will have massive virtual worlds (VR) or at least, that compete with the traditional games we know today in day. In addition, there are techniques from several years ago in computing/video games that are still used today, such as the flashing lights in Half-Life games.

[@asterlofts1565]

​@@theshortsbuster Hahaha, is Albert Freeman (LITERALLY, HE PURSUIT THE FREEDOM).

[@GAMEOVER__YT]

4:18 I think it’s because in a short he learned how to jump so he might be trying to jump across it :O

[@lauraalba3564]

7:38 Looking at this FFW, looks like the staircase is going UP rather than DOWN xD As always, great work, for Albert making throught the obstacle course, and AI Warehouse for making it possible :) I wonder what will be Albert's next lesson.

[@AquaQuokka]

Glad I wasn't just seeing things

[@amethyphoenix]

@@AquaQuokka Welcome to the world of optical illusions

[@ReyanshsAccount-pm1ln]

Our brain is interesting very very interesting,wouldn't you agree?

[@Fxrrari]

3:24 I cant even backflip! Well done Albert!😂

[@pedroMiguel0_0]

More impressive than the staircase

[@S3PH13]

So beautiful 😍

[@NubbyFNoobster]

Albert doing a backflip is so in-character lol

[@Henry00]

Thank you for adding the complete run at the end, that makes it all the more impressive!

[@AlscBR]

First, he teaches Albert to walk, then he teaches him to climb stairs, he is training Albert to dominate the world

[@nuriafabrega7410]

That video was so amazing! I was so happy to see a new video posted by you, I've adored all of them to pieces! And the way you showed your sponsor was the smoothest way I've ever seen any youtuber do it. Great job!

[@caspergaming9345]

10:22 I like how it can detect a square but it never draws a square

[@APDD5586]

beacause.... the pixels are squares? idk

[@A_Nerdian]

Ive seen a LOT of Brilliant sponsors but I have never seen one like this where it just fits perfectly into the video where it just doesnt look like a cut in part and it caught me off guard. Very interesting.

[@luisostasuc8135]

I absolutely adore that you've evolved past interrupting the presentation to stick in a sponsor bit.

[@QuirkyView]

It would be interesting if the punishment for falling were based on how much a human would feel from a fall, like the speed of impact and such, so he learns to catch himself when he falls

[@Twi_543]

Yep good idea

[@Pingviinimursu]

I believe velocity and point of contact with a "damage mapping" based on where he hits himself would be enough to learn it. More damage from head, less from feet, etc. To make it even more accurate, the mapping could be a function of both velocity and point of contact, since at some speeds it's ok to catch yourself with your palms or even forehead, but not at higher speeds 🤔

[@r_kinesis8860]

babe wake up new ai warehouse video are you one person btw? i've been seeing a lot of content farms but the way you upload it feels like you're one person

[@aiwarehouse]

I started off as one person but our team is starting to grow! I promise you though, the videos will never feel like a content farm, I have no intention of ever lowering the quality of our videos, I'll always just be trying to make them faster and better :)

[@LordDragox412]

" I started off as one person, but after implanting myself with A.I. you can call us *LEGION.* "

[@The_Dr_Fate]

​@@aiwarehousecan u make a face reveal for u and ur team when u will have for example 1 million subs?

[@gametech4101]

11:41 I expected "Now Albert will learn to survive in a zombie apocalypse"

[@Kaiser_prussia]

LOL

[@Noob-commenter-lol]

Theres a stop sign With STOP in binary..

[@SpaceUK45]

10:05 absolutely brilliant sponsor segment (get it)

[@dot.moontoon]

Episode 2834: Albert learns to care for children while his wife tries to divorce him

[@oliverfife208]

It's not deep reinforcement learning It's just learning that cuts deep

[@joywright7392]

Episode 2835 Albert learns to retire

[@ShannonJosephGlomb]

😂❤

[@emer486]

@@joywright7392episode 2836: Albert learns to come back to KZbin episode 2837: Albert learns to make a KZbin account

[@viperlineupuser]

episode 2838: albert travels back to the past to create a youtube channel called ai warehouse.

[@cryozen2467]

I love how after a certain point, every time Albert almost fell backwards, he tried to do a backflip. I guess he learned that if you're going down, you gotta go down in style! ✨

[@CaptainGlack]

Absolutely love these videos. Always look forward to the next one!

[@lambertlikoko6617]

My GODNESS !!! It's just unbelievable !!! I'm really impressed !!! Albert you're AWESOME !!!

[@casenswartz7278]

The Brilliant ad was brilliantly placed, well done!

[@felipecantarero3107]

7:18 9yr old me on the mall:

[@sethmichaelson1612]

And then you'll be pissed cause they ask you to use it correctly, which now that I think about it, they're right.

[@Phoenix-3148]

I would like to advise you to teach Albert to get up after a fall. That even if something didn’t work out for him and he fell, so that he could try to get up and continue on his way.

[@HAGCY]

Next idea! Albert learns to backflip

[@seanthefurcorn4859]

11:59 Bro got yeeted to space.

[@oliver8911]

Bro wha-

[@Istoleyourbreadandateit]

Albert go space

[@Ekstrax]

Your videos are so good! Music, editing, concept and execution! I couldn't think of anything you could do to make these videos any better, and i love the fact you can see Albert progress from cube to whatever the future may bring :D can't wait to see where this goes, subbed!

[@Bendy_cutout]

There is hidden lore in these video's... The more you know

[@Haxihoovis]

9:00 Albert's steps sync to the song "Fine" by Lemon Demon!

[@Brainmush635]

that’s very specific

[@Haxihoovis]

@@Brainmush635 I mean, it's what I was listening to at the time

[@Jroobelucios]

@@Haxihoovisbased I love that song

[@hidroixes8628]

"Why didn't you gave up?" "Cuz he never did"

[@dadeliepanguinexe2828]

The Captions are always so nice. It cannot be understated how much this passive aggressive text adds

[@ZacharyStiles]

Probably the best integrated ad I've ever seen on KZbin 😂

[@ryanzenith1984]

He literally learnt to backflip before learning to climb upstairs. Albert is ahead of us.

[@Skybird1525]

With all the text, I decided to imagine the text being voiced by the stanley parable narrator. And it fits too well. XD Great vids!

[@booferguy]

Cmon where’s the Einstein in his name?

[@Epiczhul]

Yes! Where is it!

[@alexkingsley2364]

You should teach Albert how to jump! He really wanted to backflip in the video, maybe he'd like to learn jumping?

[@iceypumpkinhead]

One must imagine Albert happy.

[@julle4017]

This has one of the most well made sponsor spots I've ever seen

[@michaeljenkins178]

For anyone curious about the binary at 2:00 It says "help us"

[@scorpioftw]

Hey someone else found it. I haven't seen another comment about it

[@thecoolbird13]

there's also a sign with binary far back at the end scene, but it seems too low quality to read

[@michaeljenkins178]

​​@@thecoolbird13 you mean on the stop sign? Its hard to read but possible if you zoom in. It says "stop" honestly dont know why I'm suprised.. If you mean the poster on the building.. that has Xs on it. So its not binary

[@thecoolbird13]

@@michaeljenkins178 i think it's binary, but its _just_ too low quality to read

[@michaeljenkins178]

@@thecoolbird13 even if it was (its not) theres numerous other symbols mixed in there. Idk of desktop KZbin has this function, but on mobile, im able to zoom in quite far and read it decently well. I cant read everything, but I can read that Its not binary. Theres numerous Xs in the poster.

[@adamhall6914]

Awesome advert placement

[@ForMiSoft]

Wow, Albert is a future parkour star! I like his style on the last stairway down ( 11:22 ). 😎

[@69420nice]

He's skipping the stairs😎

[@somebodylikeidk]

In a cool way

[@aeris-mo]

Nice to see the progress