AI Learns to Escape A Maze

[@aiwarehouse]

Thank you so much for watching!!! This video took SO long to make, if you want to learn more about how the AI works, keep reading!:) Also, Tyler on our team spent a TON of time making an awesome AI Warehouse Maze game you can download for free on our discord! Link: discord.gg/qDRtuFe5gp Mazes can be really tricky for AI because of the nature of the rewards. Albert learns via reinforcement learning, meaning he’ll make an attempt, we reward/punish him depending on how good/bad he performs, and he makes small changes to his brain over time to try to get as much reward as possible. The reason mazes can be so tricky is because the only time you can really give the agent a reward is when they beat the maze, so they have to randomly beat the maze in order to get the reward, rather than the normal small improvements over time. To try to get around this we rewarded Albert for exploring tiles, so Albert’s goal is really to explore as much as possible, and by doing that he eventually stumbles to the exit. Even with rewarding the AI for exploring, mazes are notoriously difficult for AI to complete which is why the final behaviour took so long to train and never ended up being smooth! For example, I have no idea why Albert turned around at the end of it ahaha, my only thinking is that during training he could have learned to procrastinate hitting the button in order to maximize how many tiles he explores, but there’s also a chance it was simply random. A BIG thank you to everyone who made the fanart included in the video, thank you so much!!:D echotecho, lrenrut, indigofexi, clopans, chimbrodapro, ibogdanmihai420243, kaeii_128, nltj, sparkygamez3, umii.eru_, glutenfreecactus, jaronamoetophat, lub_riot, themindbreaker, zooycuddle, midwestaphobic, usrtheusr, mugeriego, hector31459, sockssss05, victornolan, jakep2024, josh_delightful, f8kir, soys3bastian, h.oopity, lehuy3760, asdfzxcp, _ws09, pactakt, saturn0286, africc, thecerealmaster, bardofstives, _audrey0626_., bioinvasion, b3lla, cuitin, frostiethehunter, supernova15, phoenixemp123_yt, blurryfqce, gradiential, nelilol Thank you SO MUCH for watching, I hope you enjoyed the video and I hope you enjoy the free demo game:D

[@MSMKingOfBacons]

nice

[@MR.MohsenAsl]

چطوری هوش مصنوعی میاری میشه بگی با چی درست میکنی. من ایرانی ام

[@Whatssupmyfellas]

hod did he comment 1day ago???

[@XMiloxer]

How did you send this a day ago when this vid was released just 3 mins ago??

[@secilmisolan4686]

Hey, you really need to make albert play squid game, that would be very interesting lol

[@PaintTheWorld911]

Albert went back to save a Kai despite Kai trying to kill him, true forgiveness.

[@jellyfish0311]

They're brothers, after all

[@antonistasiak1343]

Always... good comments are taken

[@ImminDragon]

If you watch around 9:35, Kai actually *avoids* touching Albert. Those two were clearly working together on this one!

[@Jcarby24]

The way he almost straight up targets the glass countdown almost immediately makes my day.

[@HappyAxolotl24]

Albert be like: Step 1. Punch glass Step 2. Solve the maze

[@Pastryman-g9u]

Reminds me of the fact you can break Wheatley's screens in Portal 2 Albert for Portal 3 leaked

[@not_umbre]

​@Pastryman-g9u there are children in Africa who don't have monitors to test with

[@airmanon7213]

Did Albert think that breaking the countdown displays would buy him more time?

[@Deletirium]

That's what I was wondering - maybe he thought the countdown stopped with the display? ​@@airmanon7213

[@ChocyAddict]

Albert is the best he even saved Kai at the end

[@bable6314]

He legit went back for Kai after he opened the door lol.

[@oddlyoaktree]

I love that at the end Albert went back to save his friend Kai from the maze too.

[@Gmeare]

The quality is such a step up in this video!!!! the older ones were obviously good too but this one is amazing! good job to the whole team for this one.

[@dynastykingthereal]

yes the level design has animations stuff now very cool

[@Jakarters-tr5sd]

L trans

[@adora_was_taken]

new AI warehouse lore just dropped. albert's being tortured in a post-apocalyptic world

[@CameronONeill-y1r]

I see you are a fellow background noticer

[@YufanWang-t6k]

Now there's LORE 9:24

[@adora_was_taken]

@@YufanWang-t6k it's adventure time all over again

[@somerandomguy-3102]

there’s a lore channel in the official discord server lmao

[@ethanwilde4716]

​@somerandomguy-3102 there's Lore?!

[@iateseventeenfriesatonce]

the narrator’s use of “investors” is actually so interesting in terms of potential lore

[@dznutskong]

would definitely explain why the narrator would only conditionally show any kindness towards albert when he does well and would be mean otherwise

[@Paltic]

I think its just a metaphor for patreon members

[@beanofknowledge2125]

Wow, you really upped the Production Value for the stage changes with this one, the transition between mazes at 1:14 is so good!

[@MrDj232]

I love the little character moments of Albert smashing displays when he comes across them and spinning in circles after clearing the first trap.

[@HappyAxolotl24]

What would happen if we combine everything Albert has learned and put him into one of those Boston Dynamics robot dogs

[@that_guy1211]

that'd be extremely expensive cause you can't fuse AIs that learned different things in different environments, instead, you'd need to make a environment suited for one of those Boston Dynamic dogs, and then train an AI for it, which is what Boston Dynamics does anyway, so it's kind of pointless /shrug

[@ver_nick]

Sadly it's a different model every time, there is no single Albert model

[@fluffsquirrel]

@@ver_nickThe Albert multiverse! It's the same Albert, but in different timelines!

[@Banana_Fusion]

@@ver_nick Would be cool if they kept the same Albert for each video, it would slowly develop over time

[@nicholashuggins8201]

First of all, it would fall over. Second, do a backflip Third, try to escape.

[@ArkThePieKing]

I LOVE the new path trails, seeing where albert moves between iterations is wonderful

[@fluffsquirrel]

Kai following Albert in the end as a buddy instead of a rival just made my day. Thank you guys so much!!!

[@DangerGamer95000]

"repeatedly burning in lava is a great way to learn!" - all schools

[@khoinguyennguyen7888]

i love the "yuuotulkaomwbtafvkjfiQPomXui" at the end that lasted for 3 frames in 10:22

[@nicourugumont3798]

I Saw it too, it isnt a KZbin video btw, it's too large i tried it.

[@fluffsquirrel]

Decryption OSINT team, assemble!!!

[@GreenCat188]

​@@fluffsquirrelwhat is it

[@scalemerald]

base 64??? some type of decryption algorithm of that type would work, as the size would collapse down, but i hesitate to say its base64 bc theres no numbers....

[@GreenCat188]

@scalemerald hmmm

[@MICROWAVE362]

CHAT WAKE UP, NEW AI WAREHOUSE VID JUST DROPPED

[@thedudeinalotofthings]

waking

[@TheSupremeLeaderofTangoMangles]

finished waking, watching :p

[@Zahar-co6xz]

Just finished playing games and new video 🤑🤑

[@Septeogaming]

Yippiee

[@MrVegettofan]

Finally a new video🗣️🔥

[@verixer4032]

the fact that the ai decided on its own to go back to save kai, its perfect

[@urusaiinu]

Al hit the lava maze and just started jumping into the warm embrace of death.

[@jamesharding7536]

Loved watching the increase in production and subtle world-building as your series has gone on, the trails showing the pathing of previous Alberts is great. Can tell whoever is behind this enjoys it a great deal!

[@x_Foxy_]

Albert is the kind of being that would keep learning and learning infinitely until he becomes an eldritch cosmical entity in some years and become a new analog horror ngl

[@TheSupremeLeaderofTangoMangles]

i love how you are showing the paths

[@estrelaplatinada6506]

0:13 "albert is VERY DUMB, and we punish him for it :)" like my family, with the diferrence i did do nothing to deserve and i am not even dumb

[@thinpanix34]

Que triste mano 😭😭😭😭😭😭😭

[@rainbowmeerkat1739]

the production quality is so much higher! along with the fact this came out so quickly, AI warehouse is going places

[@keepwatching-ane]

goddamn the mazes being put together causing cracks in the floor are insane editing skills

[@TheMadCatterGaming]

I really like these AI videos! Keep up the good work!

[@dizzy_jump]

kai chasing albert at the end reminds me of the cosmic clone from super mario galaxy

[@matyas009]

"Albert starts off dumb." Albert: *Repeatedly smashes his face into a wall*

[@lifebeautiful6389]

I imagine Albert curled up in a corner like, "I don't wanna do this anymore..."

[@LiorielParx]

My kids & I love these videos and adore Albert. Thanks for all your hard work in both showing off the capabilities of ai and keeping us entertained. I love the addition of seeing the cumulative paths he takes.

[@A.I.rchist]

We thought Albert and Kai were rivals, but no, Albert risked his LIFE for Kai to free them both!

[@wardenplayz12]

I love these vids, and i now know why they take so long. Its becauseyou actually have to assemble these have albert/kai finish and so much more.

[@Mooli3878]

I really love how we can see the lines on the floor , and your editing and video visuals are improving a lot ! Awesome job as always

[@nadhiamercedes]

2:44 wow, it really took him that many attempts to not be scared anymore? *just in case you didn’t notice he leaves a trail when he moves, so that’s why there’s a whole white thing

[@thedudeinalotofthings]

7:09 albert *SPREAD*

[@prinnywizzard9608]

I swear the music in the last section made me think of "We are number one!" 😆 I liked seeing the pathlines each iteration of Albert took, so you could see where most of the iterations were covering.

[@airmanon7213]

Aww! Albert wanted Kai to see the outside world, too! How wholesome! ❤

[@ItsTheHeroicChurro]

The Albert spread killed my diaphragm so badly!

[@pixaphy]

after all this tort- Science, albert deserves a treat, a world of only ever increasing rewards with just dumber and dumber things that give more points per second. I'm curious if the ai treats punishment the same way as ever more points

[@AstarYT-R]

SO COOL I LOVE YOUR VIDEOS (you improved so much)

[@Zora_TheSideCharacter]

This channel is slowly evolving to portal in reverse

[@TimE-83746]

Now All we need is some neurotoxin

[@shinami3758]

That's actually an interesting idea. Would Albert be able to use a portal gun to navigate challenges, or would it prove too difficult for current day AI to comprehend how to use it effectively?

[@phasedpenguin]

I love these so much and i love to see the quality of these videos improving each time. keep it up!

[@griffinneal4267]

You put so much polish into your videos, it’s really impressive!

[@Rah-ng2ls]

i love so much your videos, the ironic subtitles, the overall design. Pls continue the good work, ill keep rooting for Albert success

[@Fireblade541-cx7or]

This is the only thing this month that I have watched at 1x speed instead of 2x - been watching since video 1 and Albert never fails to entertain!

[@cuttululu]

just got back home, tomorrow I have a Calc I exam, I open yt to check some maths videos and this hits my feed. I'll treat a new Ai Warehouse video as a good luck charm for tomorrow

[@Rafael.9900]

Albert help kai to get his freedom!

[@shinami3758]

To the one who added the ability to track Albert's paths: It is greatly appreciated, and I found it quite interesting to see Albert's path develop in each maze as he learned. Thank you for taking the time to add that little detail!

[@grenpuf]

4:33 "Fall Down? Get up." Edit: I could go for some albert spread rn

[@indziax20]

4:09 WE 🙌LOVE🙌KAI🙌

[@ViktorTheMachineHerald]

"He starts off dumb... and we punish him for it." Ah yes, the public school system.

[@beanofknowledge2125]

Wait I just realised: At the end, Albert waited so that Kai could get out too! How Sweet!

[@ViatorsPath]

I love the little easter eggs around the map like the "Fallen down? Get up." albert sign. Lovely!

[@suop2942]

Alternate title: Ai learns to escape torture

[@Fleurscreativehouse]

the way i have so much empathy for Albert and Kai is insane haha! Love it!

[@lexmine3997]

I am a regular person. If I see a video with Albert - I watch and like

[@Duvstep910]

love how albert keeps destroying the boards on the wall once he figures out they are destructible

[@Davi999OFC]

I love your videos! They're so good to watch!

[@RetrasoMental1]

Albert has no mouth but he must scream

[@chara4120]

The video goes straight from AI learning maze to Saw

[@kuzeyrl]

The production quality in this is awesome

[@ForYouPlays]

I love watching this orange cube learn how to do seemingly simple tasks lol

[@nadhiamercedes]

4:09 comparing him to another AI? now that’s just mean

[@shininglimbo]

But that's how he will learn to be the best

[@tepid4217]

Oh, cool. i wish kai was competing with albert though

[@wispyone3702]

I love the addition of the pathing lines!

[@PatrickHoodDaniel]

Albert finally got out of that local minimum!

[@theEevee098]

I know it's probably not this, but I like to think that Albert turns back at the end of the maze so that Kai can escape with him

[@DefaultFlame]

You make my favorite AI/ML videoas on youtube. ❤

[@Griffury]

next AI Albert will face "GPT"

[@Amateur_Everything]

I feel like this is simultaneously the most cruel and the most encouraging Warehouse has been to Albert. Yes, I'm calling the narrator Warehouse. If anyone has a better name then by all means.

[@ethanwilde4716]

The idea that the Narrator is a sentient warehouse that can alter its interior with mazes,pits,stairs, and entities and even traps makes it even more believable. Like almost a SCP in itself

[@Not_an_expert7]

​@@ethanwilde4716 It's glados and scp 3008 in one.

[@LeBabouin]

I love ur video as Always, really cool to see the path of the AI, Albert lore is incessible now ❤

[@rainbowmeerkat1739]

the absolute GOAT of youtrube has uploaded again! (and fast too)

[@csinga]

this was an aMAZEing video :D

[@Taumignon]

thank you for this pure torture session of Albert once again

[@MrBanana-6900]

Wake up ai warehouse uploaded

[@aliztra]

It's always a good day when we get another video seeing our beloved Albert doing Albert stuff.

[@aggold6757]

yoooo 2 minutes in this video is straight up cooking 🔥🔥

[@apfelrauber7793]

This is what I imagine GLaDOS was seeing while testing with robots.

[@yahyagd5637]

This is the guy who will get an AI sentient just by torturing enough and in the end starting the robopocalypse

[@spin4team4096]

5:13 The way it explodes XD

[@LongAgo_Crow_VODs]

i love the addition of the lines of where albert has been

[@Pistachio_Red]

Great vid! Albert seems to be getting smarter now

[@NikiRGB]

I'm glad you were nicer to Albert this time, he's earned it!

[@Elbacon112]

Liked how the videos evolue every day

[@bjorn1724]

I had an idea while watching this video! You should create a maze where there are some parts which need to be solved together. For example Albert goes on a pressure plate to open a door for another cube. The pressure plate and the door are in a same room, the cubes aren't isolated from each other. But of course there's a twist! In the first experiment, the cubes are trained at the same time, but separatedly (Same genetic algorithm, but it's twice in the code). In the second experiment, the cubes are trained at the same time and are both trained in the same "family". Of course they know each other's placement in the maze. I suppose second experiment would take much longer, but it would be fun to try out :)

[@HelloTurbo]

Production quality keeps getting more cinematic! 😁

[@heavygamer93]

Always nice to see Albert (and Kai) in action.

[@za_vishmoongarr]

I don't think he's truly out just yet, but maybe this kindness towards kai has earned him a new ally

[@SomeMinecrafterWasTaken]

The production quality on these video's are actually insane, I appreciate your mindset of quality over quantity!

[@Zabrik-C-dur]

I love how at start Albert is like: "vsskekfhdbs what can I do🤪" and at the end: guys, solution is simple😎

[@dlgray05]

ANOTHER VIDEO!! Also HAPPY 2025 BUD! I love ur vids :D

[@DavyanHatch]

I feel bad for Albert

[@liamdemelo7685]

It's only a matter or time before Albert becomes the Ultimate AI lifeform.

[@BonnieDeRobot20]

Guys wake up AI Warehouse posted another banger

[@TheKrazybomb]

I know it doesn't quite work to add all the previous AI movements together but it'd be fascinating to see this combined with the dodgeball for a sort of hunt and tag game between kai and albert through a maze- kinda like an old school fps arena game.

[@beanos7689]

This guy is building a invincible robot to run, shoot "balls" ( aka bullets ) and even master mazes.There's no way we will survive that.

[@politicsiscool1331]

0:38 looks a lot like albert soup

[@ArnavNeedhi]

I wait for these videos ❤ love them

[@battletechpropaganda]

this is like, reverse "I have no mouth and I must scream" where the AI is being tortured by the humans

[@commpisto5948]

Your videos always make me wish that I'd be able to like videos multiple times

[@blackbonsai]

Lets be honest Albert is not an AI but we love him anyway. I would love to see how Albert handles situations like that with the knowledge from previous challenges