I taught an A.I. to speedrun Minecraft. It made history.

[@mcbyt]

💟 If you feel like it, join the new Patreon for exclusive videos, early access, end credits, and more! ➵ patreon.com/mcbyt 🌲 Join the BlueWillow discord to make your AI masterpiece! ➵ bluewillow.ai/discord FAQ: *Did you actually train the AI at all?* Yes - while I didn't create Alto Clef or Baritone, I did modify the gamer task (the one that speedruns Minecraft) to skip some things (e.g iron armor, extra eyes) that were there as a safety net. There's a reason this run is an hour faster than most of the others out there! *Is this actually an AI?* Yeah! Baritone, and therefore Alto Clef, is based on Machine Learning (ML), which is a type of AI that takes data (for example, where a diamond is), applies an algorithm (the Baritone pathfinding code), and performs a task without being hard-coded (like mining that diamond). The other AI bots I mentioned in this video are based on Deep Learning, which uses neural networks (computer models of a brain) to "think" about how to accomplish a task; the only problem is, Minecraft deep learning bots aren't that smart yet. Music credits and chapters in the description. This is a very... different sort of video for me, but I think it turned out really well! Hopefully you'll feel the same :)

[@Codefan321]

@@user-ex4cu7ni6f :(

[@mcbyt]

@Walter D:

[@king_jumpy1]

@@mcbyt did you forget to pin this comment

[@mcbyt]

@@king_jumpy1 I pinned it then edited it, and editing comments unpins them (really dumb youtube feature). Thanks for reminding me haha :)

[@king_jumpy1]

@@mcbyt no problem

[@TacoTechnica]

Original dev of the bot here, awesome work! This is an insanely high effort production. Not only is the whole video narrated and saturated with edits, but you've also gone out of your way to modify the bot's code to make it run faster (and anyone patient enough to sift through my code deserves a medal).

[@D4N1LO]

Great job making it man 🙌

[@ItzzFinnix]

Good work to you too !!!

[@tanhrs8711]

Exept it is not an AI. It is like you said a bot.

[@sans6993]

@@tanhrs8711 well, baritone is an ai, this is a fork to baritone, so it can be considered a bot and an ai

[@Am4x667]

@@tanhrs8711 it's a deep machine learning agent since it collected data and has a dataset that it can use to perform different actions and solve problems

[@user-jt2bf6ym1o]

The title is completely misleading, considet changing it.

[@SweetJP.]

here's an ai that speedruns minecraft. *Shows a total of 21 seconds of the ai in a 11 minute video*

[@jamiefoley1200]

Literally😂😭

[@Fire_Axus]

StGeSoEm

[@jajecznica]

Worth pointing out that it's not actually "AI" as in machine learning, it's just a bot that has a select list of tasks to accomplish and it does that by using baritone (again, not "machine learning" or AI, just a fancy A* pathfinding algorithm). While you can call it an "AI", it's really just a fancy way of saying that it's a "NPC"

[@thecountrox]

was gonna comment this

[@mcbyt]

Yeah, that's my bad - I was under the impression that Baritone was machine learning because of how it navigates around obstacles, when it just mimics machine learning behavior by calculating paths in chunks instead of doing that on the spot.

[@thecountrox]

@@mcbyt great video nonetheless, machine learning models need training and something as complex as speed running mc would need soooo much training data and nodes that it would take quite long to train and an insane GPU to run properly

[@TwiStedTentom]

Regardless of what it is, it's impressive.

[@IceTank]

AI stands for artificial intelligence, which includes path searching and planning algorithms. What you are referring to is ML as in machine learning. Baritone is indeed not ML, but it is AI. And yes, a lot of people call everything AI when it would be more accurate to call it ML. Although a lot of people would call ChatGPT and other large language models an AI as it is able to act 'smart' and plan even tho it is just a machine learning model.

[@Gaming32i]

That skeleton thing was added in 1.10. They're called strays. They're skeletons that spawn in winter biomes and shoot slowness arrows.

[@FoxSlyme]

I would rather say "cold" biomes as there are no seasons

[@MCrelationz]

@@FoxSlyme Okay bud.

[@me-myself-i787]

​@@FoxSlyme There is also no temperature in Minecraft.

[@FoxSlyme]

@@me-myself-i787 burning in the fire? freezing in the powdered snow?

[@jan_Mamu]

@@me-myself-i787 (as far as i know) there is temperature but it’s only used to make sure that “hot” biomes don’t appear next to “cold” biomes

[@DaVPasS-d7w]

u didn`t thought him how to play, u just downloaded it and waited for him to beat the game

[@Rashaexe]

Regarding the bot not using a boat at around 7:03 Altoclef, or even Baritone for that matter, doesn't have the ability to ride entities and control them. You can ride a boat, or a horse, and execute any command that moves the bot, and (If I remember correctly) it would fail every time

[@mcbyt]

Yeah haha - wish I knew that ahead of time and avoided maps with thousand-block oceans

[@cheezballz8146]

@@mcbyt You woulda been put in the grave by the thing then lol, for the seventh time!

[@MrCaptainTea]

​@@cheezballz8146 Damn roasted 😂

[@Guiny]

I had this video idea but I sat on it for a while and gave up! You did a great job on this dude

[@villaainarc]

guinnyyy

[@eliteknight2137]

You didn't train or taught ai anything. You just presented someone else's work and added poem with graphics created by ai

[@ICE0124]

yea, and it didnt make history at all, also baritone isnt even an AI, its just a path finding algorithm and altoclef just gives it tasks in a specific order. this whole video is just a clickbait mess

[@brunogatti383]

@@ICE0124 Path finding IS ai. But yeah, i get it. It's not really training anything. But it's just because nowadays explicitly programming an agent with classic AI techniques like pathfinding is more profitable than using Reinforcement learning

[@Konkov]

Guarantee this video will blow up, AI is so popular, great idea MCBYT Well played.

[@mcbyt]

Haha, I hope so! And thank you :)

[@scoopet]

Wish it was real ai though, not just an algorithm going through tasks for baritone to walk to / mine / kill

[@arttukettunen5757]

Honestly he's getting relatively low views on most videos compared to the production quality imo. Ofc some topics he covers are more niche but I don't think this video would be like that.

[@ThatOnecat-m7q]

I second that

[@mcbyt]

@@arttukettunen5757 I'm honestly super pleased with how many people have gotten to see my work lately - there's definitely people who have the same quality of content at a much wider scale, but I'm sure that'll come with time as long as I can consistently create content this well-received :)

[@Choosiest]

This is criminally good content. Keep it up bro!

[@mcbyt]

Appreciate it man, I'll do my best!

[@bedrock-chess]

Sees stray: What are those? I need to play 1.19 more. Stray added in 1.10: "and i took that personally"

[@wescube-ligma]

first of all that function in the thumbnail had SOOOOO many syntax errors second of all you did not teach the ai anything someone else did , you just used it

[@guyontheinternet17635]

Agreed, cant tell if its trying to be Lua or JavaScript.

[@dontwannaatellu]

This is actually a crazy use of ai most ai ran speed runs are very linear games but mine craft has so many paths you can take to speed run it

[@MoogieSRO]

Came here to watch the AI, 80%+ of the video is watching the player. I feel clickbaited.

[@DexNathan]

Just watch the creator of the bot's run, you can see the bot's perspective and the spectator's perspective.

[@rockharddock1711]

“i found an AI to play minecraft so here’s 6 minutes of explaining how i found it then 6 minutes of my own gameplay” ok buddy 👍 change the title

[@DanielSeacrest]

6:00 that mob has been in the game since 2016, so for 7 years lol.

[@mcbyt]

Yeah, I'm uh... a bit behind.

[@Sodiumax]

from my knowledge, this is not an AI, just an algorithm. AI can make it's own decisions and use training over epochs to learn it's own strategies. This just is taking a human list of tasks and use a pathfinding algorithm to do it.

[@Steelehambrick]

The fact that he called a stray a poverty skeleton, and said it was from 1.19 shows that he has not played this game long

[@ashtonevans7254]

Bro makes Minecraft videos and had never beaten the game before 😂 which is ok I just thought it was funny lol

[@ErrorNoInternet]

Nice! Small correction though, Baritone is not an AI. Everything it does is programmed manually. The other projects are actually real AIs that have full control over the game (mouse, keyboard, etc) and have been trained on TONS of real gameplay.

[@mcbyt]

Yeah, that's my bad - I was under the impression that Baritone was machine learning because of how it navigates around obstacles, when it just mimics machine learning behavior by calculating paths in chunks instead of doing that on the spot.

[@nuarbed]

@@mcbyt yeah i thought that too

[@mariovelezescalantedelagar3961]

The stray (poverty skeleton) was added in 2016

[@privet20005]

im so glad i have sponsorblock installed

[@moonyl5341]

those strays at 5:59 were added in 1.10

[@mcbyt]

... oof. i need to get with the times

[@zhabiboss]

Bro the ai was just flexing on you with wasting 1 whole hour on just swimming back and forth thru ocean and still beating you

[@RikkTheGaijin]

Altoclef is not AI, it's a bot. And it cheats. It has x-ray vision and it knows where every block is.

[@forefie979]

"I need to play 1.19 more" Strays were added in 1.10, nearly 7 years ago...

[@e0oh]

this Al guy is learning pretty quickly, maybe they can beat the infamous TAS guy in the future

[@mcbyt]

Now that's a battle for the history books

[@SuperJaxsonmowingMorris]

TAS VS AI guy 🔥🔥🔥🔥🔥

[@shen.daniel]

6:08 man that's what you get for poor shaming skeletons. just because it wears ragged cloth and look skinny af, that doesn't mean it's poor

[@mcbyt]

honestly fair

[@BaccaDeww]

next videos gonna be about ai predicting the future of minecraft

[@mcbyt]

at this rate honestly, yeah

[@grande1900]

"I need to play 1.19 more" the Stray, added to minecraft in 1.10:

[@issad3543]

This guy is so underrated, great video!

[@mcbyt]

Thank you, I'm glad you liked it!

[@Tea_games2340]

"thousands of code lines" *Klingon text* also, you didn't teach the AI anything. you just raced someone else's AI so the title is misleading.

[@adex345]

"And everyone died. The end."

[@dearrobloxiscool]

my favorite part is when you and the Ai was good at the game

[@mcbyt]

yeah, i'm VERY good (ignore my 6 deaths)

[@nirrrzoom]

@@mcbyt e

[@earlessaxolotl8632]

I am definitely not an expert, but from what I read, MineDojo did not make it to the End by itself. The AI was artificially placed there by the developers. Currently, all it can do is perform basic instructions like "shoot at the dragon". What is impressive though is that all the information the AI receives is the screen itself. It is not given any additional data like where the blocks are. This is different from baritone, where it is fed entire chunks to process. This AI just looks at the screen and does stuff like humans do. I think that is what is the most impressive about MineDojo.

[@SimoneBellomonte]

Oh, thanks for pointing that out, I thought they actually managed to make an AI that basically did the entire game except the Ender Dragon seemingly bugged? I didn't quite understand that from the video, from how he put it, it sounded like the Ender Dragon just bugged when the AI almost completed the game? Not sure if it was a bug of the game itself or they were using some sort of modified build of the game (other than the player obviously already starting in The End, but that could just be cheats or a mod), would like some more clarifications about it.

[@NetherverseYT]

5:58 "I need to play 1.19 more" meanwhile strays being added in 1.10

[@Technodog]

The only thing that wasn’t clickbait about this title was ‘Minecraft’ 😭

[@Technodog]

Wasn’t that bad of a video but damn I got nothing that I was hoping for out of this -_- Also “bed bomb” is crazy

[@messengercreator]

6

[@CaptainTimeStories]

Here before this explodes lol. Outstanding work!

[@mcbyt]

Thanks so much, glad you liked it!

[@oglothenerd]

It is sort of cringe that you said you trained it, yet you only just downloaded a pre-trained model. (I will ignore that though.)

[@Litl_cool_sans]

uh ok?

[@CrownedRex]

What makes it cringe?

[@oglothenerd]

@@CrownedRex It shows that he is using terminology and phrases before actually researching what they truly mean.

[@PetersQuizz]

​@@oglothenerdur cringe

[@substanceabuse4667]

Yeah you’re the problem on that bro

[@epicgamerpolihedral]

Mcbyt: Mentions Open AI Me: *School flashbacks of cheating on essays*

[@형욱유-x4o]

Ohhhhhhhh mojang is gonna be shock my this anyways good work man keep it on

[@DarkChaosMC]

Oh my god the transition at 4:45 was SOO smooth.

[@mcbyt]

haha thank you :)

[@atticusjay]

@MCBYT may I ask what editing software you use? Also if you have some kind of tutorial I can reference or maybe just a brief explanation of what you did. Thanks in advance :)

[@NotChinmayi]

Bro thought stray was a 1.19 mob💀

[@Elon_Tusks]

I got all my blaze rods and pearls on my new hardcore in just under 30 minutes. I was hyped

[@8crafter]

5:58 BRUH THAT IS A STRAY AND IT WAS ADDED IN 1.10 LIKE 7 YEARS AGO

[@mcbyt]

I'M SORRY I PLAY 1.8

[@8crafter]

@@mcbyt bruh if u don't like the new combat system then just play bedrock edition

[@crusher9z9]

​@@8crafterEXTREMELY LOUD INCORRECT BUZZER❌️❌️❌️❌️❌️

[@_mark_3814]

For one cycling the head of the dragon does align with the head hit box of the dragon, when perching the physical head is actually delayed and the head hit box is by the tail

[@sangeloo]

Really impressive how AI has blown up recently so much

[@notyarrs]

I never realised that you really have such a great voice, really stood out with this type of video!

[@mcbyt]

Haha, thank you

[@notyarrs]

@@mcbyt

[@PROPLAYEN]

The Stray was added years ago at the same time as The Husk, it's not new to 1.19

[@mcbyt]

I am WAY out of date

[@kvernesdotten]

Impressive, not only did it beat you but it flexed on you by going for a half an hour swim in the middle

[@Someoneyes-y7l]

Baritone is actually super smart and really clever.

[@RoboticWisp]

The bot did the infamous "boat skip" which due to being covered in water, leads to major time saves in the nether

[@mcbyt]

Ah yes, how could I have forgotten the classic boat skip

[@DexNathan]

Used this smart path finding algorithms to beat the game in servers.

[@termisher5676]

That bot already exists and is on youtube he beated game in aroudn3.5 hours

[@meta_npc2182]

cant wait to see the bot perfected to be honest. nice work to by the way! :D

[@akulgoel9259]

I think it would be more fair if both the A.I and you had the same seed.

[@mcbyt]

True - I tried that out actually but the bot kept getting stuck in the stronghold on my seed, so I figured I'd try a new one. Turned out better in the end anyways, since it went faster (even with all the swimming) and avoided the video from being super repetitive, cutting back and forth between me and the AI but looking exactly the same

[@scottmcleod8342]

Nice 13 bed 1 cycle

[@teosk-firesteam655]

Best AI vs Worst player is really interesting

[@yjako]

9:22 nice commands bro

[@mcbyt]

thanks brudda

[@evangravell5140]

An A.I that completes minecraft for you. How useful.

[@tas1565]

For the ender dragon fight going forward, turn on hitboxes (f3 +b), it makes it a lot easier

[@thedarkknight3894]

Are we just gonna ignore him saying this is the first time he’s beat Minecraft

[@Fr_g]

The "poverty skeleton" (stray) has been in the game for a while

[@wowmeme7309]

A computer beating Minecraft?! I can’t even do that!

[@somebodywhoyes]

my heart when you called the stray a 1.19 mob

[@gamerdom7712]

The stray (poverty skeleton) was added in 1.10

[@JazzyWaffles]

6:00 "I need to play 1.19 more" Bro that's from 1.10, seven years ago

[@cypphi]

1.18 lol

[@realbrickbread]

5:59 bro strays have been in Minecraft since 2016 💀

[@AvasHodgePodge]

That was an awesome speed run. good job

[@jackwood107]

I love videos like this, you’re very talented dude

[@mcbyt]

I appreciate it man, glad you liked it!

[@Linkswords7103]

Personally I would’ve liked to see more of the bots run. Great video overall

[@mcbyt]

Thank you! And yeah, unfortunately a lot of the AI run was just the swimming part or mining trees, but I included as much of the interesting parts as I could!

[@pyroman7196]

That’s a really cool concept, I hope to see more training iterations in the future. Maybe a colab with Code Bullet for some extra hype on the project

[@ICE0124]

its not an AI he just took someone elses project that gives instructions to a path finding algorithm and then used someone else's texture pack and added like 2 new textures made by AI just to shill a sponsor.

[@calansmith655]

Very interesting and well done video. I think the time in the thumbnail is a bit misleading though. I was watching Minecraft speedrun history videos and thought maybe the AI had found a new mechanic or set a record or something.

[@БогданПаращук-у4д]

Are we Just Gonna ignore that the code on the thumbnail Just instakills the PLAYER as soon as the ender Dragon is rendered?

[@AuraTale]

Just as i thought, it's only a matter of time until AI starts beating the speedrunners.

[@wintremourn]

i like the idea of a function that just kills the player if the ender dragon exists

[@Noobdoesforfun]

Ah yes a sandbox game called "MIEEEEEE EMOOOOOOO" Classic!

[@Lampe2020]

The holes are here to get you!

[@rawrmylah]

Baritone is not an AI it's an algorithm, there is a big diffrence

[@IceTank]

Path searching algorithms are AI. The definition of AI is exactly what Baritone is doing. What you probably thought about is machine learning.

[@ryanbradley3293]

The sheer implications are that someone could teach an ai so thouroghly that it can do everything to beat the game with literal perfection for its situation. This is his the beginning of ai for Minecraftz

[@Lothyde]

bro why do I feel like some of those deaths were on purpose

[@Wreck_Crimes]

baritone is just a bot with path method, when MineRL is real AI that is training to interact with the Environment

[@cooltool.nem.n.nem.]

Poverty skeletons are their new names

[@theworkshopwhisperer.5902]

I would love to see round 2.

[@sungwanderorig]

make a Minecraft ai friend, so people with no friends can play with someone, and feel not lonely

[@Maurisanz211]

The bed bomb

[@wolfisfluffy6791]

By the the way strays have been in the game for years, those are the budget skeletons.

[@legend4646]

"I'm going head to head with the AI I trained" ...how? you keep claiming ownership of this thing Alto Clef contributors made. **E: FAQ added, all good 😄**

[@mcbyt]

I did actually "train" it, or rather made a few modifications to have the bot run faster. You can check the pinned comment for more detail. Just didn't include it in the video because coding is boring LOL

[@legend4646]

@@mcbyt Okay, gotcha! That just wasn't there before. Cool vid then :)

[@Ej-mq2fj]

lol that poverty skeleton was added in 1.10

[@DexNathan]

The bot is truly smart.

[@josiahlee7999]

5:02 all the viliagers right now 🧍‍♂️

[@thenormalminecrafter2720]

you taught an ai to speedrun minecraft? you're sure it wasn't already coded?

[@pixelstriko1642]

Ive always wondered if this was possible an now i grt to actually see it!

[@DavideoGames641]

I love how he mixed the sponsor in the actual video

[@mcbyt]

Any chance I get to do that, I take. Don't want it to seem like an ad, these are genuinely cool services not just "hehe give me your credit card"

[@GoStormPlays]

next we gotta get ai to find herobrine

[@glazechunk]

😜

[@BurgerFan27]

Time ends when you enter the portal, which you didn't seem to do, so you lost by a lot more than a few seconds lol

[@IRLtwigstan]

Yes, but keep in mind that he also didn’t know what a stray was and thought it was knew. What I am getting at is he is not very knowledgeable of the game.

[@8ennyy]

"It beat me" ,sounds like a skill issue to me.

[@mcbyt]

absolutely BUT it's also my first time beating minecraft ever so like, i didn't do THAT bad

[@ehetenandayo2742]

Cool video bro, Was Entertaining up until the ending. You are so underrated

[@theburger_king]

“Oh my god guys ai is so smart” isn’t an excuse for loosing. Sounds like a skill issue to me Edit: all of you are idiot except Nate. He is chill. Do y’all really not know what a joke is?

[@purplybtw]

bro its supposed to be an entertaining video not a competition

[@starchking765]

I just hate loosing, makes my shoes sad

[@Solutra]

@@starchking765 lmaoo

[@mcg_haki]

bro, he just said that he didn't beat the game before ( 4:13 ). For the first time doing this, it's good. It took like 3 hours for me to beat the game the first time. OF COURSE it's an "skill issue" but how do get skill by doing nothing? You also can't win a football match if you didn't played football ever before! So pleast don't write such useless comments!

[@mcbyt]

yeah i'm terrible i know LOL next run if i don't die i'll be like a full hour faster