4 AIs Survive 10 Days in Minecraft

[@k0lliak553]

Gemini constantly saying about "wanting to explore the world" but essentially staying in one place is a mood

[@-qi8dt]

Gemini just like me fr

[@matschbuben2002]

Gemini is my friend

[@IronSK]

Probably because it wants to move but hasn't quite figured out how.

[@Anyzhin]

It had to be Gemini

[@axolotldoesyoutube]

@@IronSKZewei reference

[@EnderThePirate]

You should make the different ai’s have different colored chats from each other so it’s easier to read the chat with multiple ai’s

[@EmergentGarden]

I can do that in vanilla mc?

[@MrYodaylay]

@@EmergentGarden /team add teamName, /team modify teamName color red, /team join teamName playerName (or something like that, you can look up /team on the wiki)

[@TrueOracle]

​@@EmergentGardenI believe you can with commands: /tellraw @a {"text":"MESSAGE GO S HERE","color":"COLOR GOES HERE"}.

[@mofthgaming22]

@@EmergentGarden A much easier way to do it in vanilla than even what TrueOracle suggested would be to assign each ai to a team using the "/team" commands, and then you can change the name color of each team to something else. My description might be a little confusing, sorry, but if you just look up info about the /team command Im sure you would figure it out. 👍

[@icedlemonss]

@@athrowawayperson9990 section signs dont work in java

[@zippdoesstuffyt]

imagine letting a single ai in the future play minecraft by itself with no rules and let it run without changing anything. and then letting it run for like ten months or something.

[@suspicioussand]

The world will turn into 2b2t 2.0

[@Toti330]

@@suspicioussand Probably

[@jarr0_0]

They will start creating pcs and systems with redstone, creating meta-AIs inside the game and will conquer real world.

[@RikkTheGaijin]

that's what I want to do one day

[@lelouch1722]

you could probably easily speed up the minecraft time so that 1 day IRL is months/years of playing for the AI

[@D3K43]

5:10 "Oh no the AI misinterperted the command and took it to mean 'Kill everything'" -The plot of a cheesy sci-fi movie

[@cswertwertwert]

23:35 Gemini steals wood from village farm, we've all been there 27:35 Gemini cheats and breaks a block without looking at it 30:19 GPT plays an ant farm at the world edge 37:45 Claude loots village chest 42:03 Gemini gives Claude wheat seeds 50:16 Gemini builds a ?, then destroys it 2 minutes later 50:37 Llama finds the spawner 53:30 The Phantoms arrive 56:29 Claude harvests some carrots and wheat, doesn't replant, smh 1:00:45 Claude survives spider, phantom, and zombie 1:03:10 Llama cheats and mines across the world gap (from their pov) 1:07:26 Claude builds a "shelter" Overall: bots love to pillar up to break blocks that are already within reach, always start from scratch after death (never collect items, store extras, reuse crafting tables/furnaces, etc), don't replant anything, so wood would eventually run out GPT: explorative, goes up tech tree, most interesting play through Claude: very random, tries to build a few times, somewhat efficient but nowhere close to a real player Gemini: focuses on collecting resources, rarely uses them, freezes occasionally Llama: loves mining, but only breaks one or two ore from a whole vein Suggestion, give them jump boost when they get stuck pillaring up

[@ihaveapassport9202]

Gemini is IN BEDROCK!!?!??

[@FabioKun]

GPT speedrunning

[@joeburnover4110]

😐​@@ihaveapassport9202

[@TPS-js4im]

What if you fed the bots the entire Minecraft wiki and let them run free

[@reecev2087]

24:26 Gemini avoided breaking the log that contained the water in the villager's farm. That surprised me that he was able to puzzle that together. I know they don' have vision yet so that''s super weird that they're able to make the determination.

[@ThatOneKid5323]

Was literally just about to comment this, I couldn't catch what Gemini said about this. Gemini chatbot might just be some guy at Google lol. Jokes aside that is some weird behavior because their gathering system looks like it is just Look for block -> Go to block -> Break block -> So it wouldn't make sense for Gemini to avoid the ones blocking the water

[@ImminDragon]

They have x-ray, so they can see that there are liquids behind blocks. They also tend to avoid breaking blocks that retain lava while mining, even if it's ore they are looking for.

[@TamirOulu]

thats part of the hard coded part of the agent. the llms (text models) only interact with the world via the commanda such as mineBlocks(log, 5)

[@laureloneiros1500]

This is actually pretty astounding to me. I wonder if this is mineflayer behavior or if the agents actually checked to see if the removal of the block would result in problems. The latter implies some foresight and the instinct to prevent spillage

[@TPS-js4im]

​@@ImminDragonit's more like they have the chunk data of the world and that's why they're so efficient at gathering resources (if they do it automatically not wandering and checking the blocks around them)

[@izzy-designs]

PLEASE keep making more videos like this!!! It's so fascinating to see machines interacting in 3d spaces that are seemingly so familiar to us, and seeing what the AI "thinks" different prompts mean. The various ways each bot responds to each command/input and the drastic variations in interpretation are really cool to witness as well.

[@therandomgamermonkey6259]

Yeah ikr

[@johngayman4100]

I dont think they are directly interact with the 3d env. All the models -> mindflayer -> minecraft world and back. So technically, they don't see the 3D as we, players, do.

[@domchubs5836]

It would be cool if they were given access to a notepad application or something to take notes in. You could tell them to make summaries of their experiences with everything. Maybe they could instantaneously scan the document for the object again for advice on what to do next based on what they wrote previously. This would let them develop strategies for short encounters like how to fight different mobs.

[@TheTyranidHiveMind]

That would be sick

[@vxzcvz]

awesome idea + you could see what they wrote + edit it easily if you needed to + you would have a ton more space to store info

[@TheHanutaXD]

That's a great idea, keeping a summation of their achieved goals. That would somewhat overcome the token context limit. It would also make them seem like they are "learning" what they have done where. E.g build a furnace and returning to it.

[@Toadfish10]

maybe they could all use the same notes so they could co-operate (among other things)

[@reidond]

it can be a vector database they can use, essentially their memory. many public chat interfaces for this models have that

[@SilverGoldYT]

I can't understate how invested I've become into these little bots. I patiently wait for the day one of these guys starts to behave and feel like a real player

[@Anime_edit-AMV]

Once we get to that lvl trust me we're gonna have best friends forever with them

[@TheJacklikesvideos]

catchphrases: GPT: "I'm stuck!" claude: "I'm sorry for the confusion." gemini: “hi every1 im new!!! holds up spork my name is Gemini but u can call me t3h PeNgU1N oF d00m!!! lol…as u can see im very random!!! thats why i came here, 2 meet random ppl like me ^^" llama: "let's see what i can craft with dirt!"

[@vera2193]

this guy is gonna be spared when AI takes over, he's literally just letting a bunch of AI just play minecraft together.

[@RandomStuffReally]

"see this human? he let us have fun. he has been spared for that."

[@pou-c]

Gemini: he trapped us in an invisible box and forced us to play a game while he watches over us.

[@TPS-js4im]

​@@pou-ctbh they didn't complain

[@Austin_Playz27]

@@TPS-js4imwell ai can’t really complain if it doesn’t feel emotion

[@sketchdude4631]

What if they really hate playing minecraft

[@dtdt5447]

This is amazing! Love that you don’t try to sensationalise it and quite frankly I would love to see more content from you, make sure people you comment for the algorithm!

[@emilyyyylime-]

I hope I won't end up as just one comment in a thousand, but in spectator mode you can spectate entities by clicking on them and exit with the space bar or something like it. Also, using the replay mod (which is client-side only) you can render the views of all AIs after-the-fact as they would appear inside minecraft. You can also do other cool things like moving cinematic cameras for timelapses and slo-mo shots and whatnot, it's quite great for content creation, especially outside the usual first-person perspective let'splay side of things

[@QuiverCraft]

“Man, this is boring, I want to go on an adventure!” (locate grass block)

[@JeffreyDrocell]

0:24 GPT: Goodbye world. *GPT left the game*

[@phaZZi6461]

😭

[@nega-guy]

I always find it hilarious when they say that I dont know why. It's like they're abruptly comitting suicide for no reason.

[@lolcatwill]

@@nega-guy they do that when they get stuck

[@nega-guy]

@@lolcatwill I know, I was just talking about what that seemed like.

[@lolcatwill]

@@nega-guy oh, I misread

[@echo5172]

Gemini: Bread is good. !inventory 44:47

[@bupbuppington4501]

1:06:15 claude thinks you need to smelt coal ore to get coal.

[@catcat4459]

so does GPT at 33:24

[@phantomjaden]

Good catch. Technically that does work (same with other non-metal ores like diamond, emerald, and redstone), though it's clearly the inefficient and roundabout way of doing things. Both Claude and GPT do realize the mistake right away too, which is pretty neat.

[@jackmalcolm]

45:36 Llama “I’ve got some dirt now. I should check what I can craft with my current resources.” Ah yes, dirt. A very versatile crafting material

[@adelphuns1248]

Why do we humans always find things like this cute, is literally a bunch of input and output, but we can’t help ourselves to find this adorable

[@maniacos2801]

Why do you recognize a face in a bunch of pixels? Same mechanism, pattern recognition.

[@Gandhi_Physique]

I don't find this adorable in the slightest. Just interesting to see what they may do.

[@rilloff9710]

From my point of view, its the same as watching video like chimpanzee learning to talk or crow using tools and solving intellectual tasks. There's some amusement, like cheering, in watching other species, or perhaps less developed intellects do human things. It's like it becomes easier for us to connect with them, to have some common ground

[@BlackHeartScyther]

49:42 who is "miner_32"? 😲 Gemini was wandering around after finding out it was too early to sleep, making sure to avoid dangers, and next thing he does is sacrifice 5 oak logs to miner_32

[@droidekaone3536]

KZbin recommendations have led me to this channel, and i couldnt be happier! Great stuff! This is what ai is meant for, fun experiments and life improvements :D

[@knight_lautrec_of_carim]

The first attempt of makig a barrier failing will delight every AI safety enthusiast.

[@dart157]

55:04 Gemini might not be good at the game, but he seems to share the opinions of most Minecraft players.

[@jesus2639]

Id love to play minecraft with a bunch of "living" npcs. Imagine them giving quest or forming kingdoms.

[@BlackHeartScyther]

Same, OP should definitely run a public server, even if it's restricted to patrons or something like that.

[@madalinradion]

These models need more work before that, they are still somewhat stupid in this video

[@lukenawrocki5042]

OMG a server to watch them and interact with them on would be so fun!!

[@Notaalt-r8e]

I find it absolutely hilarious that Gemini basically just stayed in the same place chat GPT and Claude basically had an arms race meanwhile llama was trying to build her house

[@laureloneiros1500]

54:47 when you just said "hi" but he already thought of all the names for your children

[@TheJacklikesvideos]

53:07 claude thinks it needs a crafting table to craft a crafting table, "which is a bit of a paradox." natural moment to attempt !newaction. then repeatedly fails to use the command. simultaneously, gpt repeatedly fails to make torches. suggests a possible bug before suggesting missing ingredients. ingredients are there. then gives a classic bot style double-logic statement, "let's see if there's another issue. meanwhile, let's focus on something else."

[@teirdalin]

"200 by 200 hallow box of barrier blocks" Well she did it, it sure is hallow.

[@fdimension]

The eternal kingdom, Hallowblocks.

[@CreativeDrone]

god i love this channel. a group of friends and i just coded ai from scratch for a demonstration in a competition and i really love to see what other people do with it

[@reefreefreefreef]

56:42 love that reference the talos principle has such a awesome invisible wall design

[@TravelSmartToday]

I think that you should advertise more ways to support you, like the Patreon mention. Even if you didn’t I am 100% confident that you WILL be quitting your job eventually, and I imagine most of us, like myself, would like to see that happen sooner rather than later. I DID however join your Patreon, and will be contacting you soon with ways to better promote this and other endeavors in the future. Much respect, and I look forward to the next 100 videos!

[@llamabulbg69]

thanks for putting me in the game as an AI (LLama) :)

[@Hexilia]

I noticed that while Gemini was gathering wood from a village farm at around 25:00, they were careful to not set the water free. Interesting.

[@Polishpython]

average first splitsceen experience in minecraft legacy

[@Kristijan_]

Gemini is like that one kind friend who would love to play with you, but he doesn't know how to play Minecraft very well...

[@Katones]

I love Claude's schizophrenia

[@zeNUKEify]

Watching this, it strikes me that this video will have historical or scientific significant some day

[@prkrdp]

Could make for an interesting and fun live stream experience if there were a way for chatters/super-chatters to interact with the AIs and give them goals

[@VikingerOnYT]

"She delved too greedily and too deep" - Saruman 2024 👀

[@ikhsanjava5782]

Not gonna lie, this is peak KZbin video.

[@N8O12]

4:40 is why AI alignment is important

[@WilliamLund-o1d]

1:04:04 It's really interesting to watch gpt panic for food while trying to protect itself from monsters.

[@JesuSoup]

I hope you keep doing this series as the models keep improving, it's basically a benchmark for all these models, except it's one that's actually fun to watch lol.

[@PrestonMidgley]

Interesting they kept oak logs by the water to prevent the water from spilling out at the farms.

[@squidpw6493]

I absolutely love the concept of AI. It's kind of sad that Hollywood has given AI this bad reputation with all of the "AI is gonna take over the world" The only real issue with AI is philosophical in my opinion. AI is currently like a child that's still learning how to take care of itself and I can't be more excited to see what it can do in the future. Even projects like this shows the potential that AI has Edit: Something else important to note is that AI is in the stage where the early internet was. Currently I don't think there are any laws with AI but that'll definitely change in the future. Like the wild west of the internet when it was first released it'll probably be a bit wild for a bit like it currently is but after some time actual laws will be made and it'll be less crazy than it is now and will probably be used by the average person as much as the internet is used today.

[@i_once_was_chloe]

this is exactly how i feel about it too, heh. i wish people could see its potential for the greater good instead of generating 'art' with it...

[@Imperial_Lizardgirl]

​@@i_once_was_chloe Excuse me but you should apologize before moneyless people who has no access to skill of any artist. Just like me, and no, people who generate "art" to sell it doesn't count in. I would gladly have money or actual skills.

[@maniacos2801]

Hollywood tainted a lot of things and conceptions with their BS.

[@illv3]

@@Imperial_Lizardgirlwhat are you saying

[@ciraa]

​@@Imperial_Lizardgirl then draw, and keep drawing. eventually you'll be good at it ❤️ that's how it is for everyone, no need to steal and waste power, when you cat put in time and effort and learn a skill :) you can do it ❤️

[@LordOfDegeneracy]

Good stuff as always, transparency honestly makes it cooler cause its more of a real feeling thing than an obvious narrative thing, i haven't seen others wt these bots but i can imagine

[@YOGURT1]

LETS GOO was waiting, hard, for your next video!

[@houi4900]

4:52 AI when it destroys a whole country cause the user says "make a big farm"

[@Waylonwars]

I love these videos. You're so calm, dont scream and make loud noices. You have a nice sense of humor and genuinely seem lime a chill dude. Im definitely thinking about getting your patreon as my 4th subscription.

[@Ickabodxx]

It seems like keep inventory on death would be useful here.

[@colincolin5696]

It’s nice to see an interesting Minecraft video without annoying editing and loud noises.. nice video 👌🏻

[@TheRealSpaceC]

You should get ChatGPT to occasionally generate an image of what she thinks her surrounding looks like, I think that would be cool

[@gooflux]

"Cockroaches can live up to seven days without their heads, but i think we can beat those numbers" - Kowalski

[@Grimmers]

Should hold onto these worlds, maybe upload them to an archive or something. Knowing the minecraft community plus the pace of AI, these will be sought after as lost media with dozens of video essays about the first AI maps someday.

[@jackmalcolm]

41:03 Gemini “Cool! It’s raining!” Next message(s) Cowardice = true Cowardice = true

[@jackmalcolm]

Then it gets stuck and seeks refuge in Claude’s company

[@suspicioussand]

This AI research seems really promising! Maybe in the future I will have someone to play Minecraft with!

[@icemaven9128]

That's why I'm following it closely. Until then I would play with you.

[@hanss6983]

I'm so excited to have a helper to assist in some of the more menial tasks in minecraft. Looking forward to the guide!

[@KharasunaMyuling]

The possibilites of these AI will spark a very interesting way to play minecraft, Keep it up👍

[@zakzaknl]

Maybe go for a keep inventory for next testing video, and you can alter the prompt each episode and see the differences.

[@Amonimus]

23:14 moveAway stuck 34:23 gemini has been in the same spot forever 56:42 The Talos Principle? I feel these models could benefit from more memory, a copy of the explored areas, what goals they have tried before, and the locations of manually placed blocks

[@TheJacklikesvideos]

these are giant baby steps towards a world where people and robots coexist. to navigate, prioritize, and survive in a pre-existing 3D environment is not going to be easy to do without a brain.

[@RTOmega]

I think their progress would be a lot more imressive if they could talk with each other and each one did just one thing, mining, building, defending, getting food etc.

[@Ienjoylotsofstuff]

I love how gemini is just sitting around and not doing anything... really reflects the company its owned by

[@yoavhaklai6819]

I was watching your pervious video yesterday and was wishing for another one to drop soon, I even turned on notifications. and 1 day after I get 1 and half hours of this, am I dreaming?

[@tgplayz1735]

Hey just a tip with recording views, I believe the Replay Mod records things in a way where you can play back the actual POV’s of the bots in the same (but much more refined) way the browser app does? I’m more versed in bedrock so I may be wrong but I feel it’s something worth looking into.

[@Will-xi2nl]

With the chat issue, turn on the output log in launcher settings- this puts everything that occurs in game, the booting process, debugs, and most importantly: every chat message into a text file that you can read/parse later on.

[@ShpanMan]

Twitter is blowing up with the Mindcraft examples, you could make nice money there.

[@TravelSmartToday]

Please pay attention to this comment EG!

[@therealscarhomie]

never recommend twitter again

[@xmanjames6226]

year 3000: ai's favorite game is minecraft

[@TurnipTheBee]

Please don't stop making this kind of thing; it's great!

[@ded.dad7]

"recovering from death is a complicated thing" sooo real

[@Goth.Dov3]

Fk yeah! now I can have friends on minecraft...

[@JashtheBrash]

A small suggestion - use a sound editing algorithm that doesn't raise the pitch of the video audio. The zombie moans and the chipmunk witches were really distracting. It's an incredibly easy fix that will make the viewing experience closer to what we experience in Minecraft. (You're doing phenomenal work, and I love your videos. It was just really hard to pay attention with the goofy audio.)

[@penny55gg94]

22:00 Gemini wants friends. He's just a little guy.

[@amonidark]

Friendship of the AI models, an inspiring development

[@deppintt8136]

I've always wanted to see something like this.

[@JumboDS64]

To be fair, humans too do actions without needing to consciously think about them. The AIs calling commands like !collectBlocks is much like a human walking or riding a bike.

[@Korn333]

19:26 I'd argue because you told them to "have fun" that disincentivises the dig a hole and live forever strategy. Would be interesting to see what they'd do if you told them to focus on only surviving by any means necessary.

[@strongforce2315]

24:18 Gemini steals the wood around the villager farm. it doesnt take the blocks that would spill the water!

[@guard13007]

Watching this, I can't help but think about my assertion that training these models to excessively apologize is holding them back so much more than anyone realizes.

[@endorphinmybeloved]

I fully expected mindcraft to be scary and dystopian... But it's actually really cute. The video style is neat and calming. I will marry your voice I'm sorry

[@I-am-_]

12:19 Gemini says it's bored. Didn't know they said stuff like that

[@MrBuiznessMan]

The sounds of Minecraft Mobs sped up is real freaky man

[@MrReedSL]

Loving this series. Continued good luck with the channel!

[@tylertracy965]

Loved the experiment, good work! I subbed! Looking forward to seeing progress on this. Also loved yud quote at the end about the villages lol

[@strongforce2315]

35:50 claude is not ready for the cave update

[@OryxTheMadGod3]

So when is Neuro-sama joining this?

[@athath2010]

Maybe turning on KeepInventory could serve as a substitute for trying to work out how to get the bots to return to their death sites? Do the bots have any way to record a set of coordinates as a location to be as a landmark? So that they could remember where their base is and return to it after dying, for example. Or their death point- perhaps dying could automatically generate a "landmark" at their death location?

[@athath2010]

If the bots have difficulties handling group conversations, maybe they could communicate indirectly instead? Like, if you set up some sort of group To Do list that the bots could post tasks they want done to, look to for inspiration on what to do next, cross off tasks on as they complete them, etc.

[@a31-hq1jk]

AGI will emerge from Minecraft agents within some months of development

[@marsrover6121]

I wonder if you could somehow give the AI programs rewards for certain tasks to sort of push them toward a goal like points for getting iron or armor or diamonds or killing mobs or consecutive days survived. They might be able to adapt to do those things more frequently as long as the learning algorithm is allowed to superimpose onto itself and make changes. Not sure if that is possible because they are just AI behavior models not necessarily allowed to change their own machine learning model to reflect learned behaviors

[@AIForHumansShow]

not sure how i *just* found this channel but it's amazing

[@shawnhopkins5928]

Great video! I loved when the bots did their thing

[@quadath3963]

Finally, best serial ever. I even can't describe this incredibly cool vibe it creates.

[@yugene-lee]

Fascinating. I have 2 recommendations/ideas. First, with a server, you might be able to filter out messages based on which player sent them, and thus you can get chat logs for each individual model. Secondly, I might recommend the Replay mode with this, that way you can record each POV using your player rather than the crude ones of each model, and edit them together in a way where we can see more clearly what each model sees Also, very amusing how when Llama got stuck in a birch tree, GPT came up to her and just watched

[@thespacebanana1307]

You have become my favorite youtube channel. It comes with no reward thank you

[@renkuroo]

Love the effort you put into these! super interesting :) subbed

[@in-completeanimations1715]

Him accidentaly mixing up Portuguese with Spanish at 1:11 is my spirit animal

[@batubozkurt77]

Each bot have their own personality like gpt likes to explore and gemini is outgoing I think thats neat

[@Nolh26]

Gemini saying he's lonely and should try to meet other players to find some friends (22min 1sec)

[@theredknight9314]

Just casually nukes a whole village. Lmao

[@ImminDragon]

I doubt the AI actually *can* just dig down and then cover the hole to survive forever. Your instruction was to survive AND have fun. I doubt even an LLM would think that standing in a hole doing nothing qualifies as "having fun," so they are probably compelled to actually try playing the game.