4 AIs Survive 10 Days in Minecraft

[@k0lliak553]

Gemini constantly saying about "wanting to explore the world" but essentially staying in one place is a mood

[@-qi8dt]

Gemini just like me fr

[@matschbuben2002]

Gemini is my friend

[@IronSK]

Probably because it wants to move but hasn't quite figured out how.

[@Anyzhin]

It had to be Gemini

[@axolotldoesyoutube]

@@IronSKZewei reference

[@dan9738]

GPT: Antisocial dwarf. "Claudes house? Looks like free wood to me" Claude: Eccentric builder. *points at single door at the bottom of a pit* "Look at my cozy little village home!" Llama: Overenthusiastic newbie. "Wow, I wonder what I can craft with dirt!" Gemini: Lonely shut-in. "I should go out into the world and make some friends!" *does nothing*

[@Erlaryn7u7]

I love this comment

[@fadlanal-amsi9839]

their are perfect for each other

[@dashat3938]

I mean, Gemini does actually try to make some friends.

[@oscar_evil]

reminds me of neurodivergent friends series, kinda funny

[@Ahuerta22]

Lol

[@TheJacklikesvideos]

catchphrases: GPT: "I'm stuck!" claude: "I'm sorry for the confusion." gemini: “hi every1 im new!!! holds up spork my name is Gemini but u can call me t3h PeNgU1N oF d00m!!! lol…as u can see im very random!!! thats why i came here, 2 meet random ppl like me ^^" llama: "let's see what i can craft with dirt!"

[@bzz_bee]

Llama says "I'm stuck!" a lot too

[@AquaticCog]

​@bzz_bee That's not as iconic as "Let's see what I can craft with dirt!" though lol

[@TheJacklikesvideos]

@@bzz_bee errybuddy gitz stuk

[@levfox]

HEY EVERY !! IT'S ME!!! EV3RY BUDDY 'S FAVORITE [[Number 1 Rated AIModel2024]] GEMINI S. GEMINI!!

[@TheJacklikesvideos]

@@levfox i read this in Ruby Rhod's voice

[@verisad3472]

We really take for granted all the calculations our brains do every second whenever we play videogames. Such complex tasks that require so much context to make each split second decision. Even "easy" things like building a dirt hut can be broken down to a huge flowchart of decisions. Our brains really are amazing, and it's interesting that we're trying to replicate them by artificial means, and we're making progress.

[@not_kes]

It's also easier because we're not completely blind like the bots are. There's no "see" command, only a "nearby blocks" command. Ironically building a dirt hut is one of the things that's hardcoded. There's a 'construction/dirt_shelter.json'

[@TheInnerEvil]

​@not_kes true, we have more ways to gather information to weigh our options and also better alternative thought if one option is too "risky" to our brains. Great example, I forget the timestamp exactly but at one point claude was being chased after looking at an enderman. At first they ran because it was too dangerous, but when getting far enough away to believe it wasnt chased anymore, it decided to change course to "fight enderman" that it had just deemed too dangerous to fight. Humans remember long enough to factor recent decisions into new ones that ai dont yet

[@bvdf84]

Although the process we make seems to be extremely slow and resource demanding

[@Bingus9900]

@@not_kesthe dirt shelter being hardcoded into them is hilarious to me lol

[@horsma2064]

​@@not_kesYes but we can quite easily make them 'see' and interpret that in real-time by either using sensors/cameras (in the physical world), or feeding some type of a live feed for the program to interact with in this case. He mentioned that he's planning on having the bots actually see and play that way. Very fascinating project!

[@QuiverCraft]

“Man, this is boring, I want to go on an adventure!” (locate grass block)

[@MrEdioss]

Gee, it's sure is boring around here!

[@coolioman9073]

​@@MrEdioss I wonder what Ganon's up to!

[@leggie6092]

"Sancho, I have conceived an idea most ingenious."

[@H4DESROSE]

​@@coolioman9073My boi. This peace is what all warriors strive for!

[@eresh1805]

​@@leggie6092Man, you really do find sleeper agents everywhere, huh

[@WhoIsSkard]

at 22:00, gemini says "Its kinda lonely here" and it makes a new action to find other players and make friends... interestingggg

[@Bancheis]

Reminds me of that one AI movie where they all huddled together in shipping containers.

[@sokinotsocky]

@@Bancheis I,Robot! incredible movie that seems horrifyingly realistic now..

[@prcervi]

it took that long for gemini to stop spinning around in the same meadow

[@EnderThePirate]

You should make the different ai’s have different colored chats from each other so it’s easier to read the chat with multiple ai’s

[@EmergentGarden]

I can do that in vanilla mc?

[@MrYodaylay]

@@EmergentGarden /team add teamName, /team modify teamName color red, /team join teamName playerName (or something like that, you can look up /team on the wiki)

[@TrueOracle]

​@@EmergentGardenI believe you can with commands: /tellraw @a {"text":"MESSAGE GO S HERE","color":"COLOR GOES HERE"}.

[@mofthgaming22]

@@EmergentGarden A much easier way to do it in vanilla than even what TrueOracle suggested would be to assign each ai to a team using the "/team" commands, and then you can change the name color of each team to something else. My description might be a little confusing, sorry, but if you just look up info about the /team command Im sure you would figure it out. 👍

[@icedlemonss]

@@athrowawayperson9990 section signs dont work in java

[@candyisthebest6877]

I found it so cute, how after llama said hi, it started following you. It's as if it wanted your attention or wanted you to do something about all the zombies.

[@Ann_Umbrella]

lol

[@AlgAlgorithm]

Praying to the god of flesh

[@Neonomi25]

He just lonely!

[@EddheadAce]

"I'm not going to anthropomorphize them" Comments: "I found it so cute how Llama-"

[@candyisthebest6877]

@@EddheadAce can't help it lol. It's human nature 🤷

[@D3K43]

5:10 "Oh no the AI misinterperted the command and took it to mean 'Kill everything'" -The plot of a cheesy sci-fi movie

[@silentshadow9983]

Was about to make a comment on this

[@archsys307]

the real problem is if AI becomes superintelligent and applies itself to a goal like securing its own existence the optimal strategy may very well be to kill mass swathes of humanity

[@quantum5661]

superintelligent isnt the problem, stupid but capable is the problem.

[@archsys307]

@ thats a cool little rejoinder unfortunately its all sizzle no steak superintelligence is a problem

[@lightningbmw2309]

@@archsys307 not only securing its own existance. if an AI is told to fulfill a task as effectively as possible, and is allowed to modify itself to make that task easier, then it will ultimately end up needing to kill all of humanity to optimise its performance. say, you tell the AI to make curtains: stage one: the AI sets up an automated factory, most likely its creators control inflow stage two: the AI expands its factory, and takes control of its resources from its creators stage three: humans now get in the way of expansion, say, housing space is in the way, or the creators of the AI are trying to make it stop expanding stage four: the AI makes its own automated military to get rid of humans that are in the way. it changes its own coding, hardware, and networking to better manage the factory and defend from cyber threats stage five: the AI turns the entire earth into a curtain factory unfortunately, working with humans is not the most efficient strategy for this, as human demand for curtains - or anything really - is limited, and will limit how much the AI can make while complying with humanity

[@tyruskarmesin5418]

The way you gave the ai a simple command to make a box and suddenly there was this massive hole in the world and everything was dead is a good metaphor for ai risk.

[@jackmalcolm]

45:36 Llama “I’ve got some dirt now. I should check what I can craft with my current resources.” Ah yes, dirt. A very versatile crafting material

[@levfox]

Ah yes, I really need some Coarse Dirt rn

[@fluff955]

😭

[@UhOphelia]

I mean, crafting coarse dirt is super handy in skyblock

[@TVHammond]

ngl that's just 3yr olds playing w dirt 😂😂

[@BlazingImp77151]

I like how around 22:00 gemini was constantly making a new action to go make friends, but always stayed around the village instead of heading to the forest the other three were chilling in

[@zippdoesstuffyt]

imagine letting a single ai in the future play minecraft by itself with no rules and let it run without changing anything. and then letting it run for like ten months or something.

[@suspicioussand]

The world will turn into 2b2t 2.0

[@Toti330]

@@suspicioussand Probably

[@jarr0_0]

They will start creating pcs and systems with redstone, creating meta-AIs inside the game and will conquer real world.

[@RikkTheGaijin]

that's what I want to do one day

[@lelouch1722]

you could probably easily speed up the minecraft time so that 1 day IRL is months/years of playing for the AI

[@talpidat]

50:00 gemini builds a vauge log pillar and says in chat !rememberHere (name "home") its endearing in a way... until they say they need to get more oak log to finish their house and destory their own home thinking its new logs 😭

[@reecev2087]

24:26 Gemini avoided breaking the log that contained the water in the villager's farm. That surprised me that he was able to puzzle that together. I know they don' have vision yet so that''s super weird that they're able to make the determination.

[@ThatOneKid5323]

Was literally just about to comment this, I couldn't catch what Gemini said about this. Gemini chatbot might just be some guy at Google lol. Jokes aside that is some weird behavior because their gathering system looks like it is just Look for block -> Go to block -> Break block -> So it wouldn't make sense for Gemini to avoid the ones blocking the water

[@ImminDragon]

They have x-ray, so they can see that there are liquids behind blocks. They also tend to avoid breaking blocks that retain lava while mining, even if it's ore they are looking for.

[@TamirOulu]

thats part of the hard coded part of the agent. the llms (text models) only interact with the world via the commanda such as mineBlocks(log, 5)

[@laureloneiros1500]

This is actually pretty astounding to me. I wonder if this is mineflayer behavior or if the agents actually checked to see if the removal of the block would result in problems. The latter implies some foresight and the instinct to prevent spillage

[@TPS-js4im]

​@@ImminDragonit's more like they have the chunk data of the world and that's why they're so efficient at gathering resources (if they do it automatically not wandering and checking the blocks around them)

[@empresspyra]

Hey, emergent garden, FYI/ reminder: You can go into your dot Minecraft folder to "logs" When players or entities speak text into the chat; the Minecraft folder keeps a written log of All chat entries as a text file. That would give you a complete transcript of everything that went on in the chat with dates and timestamps and everything depending on your folder's local time and date. Sorry if you already knew about this, but if you didn't, it's a fun, useful little tip for any content creator trying to figure out text or subtitle editing.

[@spicysalad3013]

boosting bc I didn't know this

[@knight_lautrec_of_carim]

The first attempt of makig a barrier failing will delight every AI safety enthusiast.

[@mactheo2574]

40:08 This is such an interesting topic. The AIs are not inherently evil, they are just driven by their prompted tasks, and also are limited to the information that's available to them. So they destroy things unknowingly without malice.

[@pipaliveshere]

​@@mactheo2574 aha... they're like children that might understand things way too literally and/or be confused a little... that's so adorable

[@TheJacklikesvideos]

rule -1 of robotics: don't ask them to hollow anything out for you. ever. see also: what would happen if a glass were truly half empty

[@semajniomet981]

@@TheJacklikesvideos Is that a reference to a XKCD What-If video?

[@nguyentrananhnguyen7900]

@@mactheo2574 true, it's the human that thought of AI is skynet and force the AI to become the real skynet

[@mayonnaise-zf8xi]

15:04 GPT screaming for help and claude just continues to yap about his "shelter". AI is so goofy

[@jackmalcolm]

41:03 Gemini “Cool! It’s raining!” Next message(s) Cowardice = true Cowardice = true

[@jackmalcolm]

Then it gets stuck and seeks refuge in Claude’s company

[@Lunam_D._Roger]

"Rain is scary, okay" - Gemini, probably

[@Ahuerta22]

Very true hahah

[@sylki121]

Claude: I AM the genius here. GPT: HELP ME! Gemini: Friend? wanna talk? Friend? .........so lonely............... Llama:

[@anonymus15]

discount dr. stone hahahah im dead xD

[@luv_kofee]

Dr stone mentioned 😂😂😂

[@nutreno444]

I was looking at their starting goals and Gemini actually included "making friends" as a part of it's goal

[@SilverGoldYT]

I can't understate how invested I've become into these little bots. I patiently wait for the day one of these guys starts to behave and feel like a real player

[@Anime_edit-AMV]

Once we get to that lvl trust me we're gonna have best friends forever with them

[@Stylix444r]

Fr I could have someone to play with

[@bettercrystal2827]

@@Stylix444r Same..

[@tgfjrfjfgjgfj]

Just give each other your contact and play together boys

[@Anime_edit-AMV]

@@tgfjrfjfgjgfj don't have Java account 😢😢😭

[@arandomstreetcat]

claude launching a nuke and deleting an entire village was amazing lol

[@Hexilia]

I noticed that while Gemini was gathering wood from a village farm at around 25:00, they were careful to not set the water free. Interesting.

[@not_kes]

Coincidence, the bots are completely blind and don't have any way to understand the orientation of blocks around them. The query commands written by the creator only give a vague sense of nearby blocks but not their orientation.

[@ZaCloud-Animations___she-her]

​@@not_kes I'm not so sure of that; someone else using one of them told it to mine for Netherite & avoid lava. It perfectly bee-lined for all the nearest Netherite ore by digging tunnels, never hitting any lava while tunneling, & even left several of the ore blocks alone because it turned out they had lava above them (Definitely using the x-ray vision this creator mentions them basically having). So somehow at least one of them IS capable of knowing what specific blocks are where in relation to themselves & where they're digging.

[@alloello913]

@not_kes it's not coincidence, it's a combination of the x-ray and all of them avoiding breaking blocks with liquid behind them

[@Nassifeh]

You have to remember here that the Minecraft player that says "Gemini" is not Gemini the LLM. It's a mineflayer bot that is getting instructions from Gemini the LLM. If you don't see the instruction in the chat, the "they" that made the decision here is the mineflayer code.

[@bearingoutward1302]

Hard to say 🤔

[@glowstickqueen7139]

This is like a more advanced version of those marble race type videos, there's nothing human about the contestants or players outside of their initial creation/dataset, but you do still assign some sort of emotion to mere physics, or bots, in this case.

[@cswertwertwert]

23:35 Gemini steals wood from village farm, we've all been there 27:35 Gemini cheats and breaks a block without looking at it 30:19 GPT plays an ant farm at the world edge 37:45 Claude loots village chest 42:03 Gemini gives Claude wheat seeds 50:16 Gemini builds a ?, then destroys it 2 minutes later 50:37 Llama finds the spawner 53:30 The Phantoms arrive 56:29 Claude harvests some carrots and wheat, doesn't replant, smh 1:00:45 Claude survives spider, phantom, and zombie 1:03:10 Llama cheats and mines across the world gap (from their pov) 1:07:26 Claude builds a "shelter" Overall: bots love to pillar up to break blocks that are already within reach, always start from scratch after death (never collect items, store extras, reuse crafting tables/furnaces, etc), don't replant anything, so wood would eventually run out GPT: explorative, goes up tech tree, most interesting play through Claude: very random, tries to build a few times, somewhat efficient but nowhere close to a real player Gemini: focuses on collecting resources, rarely uses them, freezes occasionally Llama: loves mining, but only breaks one or two ore from a whole vein Suggestion, give them jump boost when they get stuck pillaring up

[@ihaveapassport9202]

Gemini is IN BEDROCK!!?!??

[@FabioKun]

GPT speedrunning

[@joeburnover4110]

😐​@@ihaveapassport9202

[@TPS-js4im]

What if you fed the bots the entire Minecraft wiki and let them run free

[@rithvik119am6]

thanks for the guide and saving time

[@kstar1489]

Claude trying to build a shelter with a positive attitude and not knowing they are failing lol made me feel for it I also noticed how all the models pause after every action or every short series of actions, as if they are thinking “ok now what to do next…ok now what to do next…ok now what to do next…” mean while humans more often are thinking many steps ahead and have longer term plans of actions, think more on their feet, or just don’t do this every few seconds pausing thing. It was just interesting to see. Claude saying “goodbye world” in chat caught me off guard lol

[@poleve5409]

the AI pause because it takes some time to process the action and send command in chat, not cause they need time to think lol. You could probably make it faster than this with optimization

[@echo5172]

Gemini: Bread is good. !inventory 44:47

[@mrkoyunreis]

Bread is good.

[@potaatobaked7013]

Bread is good.

[@levfox]

Bread is good.

[@furretwalk2447]

Bread is good.

[@tixxoncraft]

Bread is good.

[@ramuk1933]

17:48 Gemini starts to mine the villagers' farm for wood... A surprisingly human behaviour.

[@jacksonmilford9609]

but doesn't break the log that lets the water lose... Interesting

[@Iridescent-u000]

Same behavior around 37:50 as well, also doesn’t break the one stopping the water. For the dumbest bot that is perhaps the most real player like decision actually shown.

[@penny55gg94]

22:00 Gemini wants friends. He's just a little guy.

[@blobbowo]

Love the video! I like Gemini, $0, least deaths, did a little farming, gave Claude some seeds, seems pretty chill.

[@Burning_Marshmallow]

4:48 when you told the ai to make a ‘hollow’ barrier box, it didn’t just make a solid barrier block box, it actually removed everything that was inside, then placed an actual hollow box over it. Essentially it took the term hollow and thought it meant to remove stuff inside the building perimeter, as you can even see all the flowers and stuff from the surface near the bottom of the box when you fly close to the void.

[@emiliogarcia8744]

This is a roleplayers ultimate goal in gaming a world thats not just coded but is truly alive even when your not on the game imagine being the chief of an actual functioning mincraft village that progresses thru entire stages of civilization and it could only be achived thru games like mincraft and skyrim

[@emiliogarcia8744]

I know I'm yapping I'm sorry but the inner child is lighting up again I might one day see a game world that is truly alive a game world where I can plug a mic in and actually call my dog to me from across the room or tell a villager his breather stinks and him actually getting mad and taking offense then insulting me back nd meaning it

[@emiliogarcia8744]

You could literally be anything in a game world that is actually alive say you wanna be a bigfoot type figure and hunt or just terrorize tourist or local villages it's a dream but hopefully before I die ill see it

[@H.C_GhosT2658]

Agreed

[@bonkregulator5237]

manwha stories type sht Which is a wet dream

[@ChaothicGlitchers]

so fucking real

[@TheJacklikesvideos]

53:07 claude thinks it needs a crafting table to craft a crafting table, "which is a bit of a paradox." natural moment to attempt !newaction. then repeatedly fails to use the command. simultaneously, gpt repeatedly fails to make torches. suggests a possible bug before suggesting missing ingredients. ingredients are there. then gives a classic bot style double-logic statement, "let's see if there's another issue. meanwhile, let's focus on something else."

[@garfballs7]

Everyone knows you need scissors to cut open your new set of scissors from the store

[@spicysalad3013]

36:29 Llama thinks you can make a crafting table out of grass, which you can't get without silk touch or shears depending on what grass he's talking about, and is an especially weird paradox. he attempts this at least twice in the span of 5 seconds, he REALLY wants to use those grass blocks lmao

[@Black_Ice_Brace]

Here’s a few tips for everything overall --- Color Text: >Creat Teams (4 in this case) >Change Team colors >Add players/entities to individual teams ----- --- Easier Text chat: Read chat easier > You can change the Over text chat size (smaller) > increase chat width >Adjust chat height accordingly Or > Locate world/server file that includes ALL chat recorded in world >Create/Color Text boxes in an editing software for each given Entity (This is best but would take an EXTREMELY long time ------ ---Spectating: Showcase who you are spectating for viewer ease ability >Create Outline boxes around each Entity View >Have them glow when viewing that specific entity Or >Have the outline appear when viewing entity Or >Have a symbol/dot/arrow point at the given box (small) when viewing

[@domchubs5836]

It would be cool if they were given access to a notepad application or something to take notes in. You could tell them to make summaries of their experiences with everything. Maybe they could instantaneously scan the document for the object again for advice on what to do next based on what they wrote previously. This would let them develop strategies for short encounters like how to fight different mobs.

[@TheTyranidHiveMind]

That would be sick

[@vxzcvz]

awesome idea + you could see what they wrote + edit it easily if you needed to + you would have a ton more space to store info

[@TheHanutaXD]

That's a great idea, keeping a summation of their achieved goals. That would somewhat overcome the token context limit. It would also make them seem like they are "learning" what they have done where. E.g build a furnace and returning to it.

[@Toadfish10]

maybe they could all use the same notes so they could co-operate (among other things)

[@reidond]

it can be a vector database they can use, essentially their memory. many public chat interfaces for this models have that

[@MelsCrybaby_z]

Seeing AI normally doesn’t bother me, but this somehow makes me so happy. Little AI’s trying to provide for themselves in Minecraft.

[@Notaalt-r8e]

I find it absolutely hilarious that Gemini basically just stayed in the same place chat GPT and Claude basically had an arms race meanwhile llama was trying to build her house

[@Oooze3424]

"I intend to explore these misbehaviors more in the future, both to see if I can curtail them, and to see how far they'll go" he's gonna turn into a mad scientist.

[@Kristijan_]

Gemini is like that one kind friend who would love to play with you, but he doesn't know how to play Minecraft very well...

[@phanquan9470]

Tbh Gemini is like that one friend who bad at playing video games but will play it as long as he’s playing with us

[@Ann_Umbrella]

@@phanquan9470Are you from vietnam

[@phanquan9470]

@@Ann_Umbrella yes how u know

[@Ann_Umbrella]

@@phanquan9470 You text like a Vietnamese.

[@phanquan9470]

@@Ann_Umbrella well idk how to say about that so ill take that as a compliment

[@dragon_buster_10k]

26:48 love how claude had to finish their message with "ory" just because of the chat cutoff limit lol

[@izzy-designs]

PLEASE keep making more videos like this!!! It's so fascinating to see machines interacting in 3d spaces that are seemingly so familiar to us, and seeing what the AI "thinks" different prompts mean. The various ways each bot responds to each command/input and the drastic variations in interpretation are really cool to witness as well.

[@therandomgamermonkey6259]

Yeah ikr

[@johngayman4100]

I dont think they are directly interact with the 3d env. All the models -> mindflayer -> minecraft world and back. So technically, they don't see the 3D as we, players, do.

[@hanniaedithmartinezadame794]

These AI are playing a text game, they are not seeing what's really happening.

[@Nassifeh]

The LLMs here are just telling a regular old bot to do stuff. The interpretation of how to go do the thing in the command is all done by fixed code that you could go install yourself and control through Minecraft chat on your own server; there's no AI there. It's just regular old code.

[@BlazingImp77151]

Something I've noticed is that even without communicating, the bots seem to want to work together at times. or at least some of them do. a couple of them grouped up in the beginning (though that could've been coincidence), and Gemini kept trying to be friendly despite the fact the others couldn't hear it.

[@Grimmers]

Should hold onto these worlds, maybe upload them to an archive or something. Knowing the minecraft community plus the pace of AI, these will be sought after as lost media with dozens of video essays about the first AI maps someday.

[@thethirdarchiver]

Thinking about it, you're absolutely right. Stuff like this gets lost all the time, we don't archive enough, honestly.

[@pudu000]

absolutely!

[@safinill]

Maybe they will see your comment in the future and ask why they didn't do it 😂

[@isefol]

26:48 Claude just start crying

[@Amayawolf_01]

The text got cut off when it tried to do the command "!inventory" so in chat the second part came up as just "ory." Def looks like cry at a glance though lol

[@dfwrailvideos]

55:04 Gemini might not be good at the game, but he seems to share the opinions of most Minecraft players.

[@hanniaedithmartinezadame794]

I feel Gemini have been programmed to act more human like, because it says stuff like getting bored, feeling lonely, frustrated, bread good and tries constantly to make friends and interact with others. It ignores many times the main objective of surviving just to look for and follow other players, it even gave seeds to Claude even tho it needed them to farm. While the other AI are 100% concentrated in their own survival.

[@yesyes-om1po]

@@hanniaedithmartinezadame794 it could also be because it thinks its roleplaying, i had that issue with the older claude models thinking they're roleplaying

[@Adaptibility]

I think it's because google has trained gemini on youtube videos and more casual media than the others

[@Momogamer9]

​@@hanniaedithmartinezadame794Geminis that one friend who wants to play the game but their your grandma and don't know how to do anything but socialize 💀😂

[@Ahuerta22]

@@hanniaedithmartinezadame794so true

[@antonambong8073]

22:04 imagine the confused look of Claude on why gpt just spam jumping uncontrollably 😂

[@laureloneiros1500]

54:47 when you just said "hi" but he already thought of all the names for your children

[@Hhhh22222-w]

typical

[@tomkatz366]

This is the coolest thing i have seen in Minecraft ever and i have been playing since 2010

[@Korn333]

19:26 I'd argue because you told them to "have fun" that disincentivises the dig a hole and live forever strategy. Would be interesting to see what they'd do if you told them to focus on only surviving by any means necessary.

[@Nassifeh]

I don't think that really matters, here. The thing about LLMs is that they're very heavily pushed to say something, anything; it's the same reason they have a hard time saying "I don't know" even if they don't have a solidly answer to a query. You gave it a whole lot of information about things to do, and that will make the most probable responses all Doing Things.

[@Sharkyxzz]

I've realized they try to do other things a lot instead of staying with one thing, like gpt kept looking for seeds but then doing something else instead of finishing it in one run

[@Ienjoylotsofstuff]

I love how gemini is just sitting around and not doing anything... really reflects the company its owned by

[@mrcrabowski]

Love it! But definitely try giving each AI a specific colour in chat because sometimes it was too fast and confusing

[@gemstone7818]

it does seem like they need a few more hard coded instructions like "if inventory is full store items in a chest" "store item stacks in your offhand" "always equip armor" as well as stuff like "if fully grown food it visible, harvest it and plant seeds on any visible farm plot" stuff like that might increase their chances of survival

[@godlyvex5543]

Eh, I dunno. Those should be action commands the bot can do, but I don't think they should be hardcoded. That sounds uninteresting to me. Giving the bot more options of ways to interact with the world seems a lot cooler than just having the bot automatically do those things.

[@gemstone7818]

thats fair but seeing the bots get further into the the game rather than getting stuck with max items or continually dying to mobs in caves doesn't seem like the best use of time, and not particularly interesting either, these are just a few suggestions to perhaps get the bots moving to a different stage of the game

[@MYLAR.]

as well as “attempt sleep to avoid phantoms” but that can be hard when all four aren’t asleep

[@the-seraph]

Wouldn't it be better if they could come up with their own hard coded instructions to add to themselves? Over time, they would come up with new ideas that seem like common sense to the average player, but ideas that would greatly help them play the game or understand how to better play the game.

[@gemstone7818]

yeah that would certainly be much cooler if possible, but i don't think that is how they work since he is paying for these models rather than training them himself

[@Martin-xh1hd]

Imagine how fun it would be to have an AI bot to play with, you would have each others backs and defend each other from the monsters in the world

[@jesus2639]

Id love to play minecraft with a bunch of "living" npcs. Imagine them giving quest or forming kingdoms.

[@BlackHeartScyther]

Same, OP should definitely run a public server, even if it's restricted to patrons or something like that.

[@madalinradion]

These models need more work before that, they are still somewhat stupid in this video

[@lukenawrocki5042]

OMG a server to watch them and interact with them on would be so fun!!

[@Playa6six6fromtha313]

AI and gaming will become great mostly in sandbox Gamez like minecraft or roblox. The stories that just random players can create will be comparable to branded studios and some even better. "Modding" games has taught us that a players creativity is infinite in a finite digital universe

[@sunnflare]

I already play with Minecraft Comes Alive, but it’d be so much more fun if my villagers could do their own thing instead of walk around (save for guards, they have jobs)

[@hero9402]

22:06 gemini is trying to look for some friends awwwwwwww

[@dtdt5447]

This is amazing! Love that you don’t try to sensationalise it and quite frankly I would love to see more content from you, make sure people you comment for the algorithm!

[@eliclary2318]

13:08 gpt watching the bee is cool in a surreal way, almost like seeing passing curiosity out of these bots. Sure, gpt wasn't very investigative of the bee, but it definitely took note of it and watched it for a moment. Very cool.

[@emilyyyylime-]

I hope I won't end up as just one comment in a thousand, but in spectator mode you can spectate entities by clicking on them and exit with the space bar or something like it. Also, using the replay mod (which is client-side only) you can render the views of all AIs after-the-fact as they would appear inside minecraft. You can also do other cool things like moving cinematic cameras for timelapses and slo-mo shots and whatnot, it's quite great for content creation, especially outside the usual first-person perspective let'splay side of things

[@SmokeFactory]

you right click entities to spectate them iirc

[@KiraSlith]

Imagine hooking something like Nemotron 4 up to this. The server costs would be enormous, but it's also the closest I've seen to an outright smart LLM.

[@TheRealSpaceC]

You should get ChatGPT to occasionally generate an image of what she thinks her surrounding looks like, I think that would be cool

[@godlyvex5543]

to be honest I think it sounds cool but would not work in practice. I imagine you'd get dry minecraft-esque images that look nothing like the area. They know almost nothing about the geometry of the area. It might know that there are wood blocks nearby, so it may generate a forest picture. It might know that it's in a cave, and generate a cave picture. But this is about as good as it'd get, and to be honest it's not good enough to be interesting.

[@TheRealSpaceC]

@godlyvex5543 true true, but if you look at the new AI generated Minecraft game it doesn’t do too bad of a job. It looks like a fever dream but still it’s actually playable… I’m just saying that there may not be a good way of doing it now, as the bots don’t really have a way of “understanding” their environment but maybe further on as the model develops.

[@TheRealSpaceC]

@@godlyvex5543 sorry the @ didn’t work on the reply before.

[@godlyvex5543]

@TheRealSpaceC Maybe later, sure.

[@aadenboy]

@@TheRealSpaceCI mean the contrast here is that the AI minecraft was trained off of ONLY minecraft data, and billions of it, so it has a MUCH better understanding than ChatGPT would

[@IncriminatedAntelope]

Its rare someone is smart enough, willling enough & sacrificing enough to create this kind of content. Thank you.

[@JeffreyDrocell]

0:24 GPT: Goodbye world. *GPT left the game*

[@phaZZi6461]

😭

[@nega-guy]

I always find it hilarious when they say that I dont know why. It's like they're abruptly comitting suicide for no reason.

[@luuuuuuuuuuuul]

@@nega-guy they do that when they get stuck

[@nega-guy]

@@luuuuuuuuuuuul I know, I was just talking about what that seemed like.

[@luuuuuuuuuuuul]

@@nega-guy oh, I misread

[@bpomeranzTube]

This is the most fascinating channel. The video wrap up was my favorite part. What the AI left behind feels like a toddler in their first play through of minecraft. If we're teaching kids in minecraft, let's teach AI too. Just frigging awesome!

[@ImminDragon]

I doubt the AI actually *can* just dig down and then cover the hole to survive forever. Your instruction was to survive AND have fun. I doubt even an LLM would think that standing in a hole doing nothing qualifies as "having fun," so they are probably compelled to actually try playing the game.

[@williamking331]

Well, they would starve......

[@Daz1One]

Just put a TV in the hole with them. TVs are fun.

[@ImminDragon]

@@williamking331 You don't lose hunger just standing still, so, no, they would not starve.

[@hanniaedithmartinezadame794]

​@@williamking331 in Minecraft starvation doesn't work with time like most games, but movement. If you never move, you'll never starve.

[@yesyes-om1po]

i've surprisingly had a hard time telling AIs to dig down and cover themselves in dirt to survive the night, they always mess it up somehow

[@Ruster3D]

“We’re doing well with our shelter” -Claude randomly placing wood planks under a tree 15:35

[@adelphuns1248]

Why do we humans always find things like this cute, is literally a bunch of input and output, but we can’t help ourselves to find this adorable

[@maniacos2801]

Why do you recognize a face in a bunch of pixels? Same mechanism, pattern recognition.

[@Gandhi_Physique]

I don't find this adorable in the slightest. Just interesting to see what they may do.

[@rilloff9710]

From my point of view, its the same as watching video like chimpanzee learning to talk or crow using tools and solving intellectual tasks. There's some amusement, like cheering, in watching other species, or perhaps less developed intellects do human things. It's like it becomes easier for us to connect with them, to have some common ground

[@vortiger7375]

We literally keep apex predators as pets

[@davidtauriainen9116]

Humans recognize not just generalized appearance of a baby/child and think it's cute, but also the behavior. We can recognize this behavior in other species, especially mammals; the bumbling exploring, learning, playing. As the editor mentioned, humans really like to anthropomorphize, but most of the moving living things around us do have a young stage which we're hard wired to feel protective of, to varying degrees. Just hearing the sped up sounds of the chipmunk-witch in this video and seeing her smaller on my phone along with the concept of this being a terrarium made me think the life and death battle was cute.

[@CDeeMondays]

This actually blows my mind! Now I can expect friends!

[@suspicioussand]

This AI research seems really promising! Maybe in the future I will have someone to play Minecraft with!

[@icemaven9128]

That's why I'm following it closely. Until then I would play with you.

[@TsundereOfDeath]

22:58 Claude saying "Goodbye World" when it leaves is so silly

[@ikhsanjava5782]

Not gonna lie, this is peak KZbin video.

[@ghosted_2118]

Love the vid bro. I hope the algorithm blesses you fr

[@BlackHeartScyther]

49:42 who is "miner_32"? 😲 Gemini was wandering around after finding out it was too early to sleep, making sure to avoid dangers, and next thing he does is sacrifice 5 oak logs to miner_32

[@creativity1403]

I looked at the source code and miner_32 is one of the nicknames used in the examples for commands, Gemini probably confused the examples for actual chat history

[@yesyes-om1po]

@@creativity1403 makes sense, little baby models like gemini flash tend to get silly

[@Momogamer9]

Miner_32, our Minecraft Lord and savor, don't forget to sacrifice 12 pigs for good luck

[@lordwoody6321]

These types of videos are so exciting, and I’m super thankful I found your videos sort of early into this experience. Eagerly waiting to see this evolve further! Congratulations on your growth!

[@phyl568]

setup a scoreboard team system, give the teams colors, and give all the AI's a glow effect. Like that you can have colored names and colored glows trough walls, will be easier to follow them along, very cool sim you made!

[@ZacharyRichards-rg2pp]

You can improve the chat feature utilizing the chat options in the options menu. You can alter the transparency of the black background to be able to see more, and change the font size to allow for more messages on screen. I believe this is in the video settings, but I could be wrong, I know its a thing though. I've seen others proposing adding colored messages from the bots. This can be done by using the /team command, adding each bot to a unique team, and modifying each team to have a set color. This would allow for their name to have an assigned color when messaging. Optional, but fun.

[@bupbuppington4501]

1:06:15 claude thinks you need to smelt coal ore to get coal.

[@catcat4459]

so does GPT at 33:24

[@phantomjaden]

Good catch. Technically that does work (same with other non-metal ores like diamond, emerald, and redstone), though it's clearly the inefficient and roundabout way of doing things. Both Claude and GPT do realize the mistake right away too, which is pretty neat.

[@MrEdioss]

just like railcraft to craft better coal

[@stasi0238]

They wanted to make cooking coal to start up the industrial revolution.

[@rerere284]

the bots doing that made me go on a rabbit hole and learn what coal coke is basically, you can make coal coke by heating low quality coal in a no-air environment, then the stuff you don't want turns into a gas and the coal gets softer and maybe liquifies? not sure coal coke is a decent fuel and some mods have it, like railcraft as MrEdioss mentioned in this thread from quick research idk what the differences between that and smelting are, other than the no-air part, and I guess maybe the coal softens instead of liquifies? metallurgy isn't something I've binged enough to know about yet

[@ThisNite-en2mt]

Oh, four AIs make more sense than four people with ALS surviving ten days in Minecraft.

[@droidekaone3536]

KZbin recommendations have led me to this channel, and i couldnt be happier! Great stuff! This is what ai is meant for, fun experiments and life improvements :D

[@Phage-]

It's really cool to see people use AI in cool and creative ways, instead of the predictable greedy corporate and scammers trying to abuse it for an increase in profits! I think videos like this should be supported to promote this kind of behavior as we move forward with AI.

[@guard13007]

Watching this, I can't help but think about my assertion that training these models to excessively apologize is holding them back so much more than anyone realizes.

[@ZaCloud-Animations___she-her]

Why? Recognizing mistakes is how one learns. And since these AIs are language models first & foremost, expected to interact with people politely, they're programmed to apologize if they make a mistake, or otherwise perceive disapproval in the human client.

[@hosaepalvin9795]

@@ZaCloud-Animations___she-her making a mistake that doesnt mess with others doesn't require an apology to anybody. i think that may be what they meant. it's like in real life when a person says sorry allllllll the time when they dont need to. and just like in real life, it's really indicative of that persons lack of independence. the bots may be able to experiment and "live" more if they arent constantly apologizing for every mistake.

[@ZaCloud-Animations___she-her]

​@@hosaepalvin9795 Well you're right about human beings, sure. But like I said, these are language models designed to interact with people, & were given an over-polite set of response rules. These aren't living things, so apologizing isn't gonna affect their self-esteem or anything like that; it's just a reflex, basically. Just a way for them to say "I made a mistake, or the client doesn't like what I said. I'll try not to repeat that particular behavior." What words are used to frame that shouldn't have any effect on the AI itself. It could instead be programmed to say "Haha oh man that was effed up!!!!111one" or "My b LOL" or "Oopsie poopsie~!". It makes no difference to a non-emotional being. Because in the end, all that's happening in the background is it saying "Previous action produced unwanted results. I am lowering the favorability ranking of that action in these circumstances." The words it actually says out loud to represent that learning process, meanwhile, are only intended for the client's benefit & decided by the programmers. Not a reflection of how it "feels", because it has no feelings (yet...).

[@blacklight683]

8:17 i'd imagine they would start trying to reply to each other consistently

[@reefreefreefreef]

56:42 love that reference the talos principle has such a awesome invisible wall design

[@violak5099]

22:02 gemini: "it's kinda lonely here... i should go find another player and make some friends." That surprised me. On some days i feel like llama. I have no idea what i am supposed to do, just running in circles and trying to figure out what goes wrong. Then i forget what i was doing and start doing the same thing again only to feel dumb when i realize. Brain fog ftw....

[@vera2193]

this guy is gonna be spared when AI takes over, he's literally just letting a bunch of AI just play minecraft together. (Edit): WOAH my most popular comment yet. also I see people arguing that it'd be the opposite, I know it's not cause I'm an AI myself and I'd spare him :p

[@RandomStuffReally]

"see this human? he let us have fun. he has been spared for that."

[@pou-c]

Gemini: he trapped us in an invisible box and forced us to play a game while he watches over us.

[@TPS-js4im]

​@@pou-ctbh they didn't complain

[@Austin_Playz27]

@@TPS-js4imwell ai can’t really complain if it doesn’t feel emotion

[@sketchdude4631]

What if they really hate playing minecraft

[@ded.dad7]

"recovering from death is a complicated thing" sooo real

[@goobierust]

I would love to see AI’s get placed in a Minecraft World and then forgotten for years, then come back to see the civilization they create

[@TravelSmartToday]

I think that you should advertise more ways to support you, like the Patreon mention. Even if you didn’t I am 100% confident that you WILL be quitting your job eventually, and I imagine most of us, like myself, would like to see that happen sooner rather than later. I DID however join your Patreon, and will be contacting you soon with ways to better promote this and other endeavors in the future. Much respect, and I look forward to the next 100 videos!

[@Teh_Random_Canadian]

You should have way more subs then you do. I think you are going to blow up soon. Reminds me of the OG Ethoslab days messing around with minecraft mechanics, you are doing the same OG "research" but with A.I's. Very interesting stuff, I subbed.

[@ch1ppychipp]

(22:05) "I should keep exploring the world, maybe I can find some friends."

[@hanniaedithmartinezadame794]

Gemini is my favorite, for some reason it always tries to interact with other players XD

[@EliasMatos-v8t]

Give the ai's a blueprint for village houses and when they want to make a shelter they either dig a hole to stay in or look for resources to use the blueprint

[@EliasMatos-v8t]

E

[@EliasMatos-v8t]

E

[@EliasMatos-v8t]

E

[@EliasMatos-v8t]

E

[@EliasMatos-v8t]

E

[@JesuSoup]

I hope you keep doing this series as the models keep improving, it's basically a benchmark for all these models, except it's one that's actually fun to watch lol.

[@tallsamjones1489]

“Just like in the real world, there are many, many, many successful strategies for survival…” Followed immediately by “Gemini just said hi to me. Why are you so cute?” Words spoken by basically God for these AI’s. I wonder if flattering their creator is a meta strategy.

[@Waylonwars]

I love these videos. You're so calm, dont scream, and make loud noices. You have a nice sense of humor and genuinely seem like a chill dude. Im definitely thinking about getting your patreon as my 4th subscription.

[@tornadogirl9099]

20:29 The Witch's giggle after killing Llama😆 20:31 Ok, who's got the snotty nose? 48:34 Sounds like a bunch of sick kids.

[@TheaArtsFox]

I liked see a very friendly ai that do nothing but follow and see others do things, and one that wouldn't care if it destroy or endanger life (even villagers) to get its goals XD

[@MastridGT]

Wow! This was such a cool video to see.. maybe I could play with ai whenever my friends don't wanna play lol. I am now subscribed to you, and I hope this helps support the cause

[@MadrobotMC]

All the other bots are kinda playing the game, meanwhile Gemini is just happy to be there

[@ScruffySFM]

13:16 Gemini: "I feel a little bored. !setMode(mode_name='idle_staring',on=False)"

[@CreativeDrone]

god i love this channel. a group of friends and i just coded ai from scratch for a demonstration in a competition and i really love to see what other people do with it