speedrunning AI minecraft.. (nether + end)

[@mugencc8496]

Holding onto the nether sounds like holding onto a dream when you know you're about to wake up.

[@prowers2623]

It's so sad, man. I remember the few rare times I knew I was dreaming, but I slowly felt myself waking up and started to feel myself shift on the bed instead of moving in the dream.

[@fumo-fumo-fumo]

2hu

[@1ntegerLimit]

Saw this listening to Wake Up by Travis “I DONT WANNA WAKE UP” 🗣️🔥🔥

[@ChaseThePinballWizard]

holy shit thats so accurate.

[@The_cgull]

HAKUREI REIMU??? 😰😰😰 Guys the CEO of racism is here

[@matt92hun]

After decades of progress we finally got an unplayable version of Minecraft.

[@DivineLight661]

bedrock is pretty unplayable

[@davebob4973]

​@@DivineLight661 your face is unplayable

[@callmenik5000]

​@@davebob4973my balls are

[@GAT957]

​@DivineLight661 ur feet is unplayable

[@rom8224]

So bedrock edition

[@Niko-bx6mc]

I specifically appreciate how they're trying to be descriptive, but since it's like reality soup that generates based on the palette of the image, the best they can do is stuff like "We need this orange" "Lets try to see what we can do with the floor" "Hold onto this red" "They're trying to take away the nether from me"

[@ackleackenkaker8508]

I have not yet heard a better descriptor for this than “Reality soup”. 😂

[@YSPACElabs]

Reality soup as simulated by linear algebra soup

[@Subird]

3:01 *Task completed:* "Get into the Nether" *Current task:* "Stay in the Nether no matter what"

[@Algo_de_Alguem]

"95% of people cannot achieve that"

[@wolowolo6179]

i love this shit lol, its like trying to control a lucid dream

[@Skuffd_Lad]

more like trying to control a verifiably non-lucid dream

[@famlrnamemssng]

More like trying to control a semi-lucid dream. Once it's lucid it's pretty easy, but when you're in that weird state where you aren't quite sure if you're dreaming and haven't stabilized it, then shit gets weird.

[@Regw2520]

Yeah fr​@@famlrnamemssng

[@muegaltomiganson]

It's more like trying to control someone else's dream

[@nicktvname3115]

Superliminal if it were a real dream

[@DumbOctopus99]

So, AI Minecraft speedrun revolves around finding colours/patterns that look like required resources/places, rather than actually finding these places/resources. It's so absurd yet so interesting.

[@adventofnull]

It hallucinates things not only into existence but out of it, so trying to experience the AI like an actual 'game' is an effort in futility.

[@LucasFerreira-fp4nj]

@@adventofnull what futility? This itself is already hella fun lmao

[@adventofnull]

@@LucasFerreira-fp4nj I meant playing it like Minecraft (mining, crafting, looting, farming) is useless because when you do a 360 flip everything is replaced. Like at the very least other AI generative stuff you could maybe see as a (worse, poorer quality) version of the 'real thing', but this is more 'the backrooms' than it is 'minecraft'

[@cortster12]

​@@adventofnullIt's also in its infancy, and is already amazing if you understand how it works. I'm baffled at how they managed to make it this coherent. It really should be even worse than this. Technology is getting crazy.

[@AV-ir9dh]

​@@adventofnull it needs to have enough nodes to render full 360° of the game and then it zooms in to produce the view

[@NotoriousICG]

i love the references to the ethereal "they", as if there are little men inside the computer making the image shift

[@lamelime1]

"they" want you to think that "they" aren't real

[@kiattim2100]

Bro fighting his own dementia 💀

[@mrbartinio]

The woke left is trying to take away our nether

[@Subird]

It's obviously the Machine Spirit

[@NicoleColenico]

@@Subird The machine spirit on this case being, ironically, non-binary

[@daknboot]

this is actually so cool, having to try to trick the game into generating what you want is so fun

[@kalahatze]

I feel like if the AI was a little less sloppy and had a slightly longer memory, it could actually be amazing. Of course, it won't be actual Minecraft and probably never can be, but the idea of having to find red blocks to convert to lava to get to the nether is really interesting. As it is, it's too random to actually be enjoyable for more than a one-off gimmick, though. If the AI could remember, like, a couple hundred frames in the past, then it might be cool. It'd still allow for converting your surrondings based on blocks; you'd just need to stare at the blocks for a bit longer. A couple hundred frames, or however long the AI memory is.

[@LaserTractor]

*gaslight the game into thinking😂

[@HoodedSpidey]

@@kalahatze One solution I’d propose is a scenario-detection model that changes the dataset depending on certain recognized images, I.E. nether portal/end portal blocks. From that moment forward, the AI model switches from its overworld training to strictly Nether/End gameplay, preventing an accidental return from looking at the wrong color. Granted, implementing segmented diffusion defeats the purpose of this being purely a tech demo. But if you wanted to turn this into a game, that would be the next step. Signed, armchair programmer.

[@kalahatze]

@HoodedSpidey You don't need segmented diffusion. This creates images frame by frame, at least as far as my understanding goes. Just switch to a different AI after a certain frame is complete. Use some kind of grounding dino model to recognize a nether portal, then for the next frame, you can change the AI or something. It actually seems fairly easy to do, although I'm not quite sure exactly how this works in detail. Edit: Actually, you don't even need a new dataset. Just use a LoRA.

[@HoodedSpidey]

@@kalahatze My main concern about just using a LoRA is that there may not be enough footage in the nether, and I worry about how it’ll affect the “rules” of Minecraft (it’s broken enough as is.) I do agree that we *probably* don’t need an entirely new dataset, however there should definitely be more footage to supplement things like portal ignition, traversing fortresses, gravitational acceleration, and mob behavior. Admittedly I didn’t even know about DINO models until now, It’s really cool to learn that most of the tech exists already & that it’d be simpler than I imagined. Thank you for being willing to talking to me despite my limited knowledge. I’ll be doing more research on all of this.

[@aaronconvery]

This is such an interesting concept, the game is trying to gaslight them and they are trying to gaslight the game back, it's like a boss fight against the entire world

[@xlretard]

Definitely not gaslighting lmao 🤣

[@jhsevs]

@@xlretardstop gaslighting

[@benjaminmurrayesquire]

3:37 That carrot casually turning into a yellow bed

[@SchadenfreudeUY]

Metamorphosis

[@apenaseu7588]

@@SchadenfreudeUY I can do anything! Ueheheh!

[@galoomba5559]

0:16 yellow bed casually turning into a carrot

[@Coriander1988]

Don't let them take it from you. You worked hard for that nether.

[@DoctorAlright]

*neither

[@Eltralor]

@@DoctorAlrightwhat

[@Payday5]

@@DoctorAlright what

[@Met1300]

@@DoctorAlrightwhat

[@freep3115]

They’re trying to take away our nether, we need to stop this

[@ЧистоеНебо-ш2ц]

Make the nether great again

[@condensationz7308]

We are now unburdened by what has been

[@willgoogletakethisname3963]

We need to build a wall and make the piglins pay for it

[@masterspark9880]

They're eating the ocelots

[@thestudentofficial5483]

This is like an SCP entry about containing a cognitohazard

[@WanderTheNomad]

The nether is an antimeme

[@Cosmixthegoober_]

Genuinely yeah this seems like an unimaginable dimension the scp foundation would contain or something

[@ashendude3394]

​@@WanderTheNomad there is no antimemetic division, there is no antimemetic division, there is a body in that water, there is no antimemetic division.

[@greylight5]

I tried playing this the other day and seriously all day I was going around feeling like everything was shifting around me and nothing was real. Real-life cognitohazard.

[@AlphaSeagull]

I love the whole 0:30 these are vines 0:33 nevermind they're magma blocks congrats 0:39 what blocks

[@Xathonn]

It looks like it interpreted the magma texture as the block break particles, so they just exploded.

[@tessabakker662]

2 Magma blocks: *Mr.* *Stark* *I* *don't* *feel* *so* *good.*

[@NikoKun]

Wild. Almost seems like they trained it on a lot of simpler short videos, and only a few contained nether, so while it knows what nether looks like, it wants to maintain the overworld look instead.

[@thebrownfrog]

Your intuition is actually 100% true

[@MangroveLord]

Nah it's definitely because most of Minecraft content and gameplay is in the overworld

[@FloodlightGamingReal]

I mean while most content is in the overworld that doesnt really change the fact that not enough nether footage means the ai cant simulate anything BUT the overworld too well

[@solalabell9674]

I’d guess that virtually all Minecraft content is overwold since most smps and guides are mostly there

[@BobTheEnderman]

0:33 geologists when an eruption occurs

[@CJSavageGaming]

Duh

[@SoewoeMoloko]

LMAOOOOO

[@l33per509]

Me and my imaginary friend trying to beat minecraft in a lucid dream

[@utfigyii5987]

It most likely did not have enough training footage for the nether, so it did not understand the difference well enough and that's why it was trying to take the nether away

[@ciuek]

In this demo I suppose, they used footage with keys clicked at exact time as training data. They had to use nether footage, because this algorithm wouldn't be generating those images without it. It was most probably less frequent in dataset, therefore occured the effect of nether vanishing.

[@Flowery0]

Ok, that's the best use of ai: dream games. Like, make it a little less erratic, optimise it, remove the time limit and it's just gonna be so much fun

[@Wott786]

FRRRR

[@beex6]

omg such an amazing idea

[@GoroAkechi_Real]

screw AI art. embrace near unplayable non euclidian versions of well known videogames

[@sexygirlmax2019]

​@@GoroAkechi_Real Catacombs of Solaris my beloved

[@sexygirlmax2019]

​@@GoroAkechi_Real i misread your comment but still. also infinite pizza

[@Sean_Jaggers]

Minecraft manifestation speedrun

[@relic4948]

“lock in” *manifests harder*

[@moncef2733]

This feels EXACTLY like how you try to keep a dream from changing to something else, the most tripping thing about minecraft ai is that it's the closest thing we have to actual dreams

[@sexygirlmax2019]

Comparing it to reconstructed dreams it's pretty accurate. Our brain does the exact same thing just like data moshing....You think of a lamp post for a few seconds but now you move and you're next to a wall, not a lamp post. also PilotRedSun's "Not so fast" is so incredibly dreamlike it's scary. I don't know how he created them so accurately

[@jacobp.2024]

You and your friend's commentary is absolutely immaculate. The way you call out things like it's some kind of official speedrunning terminology is too good. "It's reddening!" "Orangification." "THEY'RE TRYING TO TAKE IT AWAY" "They can't take this away from me" "It's starting to turn to dirt.." You should do something fun, like crazy BS modpack reviews or such, like those terrible Minecraft horror mods. Something fun just reviewing absurd Minecraft things

[@sexygirlmax2019]

for real, im in hysterics 😭 Orangification especially

[@nameless_guy434]

How speedruning minecraft on good zaza feels like :

[@sigmamale4147]

Your zaza got laced with dmt bro

[@DaviUndertale]

"Are you sure you want all of them? it's gonna make you very very high" "Yes, all of them." "See? this zaza ain't shi-"

[@nathanstafford8412]

This video feels revolutionary in terms of what's possible with this "game"

[@Coriander1988]

5:45 there was a stronghold to the left

[@Circxles]

i was going to say that

[@Pigeon_of_Doom]

This AI really is amazing. You've really shown how to manipulate it to get to different areas of the game. Amazing video

[@cheetah_zs]

"i think I'll be ok with this amount of acid, i won't lose control of my mind or anything" My mind 1 hour in:

[@BabyLeonards]

getting enchanted diamond tools is crazy

[@jeslinmx22]

What did this player dream? This player dreamed of sunlight and trees. Of fire and water. It dreamed it created. And it dreamed it destroyed. It dreamed it hunted, and was hunted. It dreamed of shelter. - Minecraft end credits

[@1ntegerLimit]

It dreamed of feeling like being on drugs while playing minecraft.

[@VladimirChibuckov]

Someone make a mod where you can play ai generated minecraft while you sleep

[@hephaestus2031]

I think having good items (enchanted tools, etc) triggers more endgame stuff, like the fortress and the end

[@noahboddy1484]

4:21 You guys almost made it to the end if you had just kept up with the obsidian pillars and the purple.

[@LuminousXDMC]

I love how the whole speed run is just tricking the AI into giving them what they want

[@varuhash50]

My eyes have never hurt so much, but its crazy to think its at all possible to fuck with the AI and force it to not only create the Nether but potentially the End with the right conditions

[@RightBoyKA-POW]

2:10 You would have to really understand how AI sees the world to achieve this.

[@cancerousnut7767]

Do you though? It’s just that it goes off of fed data. A lot of the times it was fed lava was likely pictures in the nether. It just assumes what should be there based off of the conditions of whatever it was trained on.

[@sayorancode]

@@cancerousnut7767 turns into orange

[@MBSfilms77]

I'm convinced the guy talking in the background is just schizophrenia

[@Chicenk]

"ah we got some magma, we can use this we can use this-" *magma dematerializes* "AH D:"

[@sexygirlmax2019]

trying to grab a glass of water off your nightstand half awake with a fever but then you realize your mom took the cup away and you're actually grasping at air

[@epicshinji9258]

Holy fucking shit, I ain’t ever seen anything like this. AI generated videos felt weird themselves, now we can play an real-time AI generating game? This is actually fascinating.

[@Shadow-sword]

This perfect encapsulated the feeling of trying to cling to the memories of a dream as I wake slowly and try and finish the dream

[@APEXYOTA]

this is what chasing that drugged out sleep trip was like

[@arestheprime9178]

Normal Minecraft: you go to places to beat the game AI Minecraft: the places go to you to beat the game

[@grodygibsonlcd8038]

Trying to go to the nether and the end looks like they’re discovering how to warp reality for the first time 😂

[@james-rg5uk]

This is how i am when i am in the middle of a good dream and keep waking up

[@wlockuz4467]

This is like playing non-euclidian Minecraft while being on 10 different psychedelics.

[@TheSpiritedFendron]

Time traveller: *Moves a chair* The timeline:

[@JRBX-09]

The AI constantly guessing where the speedrunners are, while the Speedrunners themselves are trying to guess what the AI will interpret is absolutely funny

[@zyxeyswizzle]

This is actually absurd lmaooo

[@Damian-cilr2]

The ai seems to be trained on mostly overworld footage,hence why when you go to the nether it just turns into overworld so quickly,same with the end

[@muhammadriskysubhannorazha6815]

Nice, never thought of doing a Speedrun using AI generated image game? idk how you call it

[@ethanodell8044]

Accurate portrayal of me learning how to control my lucid dreams for the first time

[@Yazume]

this has to be one of my favorite demonstrations of AI right now. Tricking the AI into thinking you're in a certain biome/Dimension by looking at the right blocks is such an interesting skill

[@SquintXD]

this feels like a dreamscape i fw it heavily

[@eiko1]

I love how they say "dont let THEM take it away!" as if it were a conscious person plotting against them

[@cancerousnut7767]

It’s like a game with no internal memory. It’s just generating everything in real time and culling it once it’s no longer on screen

[@I_am_bacon._.]

The way you look into lava and wait until it becomes nether feels like a lucid dream

[@Camlling]

I’ve been periodically getting sicker throughout the day. I have a feeling my dreams tonight are going to mirror this…

[@gustavogodoy9626]

This is like trying to cling to a dream instead of waking up

[@pandaonios83]

It’s interesting because this AI has been trained on millions of videos, but only of mainly the first 5 minutes of Minecraft gameplay. So I doubt many had videos of getting to the nether or the end explaining the AI essentially panicking trying to bring him back to the overworld

[@dr.dr4cula785]

Amazing work man, I was waiting for someone to try this lmao

[@ribbonduckling1314]

This feels like a psychic prediticing your minecraft speedrun

[@binkaminOfficial]

lucid dream speedrun

[@Kaulusiin]

Best AI minecraft content so far. You were able to exercise some sort of control over this thing!

[@puzzlepuddles6712]

it's crazy that you're playing minecraft without any of the original code, nor a functional physics engine. it's just pictures

[@MarcusHelius]

This was like watching a recording of a dream about minecraft.

[@asoggyflipflop]

The magma blocks disappearing was insane

[@XxSanderMLGamerXx]

This is just the trippiest thing ever! The way things appear and dissapear out of nowhere, the way you end up in a completely different place when you look away, the way when you trying to enter a house, but instead enter a realm of wooden blocks is just MIND BREAKING!

[@Ankhikamun]

"i cant get to the end of this wood" its literally a dream

[@chaoshelm]

the ais lack of object permanence makes it so much better lol

[@bigotis9042]

I love the dude's friend in the background 😭

[@donovanmahan2901]

4:42 pale garden moment

[@stargazer2312]

I love how most of the process is purely based on colors and shapes.

[@MFAN64]

*looks at like 6 warp blocks* OH MY GOSH THIS IS NETHER THIS IS NETHER THIS IS NETHER

[@flouserschird]

Wow this is incredible tech. Imagine in the future you will be able to have unique game experiences based on your play style with artificial intelligence changing the game do your gameplay.

[@cowboiky]

This is like realizing your lucid in a dream and trying to make it go your way before waking up.

[@tabs8231]

I love the shorthand you've developed for the wacky behavior

[@HoodedSpidey]

*NOW YOU’RE PLAYING WITH AI.* I’m so glad another YTer is using the short context span to its advantage.

[@darkdwarf007]

like the other commenter pointed out, mentions of "them" trying to take "it" away from you are extremely funny

[@Joao-1114]

Isso é tão absurdo, ele tem um limite de tempo pra continuar jogando e é tudo carregado aleatoriamente em tempo real, lenda 👊🔥

[@botikfreetime8803]

playing this minecraft feel like when you recognize the dream, but trying to not wake up

[@Big_Sloppa]

Truly fresh and novel entertainment, what an era to be alive...

[@tarikeld11]

I love how they play Minecraft by colors and looks and it makes totaly sense the way it's generated

[@TeleviseGuy]

It is like telling a dementia patient to remember a specific memory they had (not that I have any experience with that).

[@swedneck]

gaslighting speedrun

[@troomatot402]

Of course you hadn't, you didn't remember it

[@Clyde_E]

Beating Minecraft With Dementia

[@Clyde_E]

Is it even Possible?

[@Gulgululubaligim]

Dementia craft

[@thenaptaker4124]

That honeycomb horizon to lava strat is so smart! I could never get past the lava honeycombing.

[@mikethemelon5690]

Minecraft AI it's like that one dream that got so good but you wake up too soon so you got to lock in back to sleep to imagine what would happened next

[@JoelNGs]

Me: Plays minecraft What my grandparents see:

[@Basit-AA]

Its so cool how this is very beginning of this Ai generated game tech stuff and people are still having lots of fun with it and making it work

[@irmaoitsover]

here as your 1k subscriber, i feel im gonna see more of you

[@MatchaTheVibeking]

This is like being able to consciously explore dreams with your friends

[@nevork7578]

That looks like when you’re trying to control a lucid dream

[@Mic.vencer]

This is seriously meta, I can’t wait for the AI to adapt to the fact that you are taking the limitations of the AI and using it as part of the game.

[@thenthtinkerer7635]

One of the sad things of how "AI" like this one works is that it doesn't really learn anymore after being deployed/published. It's like crystallized intelligence. The forms of AI that can continously learn are more expensive to run and may require dedicated brain-like circuit chips to be feasible. All of the above is just the vague impression I have gathered so far about "AI", I'm no expert.

[@fraraymond5631]

4:34: Polnareff vs Dio Brando moment

[@jordanjamison97]

it's like listening to a guy calling out commands to his nascar driver on how to race

[@silverflash2889]

I had a nightmare of the beginning part of being trapped in some wood area of just infinite overlapping roofs in angles like mc houses

[@nekithunt]

In this Minecraft it is impossible to die because death takes a moment, which is not enough to train AI, unlike constant damage.

[@adamdynasoft]

i love how you got diamond tools when you got the stronghold. it is 100% likely that most of the stronghold data used to train the plays had diamond tools.

[@spiffvr9425]

New title: Trying to beat mincraft but its a drug trip

[@Zozz-tw9vn]

Getting enchanted diamond tools in ai minecraft is actually insane

[@markpronin2862]

They finally beat Minecraft with dementia.

[@mcsquilliam3978]

Ever since this got popular I’ve been waiting to see someone just spin around and look up and down to keep generating new landscapes until something cool happens. That would be the first thing I would do in this game

[@icenovice]

0:38 BRO IT LITERALLY JUST EXPLODES AND VANISHES LOL