speedrunning AI minecraft.. (nether + end)

[@mugencc8496]

Holding onto the nether sounds like holding onto a dream when you know you're about to wake up.

[@prowers2623]

It's so sad, man. I remember the few rare times I knew I was dreaming, but I slowly felt myself waking up and started to feel myself shift on the bed instead of moving in the dream.

[@f.u.m.o.5669]

2hu

[@Aayuuush721]

Saw this listening to Wake Up by Travis “I DONT WANNA WAKE UP” 🗣️🔥🔥

[@ChaseThePinballWizard]

holy shit thats so accurate.

[@The_cgull]

HAKUREI REIMU??? 😰😰😰 Guys the CEO of racism is here

[@matt92hun]

After decades of progress we finally got an unplayable version of Minecraft.

[@DivineLight661]

bedrock is pretty unplayable

[@davebob4973]

​@@DivineLight661 your face is unplayable

[@callmenik5000]

​@@davebob4973my balls are

[@GAT957]

​@DivineLight661 ur feet is unplayable

[@rom8224]

So bedrock edition

[@wolowolo6179]

i love this shit lol, its like trying to control a lucid dream

[@Skuffd_Lad]

more like trying to control a verifiably non-lucid dream

[@famlrnamemssng]

More like trying to control a semi-lucid dream. Once it's lucid it's pretty easy, but when you're in that weird state where you aren't quite sure if you're dreaming and haven't stabilized it, then shit gets weird.

[@Regw2520]

Yeah fr​@@famlrnamemssng

[@muegaltomiganson]

It's more like trying to control someone else's dream

[@nicktvname3115]

Superliminal if it were a real dream

[@Niko-bx6mc]

I specifically appreciate how they're trying to be descriptive, but since it's like reality soup that generates based on the palette of the image, the best they can do is stuff like "We need this orange" "Lets try to see what we can do with the floor" "Hold onto this red" "They're trying to take away the nether from me"

[@ackleackenkaker8508]

I have not yet heard a better descriptor for this than “Reality soup”. 😂

[@YSPACElabs]

Reality soup as simulated by linear algebra soup

[@Subird]

3:01 *Task completed:* "Get into the Nether" *Current task:* "Stay in the Nether no matter what"

[@Algo_de_Alguem]

"95% of people cannot achieve that"

[@NotoriousICG]

i love the references to the ethereal "they", as if there are little men inside the computer making the image shift

[@lamelime1]

"they" want you to think that "they" aren't real

[@kiattim2100]

Bro fighting his own dementia 💀

[@mrbartinio]

The woke left is trying to take away our nether

[@Subird]

It's obviously the Machine Spirit

[@NicoleColenico]

@@Subird The machine spirit on this case being, ironically, non-binary

[@DumbOctopus99]

So, AI Minecraft speedrun revolves around finding colours/patterns that look like required resources/places, rather than actually finding these places/resources. It's so absurd yet so interesting.

[@adventofnull]

It hallucinates things not only into existence but out of it, so trying to experience the AI like an actual 'game' is an effort in futility.

[@LucasFerreira-fp4nj]

@@adventofnull what futility? This itself is already hella fun lmao

[@adventofnull]

@@LucasFerreira-fp4nj I meant playing it like Minecraft (mining, crafting, looting, farming) is useless because when you do a 360 flip everything is replaced. Like at the very least other AI generative stuff you could maybe see as a (worse, poorer quality) version of the 'real thing', but this is more 'the backrooms' than it is 'minecraft'

[@cortster12]

​@@adventofnullIt's also in its infancy, and is already amazing if you understand how it works. I'm baffled at how they managed to make it this coherent. It really should be even worse than this. Technology is getting crazy.

[@AV-ir9dh]

​@@adventofnull it needs to have enough nodes to render full 360° of the game and then it zooms in to produce the view

[@daknboot]

this is actually so cool, having to try to trick the game into generating what you want is so fun

[@kalahatze]

I feel like if the AI was a little less sloppy and had a slightly longer memory, it could actually be amazing. Of course, it won't be actual Minecraft and probably never can be, but the idea of having to find red blocks to convert to lava to get to the nether is really interesting. As it is, it's too random to actually be enjoyable for more than a one-off gimmick, though. If the AI could remember, like, a couple hundred frames in the past, then it might be cool. It'd still allow for converting your surrondings based on blocks; you'd just need to stare at the blocks for a bit longer. A couple hundred frames, or however long the AI memory is.

[@LaserTractor]

*gaslight the game into thinking😂

[@HoodedSpidey]

@@kalahatze One solution I’d propose is a scenario-detection model that changes the dataset depending on certain recognized images, I.E. nether portal/end portal blocks. From that moment forward, the AI model switches from its overworld training to strictly Nether/End gameplay, preventing an accidental return from looking at the wrong color. Granted, implementing segmented diffusion defeats the purpose of this being purely a tech demo. But if you wanted to turn this into a game, that would be the next step. Signed, armchair programmer.

[@kalahatze]

@HoodedSpidey You don't need segmented diffusion. This creates images frame by frame, at least as far as my understanding goes. Just switch to a different AI after a certain frame is complete. Use some kind of grounding dino model to recognize a nether portal, then for the next frame, you can change the AI or something. It actually seems fairly easy to do, although I'm not quite sure exactly how this works in detail. Edit: Actually, you don't even need a new dataset. Just use a LoRA.

[@HoodedSpidey]

@@kalahatze My main concern about just using a LoRA is that there may not be enough footage in the nether, and I worry about how it’ll affect the “rules” of Minecraft (it’s broken enough as is.) I do agree that we *probably* don’t need an entirely new dataset, however there should definitely be more footage to supplement things like portal ignition, traversing fortresses, gravitational acceleration, and mob behavior. Admittedly I didn’t even know about DINO models until now, It’s really cool to learn that most of the tech exists already & that it’d be simpler than I imagined. Thank you for being willing to talking to me despite my limited knowledge. I’ll be doing more research on all of this.

[@aaronconvery]

This is such an interesting concept, the game is trying to gaslight them and they are trying to gaslight the game back, it's like a boss fight against the entire world

[@xlretard]

Definitely not gaslighting lmao 🤣

[@jhsevs]

@@xlretardstop gaslighting

[@benjaminmurrayesq]

3:37 That carrot casually turning into a yellow bed

[@SchadenfreudeUY]

Metamorphosis

[@apenaseu7588]

@@SchadenfreudeUY I can do anything! Ueheheh!

[@Coriander1988]

Don't let them take it from you. You worked hard for that nether.

[@DoctorAlright]

*neither

[@Eltralor]

@@DoctorAlrightwhat

[@Payday5]

@@DoctorAlright what

[@Met1300]

@@DoctorAlrightwhat

[@freep3115]

They’re trying to take away our nether, we need to stop this

[@ЧистоеНебо-ш2ц]

Make the nether great again

[@condensationz7308]

We are now unburdened by what has been

[@willgoogletakethisname3963]

We need to build a wall and make the piglins pay for it

[@masterspark9880]

They're eating the ocelots

[@thestudentofficial5483]

This is like an SCP entry about containing a cognitohazard

[@WanderTheNomad]

The nether is an antimeme

[@Cosmixthegoober_]

Genuinely yeah this seems like an unimaginable dimension the scp foundation would contain or something

[@ashendude3394]

​@@WanderTheNomad there is no antimemetic division, there is no antimemetic division, there is a body in that water, there is no antimemetic division.

[@greylight5]

I tried playing this the other day and seriously all day I was going around feeling like everything was shifting around me and nothing was real. Real-life cognitohazard.

[@AlphaSeagull]

I love the whole 0:30 these are vines 0:33 nevermind they're magma blocks congrats 0:39 what blocks

[@Xathonn]

It looks like it interpreted the magma texture as the block break particles, so they just exploded.

[@tessabakker662]

2 Magma blocks: *Mr.* *Stark* *I* *don't* *feel* *so* *good.*

[@NikoKun]

Wild. Almost seems like they trained it on a lot of simpler short videos, and only a few contained nether, so while it knows what nether looks like, it wants to maintain the overworld look instead.

[@thebrownfrog]

Your intuition is actually 100% true

[@MangroveLord]

Nah it's definitely because most of Minecraft content and gameplay is in the overworld

[@FloodlightGamingReal]

I mean while most content is in the overworld that doesnt really change the fact that not enough nether footage means the ai cant simulate anything BUT the overworld too well

[@solalabell9674]

I’d guess that virtually all Minecraft content is overwold since most smps and guides are mostly there

[@TeleviseGuy]

It is like telling a dementia patient to remember a specific memory they had (not that I have any experience with that).

[@swedneck]

gaslighting speedrun

[@troomatot402]

Of course you hadn't, you didn't remember it

[@Clyde_E]

Beating Minecraft With Dementia

[@Clyde_E]

Is it even Possible?

[@Gulgululubaligim]

Dementia craft

[@BobTheEnderman]

0:33 geologists when an eruption occurs

[@CJSavageGaming]

Duh

[@SoewoeMoloko]

LMAOOOOO

[@l33per509]

Me and my imaginary friend trying to beat minecraft in a lucid dream

[@jacobp.2024]

You and your friend's commentary is absolutely immaculate. The way you call out things like it's some kind of official speedrunning terminology is too good. "It's reddening!" "Orangification." "THEY'RE TRYING TO TAKE IT AWAY" "They can't take this away from me" "It's starting to turn to dirt.." You should do something fun, like crazy BS modpack reviews or such, like those terrible Minecraft horror mods. Something fun just reviewing absurd Minecraft things

[@sexygirlmax2019]

for real, im in hysterics 😭 Orangification especially

[@utfigyii5987]

It most likely did not have enough training footage for the nether, so it did not understand the difference well enough and that's why it was trying to take the nether away

[@ciuek]

In this demo I suppose, they used footage with keys clicked at exact time as training data. They had to use nether footage, because this algorithm wouldn't be generating those images without it. It was most probably less frequent in dataset, therefore occured the effect of nether vanishing.

[@Flowery0]

Ok, that's the best use of ai: dream games. Like, make it a little less erratic, optimise it, remove the time limit and it's just gonna be so much fun

[@Wott786]

FRRRR

[@beex6]

omg such an amazing idea

[@GoroAkechi_Real]

screw AI art. embrace near unplayable non euclidian versions of well known videogames

[@sexygirlmax2019]

​@@GoroAkechi_Real Catacombs of Solaris my beloved

[@sexygirlmax2019]

​@@GoroAkechi_Real i misread your comment but still. also infinite pizza

[@Sean_Jaggers]

Minecraft manifestation speedrun

[@relic4948]

“lock in” *manifests harder*

[@Coriander1988]

5:45 there was a stronghold to the left

[@Circxles]

i was going to say that

[@nameless_guy434]

How speedruning minecraft on good zaza feels like :

[@sigmamale4147]

Your zaza got laced with dmt bro

[@DaviUndertale]

"Are you sure you want all of them? it's gonna make you very very high" "Yes, all of them." "See? this zaza ain't shi-"

[@moncef2733]

This feels EXACTLY like how you try to keep a dream from changing to something else, the most tripping thing about minecraft ai is that it's the closest thing we have to actual dreams

[@sexygirlmax2019]

Comparing it to reconstructed dreams it's pretty accurate. Our brain does the exact same thing just like data moshing....You think of a lamp post for a few seconds but now you move and you're next to a wall, not a lamp post. also PilotRedSun's "Not so fast" is so incredibly dreamlike it's scary. I don't know how he created them so accurately

[@nathanstafford8412]

This video feels revolutionary in terms of what's possible with this "game"

[@Pigeon_of_Doom]

This AI really is amazing. You've really shown how to manipulate it to get to different areas of the game. Amazing video

[@BabyLeonards]

getting enchanted diamond tools is crazy

[@hephaestus2031]

I think having good items (enchanted tools, etc) triggers more endgame stuff, like the fortress and the end

[@noahboddy1484]

4:21 You guys almost made it to the end if you had just kept up with the obsidian pillars and the purple.

[@LuminousXDMC]

I love how the whole speed run is just tricking the AI into giving them what they want

[@jeslinmx22]

What did this player dream? This player dreamed of sunlight and trees. Of fire and water. It dreamed it created. And it dreamed it destroyed. It dreamed it hunted, and was hunted. It dreamed of shelter. - Minecraft end credits

[@Aayuuush721]

It dreamed of feeling like being on drugs while playing minecraft.

[@VladimirChibuckov]

Someone make a mod where you can play ai generated minecraft while you sleep

[@cheetah_zs]

"i think I'll be ok with this amount of acid, i won't lose control of my mind or anything" My mind 1 hour in:

[@epicshinji9258]

Holy fucking shit, I ain’t ever seen anything like this. AI generated videos felt weird themselves, now we can play an real-time AI generating game? This is actually fascinating.

[@MBSfilms77]

I'm convinced the guy talking in the background is just schizophrenia

[@RightBoyKA-POW]

2:10 You would have to really understand how AI sees the world to achieve this.

[@cancerousnut7767]

Do you though? It’s just that it goes off of fed data. A lot of the times it was fed lava was likely pictures in the nether. It just assumes what should be there based off of the conditions of whatever it was trained on.

[@sayorancode]

@@cancerousnut7767 turns into orange

[@varuhash50]

My eyes have never hurt so much, but its crazy to think its at all possible to fuck with the AI and force it to not only create the Nether but potentially the End with the right conditions

[@Chicenk]

"ah we got some magma, we can use this we can use this-" *magma dematerializes* "AH D:"

[@sexygirlmax2019]

trying to grab a glass of water off your nightstand half awake with a fever but then you realize your mom took the cup away and you're actually grasping at air

[@APEXYOTA]

this is what chasing that drugged out sleep trip was like

[@Shadow-sword]

This perfect encapsulated the feeling of trying to cling to the memories of a dream as I wake slowly and try and finish the dream

[@wlockuz4467]

This is like playing non-euclidian Minecraft while being on 10 different psychedelics.

[@binkaminOfficial]

lucid dream speedrun

[@Yazume]

this has to be one of my favorite demonstrations of AI right now. Tricking the AI into thinking you're in a certain biome/Dimension by looking at the right blocks is such an interesting skill

[@zyxey]

This is actually absurd lmaooo

[@eiko1]

I love how they say "dont let THEM take it away!" as if it were a conscious person plotting against them

[@J09-555]

The AI constantly guessing where the speedrunners are, while the Speedrunners themselves are trying to guess what the AI will interpret is absolutely funny

[@Damian-cilr2]

The ai seems to be trained on mostly overworld footage,hence why when you go to the nether it just turns into overworld so quickly,same with the end

[@james-rg5uk]

This is how i am when i am in the middle of a good dream and keep waking up

[@TheSpiritedFendron]

Time traveller: *Moves a chair* The timeline:

[@cancerousnut7767]

It’s like a game with no internal memory. It’s just generating everything in real time and culling it once it’s no longer on screen

[@ethanodell8044]

Accurate portrayal of me learning how to control my lucid dreams for the first time

[@puzzlepuddles6712]

it's crazy that you're playing minecraft without any of the original code, nor a functional physics engine. it's just pictures

[@I_am_bacon._.]

The way you look into lava and wait until it becomes nether feels like a lucid dream

[@pandaonios83]

It’s interesting because this AI has been trained on millions of videos, but only of mainly the first 5 minutes of Minecraft gameplay. So I doubt many had videos of getting to the nether or the end explaining the AI essentially panicking trying to bring him back to the overworld

[@Camlling]

I’ve been periodically getting sicker throughout the day. I have a feeling my dreams tonight are going to mirror this…

[@fraraymond5631]

4:34: Polnareff vs Dio Brando moment

[@Kaulusiin]

Best AI minecraft content so far. You were able to exercise some sort of control over this thing!

[@ribbonduckling1314]

This feels like a psychic prediticing your minecraft speedrun

[@SquintXD]

this feels like a dreamscape i fw it heavily

[@sanderhackerhd8369]

This is just the trippiest thing ever! The way things appear and dissapear out of nowhere, the way you end up in a completely different place when you look away, the way when you trying to enter a house, but instead enter a realm of wooden blocks is just MIND BREAKING!

[@gustavogodoy9626]

This is like trying to cling to a dream instead of waking up

[@MarcusHelius]

This was like watching a recording of a dream about minecraft.

[@muhammadriskysubhannorazha6815]

Nice, never thought of doing a Speedrun using AI generated image game? idk how you call it

[@dr.dr4cula785]

Amazing work man, I was waiting for someone to try this lmao

[@donovanmahan2901]

4:42 pale garden moment

[@Mic.vencer]

This is seriously meta, I can’t wait for the AI to adapt to the fact that you are taking the limitations of the AI and using it as part of the game.

[@thenthtinkerer7635]

One of the sad things of how "AI" like this one works is that it doesn't really learn anymore after being deployed/published. It's like crystallized intelligence. The forms of AI that can continously learn are more expensive to run and may require dedicated brain-like circuit chips to be feasible. All of the above is just the vague impression I have gathered so far about "AI", I'm no expert.

[@flouserschird]

Wow this is incredible tech. Imagine in the future you will be able to have unique game experiences based on your play style with artificial intelligence changing the game do your gameplay.

[@bigotis9042]

I love the dude's friend in the background 😭

[@Joao-1114]

Isso é tão absurdo, ele tem um limite de tempo pra continuar jogando e é tudo carregado aleatoriamente em tempo real, lenda 👊🔥

[@HoodedSpidey]

*NOW YOU’RE PLAYING WITH AI.* I’m so glad another YTer is using the short context span to its advantage.

[@stargazer2312]

I love how most of the process is purely based on colors and shapes.

[@tabs8231]

I love the shorthand you've developed for the wacky behavior

[@cowboiky]

This is like realizing your lucid in a dream and trying to make it go your way before waking up.

[@chaoshelm]

the ais lack of object permanence makes it so much better lol

[@Ankhikamun]

"i cant get to the end of this wood" its literally a dream

[@Basit-AA]

Its so cool how this is very beginning of this Ai generated game tech stuff and people are still having lots of fun with it and making it work

[@thenaptaker4124]

That honeycomb horizon to lava strat is so smart! I could never get past the lava honeycombing.

[@MFAN64]

*looks at like 6 warp blocks* OH MY GOSH THIS IS NETHER THIS IS NETHER THIS IS NETHER

[@Big_Sloppa]

Truly fresh and novel entertainment, what an era to be alive...

[@MatchaTheVibeking]

This is like being able to consciously explore dreams with your friends

[@重巡キヌ]

0:39 「あー！終わっちゃった！」

[@sanctokalibero]

here as your 1k subscriber, i feel im gonna see more of you

[@botikfreetime8803]

playing this minecraft feel like when you recognize the dream, but trying to not wake up

[@samhdxl]

finally the first AI mincraft run

[@james_harper1]

I literally searched for AI Minecraft speedrun 2 days ago and now I see ur video on my fyp.. Crazy

[@adamdynasoft]

i love how you got diamond tools when you got the stronghold. it is 100% likely that most of the stronghold data used to train the plays had diamond tools.

[@silverflash2889]

I had a nightmare of the beginning part of being trapped in some wood area of just infinite overlapping roofs in angles like mc houses

[@tarikeld11]

I love how they play Minecraft by colors and looks and it makes totaly sense the way it's generated

[@samuelsalvatore4511]

ai is supposed to be studying us, now it's the other way around lmao also those magma blocks getting thanos-snapped out of your screen is just too funny

[@aidancostell4395]

AI minecraft is like playing in a world being held together by the universe’s most schizophrenic alchemist

[@mcsquilliam3978]

Ever since this got popular I’ve been waiting to see someone just spin around and look up and down to keep generating new landscapes until something cool happens. That would be the first thing I would do in this game

[@asoggyflipflop]

The magma blocks disappearing was insane

[@mazda9624]

If you showed this to me in 2011 I think I would actually have an aneurism and die

[@markpronin2862]

They finally beat Minecraft with dementia.

[@spiffvr9425]

New title: Trying to beat mincraft but its a drug trip

[@PERTEKofficial]

This feels kinda like when you’re in a lucid dream and you’re trying to shift the dreamscape into something else lol

[@four-en-tee]

Finally, LSD Dream Emulator 2

[@Lovesick.Sagebrush]

BAHAHA

[@hackzlenny2580]

bro is manifesting the speedrun

[@nekithunt]

In this Minecraft it is impossible to die because death takes a moment, which is not enough to train AI, unlike constant damage.