I beat the new AI Minecraft game (kind of)

[@KohlPowered]

If you enjoyed the video, make sure to leave a like and subscribe! Twitch stream: www.twitch.tv/kohlpowered Twitter: twitter.com/KohlPowered Discord: discord.gg/Ka24SXXxeY

[@H3n7yx76]

Epic video dude, nice work!

[@Jelly_shy_guy_man]

Hey coal powder

[@profellow8753]

😊

[@Alfred-Neuman]

BTW you are wrong when saying this AI is trained on videos of people playing Minecraft... It was NOT trained on these video, it was trained using bots moving randomly inside what is basically a sandbox world, it knows a few animals like the sheep but it has never seen a creeper or zombie etc...

[@baconlettucepotato69]

Kohl: _moves his head 15 degrees_ AI: I sentence you to *desert*

[@drakovangorder8160]

OH NOOOOO!!!

[@handlebar4520]

tasty

[@Gabe-Utseck]

Anakin’s worst nightmare

[@Snowy_Nevin]

The Pharaoh's curse

[@aprillong1258]

​​@@handlebar4520what the *F u c k* are you doing here

[@oliver_editzz61]

Ai: *sees a single yellow pixel* Also Ai: D E S E R T

[@ashriqe]

it's probably seen more sand than any other yellow-ish block, so it assumes it's sand.

[@MozIx256]

999 likes? Lemme do 1k

[@jdg3913]

@@MozIx256 sybau

[@eastterminal2246]

Ai trained on millions of hours of first 5 minutes after spawn

[@wedmunds]

I mean how long does the average player spend in the end vs the overworld

[@joaquinlaroca2886]

AI was trained on millions of hours of desert gameplay

[@endarkenedgd]

millions of hours of honeycomb blocks

[@VincentVanJoYT]

getting to the nether in this is like trying to remember a dream thats slowly fading

[@Yeen_Ko]

YESSSSSSSSSSSSSSSSS

[@NotTheDotDot]

dementia...

[@ryantalley5284]

I want you to just stop saying odd shit, alright? Like you can smell a psycho's fear or you're in someone's fading memory of the Nether.

[@Yeen_Ko]

@@ryantalley5284 ?

[@ultimaxkom8728]

It's just a burning memory.

[@Taurmega]

Banished to the desert for his insolence.

[@TheSleepyDog]

3:46

[@chebryan]

It’s never “just endstone”

[@dedmed8139]

CURSE OF RA

[@DoomSpiderXII]

The whole video summed up in one comment

[@sussdood]

1000th like yay

[@daddyshrek2295]

3:32 i'm shocked it actually did the screen effect

[@Willio20000]

Same

[@Numbabu]

I think it’s just the purple tint. The only time it has ever seen that effect is when you have the purple tint

[@lionare1]

@@Numbabunausea?

[@etetgg1364]

It's traveling through a portal. That's what it is. ​@Numbabu

[@there-is-weeping-in-the-at1746]

@@etetgg1364 They mean that the AI knew to do the screen effect because the entire screen had a purple tint. When the AI sees purple tint, it correlates that with the portal effect and generates that

[@dantheman4067]

Minecraft: Tripping Balls Edition

[@ElectricoGamez]

... Huh?

[@warmekip]

@@ElectricoGamezwhat don’t you understand

[@andreacorrea5921]

Tripping cubes

[@ElectricoGamez]

@@warmekip that being, how is this (seemingly) unrelated joke relevant of any humor to the topic of this video? Is this joke supposed to add anything to what I'm being shown? I really don't think so.

[@bean-eater28]

Minecraft: These Edibles ain’t sh- edition

[@CoverEats]

What if they replaced the nausea effect with this

[@mojoe04]

or this just happens when you eat suspicious stee

[@austinwhiteted8231]

Nah its more on the line of straight drugs 😂

[@HungryWarden]

It would make it by far the most destructive effect in the game, but I don’t think it would really work in multiplayer.

[@russman3787]

ok satan

[@syoexpedius7424]

​@@HungryWarden It could work if the actual game world and player character remains normal, but what is shown to the player is this. Like an actual hallucination.

[@everythingye]

training footage consisted of : 80% desert 10% plains 5% water 5% all other stuff

[@wedmunds]

Don't forget honeycomb floors for some reason

[@everythingye]

@wedmunds fr

[@sandiaconmelon3266]

​@@wedmunds and the yellow world

[@WeWorkToEarnTheRightToWork]

220% D E S E R T 0.0000001% I think this is the end

[@schniemand]

@@wedmunds Just wanted to point out honeycomb too lol It's like "rooms made entirely out of honeycomb" was a super important training category

[@jeremsh]

its like youre dying of dehydration and everything you see is a mirage and then you snap out of it only to find youre still stranded in the desert

[@unlomtrash]

Underrated

[@HydraKittten]

"And It's a desert..." summarizes the whole video

[@user-fe7bo5mm1o]

or a mountain

[@GoofySlugpup]

Desert

[@livebungusreaction]

The dude wouldn’t stop yanking his head around he kept instantly breaking it it was so painful to watch

[@snakesnail6664]

Its clearly just trained on the overworld surface. I tried giving it some screenshots of the deep dark and wardens, and it kept turning them into grass and sand.

[@snakesnail6664]

And, since several screenshots were from my survival world, I was able to determine it has no idea what netherite tools are. They all turned into iron.

[@fatyoshi1456]

But then how does it know how to generate boss healthbars? It can also generate the ui for status effects in the inventory menu sometimes which would be rare if it was just trained on the overworld

[@elbonnieto8929]

​@@fatyoshi1456the ai devs cheated

[@snakesnail6664]

@@fatyoshi1456 exaggeration on my behalf. A vast majority wouldve just been overworld footage, with a bit being scenarios like this. If there was more end footage you'd bump into bossbars more often.

[@SkisnwOnTop]

@@snakesnail6664i would imagine they just trained it on the fundamentals of the game like the overworld being the biggest focus and then had every minor/specific detail left out for simplicity

[@CatBatss]

"Wait, it's another desert?" 🌍👨‍🚀 "Always has been." 🔫👨‍🚀

[@tjthr]

Dead ahh meme

[@ghost_ship_supreme]

Something tells me the AI has almost never seen either the nether or the end. It always just teleports you to the overworld. Any image you use seems to slowly corrupt

[@KohlPowered]

I think it has seen the ender dragon die. If you look at the first time I get a close Ender dragon spawn its health bar actually goes down, also I think the purple particles are supposed to be the animation when it dies. Probably hasn’t seen it enough but it looks like it’s close

[@ap4lofficial]

once this is fully done its gonna be great​@@KohlPowered

[@fiblz5443]

I’ve seen people go into a warped forest biome

[@Daybroken]

It has seen the nether and the end, it just hasn't seen enough of it to justify making anything that isn't the overworld. I've been in the nether a few times now, and it does know how to generate it, the end however is practically impossible to do anything in.

[@tammid8423]

​@@fiblz5443After manipulating some red hues I got to a crimson forest too

[@PunmasterSTP]

The more I watch this AI Minecraft footage, the more uncanniness I feel. Trying to manipulate objects and images like this reminds me so much of trying to influence my dreams whenever I realize I'm actually dreaming. Watching this is just insane!

[@onlyone8331]

Makes me feel uncomfortable and scared but I just need to see what happens

[@PunmasterSTP]

@@onlyone8331 I feel the same way to an extent. The entire experience doesn't necessarily make me uncomfortable and scared, but parts of it do, but then I also can't look away.

[@MRKMS6]

​@@onlyone8331 bro same.its very disgusting 🤢

[@tuko8559]

the same anxiety when dreams begin to break

[@PunmasterSTP]

@@tuko8559 I feel it’s kind of ironic that such a new creation (AIs and transformers) can unlock fears that appear to be so primal.

[@yadude_log]

I think a lot of people seem to think that it knows what Minecraft is and uses logic. All its doing is taking the color patterns from the starting image and making new colors in a similar pattern to the gameplay its trained off of. Basically a monkey slathering paint on a canvas until it gets something that resembles Minecraft.

[@Neko-kun-0w0ラーメン]

Basically it's like child that try make math homework. Understand nothing, but try guess an adaptate

[@emmaselmeci966]

Thanks. I really hate how all the youtubers repeat the same words without understanding anything about what's really happening. "It has none of the original Minecraft code"

[@The_jmaster2]

"Im in an end cave" Ai: "not anymore"

[@johnmarkretante3397]

A n d i t ' s a d e s e r t

[@bliztheoplord]

Imagine this shit in VR 💀

[@doctorlucasp9113]

My natural intelligence model isnt fast enough to run what this artificial intelligence modem has to offer my photoreceptive organs

[@flynnmaxwell4089]

fucking hell 💀

[@davigemz]

This could legit kill you

[@stormy404]

schizophrenia simulator

[@NotAdachiPeople]

@@doctorlucasp9113My natural intelligence model will likely immediately crash with this kind of input, or worse.

[@GreenLobsterMonster]

The biggest problem with trying to accomplish anything is that it seems to have no memory. So like when trying to jump in a portal, it first has to recognize the portal, then it has to remember that it’s a portal when you jump in and can no longer see the entire portal

[@sunbleachedangel]

No, it literally has no memory. Every frame is generated solely based on the previous frame and nothing else

[@stellathefoxgirl3648]

I’m not sure why they think that this is how they should go about generating games… they will never get the effect desired via just generating each frame on the last with 0 memory whatsoever

[@GreenLobsterMonster]

@ I think it’s a step forward here

[@asdfoifhvjbkaos]

@@stellathefoxgirl3648that's the whole point of it being ai, if you had memory you would just make an actual game instead

[@stellathefoxgirl3648]

@ ai doesn’t just have to be a image generator yk, honestly what we’re looking at isn’t even truly ai… and it having some kind of memory or not doesn’t exactly change what it is at it’s core, you could just give it a feature to save what it thinks the last x frames were and what would logically come after that. Besides isn’t it, already a game?? A game powered by an image generator, the terms aren’t mutually exclusive

[@Gamba16374]

1:07 for those who dont know the AI has a relativly short „contexttime“ the time where the AI can grab data from past renderd scenes/frames and make new stuff out of it would it be longer some stuff could stay as you look away for a bit but that needs more power and memory (im sorry if my bad english its not my first language)

[@qwertyuiop.lkjhgfdsa]

it literally just goes off the last frame, theres 0 object permenance

[@coatola]

it really was desert all along

[@KrazyRhino2410]

8:32 was that a sea of armor stands

[@shani_sth]

the desert is the new backrooms in this AI

[@annahtosahs]

i think the model might be suffering from some form of overfitting. it generate the surface of overworld pretty well (because footage of it is very common), but it starts to struggle once asked to generate things that arent in that category probably for several reasons, because its overfit to generate the overworld, there is simply not enough data for for the model used, the model is bad, the model is too small (the showcase that's advertised seems to be generated with more time/ larger model/more resources).. also does anyone who played this for 15min feel like internet content is being generated on the fly when scrolling or is it just me ?

[@nathan41206]

I think the items on your hotbar is gonna determine a lot of what generates. If it's empty or just some wood/bread it will assume you just spawned in the overworld but if you got diamond tools/golden carrots/fireworks then maybe it would start loading more late game things.

[@Deltriz]

​@@nathan41206 I will try it

[@pannenkoeketjereborn174]

you're the second person i've seen mention the content generation thing, the other person was tripping and making another commenter question their existence by telling them their comment got generated in an ai game

[@DanielSeacrest]

Make the model a thousand times bigger, train it on one or 2 orders of magnitude more data and it should honestly be extremely playable (well, it'd be pretty much impossible to get enough compute to have a 500b param model generate so many frames so quickly for so many people for now, but it should be far more playable than the current state of the game atleast lol).

[@Lar_me]

Now that they released the model locally, it would be cool if we could see community finetunes of the model being made and uploaded on CivitAI. Imagine if it could even be finetuned to generate other games!

[@Sithandra_Likes_To_Art]

I watched the last AI Minecraft video, and couldn’t sleep that night because all my dreams were trippy AI Minecraft and my brain was so confused I kept waking up. Ready to take that risk once more with this video

[@R2Bl3nd]

I've been having weird dreams too after seeing videos of and playing this! It's like it made my brain question whether reality has any meaning or permanency.

[@hellfire5195]

hmm, today I had a dream or nightmare that some evil mind captured me in my dreams, I couldn’t escape from different locations, was trying to communicate with local people that I had seen in my dreams, by the way locations could change just like in AI Minecraft videos. I assume partly these dreams were created because of these AI Minecraft videos. What a fun experience

[@DrawerGamer]

It's actually not fun experience it's kind of disturbing tho

[@hellfire5195]

@@DrawerGamer nah at least some action instead of basic dreams

[@Neko-kun-0w0ラーメン]

The fact that all my dreams like that 💀

[@tbpbTB2010]

I'd like to think that the sheer amount of hours of collective players being in plains/deserts/mountains/forests as opposed to the end/nether leads the AI to be weighted heavily towards those circumstances. Same with creepers, while yeah they're pretty iconic you usually aren't looking at one for very long compared to all the other things it could be.

[@ashriqe]

it's probably that it's seen more sand/deserts than end stone and the end dimension- so it thinks that it's suppose to be a desert. and you're also probably right, creepers are iconic- but usually only on screen for like 10 seconds.

[@ItsB3enLikeThis]

AI Minecraft is going to be the next KZbin trend like how Minecraft Hardcore was

[@startea0412]

It already is

[@reverendnon5959]

No, it will die out, because it is interesting only for a few minutes in a current state

[@agusnicoletti3051]

Pff, what makes you think this is gonna surpass the original Minecraft?

[@Binglesquirk]

I survive 10 mojillion days in ai minceraft

[@SkibsDaThird]

​@@agusnicoletti3051 Its called... trying new things..

[@cheesychesnut6416]

[shows picture of creeper] ai: hmm yes, desert

[@reverendnon5959]

AI seems to really like deserts

[@Karmacat]

Kohl:Tries to make the ai spawn him in the end Ai: all I see is Sand so it will be a desert

[@dranorter]

The problem (well, one problem) is that it's trained on actual gameplay, so certain things are very rare. How often do people jump into the End portal in a video, compared to breaking a block or swinging a sword? And we already know how iffy block-breaking and sword-swinging are in this. Also, jumping into an End portal is a hard cut, without a transition animation I'm thinking the AI may believe the video was just edited. They could do more specific training to get the AI to grasp stuff like end portals. But at some point they're just working ridiculously hard to clone Minecraft... which would just get them sued by Microsoft. A working Minecraft clone isn't really their goal.

[@spacesharkarzul6069]

Yayy someone who understands how this works. I got a bit frustrated when he expected it to place end eyes or things, acting like it’s a programmed game and not an ai interpreting and generating stuff based on the things it watched.

[@dranorter]

@@spacesharkarzul6069 It's funny you say that, this guy seems way above average in his understanding. I watched another random youtuber and they gave it a quick review after playing as if it were designed, stuff like "I don't see why they included inventory as a feature". Whereas this Kohl person learned to summon sheep and refers to it "interpreting things" as blocks.

[@hostomelhorsehoarder]

The ai cannot believe anything. It's moving slop around based on image soup. It doesn't even have object permanence.

[@99Starlord99]

This feels like a simulator where you choose what kind of fever dreams you want to relive

[@im_a_tide_pod]

Looking at the AI Minecraft thing for more than two minutes makes me violently uncomfortable

[@HungryWarden]

Seems like a good horror concept.

[@lilbr0b3aryt]

i swear he needs to do this again. seeing him get disappointed over deserts is WAY too funny

[@UnRandomDeChile]

We need someone to use that herobrine screenshot.

[@KaiwunShowtime]

Would probably turn his shirt into an ocean after we walk towards him

[@JustMark228]

@@KaiwunShowtimeor turn him into a plant 💀💀💀💀

[@gl1tchcat]

2:04 🗣🔥💯 ONE PIECE 🗣🔥💯

[@tizi5594]

So high

[@TheFamilyAndGamingChannel]

w profile pic

[@pancakeinabin]

Transitions with the AI are kind clean tho. 🔥🔥🔥

[@drowhodis556]

bro this is trippy as hell lmao love the vids/streams

[@KohlPowered]

thanks I appreciate it!

[@charl2182]

my guess is not that it hasn't seen the end, or the nether, or the dragon, it's just that it's seen the overworld grass, plains, desert, stone and snow so much more. Like 90% of its dataset is probably just the overworld with nothing. If it generates the end, it probably thinks its wrong and tries to correct it to something more normal.

[@Monkey832]

This is what Minecraft is like when you play it in a dream

[@HungryWarden]

Or while you have dementia. Or while you have dementia.

[@flocon9388]

I already dreaming of Minecraft and this was most stable than this

[@J3ditz-y3v]

@@HungryWarden😭🙏

[@ifdesy]

13:00 MF DOOM!?

[@Magmathedragon]

13:21 i sent that photo of herobrine in discord 😎

[@BumBumTheBarbarian]

this is what Herobrine sees

[@alwaysthesame98]

Hebrews: Have we finally found the promised land? AI: Nope, just more desert.

[@Moonlight_Sashimio]

"When in doubt, just desert" 7:40

[@aiedenoldstien9751]

"Think what gaming could be" The Ai: *Deletes game*

[@R4ndomUser567]

Trying not to look away from something you want to keep is like trying not to lose control of a lucid dream

[@gamerclips3606]

Funny how it was like “no I think your here instead”

[@3173_Delta]

7:50 He shriveled 😭

[@daddyshrek2295]

xd

[@domanacs7513]

-Wait it's all dessert? -Always has been...

[@diabIok]

this is what getting home feel like when you’re drunk except everything slowly becomes a desert

[@modernmage]

They clearly only trained it on videos of flying around the overworld. They need to train it on more data...

[@ZaneGomes-w7c]

The ai has the smoothest transitions

[@tejasbr5455]

9:16 bro in the backrooms

[@MBSfilms77]

6:35 MC chat says "Scoob Wartgrop" wtf

[@ObviousGuy_]

"no, it's a desert" has to be my favourite quote from the video

[@rhythmiclovechild785]

This is what it’s like to play Minecraft in a dream

[@christophergomez4014]

: “It’s all a desert?” : “Always has been.”

[@ٴٴٴٴٴٴٴٴٴٴٴٴٴٴ0]

the ai loves warped wood

[@ThatOnlineDumbass]

Bro got the Paraoh's curse.

[@ThatOnlineDumbass]

i just noticed there is a comment like that so its technically not stolen cause i didnt kno-

[@CallMeKenny1121]

I love seeing these kind of videos!

[@MDG-mykys]

I'm pretty sure it has been trained only on overworld peaceful world footage.

[@KohlPowered]

It definitely knows what the nether and end are but yeah probably trained off like 95% overworld since it always wants to turn back to that. You're probably right about the peaceful part, hopefully they train it with hostile mobs in the future

[@Fazehamster69]

minecraft with dementia minecraft with dementia minecraft with dementia minecraft with dementia

[@africanveteran7728]

that first portal took blud to the twilight forest dimension 💀

[@RoyalO2TB]

Minecraft: Schizophrenic N’ Dementia Edition

[@Nebesus]

I think the sun and the clouds is what turns it into the desert, it being white and yellow.

[@teel3651]

@KohlPowered The Reason why hostile mobs don't work, is because the training data only includes footage from peaceful mode

[@LazorVideosDestruction]

Can't be true because sometimes it will show your hunger bar depleted

[@EDoyl]

The boat working was great, you were ZOOMING

[@martinbaxa330]

When in doubt... "teleporting to desert"

[@chaotickreg7024]

To be fair, we don't spend a lot of time looking directly at this stuff. I like how you tried to tower and it couldn't figure out if looking down meant placing blocks or removing blocks.

[@StellarBrian]

I imagine the farlands on this ai version of minecraft lol

[@dmwanderer9454]

It would be interesting to try and find a seed associated with each generation. Like when you first load into Minecraft AI, take a screenshot of where you start and see if any seeds exist that resemble it Should technically be possible, as Minecraft AI uses compiled images of real gameplay

[@Wulfjager]

they really need to curate it to have less spanses of generic minecraft worlds. its annoying when youre trying to do something cool but it just thinks youre in a plains instead. it needs to be trained with more nether, more caves, and more end

[@stargazer2312]

And way less deserts it seems

[@Matyas_Ceo_Of_Matyas]

Minecraft: drunk edition

[@thatGUYbehindthemask]

It would be cooler if this ai could see a picture of a minecraft world, and find the exact seed needed to gendrate the sam world, using ai.

[@zhabiboss]

The boat: “Mr Stark i don’t feel so good…” *turns into an entire desert*

[@thevictorydoge]

this thing kinda seems like it was trained on a single minecraft video where they were in a desert for most of it and never got to the nether or end or saw any hostile mobs

[@sunbleachedangel]

It was definitely not generated on ONE video. One petabyte maybe

[@BRUH-lx3jv]

They should train on more nether and end stuff, because right now, the ai just assumes everything happens in the overworld. And I also realized that the ai does not go underground, so they also need to train the ai on underground images as well.

[@fortheloveofnoise]

My AI Minecraft is much more unhinged than what I am seeing on YT. I cant even get close to a chicken without it turning into a flower.

[@colincayden2068]

Minecraft but it's a fever dream

[@sethbryant7894]

*Literally anything happens* AI: Interesting... interesting.... DESERT

[@vitormendonca2905]

dude the desert gag KILLED ME all along the video

[@VirtueSAR]

Glad you continued this, Kohl! The AI's evolved but still looks like a dream under anesthesia. Good work as always!

[@LukesterGD]

3:33 I’m kinda impressed that it knew to do the warp effect when it saw purple

[@RealityBoat]

the ai knowing to put you in the nether is so cool

[@xoe1913]

I was in this stream and fell asleep during it. I was so confused when I woke up and saw this monstrosity

[@KoffeeB]

Minecraft on 7 boxes of Benadryl

[@Shadeow651]

I love how creepers open up dimensional rifts

[@Vartazian360]

Annnnnnd its a DESERT

[@pyxesghost1426]

Man going down and an infinity limbo is so scary and gives me agony lol, total hallucination

[@stellarfax]

Oh, so this is what it feels like playing Minecraft while high

[@Brice-OnYT]

please do more of these, they're so cool

[@ITHrealXD]

technoblade + penguinz0 = kohlpowered

[@Apollo_Yeet]

Minecraft: Drug addiction

[@7SetTin]

wait, its all desert? always has been.

[@Tictac03-q4f]

minecraft dessert update

[@Popcornfr]

“Am I above the clouds?” No you’re in a desert

[@exhaustedeloise]

it’s like watching someone try to control a dream

[@Bacon6066]

7:30 bro used a domain expansion