I beat the new AI Minecraft game (kind of)
Вставка
- Опубліковано 6 лют 2025
- FIRST VIDEO: • the new AI Minecraft g...
Check Out My Stream! / kohlpowered
I beat the new AI Minecraft game
oasis AI: www.decart.ai/...
BECOME A CHANNEL MEMBER: / @kohlpowered
SECOND CHANNEL: / @kohl23
JOIN MY DISCORD / discord
MY TWITTER / kohlpowered
This is Minecraft AI the new game from Oasis AI that lets you fully play Minecraft through AI. It does not use code from the original game at all, but learned from watching Minecraft videos and now allows you to play in AI. Watch As I try to make it to the nether and the end to beat the Ender Dragon in Minecraft AI! I also go underwater in AI Minecraft and make it to the end and I kill the enderdragon and beat the game.
#minecraft #ai #minecraftai
If you enjoyed the video, make sure to leave a like and subscribe!
Twitch stream: www.twitch.tv/kohlpowered
Twitter: twitter.com/KohlPowered
Discord: discord.gg/Ka24SXXxeY
Epic video dude, nice work!
Hey coal powder
😊
BTW you are wrong when saying this AI is trained on videos of people playing Minecraft...
It was NOT trained on these video, it was trained using bots moving randomly inside what is basically a sandbox world, it knows a few animals like the sheep but it has never seen a creeper or zombie etc...
Kohl: _moves his head 15 degrees_
AI: I sentence you to *desert*
OH NOOOOO!!!
tasty
Anakin’s worst nightmare
The Pharaoh's curse
@@handlebar4520what the *F u c k* are you doing here
Ai: *sees a single yellow pixel*
Also Ai: D E S E R T
it's probably seen more sand than any other yellow-ish block, so it assumes it's sand.
999 likes? Lemme do 1k
@@MozIx256 sybau
Ai trained on millions of hours of first 5 minutes after spawn
I mean how long does the average player spend in the end vs the overworld
AI was trained on millions of hours of desert gameplay
millions of hours of honeycomb blocks
Banished to the desert for his insolence.
3:46
It’s never “just endstone”
CURSE OF RA
The whole video summed up in one comment
1000th like yay
getting to the nether in this is like trying to remember a dream thats slowly fading
YESSSSSSSSSSSSSSSSS
dementia...
I want you to just stop saying odd shit, alright? Like you can smell a psycho's fear or you're in someone's fading memory of the Nether.
@@ryantalley5284 ?
It's just a burning memory.
training footage consisted of :
80% desert
10% plains
5% water
5% all other stuff
Don't forget honeycomb floors for some reason
@wedmunds fr
@@wedmunds and the yellow world
220% D E S E R T
0.0000001% I think this is the end
@@wedmunds Just wanted to point out honeycomb too lol
It's like "rooms made entirely out of honeycomb" was a super important training category
Minecraft: Tripping Balls Edition
...
Huh?
@@ElectricoGamezwhat don’t you understand
Tripping cubes
@@warmekip that being, how is this (seemingly) unrelated joke relevant of any humor to the topic of this video? Is this joke supposed to add anything to what I'm being shown? I really don't think so.
Minecraft: These Edibles ain’t sh- edition
3:32 i'm shocked it actually did the screen effect
Same
I think it’s just the purple tint. The only time it has ever seen that effect is when you have the purple tint
@@Numbabunausea?
It's traveling through a portal. That's what it is. @Numbabu
@@etetgg1364 They mean that the AI knew to do the screen effect because the entire screen had a purple tint. When the AI sees purple tint, it correlates that with the portal effect and generates that
What if they replaced the nausea effect with this
or this just happens when you eat suspicious stee
Nah its more on the line of straight drugs 😂
It would make it by far the most destructive effect in the game, but I don’t think it would really work in multiplayer.
ok satan
@@HungryWarden It could work if the actual game world and player character remains normal, but what is shown to the player is this. Like an actual hallucination.
its like youre dying of dehydration and everything you see is a mirage and then you snap out of it only to find youre still stranded in the desert
Underrated
Its clearly just trained on the overworld surface. I tried giving it some screenshots of the deep dark and wardens, and it kept turning them into grass and sand.
And, since several screenshots were from my survival world, I was able to determine it has no idea what netherite tools are. They all turned into iron.
But then how does it know how to generate boss healthbars? It can also generate the ui for status effects in the inventory menu sometimes which would be rare if it was just trained on the overworld
@@fatyoshi1456the ai devs cheated
@@fatyoshi1456 exaggeration on my behalf. A vast majority wouldve just been overworld footage, with a bit being scenarios like this. If there was more end footage you'd bump into bossbars more often.
@@snakesnail6664i would imagine they just trained it on the fundamentals of the game like the overworld being the biggest focus and then had every minor/specific detail left out for simplicity
"And It's a desert..." summarizes the whole video
or a mountain
Desert
The dude wouldn’t stop yanking his head around he kept instantly breaking it it was so painful to watch
Something tells me the AI has almost never seen either the nether or the end. It always just teleports you to the overworld. Any image you use seems to slowly corrupt
I think it has seen the ender dragon die. If you look at the first time I get a close Ender dragon spawn its health bar actually goes down, also I think the purple particles are supposed to be the animation when it dies. Probably hasn’t seen it enough but it looks like it’s close
once this is fully done its gonna be great@@KohlPowered
I’ve seen people go into a warped forest biome
It has seen the nether and the end, it just hasn't seen enough of it to justify making anything that isn't the overworld. I've been in the nether a few times now, and it does know how to generate it, the end however is practically impossible to do anything in.
@@fiblz5443After manipulating some red hues I got to a crimson forest too
The more I watch this AI Minecraft footage, the more uncanniness I feel. Trying to manipulate objects and images like this reminds me so much of trying to influence my dreams whenever I realize I'm actually dreaming. Watching this is just insane!
Makes me feel uncomfortable and scared but I just need to see what happens
@@onlyone8331 I feel the same way to an extent. The entire experience doesn't necessarily make me uncomfortable and scared, but parts of it do, but then I also can't look away.
@@onlyone8331 bro same.its very disgusting 🤢
the same anxiety when dreams begin to break
@@tuko8559 I feel it’s kind of ironic that such a new creation (AIs and transformers) can unlock fears that appear to be so primal.
"Wait, it's another desert?"
🌍👨🚀
"Always has been."
🔫👨🚀
Dead ahh meme
"Im in an end cave"
Ai: "not anymore"
A n d i t ' s a d e s e r t
I think a lot of people seem to think that it knows what Minecraft is and uses logic. All its doing is taking the color patterns from the starting image and making new colors in a similar pattern to the gameplay its trained off of. Basically a monkey slathering paint on a canvas until it gets something that resembles Minecraft.
Basically it's like child that try make math homework. Understand nothing, but try guess an adaptate
Thanks. I really hate how all the youtubers repeat the same words without understanding anything about what's really happening. "It has none of the original Minecraft code"
1:07 for those who dont know the AI has a relativly short „contexttime“ the time where the AI can grab data from past renderd scenes/frames and make new stuff out of it would it be longer some stuff could stay as you look away for a bit but that needs more power and memory (im sorry if my bad english its not my first language)
it literally just goes off the last frame, theres 0 object permenance
Imagine this shit in VR 💀
My natural intelligence model isnt fast enough to run what this artificial intelligence modem has to offer my photoreceptive organs
fucking hell 💀
This could legit kill you
schizophrenia simulator
@@doctorlucasp9113My natural intelligence model will likely immediately crash with this kind of input, or worse.
The biggest problem with trying to accomplish anything is that it seems to have no memory. So like when trying to jump in a portal, it first has to recognize the portal, then it has to remember that it’s a portal when you jump in and can no longer see the entire portal
No, it literally has no memory. Every frame is generated solely based on the previous frame and nothing else
I’m not sure why they think that this is how they should go about generating games… they will never get the effect desired via just generating each frame on the last with 0 memory whatsoever
@ I think it’s a step forward here
@@stellathecatgirlthat's the whole point of it being ai, if you had memory you would just make an actual game instead
@ ai doesn’t just have to be a image generator yk, honestly what we’re looking at isn’t even truly ai… and it having some kind of memory or not doesn’t exactly change what it is at it’s core, you could just give it a feature to save what it thinks the last x frames were and what would logically come after that. Besides isn’t it, already a game?? A game powered by an image generator, the terms aren’t mutually exclusive
it really was desert all along
I watched the last AI Minecraft video, and couldn’t sleep that night because all my dreams were trippy AI Minecraft and my brain was so confused I kept waking up.
Ready to take that risk once more with this video
I've been having weird dreams too after seeing videos of and playing this! It's like it made my brain question whether reality has any meaning or permanency.
hmm, today I had a dream or nightmare that some evil mind captured me in my dreams, I couldn’t escape from different locations, was trying to communicate with local people that I had seen in my dreams, by the way locations could change just like in AI Minecraft videos. I assume partly these dreams were created because of these AI Minecraft videos. What a fun experience
It's actually not fun experience it's kind of disturbing tho
@@DrawerGamer nah at least some action instead of basic dreams
The fact that all my dreams like that 💀
i think the model might be suffering from some form of overfitting. it generate the surface of overworld pretty well (because footage of it is very common), but it starts to struggle once asked to generate things that arent in that category probably for several reasons, because its overfit to generate the overworld, there is simply not enough data for for the model used, the model is bad, the model is too small (the showcase that's advertised seems to be generated with more time/ larger model/more resources).. also does anyone who played this for 15min feel like internet content is being generated on the fly when scrolling or is it just me ?
I think the items on your hotbar is gonna determine a lot of what generates. If it's empty or just some wood/bread it will assume you just spawned in the overworld but if you got diamond tools/golden carrots/fireworks then maybe it would start loading more late game things.
@@nathan41206 I will try it
you're the second person i've seen mention the content generation thing, the other person was tripping and making another commenter question their existence by telling them their comment got generated in an ai game
Make the model a thousand times bigger, train it on one or 2 orders of magnitude more data and it should honestly be extremely playable (well, it'd be pretty much impossible to get enough compute to have a 500b param model generate so many frames so quickly for so many people for now, but it should be far more playable than the current state of the game atleast lol).
Now that they released the model locally, it would be cool if we could see community finetunes of the model being made and uploaded on CivitAI. Imagine if it could even be finetuned to generate other games!
I'd like to think that the sheer amount of hours of collective players being in plains/deserts/mountains/forests as opposed to the end/nether leads the AI to be weighted heavily towards those circumstances. Same with creepers, while yeah they're pretty iconic you usually aren't looking at one for very long compared to all the other things it could be.
it's probably that it's seen more sand/deserts than end stone and the end dimension- so it thinks that it's suppose to be a desert. and you're also probably right, creepers are iconic- but usually only on screen for like 10 seconds.
IIRC it's not trained on human players, they just had bots run through the game and do various actions a bunch of times.
@@ValeBridges Interesting!
the desert is the new backrooms in this AI
8:32 was that a sea of armor stands
This feels like a simulator where you choose what kind of fever dreams you want to relive
AI Minecraft is going to be the next UA-cam trend like how Minecraft Hardcore was
It already is
No, it will die out, because it is interesting only for a few minutes in a current state
Pff, what makes you think this is gonna surpass the original Minecraft?
I survive 10 mojillion days in ai minceraft
@@agusnicoletti3051 Its called... trying new things..
The problem (well, one problem) is that it's trained on actual gameplay, so certain things are very rare. How often do people jump into the End portal in a video, compared to breaking a block or swinging a sword? And we already know how iffy block-breaking and sword-swinging are in this.
Also, jumping into an End portal is a hard cut, without a transition animation I'm thinking the AI may believe the video was just edited.
They could do more specific training to get the AI to grasp stuff like end portals. But at some point they're just working ridiculously hard to clone Minecraft... which would just get them sued by Microsoft. A working Minecraft clone isn't really their goal.
Yayy someone who understands how this works.
I got a bit frustrated when he expected it to place end eyes or things, acting like it’s a programmed game and not an ai interpreting and generating stuff based on the things it watched.
@@spacesharkarzul6069 It's funny you say that, this guy seems way above average in his understanding. I watched another random youtuber and they gave it a quick review after playing as if it were designed, stuff like "I don't see why they included inventory as a feature". Whereas this Kohl person learned to summon sheep and refers to it "interpreting things" as blocks.
The ai cannot believe anything. It's moving slop around based on image soup. It doesn't even have object permanence.
The AI isn't trained on just videos, if that were the case it would have no way to read keyboard/mouse input. It's trained on recordings of bots playing the game, including their input actions, with them doing certain actions a bunch of times and viewing whatever results from it. That's why you can do things like press space to jump, or right click to place a block.
@@ValeBridges I can't swear to know what they've done here, but I believe they trained a simpler model to infer button presses, which then annotated UA-cam videos. With mouse movement this is very easy, they just used average screen motion as mouse movement.
[shows picture of creeper]
ai: hmm yes, desert
AI seems to really like deserts
Kohl:Tries to make the ai spawn him in the end
Ai: all I see is Sand so it will be a desert
i swear he needs to do this again. seeing him get disappointed over deserts is WAY too funny
Looking at the AI Minecraft thing for more than two minutes makes me violently uncomfortable
Seems like a good horror concept.
bro this is trippy as hell lmao love the vids/streams
thanks I appreciate it!
my guess is not that it hasn't seen the end, or the nether, or the dragon, it's just that it's seen the overworld grass, plains, desert, stone and snow so much more. Like 90% of its dataset is probably just the overworld with nothing. If it generates the end, it probably thinks its wrong and tries to correct it to something more normal.
We need someone to use that herobrine screenshot.
Would probably turn his shirt into an ocean after we walk towards him
@@KaiwunShowtimeor turn him into a plant 💀💀💀💀
Transitions with the AI are kind clean tho. 🔥🔥🔥
This is what Minecraft is like when you play it in a dream
Or while you have dementia.
Or while you have dementia.
I already dreaming of Minecraft and this was most stable than this
@@HungryWarden😭🙏
Trying not to look away from something you want to keep is like trying not to lose control of a lucid dream
13:00 MF DOOM!?
this is what getting home feel like when you’re drunk
except everything slowly becomes a desert
Hebrews: Have we finally found the promised land?
AI: Nope, just more desert.
13:21 i sent that photo of herobrine in discord 😎
-Wait it's all dessert?
-Always has been...
this is what Herobrine sees
Funny how it was like “no I think your here instead”
"Think what gaming could be"
The Ai: *Deletes game*
They clearly only trained it on videos of flying around the overworld.
They need to train it on more data...
2:04 🗣🔥💯 ONE PIECE 🗣🔥💯
So high
w profile pic
Bro got the Paraoh's curse.
i just noticed there is a comment like that so its technically not stolen cause i didnt kno-
"no, it's a desert" has to be my favourite quote from the video
The ai has the smoothest transitions
I think the sun and the clouds is what turns it into the desert, it being white and yellow.
This is what it’s like to play Minecraft in a dream
minecraft with dementia
minecraft with dementia
minecraft with dementia
minecraft with dementia
I'm pretty sure it has been trained only on overworld peaceful world footage.
It definitely knows what the nether and end are but yeah probably trained off like 95% overworld since it always wants to turn back to that. You're probably right about the peaceful part, hopefully they train it with hostile mobs in the future
I love seeing these kind of videos!
: “It’s all a desert?” : “Always has been.”
To be fair, we don't spend a lot of time looking directly at this stuff. I like how you tried to tower and it couldn't figure out if looking down meant placing blocks or removing blocks.
My AI Minecraft is much more unhinged than what I am seeing on YT. I cant even get close to a chicken without it turning into a flower.
"When in doubt, just desert"
7:40
It would be cooler if this ai could see a picture of a minecraft world, and find the exact seed needed to gendrate the sam world, using ai.
the ai loves warped wood
6:35 MC chat says "Scoob Wartgrop" wtf
The boat: “Mr Stark i don’t feel so good…” *turns into an entire desert*
7:50 He shriveled 😭
xd
Glad you continued this, Kohl!
The AI's evolved but still looks like a dream under anesthesia.
Good work as always!
this thing kinda seems like it was trained on a single minecraft video where they were in a desert for most of it and never got to the nether or end or saw any hostile mobs
It was definitely not generated on ONE video. One petabyte maybe
The boat working was great, you were ZOOMING
they really need to curate it to have less spanses of generic minecraft worlds. its annoying when youre trying to do something cool but it just thinks youre in a plains instead. it needs to be trained with more nether, more caves, and more end
And way less deserts it seems
@KohlPowered The Reason why hostile mobs don't work, is because the training data only includes footage from peaceful mode
Can't be true because sometimes it will show your hunger bar depleted
I was in this stream and fell asleep during it. I was so confused when I woke up and saw this monstrosity
9:16 bro in the backrooms
I imagine the farlands on this ai version of minecraft lol
Man going down and an infinity limbo is so scary and gives me agony lol, total hallucination
dude the desert gag KILLED ME all along the video
It would be interesting to try and find a seed associated with each generation.
Like when you first load into Minecraft AI, take a screenshot of where you start and see if any seeds exist that resemble it
Should technically be possible, as Minecraft AI uses compiled images of real gameplay
Oh, so this is what it feels like playing Minecraft while high
Minecraft: drunk edition
They should train on more nether and end stuff, because right now, the ai just assumes everything happens in the overworld. And I also realized that the ai does not go underground, so they also need to train the ai on underground images as well.
that first portal took blud to the twilight forest dimension 💀
congrats for 500k subs
Khol: looks to the sky
AI: *desert*
When you are on shrooms and just trying to get to the couch
I was walking and randomly got a portal overlay and nausea. Amazing because this AI is very spatial, I'm impressed.
*Literally anything happens*
AI: Interesting... interesting.... DESERT
When in doubt, desert it out.
Minecraft should add this with a “fugue state” effect where for the duration of the effect it does this to you and then when it ends it spawns you in at some random coordinates in your world
Minecraft but it's a fever dream
please do more of these, they're so cool
it’s like watching someone try to control a dream
It honestly feels like they trained it with 99% overworld above ground images, so that's where it always puts you when in doubt... like it's trying to play Geoguessr in Minecraft and just picks the most likely place that *anyone* would be in that game.
Minecraft: Drug addiction
It actually looks like a dream, you can see vague images, but you can't tell for the fuch of you what this thing actually is.
I love how creepers open up dimensional rifts
Anakin definitely hates this AI for the amount of times it put KohlPowered into the desert.
Minecraft: Schizophrenic N’ Dementia Edition
I really hope they continue to train this as much as they can, it would be insane to see a working ai-generated minecraft