AI-generated Minecraft unveiled, showcasing AI's unlimited ability to copy things but worse - 'AI, make me a version of this game but kinda bad.'

  • 🐕 I am attempting to get the site runnning as fast as possible. If you are experiencing slow page load times, please report it.
1.png
(Image credit: Decart)

AI has been up to some funny things in the last few years. People have declared the supposed merits of generative AI for creating textures, they have managed to get Doom running on a neural network, and, 'any day now', we're supposed to get user prompt-inspired games to play. As you might expect, today is not that day.

Decart, an AI company that seemingly popped up overnight, has unveiled Oasis, "the world's first real-time AI world model".

Oasis works via frame prediction. An AI model is given huge masses of data, which can then be used to predict the next frame. This is why the tool seems to invent blocks and doesn't seem to have object permanence. It doesn't store data from your world and loses track of things you've done after some time.

"Oasis takes in user keyboard and mouse input and generates real-time gameplay, internally simulating physics, game rules, and graphics," Decart says.

You aren't playing the game, per se, you are instead playing an approximation of the game.

tweet.png


In the announcement for this new model, Decart published where this tech can go, saying:

"Simply imagine a world where this integration is so tight that foundation models may even augment modern entertainment platforms by generating content on the fly according to user preferences. Or perhaps a gaming experience that provides new possibilities for the user interaction such as textual and audio prompts guiding the gameplay."

That last part suggests that users can generate their own experiences, by heightening stakes on the fly or manipulating the game as they go. However, the current model is much more limited than that.

Decart is seemingly generating a version of Minecraft, and a poor pixelated one at that. The end of the trailer for this new engine says "Imagine what AI experiences could look like if everyone had the power to create them" and that's exactly what I have to do as this game was created by Mojang almost two decades ago.

If everything is as Decart says here, the idea of AI-generating Minecraft could be quite impressive, but it's important to note this is not even close to the future envisioned. The work required to mimic a game that is widely accessible is different from the ability to effectively imagine and create bespoke experiences based on user prompts.

Decart says it wants to reach a point where a user can say "Imagine that there is a pink elephant chasing me down" and one appears, but right now it's struggling to make a look-a-like of a very old game using tons of training data from said game. Millions of hours of Minecraft gameplay, according to MIT Technology review.

This is before mentioning whether or not users even want this, the copyright implications of where that data is scraped from, and if the ability to frame all your art around yourself is particularly good for your media diet.

This tool was created with Nvidia H100 cards, and if you thought Minecraft was a generally easy game to run, this isn't. It runs at 360p at 20 fps. Though the future of this hardware is proposed to be made with Etched ASICs, Decart's partner here. These will supposedly allow it to run this sort of tech at 4K.

Of course, not all uses of this kind of AI in games are intended to just copy other games, and some of it is, in fact, very good for the average gamer. AI-powered Frame Generation can give much better performance in games with the same basic gear, and in theory, also relies on generating future frames based on the previous information presented to it.

I thought I would try to give Oasis a go, by accessing the site, and after getting through the waiting time, the whole thing wouldn't load. This isn't to say you can't access it but that I couldn't, and, at this rate, I'd rather just boot up the real thing.

Article Link

Archive
 
These things are just a scam. The A.I. is just copying what it sees, it has no spacial awareness or game logic. And if you ever got A.I. to a point where you could copy every fine detail right down to game logic (good fucking luck) all that time is wasted when you could have just made the game properly in the first place.
 
Here is my "game play." Key takeaway is that the AI has alzheimers. The terrain will change the moment you look away. You cant even build a dirt house.
View attachment 6589415
Honestly that would be kinda sick if it wasn’t just a shitty Minecraft clone. I’d play the fuck out of a horror game where the terrain constantly changes as soon as you look away. There’s potential here, but they won’t manage to utilize it effectively.

Edit: HOLY SHIT THAT FUCKING PIG! This technology could absolutely be utilized for a horror game. It’s like a fucking fever dream lmao
 
I'd like to see this applied to a simple fixed perspective game like N. Even a one-way scrolling game like Super Mario Bros. where it can't reimagine what came before. It might even juggle the "state" between the status bar and the level caption screens.
 
  • Agree
Reactions: Store Brand Cereal
Article is equivalent of watching a fashion show and telling yourself "what's the point?! No one wears this ridiculous concpts of ballons in hair, comically oversized clothes and other weirdness they do on the fashion walk"

It's about highlighting something. It's the idea and concept being shown in the product, not the product itself.

Pretty cool stuff. Will be interested to see how it develops. Looking forward to when it can do RPGs that give you truly immerseive experiences with unique characters that can be interacted with rather then playing the script. Likely won't happen for many more years but we are heading that way.
Yeah, I agree, it feels like a lot of people are shitting on what is essentially a proof concept. I don't disagree that AI techbros are among the most annoying bullshitters on the planet, but give some credit where credit is due.

In this case its like going "A car? HA, right because I'd love to ride a horse that eats coal, spits pollution and moves slower than an actual horse. What a retarded idea, ford is such a grifter."
 
This is the equivalent of "can it run crysis" in a minecraft scenario. The java scriped game was an absolute bloat before being ported to c and using 100 times less resources, this is even worse than that.
 
  • Like
Reactions: TheGuntinator
Yeah, I agree, it feels like a lot of people are shitting on what is essentially a proof concept. I don't disagree that AI techbros are among the most annoying bullshitters on the planet, but give some credit where credit is due.

In this case its like going "A car? HA, right because I'd love to ride a horse that eats coal, spits pollution and moves slower than an actual horse. What a retarded idea, ford is such a grifter."
The problem with this is that it's not really doing much that's novel, nor is it significantly more impressive than GameNGen.

Same thing with LLMs and "true" Artificial Intelligence, as it is right now, there is no way LLMs can reason or develop things like emotional states, or even grow, because all they are is fancy autocomplete, and the only "reasoning" that happens only happens because of character matching.
No memory, no Phantasia, no concepts, just a suite of numbers in, and a suite of numbers out.

Without a severe change/revolution in model shapes and execution, LLMs will hit a wall, which we know about and have graphed before.

1730544563317.png

It's the same thing with these kinds of "AI Games" which are just a frame generator with control biases built in.
If you exclusively train them on Minecraft, it'll only ever be able to output Minecraft.
If you train them on multiple games, you run the risk of your game becoming extremely inconsistent, if not changing in the middle of nowhere.

Since the message of the company is clearly to "empower everyone to make video games", using AI to make every part of a game, then running it, would be a much safer approach.
If they really want to make the AI generate everything, including render graphics, then you need a Cohort of Experts with significantly different shapes, and extended memory.
Whatever the case may be, their current approach is a dead end.
 
And if you ever got A.I. to a point where you could copy every fine detail right down to game logic (good fucking luck) all that time is wasted when you could have just made the game properly in the first place.
I'm not disagreeing with your core premise. But statements like this are kinda dumb.
"in all that time it took you to make a drill, you could have just made a hole."
Well yeah, but now I DO have a drill and can make 6 holes faster than you can make 1.
 
I'm not disagreeing with your core premise. But statements like this are kinda dumb.
"in all that time it took you to make a drill, you could have just made a hole."
Well yeah, but now I DO have a drill and can make 6 holes faster than you can make 1.
The point is, even if you get the A.I. working perfectly (doubtful), you still need to train it with lots and lots of data. Time and money that could be spent elsewhere.
 
  • Agree
Reactions: frozen_runner
The point is, even if you get the A.I. working perfectly (doubtful), you still need to train it with lots and lots of data. Time and money that could be spent elsewhere.
The end goal of the project isn't to mimic existing games, but to generate new ones from scratch.
It's not remotely in the realm of possibility. But if such a thing were created, it would be a massive development.
 
I really get the sense that the people who are obsessed with developing AI have never once actually thought about if this is something anybody should want.
There is, conceptually, a certain use for stuff like this. Imagine a crowded RPG town where crowd conversations and noise are generated on the fly by these algos. It would be extremely immersive because you won't hear the same conversation twice. (This would probably end the second someone claimed to hear the Gamer Word and got litigious.)

Or let's say you're in an in-game vehicle traveling during a cutscene. The background passing outside could be generated by algorithms so it's not the same thing every time. If this was a pre-made solution, maybe the devs could just plug that in and focus on other things.

But, generally, yeah... I don't see this as obviously useful. The example in this article isn't doing anything but using tons of data of real Minecraft gameplay to generate a semi-plausible series of frames of fake Minecraft gameplay. If this were offered as an actual gaming service (and it won't be, ever), it would be like an even shittier deal than Stadia: "no, you aren't running an actual game, on your computer or anywhere, you're just getting visuals that kind of look like a a semi-coherent game." This is a neat trick and nothing more.

The day where you can get an algo to generate a game from nothing is coming, though. I'm sure they'll all be shitty.
 
I know this is just a tech demo and whatever. But I feel like an AI company would be better off focusing on making some elaborate Skyrim mod that generates infinite unique NPCs with lore-accurate dialogue and quests with unique armor/weapons and dungeons, or what have you. That would be far more impressive and sell people on the idea better than an AI-generated letsplay you can sort of direct.
 
  • Like
Reactions: TheGuntinator
The bad work and the lack of innovations is a feature.
LLMs are designed to replace chinks...
 
Or let's say you're in an in-game vehicle traveling during a cutscene. The background passing outside could be generated by algorithms so it's not the same thing every time. If this was a pre-made solution, maybe the devs could just plug that in and focus on other things.
My issue is more fundamental than that. A cutscene, as it is in a film, is a form of storytelling. You're being fed a narrative that is a journey that is yours to experience, because even games must ultimately direct you somewhere. This AI is promising a completely controlled experience - if the story told to me is randomized or under my control, even if its just in superficial elements like scenery, then I am not being told a story, I am working to dictate my own daydream. I am upholding an imposition on somebody else's world, I am my own fanfiction self-insert, which destroys my own suspension of disbelief in the story I'm being told. It makes the idea of fiction (and all that comes with it, imagination, idealism, hope, aspiration) worthless. It's not just the death of the artist, it could be the death of art.

I know nobody is particularly well disposed toward the artist (since most of them these days rarely make something good) but industrializing the imagination is as anti-human as it gets.
 
Honestly, with how bad gaming is nowadays, let me fine tune an LLM and prompt my own game into existence. I’m totally down with that.
 
Back