AI-generated Minecraft unveiled, showcasing AI's unlimited ability to copy things but worse - 'AI, make me a version of this game but kinda bad.'

(Image credit: Decart)

AI has been up to some funny things in the last few years. People have declared the supposed merits of generative AI for creating textures, they have managed to get Doom running on a neural network, and, 'any day now', we're supposed to get user prompt-inspired games to play. As you might expect, today is not that day.

Decart, an AI company that seemingly popped up overnight, has unveiled Oasis, "the world's first real-time AI world model".

Oasis works via frame prediction. An AI model is given huge masses of data, which can then be used to predict the next frame. This is why the tool seems to invent blocks and doesn't seem to have object permanence. It doesn't store data from your world and loses track of things you've done after some time.

"Oasis takes in user keyboard and mouse input and generates real-time gameplay, internally simulating physics, game rules, and graphics," Decart says.

You aren't playing the game, per se, you are instead playing an approximation of the game.

In the announcement for this new model, Decart published where this tech can go, saying:

"Simply imagine a world where this integration is so tight that foundation models may even augment modern entertainment platforms by generating content on the fly according to user preferences. Or perhaps a gaming experience that provides new possibilities for the user interaction such as textual and audio prompts guiding the gameplay."

That last part suggests that users can generate their own experiences, by heightening stakes on the fly or manipulating the game as they go. However, the current model is much more limited than that.

Decart is seemingly generating a version of Minecraft, and a poor pixelated one at that. The end of the trailer for this new engine says "Imagine what AI experiences could look like if everyone had the power to create them" and that's exactly what I have to do as this game was created by Mojang almost two decades ago.

If everything is as Decart says here, the idea of AI-generating Minecraft could be quite impressive, but it's important to note this is not even close to the future envisioned. The work required to mimic a game that is widely accessible is different from the ability to effectively imagine and create bespoke experiences based on user prompts.

Decart says it wants to reach a point where a user can say "Imagine that there is a pink elephant chasing me down" and one appears, but right now it's struggling to make a look-a-like of a very old game using tons of training data from said game. Millions of hours of Minecraft gameplay, according to MIT Technology review.

This is before mentioning whether or not users even want this, the copyright implications of where that data is scraped from, and if the ability to frame all your art around yourself is particularly good for your media diet.

This tool was created with Nvidia H100 cards, and if you thought Minecraft was a generally easy game to run, this isn't. It runs at 360p at 20 fps. Though the future of this hardware is proposed to be made with Etched ASICs, Decart's partner here. These will supposedly allow it to run this sort of tech at 4K.

Of course, not all uses of this kind of AI in games are intended to just copy other games, and some of it is, in fact, very good for the average gamer. AI-powered Frame Generation can give much better performance in games with the same basic gear, and in theory, also relies on generating future frames based on the previous information presented to it.

I thought I would try to give Oasis a go, by accessing the site, and after getting through the waiting time, the whole thing wouldn't load. This isn't to say you can't access it but that I couldn't, and, at this rate, I'd rather just boot up the real thing.

Article Link

Archive

 

[Precision Anal Strike]

 

[Squawking Macaw]

It's frustrating to see it walk forward yet get no closer to the terrain on the horizon. Walk for long enough and the world breaks completely, it really shows how it's not really a game, but just a collection of similar images generated on the fly. And yet, it completely changing the terrain when you turn back around would be an awesome idea for a Minecraft mod or even a full-fledged game.

This is the equivalent of "can it run crysis" in a minecraft scenario. The java scriped game was an absolute bloat before being ported to c and using 100 times less resources, this is even worse than that.

And somehow the C version of the game is worse.

 

[LurkTrawl]

So is there going to be a point where someone invents the 'glue' to start mashing all these different specialized LLM into one giga-AI or going forward is each industry going to have its own companies investing into niche applications indefinitely?

 

[frozen_runner]

My issue is more fundamental than that. A cutscene, as it is in a film, is a form of storytelling. You're being fed a narrative that is a journey that is yours to experience, because even games must ultimately direct you somewhere. This AI is promising a completely controlled experience - if the story told to me is randomized or under my control, even if its just in superficial elements like scenery, then I am not being told a story, I am working to dictate my own daydream. I am upholding an imposition on somebody else's world, I am my own fanfiction self-insert, which destroys my own suspension of disbelief in the story I'm being told. It makes the idea of fiction (and all that comes with it, imagination, idealism, hope, aspiration) worthless. It's not just the death of the artist, it could be the death of art.

I know nobody is particularly well disposed toward the artist (since most of them these days rarely make something good) but industrializing the imagination is as anti-human as it gets.

I generally agree and think removing the artist from the "art" means, by definition, it isn't art and that it has less value.

However, most games only contain art but aren't art and don't even try to be art. If AI can become a developer's tool, I'm not as concerned with its sparing use. I will be more discerning about what I play, though.