AI-generated Minecraft unveiled, showcasing AI's unlimited ability to copy things but worse - 'AI, make me a version of this game but kinda bad.'

  • 🐕 I am attempting to get the site runnning as fast as possible. If you are experiencing slow page load times, please report it.
1.png
(Image credit: Decart)

AI has been up to some funny things in the last few years. People have declared the supposed merits of generative AI for creating textures, they have managed to get Doom running on a neural network, and, 'any day now', we're supposed to get user prompt-inspired games to play. As you might expect, today is not that day.

Decart, an AI company that seemingly popped up overnight, has unveiled Oasis, "the world's first real-time AI world model".

Oasis works via frame prediction. An AI model is given huge masses of data, which can then be used to predict the next frame. This is why the tool seems to invent blocks and doesn't seem to have object permanence. It doesn't store data from your world and loses track of things you've done after some time.

"Oasis takes in user keyboard and mouse input and generates real-time gameplay, internally simulating physics, game rules, and graphics," Decart says.

You aren't playing the game, per se, you are instead playing an approximation of the game.

tweet.png


In the announcement for this new model, Decart published where this tech can go, saying:

"Simply imagine a world where this integration is so tight that foundation models may even augment modern entertainment platforms by generating content on the fly according to user preferences. Or perhaps a gaming experience that provides new possibilities for the user interaction such as textual and audio prompts guiding the gameplay."

That last part suggests that users can generate their own experiences, by heightening stakes on the fly or manipulating the game as they go. However, the current model is much more limited than that.

Decart is seemingly generating a version of Minecraft, and a poor pixelated one at that. The end of the trailer for this new engine says "Imagine what AI experiences could look like if everyone had the power to create them" and that's exactly what I have to do as this game was created by Mojang almost two decades ago.

If everything is as Decart says here, the idea of AI-generating Minecraft could be quite impressive, but it's important to note this is not even close to the future envisioned. The work required to mimic a game that is widely accessible is different from the ability to effectively imagine and create bespoke experiences based on user prompts.

Decart says it wants to reach a point where a user can say "Imagine that there is a pink elephant chasing me down" and one appears, but right now it's struggling to make a look-a-like of a very old game using tons of training data from said game. Millions of hours of Minecraft gameplay, according to MIT Technology review.

This is before mentioning whether or not users even want this, the copyright implications of where that data is scraped from, and if the ability to frame all your art around yourself is particularly good for your media diet.

This tool was created with Nvidia H100 cards, and if you thought Minecraft was a generally easy game to run, this isn't. It runs at 360p at 20 fps. Though the future of this hardware is proposed to be made with Etched ASICs, Decart's partner here. These will supposedly allow it to run this sort of tech at 4K.

Of course, not all uses of this kind of AI in games are intended to just copy other games, and some of it is, in fact, very good for the average gamer. AI-powered Frame Generation can give much better performance in games with the same basic gear, and in theory, also relies on generating future frames based on the previous information presented to it.

I thought I would try to give Oasis a go, by accessing the site, and after getting through the waiting time, the whole thing wouldn't load. This isn't to say you can't access it but that I couldn't, and, at this rate, I'd rather just boot up the real thing.

Article Link

Archive
 
"no logic, no code"
except the entire AI being used to generate the image from information it has gathered and assembled in a way to logically match past examples

probably way less efficient than actual code given LLM energy consumption, but it might make for some interesting games from scratch in some years
 
I feel like this is all bullshit and it's just Minecraft.

AI still has trouble writing plots with consistency (part of writing is not just slamming down words, it's also remembering that Princess Dycia is tied up in the basement, Jimbo is dead, and Mark is in London), writing readable coherent text, and so forth. Remember, one of the biggest tech scandals recently was when a bunch of cameras inside of stores was not computers reading what people purchased but hundreds of Indians in a tech center.
 
"no logic, no code"
except the entire AI being used to generate the image from information it has gathered and assembled in a way to logically match past examples

probably way less efficient than actual code given LLM energy consumption, but it might make for some interesting games from scratch in some years
For what amounts to a tech demo it is quite fascinating in concept but the way it works at all is pretty indicative all generative AI "video game" technology can do right now is make projected approximations of existing media with world consistency issues after amassing large amounts of training data.

At the very least, there is a good chance this little experiment will probably get the company behind it more funding from outside investors and maybe a lawsuit from Microsoft if they didn't abide by copyright laws.
 
Oasis works via frame prediction. An AI model is given huge masses of data, which can then be used to predict the next frame. This is why the tool seems to invent blocks and doesn't seem to have object permanence. It doesn't store data from your world and loses track of things you've done after some time.
And this is why AI "games on the fly" will never work. I know a lot of people have said "AI will never replace x", but in this case it's a sure thing. They're using AI to try and bypass the rules and data structures inherent to a game. Games literally only consist of rules and data structures. There's nothing more to them once you strip away the audiovisual components, but those only exist to let the player interact meaningfully with the rules. And if you make a specialized AI that creates a set of rules universal to all players and has the ability to store the data needed for these rules, you know what you've just created? A game. You've just done it circuitously.

Do I think one day, Ubisoft is going to be able to say "hey Alexa, make Slop Quest 54" and sell the resulting program to idiots? Sure. But the idea of a game being generated on the fly with just a vague description of what's supposed to happen won't work, because people won't accept a game that nobody else can play. It's too dystopian even for the most terminal consoomers.
 
Machine learning is just a brute force method to solve mathematical problems, it all will work eventually if you just throw enough of computational power (and data) into it... This is so useless, I don't get it? This requires tons of power for something that could run on a 2010's laptop.... it all reeks the reddit "quirky tech achievements".

Millions of hours of Minecraft gameplay,
created with Nvidia H100 cards

See, they had to take the most uploaded content on the internet for this to work at all. And the cutting edge tech to replicate something that already exists (in a practical manner).

These will supposedly allow it to run this sort of tech at 4K.
They will just grind it to up to 1080p and then throw an upscaler on it so the user sees "4K".



I give the AI bubble another 5 years until it loses its novelty and goes back to just being a bruteforce mathematical tool again, that will only be used sparingly.
 
Simply imagine a world where this integration is so tight that foundation models may even augment modern entertainment platforms by generating content on the fly according to user preferences.
I really get the sense that the people who are obsessed with developing AI have never once actually thought about if this is something anybody should want.
 
This is interesting but not really useful. I seriously doubt this thing uses less resources than the Java, or that it provides any sort of advantage over regular game engines.

If they want to really showcase the tech then try and show off it doing something cool that actually NEEDS procedural generation, not just copying a already existing game.
 
If this is the first step to me telling an AI program to make a video game than that's pretty cool. Video games cost a stupid amount of time and money to make already and the most expensive ones are all being made by DEI retards. Think about what will happen to gaming if four people with an AI and a good idea can crank out something that looks just as good.

That sort of thing is a long way off but if it's possible I'm going to make the dumbest video games ever.
 
When the research paper for this was discussed, it was noted how none of the examples show the character doing a 360 (or even 180 really) because it would just hallucinate whatever scene it thinks would fit the bill. I imagine this would be really fun for a psychedelic kind of experience though.
 
Back