AI-generated Minecraft unveiled, showcasing AI's unlimited ability to copy things but worse - 'AI, make me a version of this game but kinda bad.'

  • 🐕 I am attempting to get the site runnning as fast as possible. If you are experiencing slow page load times, please report it.
1.png
(Image credit: Decart)

AI has been up to some funny things in the last few years. People have declared the supposed merits of generative AI for creating textures, they have managed to get Doom running on a neural network, and, 'any day now', we're supposed to get user prompt-inspired games to play. As you might expect, today is not that day.

Decart, an AI company that seemingly popped up overnight, has unveiled Oasis, "the world's first real-time AI world model".

Oasis works via frame prediction. An AI model is given huge masses of data, which can then be used to predict the next frame. This is why the tool seems to invent blocks and doesn't seem to have object permanence. It doesn't store data from your world and loses track of things you've done after some time.

"Oasis takes in user keyboard and mouse input and generates real-time gameplay, internally simulating physics, game rules, and graphics," Decart says.

You aren't playing the game, per se, you are instead playing an approximation of the game.

tweet.png


In the announcement for this new model, Decart published where this tech can go, saying:

"Simply imagine a world where this integration is so tight that foundation models may even augment modern entertainment platforms by generating content on the fly according to user preferences. Or perhaps a gaming experience that provides new possibilities for the user interaction such as textual and audio prompts guiding the gameplay."

That last part suggests that users can generate their own experiences, by heightening stakes on the fly or manipulating the game as they go. However, the current model is much more limited than that.

Decart is seemingly generating a version of Minecraft, and a poor pixelated one at that. The end of the trailer for this new engine says "Imagine what AI experiences could look like if everyone had the power to create them" and that's exactly what I have to do as this game was created by Mojang almost two decades ago.

If everything is as Decart says here, the idea of AI-generating Minecraft could be quite impressive, but it's important to note this is not even close to the future envisioned. The work required to mimic a game that is widely accessible is different from the ability to effectively imagine and create bespoke experiences based on user prompts.

Decart says it wants to reach a point where a user can say "Imagine that there is a pink elephant chasing me down" and one appears, but right now it's struggling to make a look-a-like of a very old game using tons of training data from said game. Millions of hours of Minecraft gameplay, according to MIT Technology review.

This is before mentioning whether or not users even want this, the copyright implications of where that data is scraped from, and if the ability to frame all your art around yourself is particularly good for your media diet.

This tool was created with Nvidia H100 cards, and if you thought Minecraft was a generally easy game to run, this isn't. It runs at 360p at 20 fps. Though the future of this hardware is proposed to be made with Etched ASICs, Decart's partner here. These will supposedly allow it to run this sort of tech at 4K.

Of course, not all uses of this kind of AI in games are intended to just copy other games, and some of it is, in fact, very good for the average gamer. AI-powered Frame Generation can give much better performance in games with the same basic gear, and in theory, also relies on generating future frames based on the previous information presented to it.

I thought I would try to give Oasis a go, by accessing the site, and after getting through the waiting time, the whole thing wouldn't load. This isn't to say you can't access it but that I couldn't, and, at this rate, I'd rather just boot up the real thing.

Article Link

Archive
 
Article is equivalent of watching a fashion show and telling yourself "what's the point?! No one wears this ridiculous concpts of ballons in hair, comically oversized clothes and other weirdness they do on the fashion walk"

It's about highlighting something. It's the idea and concept being shown in the product, not the product itself.

Pretty cool stuff. Will be interested to see how it develops. Looking forward to when it can do RPGs that give you truly immerseive experiences with unique characters that can be interacted with rather then playing the script. Likely won't happen for many more years but we are heading that way.
 
This is interesting but not really useful. I seriously doubt this thing uses less resources than the Java, or that it provides any sort of advantage over regular game engines.

If they want to really showcase the tech then try and show off it doing something cool that actually NEEDS procedural generation, not just copying a already existing game.
It is useful — as a proof of concept regarding the accuracy of their technology for recreating scenes — not for gaming. This isn’t about “AI” Minecraft, or even gaming in general, but a company advertising their capabilities with recreating real-world scenes for machine learning tasks such as for robots. For a robot, most tasks are within a stationary visible area (thus persistence isn’t as big of a problem), and with enough data of, say, a factory and general physics, they can create decently detailed simulations using MLMs. They’re casting their net wide in terms of marketing and using Minecraft (just as another company used CSGO) to further market themselves, with the hopes for big contracts with model training or even model inferences.
 
I think Ross Scott (the guy who runs the Stop Killing Games) is going to love this. He's been hoping for an AI that could replicate games with just footage of it. Not for piracy but as a way to preserve games that get killed by their developers or to at the very least create a representation of a lost game.
 
Would be a cool concept for a weird world in a roguelike or the Warp in Warhammer. This all feels like a feature or tool for futures games or tech rather than something that will replace gamedev or other jobs and in general this is how I feel for most of the AI tech lately.

Also, JUSTICE FOR PRAGG SNARBO
 
Last edited:
  • Agree
Reactions: byuuWasTaken
When the research paper for this was discussed, it was noted how none of the examples show the character doing a 360 (or even 180 really) because it would just hallucinate whatever scene it thinks would fit the bill. I imagine this would be really fun for a psychedelic kind of experience though.
Interesting, like a maze that rearranges around you infinitely in real time
 
View attachment 6588738
gameplay video for phonefags
Yeah, this is what any actual, non cherry-picked gameplay is going to look like. Here's another one I found on /v/ last night

LMAO @ the "spatial consistency" bit in the trailer, those two words do not describe it at all, literally blink and it's gone. This will not be remotely useful for anything outside of short bursts of entertainment. Technology like the 3D graphics/gameplay engines you find in games can have all sorts of other uses, from training simulators for jobs to use for animation... but this is dogshit even for the purpose they're showing off. Outside of a D.A.R.E. program showing kids what it's like to fry your brain with drugs or something, this is way too schizophrenic to ever be useful for any purpose businesses would be willing to pay big bucks for.

The big, obvious problem is how quickly it loses context; look up into the sky and then back down, and it generates an entirely new world around you with no regard for the one that was there literally half a second ago. Maybe they could improve it to hold onto context longer, but context length makes things increasingly slow, computationally intensive, and most importantly of all, expensive as it goes on when it comes to language models, and text is one of the smallest and most easily-parseable types of data. Video? With real-time user interaction? This is beyond even a pipe dream, if they somehow made a version that worked even a fraction as well as it would need to, operating it would cost obscene amounts of money. Like all tech bubbles, its only purpose is to be a tech demo to attract a bunch of investor money by wowing them, it can't actually scale to what they're convincing investors it can.
 
Only Windows can create the AI game engine. They already have the compute and they can get the data.
Maybe they can make a free gamepass tier where you have to allow them to record your gameplay and inputs.
 
  • Thunk-Provoking
Reactions: byuuWasTaken
I've said it before and I'll say it again. AI/machine learning/advanced procedural generation is a fascinating area with genuine uses being strangled in the crib by grifters and doomsayers.

For gaming, using advanced procedural algorithms for elements of games (dialogue-generation for NPCs, advanced world generation, or in the development cycle minor elements like textures etc) would actually make sense. I believe there's a mod for Skyrim that lets you freely talk to people using AI generated dialogue and voices. But of course we have snake oil salesmen trying to swindle investor money with the idea of "real-time AI-generated games". And of course, idiots will fall for it on both sides- pro-Skub will claim it's the future of technology, anti-Skub will claim the entire technology is EVIL and needs to be banned, and we'll be no further forward.
 
Looking slightly down and walking across flat surfaces makes it completely hallucinate everything, it genuinely stops looking like minecraft at all.
There's frame-by-frame consistency, but this is basically just AI frame generation that has trained biases via inputs, don't get me wrong, it's not a bad idea, but it's... not really impressive.


 
I feel like this is all bullshit and it's just Minecraft.

AI still has trouble writing plots with consistency (part of writing is not just slamming down words, it's also remembering that Princess Dycia is tied up in the basement, Jimbo is dead, and Mark is in London), writing readable coherent text, and so forth. Remember, one of the biggest tech scandals recently was when a bunch of cameras inside of stores was not computers reading what people purchased but hundreds of Indians in a tech center.
Literally the immediate first thought I saw upon watching the video in the OP. Can't wait for the inevitable technical breakdown of this by like three different youtubers explaining how it was an elaborate scam to boost AI stock value and drive engagement despite being incredibly misleading.
 
  • Like
Reactions: TheGuntinator
It would be interesting if you could provide it a starting screenshot to base things off. Imagine the visuals if you could get this thing to start generation at the far lands.
 
  • Like
Reactions: TheGuntinator
Interesting, like a maze that rearranges around you infinitely in real time
Yeah essentially. The tech isn't there yet for a full game, but something like a cut scene or minigame could be fun. The problem right now is, you need to train the AI on footage of an already-existing game, so that the prediction is accurate.

If anyone wants to see more, DOOM (of course) was the first game this was tried on:

 
  • Like
Reactions: Caesar
Back