Minecraft with Object Impermanence

Every once in a while, a generative AI project emerges that is so glitchy and broken, it becomes strangely compelling. Oasis Minecraft, a generative AI knockoff of the popular game, attempts to replicate Minecraft’s expansive, randomly-generated landscapes. However, it introduces a bizarre twist: There is no object permanence.

Imagine yourself in a wooden cavern, a structure you didn’t construct but stumbled upon like a natural formation. You glance away, and when you look back, the cavern has vanished completely. Build something, and if you fail to keep it in direct view, it disappears the moment you look away. This strange impermanence stems from the AI’s training process, which predicts the next frame of the game based on previous frames and user commands, without an underlying physics engine or standard block library.

Bizarre Transformations and Glitches

This lack of permanence leads to bizarre transformations. A torchlit stone morphs into birch tree bark, and a birch bark wall becomes a snowy floor, only to transform again into a desert. Occasionally, rare blocks like lava or pigs appear, but they often turn into ordinary dirt or sand upon closer inspection. Interestingly, ordinary blocks become increasingly distorted when stared at continuously, a result of accumulating noise in the algorithm.

The generated landscapes sometimes exhibit chaotic misinterpretations. A natural cave can change frames from a plausible feature to an indecipherable shadow on the landscape. At times, the player’s health bar fluctuates inexplicably, and the inventory contains nonsensical items. Attempting to use these items often yields no effect, emphasizing the AI’s unpredictable nature.

Engaging Chaos

This version of Minecraft challenges traditional gameplay mechanics. Players can manipulate the landscape by forcing glitches and watching landscapes transform into unforeseen formations. For instance, swimming toward a horizon reveals strange, striped reflections that evolve into static, suggesting the AI is on the brink of mode collapse.

While the developers of Oasis Minecraft acknowledge these glitches in their technical report, they argue that improvements could come with a larger model and more training data. However, if successful, the AI version might only replicate the original Minecraft with greater expense and complexity.

Despite these issues, the glitchy, dreamlike landscape remains a fascinating exploration of generative AI capabilities. This AI-driven experience is reminiscent of early attempts to mimic text-based dungeon crawling games, where lack of memory and comprehension led to endlessly entertaining shifts. Whether such explorations lead to new gaming paradigms remains uncertain, but for now, the quirky nature of Oasis Minecraft offers a unique gaming experience.

Play this delightfully glitchy game while it’s still weird enough to be fun!