GoogleIts DeepMind The team recently launched Genie brand new AI Models,With 11 billion parameters, it is capable of generating a more complete 2D platformer based on a single image and prompts entered by the user.
Genie has been trained on over 200,000 hours of 2D gameplay videos from around the web, and is currently only a research preview of games that are more like 2D platformers than full-blown VR games.
The team commented, "Genie has 11B parameters and can be described as a base world model. It consists of a spatio-temporal video tagger, an autoregressive dynamics model, and a simple and extensible potential action model."
Genie is trained on unsupervised and unlabeled video, and is therefore able to learn the movements, controls, and actions of a wide variety of characters in a consistent manner.
For users, basically just provide a sketch on paper, a perfect piece of digital art, or even an AI-generated description of the 2D world, and Genie will do the rest, generating the 2D game for you.
It generates images and other assets, turns your sketch into a fully realized open world, and then predicts the next pixel frame based on player-provided actions.