Another month, another revolutionary generative AI development that will apparently fundamentally alter how an entire industry operates. This time tech giant Microsoft has created a gameplay ideation tool, Muse, which it calls the worlds first Wham, or World and Human Action Model. Microsoft claims that Muse will speed up the lengthy and expensive process of game development by allowing designers to play around with AI-generated gameplay videos to see what works.Muse is trained on gameplay data from UK studio Ninja Theorys game Bleeding Edge. It has absorbed tens of thousands of hours of peoples real gameplay, both footage and controller inputs. It can now generate accurate-looking mock gameplay clips for that game, which can be edited and adapted with prompts.All well and good, but in an announcement video for Muse, Microsoft Gaming CEO Phil Spencer caused confusion when he said that it could be invaluable for the preservation of classic games: AI models, he implied, could learn those games and emulate them on modern hardware. Its not clear how this would be possible. Further muddying the waters, Microsofts overall CEO Satya Nadella then implied in a podcast interview that Muse was the first step in creating a catalogue of AI-generated games.But Muse, as it stands, cant create a game it can only create made-up footage of a game. So just what is this new gaming AI tool? A swish addition to game developers tool belts? Or the first step towards an era of AI-generated gaming detritus?The idea is that designers (or indeed players) can try out ideas with Muse without spending hours (or days) in a gameplay engine implementing something that might not feel good or even work. If a designer wants to see what, say, a power-up would look like in-game, they could generate mock video showing what that might look like, with the AI filling in the gaps.Game engines are complicated, messy things and it takes a lot of time to simulate things theyre not built for that, comments Julian Tongelius, associate professor in computer science and engineering at the New York University Tandon School of Engineering. [Working with] a simulation of the game can be much easier and faster. The opportunities opened up by this kind of study are pretty big, but the limitations are also real.AI gameplay simulations arent totally new Googles GameNGen project created a playable version of Doom that ran without a game engine in 2024. But the problem has always been consistency. Googles Doom simulation worked well at first, but the longer you played, the more the AI would dream up game elements that werent accurate. This is what Microsoft claims to have solved with Muse, but it comes with a massive caveat.This particular model is trained on 500,000 game sessions, so likely around 100,000 hours of gameplay. But it only works because you have so much data. If you move far beyond whats been recorded, simulations generally stop behaving well, explains Tongelius.Microsoft has stated that it is already using Muse to develop real-time playable AI models trained on its other first-party games. But while Muse is great for live-service games such as Bleeding Edge, with access to thousands of hours of live gameplay, for smaller games and single-player titles, it would be a monumental and probably pointless effort to train a generative AI model in each and every specific game.skip past newsletter promotionSign up to Pushing ButtonsFree weekly newsletterKeza MacDonald's weekly look at the world of gamingPrivacy Notice: Newsletters may contain info about charities, online ads, and content funded by outside parties. For more information see our Privacy Policy. We use Google reCaptcha to protect our website and the Google Privacy Policy and Terms of Service apply.after newsletter promotionIts an amazing technical hurdle that theyve jumped, but it kind of feels like theyre going through their Zoom moment: a product coming into a market that doesnt really have a purpose, says Ken Noland, the veteran game designer and self-described AI realist who runs AI Guys, an AI-focused co-development company. The technology is cool, and dont get me wrong, video generation is not an easy thing to do I just dont see its target audience. Game developers wont be able to use it for rapid production because it doesnt actually, aside from visualising a particular thing, address any underlying game development issues.Ultimately, there appears to be a disconnect between Spencer and Nadellas comments and what Muse actually does at the moment. Unless something significant changes, it doesnt appear capable of creating playable simulations of classic games, and it certainly doesnt create entirely new AI-generated games. It isnt even clear how Muses generated videos could be translated into actual gameplay.AI-generated video games may yet be on the horizon. Google quietly released Genie 2 a few months back, which is capable of generating playable worlds but thats not what Muse does, at least for now. I will choose to graciously interpret what Satya said as visions of what could be done in the future, says Tongelius. Its entirely possible that we will get to some version of that, but its not around the corner. What Microsoft has done in this paper is a foundation stone.