Google DeepMind announced Genie 4 on October 27. You set a scene in motion and steer it in real time with natural language: move the camera, change the weather, bring in new characters. Each world also generates its own audio on the fly, including ambient sound, music and spoken dialogue. DeepMind says Gemini Omni grounds how things look and behave, while other Gemini models keep the simulation coherent.
Access is narrow for now. It's rolling out to a limited group of trusted testers, then to Google AI Ultra subscribers in Project Genie and to early-access partners in the Gemini API and AI Studio. There's a waitlist.
DeepMind lists the limits itself: visual details and object permanence can drift in longer sessions or after several complex prompt edits, and physics, audio accuracy, legible text and long-term consistency are still open research problems.

