Introducing the Playable World Model, GWM Worlds 2

Runway’s GWM Worlds 2 is a research preview of an interactive world model that generates video and audio in real time in response to text actions and camera input. Users can define an environment, its

Runway’s research preview GWM Worlds 2 is an interactive world model that continuously generates 720p, 24-frames-per-second video and 48kHz audio in response to inputs during exploration. Rather than playing fixed-length clips, the world advances to its next state whenever the user provides new input. After setting the environment and entities, visual style, physical rules, and ambient sounds, users can manipulate the scene through textual actions and continuous camera movement.

A live example on the public page shows a survivor in a first-person desert world stabbing with a spear, drinking from a canteen, and then running. In a scene that handles the same space from a director’s perspective, prompts are sent separately to the campfire and weather, enlarging the flames and changing the sunset into a star-filled night. A configuration that inputs the player’s actions and scene direction simultaneously is also presented.

The core input format, WorldPrompt, is divided into persistent world context and a time-stamped event stream. The former contains the scene, entities, rules such as gravity and collisions, and the first frame; the latter contains movement, gestures, object interactions, dialogue, sounds, and frame-by-frame camera inputs. Runway notes that textures and geometry may waver during rapid camera movement in real-time generation, and that long-term consistency is not yet perfect.

Maru