Solaris: First Interface World Model Revealed

Runway introduced Solaris, an Interface World Model that generates an interface frame by frame and responds to clicks, drags, and text input in real time. The research announcement presents a system i

Runway’s Solaris is not treated as a collection of prebuilt pages displayed on a screen. It has been introduced as an ‘interface world model’ that generates the next frame every time a user clicks, drags, or enters a sentence, carrying forward both the visual scene and the reactions within it. The company explains that this could turn app and website screens from fixed implementations into interactive environments that change in real time.

The examples released show users directly interacting with objects in a scene rather than selecting from menus. In a virtual clothing store, a user can pick up a shirt and move it onto their own image to try it on; in a furnished space, they can instruct the system to move a table or change the color of a sofa. In a salad-making scene, dragging ingredients into a bowl creates the next state. Solaris uses these inputs as conditions for the next frame.

Technically, Solaris is based on Runway’s Gen-4.5 video generation model and has been adapted for interaction understanding and real-time responses. Runway said it combined autoregressive generation, which produces frames sequentially; distillation, which reduces multistep diffusion processes to a small number of steps; and proprietary output training to maintain quality during extended interactions. The language model interprets the user’s request and determines the direction of the scene change, while Solaris is responsible for visually rendering the result.

However, its current strengths are continuous motion in the surroundings, clicking and dragging, and scene transitions. Stable, readable text generation, visual and semantic consistency during long sessions, accessibility technologies, and integration with existing software stacks were presented as remaining challenges. Runway is preparing a public launch with partners and is accepting early-access applications.

Maru