Runway’s New AI Generates Worlds as You Play

Playing inside the scene

The next demo puts those instructions on a keyboard and mouse. A player guides a mage through the snow, casts a spell, and opens a portal. Each input gives the model a new action to generate while the scene keeps moving.

Runway calls the instruction format WorldPrompt. It sets out the characters, actions, and camera movements. A separate demo splits control between a player and a director, so one person can move the character while the other changes the surroundings.

According to Runway, GWM Worlds 2 generates 720p video at 24 frames per second with sound. That continuous response lets a person play through the scene as it is being created.

An agent at the controls

Those controls also work with an AI agent. Runway gave one a generated robot in a warehouse and a goal of reaching the red flag, then the blue one. The agent chose the movements, and the model generated the robot following that route.

Access

GWM Worlds 2 remains a research preview. Runway notes that fast camera turns can lose detail and the model can forget earlier parts of a scene. Public pricing and a general release date have not been announced.

Businesses can contact Runway through its research page (opens in a new tab) to discuss access. The demos offer an early look at creating a scene you can keep directing and exploring as it unfolds.