Runway’s New AI Generates Worlds as You Play
GWM Worlds 2 makes AI-generated video interactive, creating each moment in response to your actions.
Runway unveiled GWM Worlds 2 (opens in a new tab) on September 3, showing AI-generated worlds that respond as people move through them. The model creates the next moments of video and sound from the actions it receives.
One demo starts on a wet city sidewalk. A woman in a green coat approaches a street sweeper, and the two talk as the camera follows her. Instructions describe their movements and dialogue; the model turns them into the scene below.
Playing inside the scene
The next demo puts those instructions on a keyboard and mouse. A player guides a mage through the snow, casts a spell, and opens a portal. Each input gives the model a new action to generate while the scene keeps moving.
Runway calls the instruction format WorldPrompt. It sets out the characters, actions, and camera movements. A separate demo splits control between a player and a director, so one person can move the character while the other changes the surroundings.
According to Runway, GWM Worlds 2 generates 720p video at 24 frames per second with sound. That continuous response lets a person play through the scene as it is being created.
An agent at the controls
Those controls also work with an AI agent. Runway gave one a generated robot in a warehouse and a goal of reaching the red flag, then the blue one. The agent chose the movements, and the model generated the robot following that route.
Access
GWM Worlds 2 remains a research preview. Runway notes that fast camera turns can lose detail and the model can forget earlier parts of a scene. Public pricing and a general release date have not been announced.
Businesses can contact Runway through its research page (opens in a new tab) to discuss access. The demos offer an early look at creating a scene you can keep directing and exploring as it unfolds.
More from Capture & Create.
Browse all stories
Immersive Training · 2 min read
Apple Vision Pro Helps Astronauts Revisit Their Underwater Training
Apple is filming spacewalk practice in immersive video, giving astronauts and their support teams a way to review each session in 3D.
Gaussian splats · 2 min read
Scenery Is Adding Gaussian Splats to Its App Across Apple Platforms
Scenery says the feature will arrive with the public releases of iOS 27, macOS 27, and visionOS 27. Scripts can update hundreds of thousands of splats per frame.
3D scanning · 2 min read
XGRIDS Turns Your iPhone Into a 3D Spatial Camera
The LCC Scan app builds explorable 3D scenes right on your iPhone, without a cloud upload or server queue.