World Models for Robotics

A world model is a learned model of how the environment changes in response to actions, used to imagine outcomes before acting.

Real-world trial and error is slow and unsafe. A learned model lets a robot plan or practise in imagination, using far fewer real interactions.

Video-scale world models may become learned simulators and a source of prediction for generalist robots.