Nvidia unveils GR00T 2 world-action model to transfer human video movements to robots
Nvidia's research report on GR00T 2 describes a 'world-action' foundation model that predicts both next robot actions and short future video frames, enabling transfer of human demonstrations from head-mounted videos to different robot embodiments. Trained on a cluster using over a thousand GB300 chips and about 400,000 hours of footage, the system (and a Turbo variant for bipedal robots running on Jetson Thor) achieved mixed task success rates (10–80%), rapid few-minute fine-tuning for some tasks, and higher assembly reliability when paired with a higher-level planner such as OpenAI's GPT-6 Astra, but still faces limitations like lack of tactile input, missed fine errors, and latency from the planner.