1. From Tabletop Tasks to Clinical Scenes 2. What is New in Cosmos3-H-Dreams? 2.1 A Cosmos 3 Foundation and Richer Surgical Controls 2.2 From Teacher to Four-Step and Two-Step Students 2.3 Streaming through FlashDreams 3. Exploring Unseen Trajectories 4. Adapting to Your Own Data and Controller 5. What is Next 6. Get Started Today Picture moving the Cadiere grasper, grasping the gallbladder, and lifting it, all within a generated surgical scene that responds in real time. Today, we take the next step and introduce Cosmos3-H-Dreams, bringing interactive generative simulation to the visual and procedural complexity of clinical surgery with our most convincing in-body imagery to date.
Our first Cosmos-H-Dreams release, built on Cosmos-Predict2.5, brought interactive generative simulation to dVRK tabletop suturing, a foundational proving ground for surgical robotics. As world foundation model (WFM), Cosmos-H-Dreams demonstrated an alternative to numerical simulation: rather than explicitly modeling scene geometry, tissue deformation, and physical interactions, it learned visual dynamics directly from synchronized video and robot kinematics, yielding interactive tabletop task simulation with high realism.
