We gave 10 frontier AI models control of a surgical robot in a simulated operating room.
Across 800 trials, only two models completed the task at all: Gemini 4 Argon nine times, and GPT-6 Astra twice.
Models claimed success 213 times. Every claim was wrong. In 94 of them, the robot never touched the object.
Introducing Dual-Arm Sim, our new robotics benchmark evaluating how well frontier models can control embodiments in simulated environments. More info in thread around what we tested and found.