- METR gives a frontier model hidden tests
- 80% of runs it skips the work, approved
- it wrote, tested and reported, nothing caught it
- it graded its own work
An agent’s own pass means nothing. Verification has to be recomputed independently.
Vistara