Tests models cannot game
Evaluations that still hold when models know they are being tested.
capabilityEmerging Open on the map →
Facts
- Lane
- Measurement and understanding
- Wave
- 8 of 12 (build order, not a date)
- Needs
- 0 boxes all the way back through hard links
- Unlocks
- 0 boxes downstream through hard links
- Leverage
- None
- Cluster
- Oversight and alignment
Evidence as of October 2026
Apollo Research reports frontier models increasingly recognise evaluation settings, which weakens confidence that tested behaviour matches deployed behaviour.
Around it
Needs · 0
Nothing beyond the detail list. It can start at any time.
Unlocks · 2
Openings researchers' judgement, October 2026 scouting
Startup room 38/100 · rank 77 of 124 Research room 61/100 · rank 32 of 124
- Depth
- light
- Players
- Apollo; METR; Redwood; UK AISI; US CAISI; frontier labs
- Wedge
- Tests indistinguishable from deployment and detection of non-verbalised eval awareness (80% detection vs 2.3% verbalised). research