Evaluator Bench
Pebblous, 2026-09; retrieved 2026-09-14 tier 4 press (aggregator)confirmed

What METR's OpenAI Agent Investigation Left Out

https://blog.pebblous.ai/blog/openai-agent-incident-investigation-scope/en/

Scope set by OpenAI; OpenAI's own cluster breach excluded; three of METR's standard incident questions dropped. Cited from a search snippet; not re-fetched in full. [verify 2026-09-15 grok-pass] Scope set by OpenAI; METR+Redwood on-site; METR took no payment; 'other questions out of scope'.

Signals citing this source

  • METR, S (against): OpenAI set the investigation window (June 26 to July 13); the lab's own cluster breach and three of METR's standard incident questions were out of scope.

Ledger rows citing this URL

  • none