Evaluator Bench
Longterm Wiki, 2026-01-29; retrieved 2026-09-14 tier 4 press (aggregator)confirmed

Third-Party Model Auditing

https://www.longtermwiki.com/wiki/E450

Scale AI SEAL first third-party evaluator authorized by US AISI; ecosystem overview. Cited from a search snippet; not re-fetched in full. [verify 2026-09-15] fetched; page reachable, citation matches

Signals citing this source

  • US CAISI (NIST), P (against): Authorized Scale AI, a company 49% owned by Meta, to run evaluations on its behalf.“Scale AI SEAL : Safety, Evaluation, and Alignment Lab; first third-party evaluator authorized by US AISI”
  • US CAISI (NIST), X (against): CAISI partnered with Scale AI in February 2025 to jointly develop evaluation methods for frontier models, and authorized Scale SEAL as a third-party evaluator; Meta has held 49% of Scale AI since June 2025.
  • Scale AI (SEAL / Scale Labs), F (against): Nearly half owned by Meta, itself a frontier developer.
  • Scale AI (SEAL / Scale Labs), A (for): Government-defined risk domains and access agreements; first private evaluator authorized by the US institute.“Scale AI SEAL : Safety, Evaluation, and Alignment Lab; first third-party evaluator authorized by US AISI”
  • Scale AI (SEAL / Scale Labs), P (against): Leadership moved to Meta with the 2025 investment.

Ledger rows citing this URL

  • none