Evaluator Bench
NIST, 2026-08-08; retrieved 2026-09-14 tier 3 self (caisi)confirmed

Center for AI Standards and Innovation

https://www.nist.gov/caisi

Mandate: voluntary agreements with developers and evaluators; focus on demonstrable risks. Cited from a search snippet; not re-fetched in full. [verify 2026-09-15] fetched; page reachable, citation matches

Signals citing this source

  • US CAISI (NIST), F (for): Public funding; formal access agreements with five developers.
  • US CAISI (NIST), M (against): Methods partly published through NIST; per-evaluation methods not public.“CAISI published a write-up on how AI models can cheat on agentic evaluations”
  • US CAISI (NIST), X (for): No commercial products.“lead unclassified evaluations of AI capabilities that may pose risks to national security”
  • US CAISI (NIST), F (against): Public appropriation of about $10M in FY2026; free pre-deployment access from labs is in-kind. No confirmed primary-filing negative on lab money is on file.
  • US CAISI (NIST), P (for): CAISI staff are NIST federal employees bound by the criminal conflict-of-interest statute (18 U.S.C. 208) and the post-employment statute (18 U.S.C. 207), which restricts former employees for one to two years after leaving.
  • US CAISI (NIST), G (for): CAISI is a NIST center whose staff are bound by the federal conflict-of-interest statute, 18 U.S.C. 208.

Ledger rows citing this URL

  • N18 no CAISI contract to METR, Apollo, or other private evaluators found imported