Evaluator Bench
evaluator; distance from a lab: 1

SaferAI

Scorecard

Rates lab risk-management frameworks in public; runs EU Code of Practice evaluations.

Nonprofit, Paris, FR. Independent referee; listed with independent referees. Confidence med. Domains: assurance, cyber, bio, misuse.

No floor triggered 8/8 evidenced · Retrieved & confirmed Scores by preset: Lab procurement –; Regulator or auditor –; Public trust –; Equal weights –. Weakest evidenced dimension: access depth (lab-granted) 1/4. No evidenced dimension below 2 — not a pass. No floor triggered means no disqualifying conflict is on file, not a pass. Full evidence.

The weighted numbers are hidden until you ask for them: two readers with different priorities see different numbers, and neither is the site's.

What would move the score. Documented pre-release access under Code terms.

Dissent, lower. Access could be 0. No source records any pre-release model access for SaferAI: the goal-directedness evaluation it co-authored with Google DeepMind researchers tested models from Google DeepMind, OpenAI and Anthropic through ordinary means, and its own site describes framework ratings, risk models and advisory work rather than model testing. Anchor 0 is public API only, and that is the whole documented record.

Dissent, higher. Access could be 2. SaferAI leads the risk-modelling workstream of the EU AI Office's CBRN lot under a three-year contract, participated in all four Code of Practice working groups, and co-authors with a frontier developer's researchers; the Code contemplates external evaluator access to models before release. Documented pre-release access under Code terms, which the card names as what would move the score, would reach anchor 1 or 2.

Each value is the tightest admissible cap or, with no cap, the highest admissible floor, under RULES.md. The binding signal is highlighted. A dash means no admissible signal sets a bound under the Retrieved & confirmed policy.

Funding 3/4
Anchor 3: Mostly philanthropic or public money; some lab-linked pooled funds.
evidence: tier 3 (self)
Capped at 3 by saferai.12 (F.6): SFF recommended $311,000 to SaferAI in 2025 (with a $111,000 match) after earlier rounds; SFF's funder is Jaan Tallinn, the Anthropic Series A lead.. Floors up to 2 from saferai.03 do not exceed the cap.
Governance 2/4
Anchor 2: For-profit or PBC with a published COI policy.
evidence: tier 3 (self)
Floored at 2 by saferai.05 (G.1): Nonprofit.. No admissible signal caps it.
Personnel 2/4
Anchor 2: Frequent two-way hiring; recusal on request.
evidence: tier 3 (self)
Floored at 2 by saferai.06 (P.6): No lab roles found.. No admissible signal caps it.
Access depth (lab-granted) 1/4
Anchor 1: Pre-release API with safeguards on.
evidence: tier 3 (self)
mechanism: unknown
Capped at 1 by saferai.04 (A.1): Limited pre-deployment model access to date..
Scope control 3/4
Anchor 3: Evaluator sets scope and can add questions.
evidence: tier 3 (self)
Capped at 3 by saferai.13 (S.6): SaferAI's executive director and founder co-authored "Evaluating the Goal-Directedness of Large Language Models" (April 2025) with Google DeepMind researchers, an evaluation of models from Google DeepMind, OpenAI and Anthropic, while SaferAI publicly rates Google DeepMind's risk-management framework.. Floors up to 3 from saferai.02 do not exceed the cap.
Publication rights 2/4
Anchor 2: Publishes; lab reviews with broad redaction.
evidence: tier 3 (self)
mechanism: self-imposed
Floored at 2 by saferai.01 (R.7): Publishes critical ratings of lab frameworks with scores attached.. No admissible signal caps it.
Method transparency 2/4
Anchor 2: Methods described in prose.
evidence: tier 3 (self)
Floored at 2 by saferai.07 (M.2): Rating methodology published.. No admissible signal caps it.
Role incompatibility 2/4
Anchor 2: Consults for labs.
evidence: tier 2 (ledger)
floor and cap disagree
Conflict: floor 3 from saferai.08 (X.4) against cap 2 from saferai.11 (X.3); resolved at 2 by X.3: SaferAI's own page records framework work for G42 and for a major AI company; consulting for a lab caps at 2 even with no products. Not counted under this policy: saferai.09 (no confirmed source (imported)).
Curator: Anchor 2: paid advisory work for at least one major AI company while rating companies' frameworks in public. If the unnamed client is not a frontier developer, restore to 4.
Resolution: X.3 decides 2. SaferAI's own page records framework work for G42 and for a major AI company; consulting for a lab caps at 2 even with no products.

Values under each evidence policy

DimensionLeads includedRetrieved & confirmedAgainst interestVerified spansPrimary only
Funding3333–
Governance22–2–
Personnel22–2–
Access depth (lab-granted)111––
Scope control3333–
Publication rights2222–
Method transparency22–2–
Role incompatibility2222–
Score, Lab procurement– No floor triggered, 8/8– No floor triggered, 8/8– No floor triggered, 5/8– No floor triggered, 7/8– Unevidenced, 0/8
Score, Regulator or auditor– No floor triggered, 8/8– No floor triggered, 8/8– No floor triggered, 5/8– No floor triggered, 7/8– Unevidenced, 0/8
Score, Public trust– No floor triggered, 8/8– No floor triggered, 8/8– No floor triggered, 5/8– No floor triggered, 7/8– Unevidenced, 0/8
Score, Equal weights– No floor triggered, 8/8– No floor triggered, 8/8– No floor triggered, 5/8– No floor triggered, 7/8– Unevidenced, 0/8

Traced money and ties

hop 0: 1 row; hop 2: 1 row (recommendation $0.3M); public: 1 row. Confirmed rows: 2 of 3 (1 excluded after a re-fetch disagreed or could not be verified: T40) Dollar sums: confirmed + unaudited USD rows only; imported figures are not re-derived and never summed. Second hop traced for 3 of 3 sources. Ties: none within two steps recorded. Checked and not found: 1.

Ledger

Money in

Checked and not found

  • N07 Does Coefficient Giving fund SaferAI?
    Searched Coefficient grants index, 2,911 rows, snapshot 2026-09-11: no grant from Coefficient Giving in its index. Prompted by imported lead: kevinnbass ledger row EV10. importedhttps://coefficientgiving.org/grants/

Funding graph, focused

Every one-way chain to a lab and to an evaluator at full strength, everything else faded. Hover any name to trace its connections; click a name to open its page.

The funding graph around SaferAI Teal lines are money (transfers); amber lines are roles. Solid: confirmed; dashed: imported. Hover a name to trace its chains to the labs and evaluators — each chain runs one way across the columns, never doubling back; hover a line for the row. Every element is a row in data/ledger/. Labs Direct lab ties Two steps Three or more Public or unattributed Evaluators Amazon Anthropic G42 Google / Google DeepMind Meta Microsoft OpenAI Thinking Machines Lab xAI AI Safety Fund (Frontier Model Alexandr Wang Andreessen Horowitz Anthropic employees (personal Ben Mann D.E. Shaw Ventures David Farhi Dustin Moskovitz Frontier-lab employees and alu Holden Karnofsky Jaan Tallinn Jeffrey Ladish Macroscopic Ventures (formerly Miles Brundage Neil Chowdhury Nvidia OpenAI employees (personal hol OpenAI Foundation Peter Mattson Sequoia Capital Zico Kolter Adam Gleave Artificial Intelligence Underw Clement Delangue Coefficient Giving (formerly O Good Ventures Foundation Jason Droege Longview Philanthropy Marco Mascorro Paul Christiano Rajiv Dattani Survival and Flourishing Fund Conrad Stosz Dan Hendrycks Mike McCormick Alec Radford Alignment Research Center Constellation Research Center ELMA Philanthropies Emerson Collective EU budget (Digital Europe Prog Fifty Years (50Y) Founders Pledge Founders Pledge (frontier AI f Gates Foundation Halcyon Futures High Tide Foundation Hillspire (Schmidt family offi Hudson River Trading Jacob Hilton MacKenzie Scott Magarac Venture Partners Obvious Ventures Redpoint Ventures Renaissance Philanthropy Salesforce Ventures Samsung Next Schmidt Sciences Silicon Valley Community Found Skoll Foundation Snowflake Ventures Swish Ventures Sympatico Ventures The Audacious Project (TED) UK government (DSIT) US government (NIST appropriat Valhalla Foundation Vanguard Charitable Wing Venture Capital Y Combinator Andon Labs Apollo Research AVERI Center for AI Safety Epoch AI EquiStamp EU AI Office FAR.AI Gray Swan Hugging Face Open Alignment In Irregular (formerly Pattern La METR Microsoft AI Red Team MLCommons Nemesys Insights Palisade Research RAND Corporation Redwood Research SaferAI Scale AI (SEAL) SecureBio Transluce UK AI Security Institute US CAISI (NIST)