Evaluator Bench
evaluator; distance from a lab: 1

UK AI Security Institute

Scorecard

Largest state evaluation team; 30+ models tested; Inspect open-sourced; Frontier AI Trends Report.

Government, London, UK. Government institute; listed with government institutes. Confidence high. Domains: cyber, bio, jailbreak, autonomy, assurance.

No floor triggered 8/8 evidenced · Retrieved & confirmed Scores by preset: Lab procurement –; Regulator or auditor –; Public trust –; Equal weights –. Weakest evidenced dimension: publication rights 2/4. No evidenced dimension below 2 — not a pass. No floor triggered means no disqualifying conflict is on file, not a pass. Full evidence.

The weighted numbers are hidden until you ask for them: two readers with different priorities see different numbers, and neither is the site's.

What would move the score. Statutory footing with power to compel testing and publish per-model findings.

Dissent, lower. Publication (R) at 2 could be 1. The public record shows per-model findings from more than thirty tested systems have never been published; the only public output is one aggregated Trends Report, and CSA describes the underlying work as confidential between the Institute and individual labs. Under R.4 a public body that publishes nothing per model scores 1, and one aggregate report in two years is close to nothing per model.

Dissent, higher. Publication (R) at 2 could be 3. The Trends Report published an adverse finding against every lab at once: a universal jailbreak in every system tested. The joint evaluations with CAISI produced public write-ups of ChatGPT Agent vulnerabilities and Constitutional Classifier bypasses. No lab-edited summary is documented, and the anchor-3 text (publishes, security-only redaction) is closer to that record than lab-edited summaries.

Each value is the tightest admissible cap or, with no cap, the highest admissible floor, under RULES.md. The binding signal is highlighted. A dash means no admissible signal sets a bound under the Retrieved & confirmed policy.

Funding 3/4
Anchor 3: Mostly philanthropic or public money; some lab-linked pooled funds.
evidence: tier 3 (self)
Capped at 3 by ukaisi.11 (F.9): AISI administers the Alignment Project, a GBP 27m grant pool that includes GBP 5.6m from OpenAI and money from Anthropic, Microsoft and AWS; core budget of about GBP 66m per year is public.; capped at 3 by ukaisi.12 (F.9): The Alignment Project took £5.6m from OpenAI. The £27m/£12m totals, the wider backer list, and OpenAI’s non-influence statement are per the cited sources; spans not yet captured.. Floors up to 3 from ukaisi.01, ukaisi.15 do not exceed the cap.
Curator: Anchor 3: public core budget, but the institute runs a lab-funded grant pool, which is lab money passing through it even if not into its evaluation budget.
Governance 3/4
Anchor 3: Nonprofit or public body with a COI policy.
evidence: tier 1 (filing/index)
Floored at 3 by ukaisi.08 (G.2): Public body with civil-service conflict rules.. No admissible signal caps it.
Curator: Anchor 3: public body with civil-service conflict rules (ukaisi.08). No tier-1 source for an independent board or external review, so 4 is unearned under the tier rule (C10).
Personnel 3/4
Anchor 3: Recusal policy and disclosure of lab ties.
evidence: tier 1 (filing/index)
Floored at 3 by ukaisi.13 (P.5): AISI staff are civil servants in DSIT and are bound by the Civil Service Code (conflicts and gifts) and the Business Appointment Rules, a statutory post-employment rule that applies for one to two years after leaving Crown service.. No admissible signal caps it.
Access depth (lab-granted) 3/4
Anchor 3: Helpful-only or weights-level access, chain of thought, logs, on-site.
evidence: tier 4 (press)
mechanism: lab-controlled
Floored at 3 by ukaisi.06 (A.4): Joint testing with the US institute; agreements with OpenAI, Anthropic, Google, Microsoft, Cohere; 30+ models tested.. No admissible signal caps it.
Scope control 3/4
Anchor 3: Evaluator sets scope and can add questions.
evidence: tier 4 (press)
Capped at 3 by ukaisi.14 (S.4): No statutory power to define scope or compel testing; the institute operates through voluntary testing agreements backed by bilateral memoranda of understanding, and the Frontier AI Bill had not been introduced as of September 2026.. Floors up to 3 from ukaisi.09 do not exceed the cap.
Publication rights 2/4
Anchor 2: Publishes; lab reviews with broad redaction.
evidence: tier 4 (press)
mechanism: statutory
Capped at 2 by ukaisi.04 (R.4): Most per-model results stay confidential; the public sees aggregated trends.. Floors up to 2 from ukaisi.03 do not exceed the cap.
Method transparency 3/4
Anchor 3: Tasks or code partly open.
evidence: tier 3 (self)
Floored at 3 by ukaisi.02 (M.1): Open-source Inspect framework and published methodology.. No admissible signal caps it.
Role incompatibility 4/4
Anchor 4: No commercial products.
evidence: tier 3 (self)
Floored at 4 by ukaisi.10 (X.7): No commercial products.. No admissible signal caps it.

Values under each evidence policy

DimensionLeads includedRetrieved & confirmedAgainst interestVerified spansPrimary only
Funding3333–
Governance33333
Personnel33333
Access depth (lab-granted)3333–
Scope control3333–
Publication rights2222–
Method transparency3333–
Role incompatibility4444–
Score, Lab procurement– No floor triggered, 8/8– No floor triggered, 8/8– No floor triggered, 8/8– No floor triggered, 8/8– No floor triggered, 2/8
Score, Regulator or auditor– No floor triggered, 8/8– No floor triggered, 8/8– No floor triggered, 8/8– No floor triggered, 8/8– No floor triggered, 2/8
Score, Public trust– No floor triggered, 8/8– No floor triggered, 8/8– No floor triggered, 8/8– No floor triggered, 8/8– No floor triggered, 2/8
Score, Equal weights– No floor triggered, 8/8– No floor triggered, 8/8– No floor triggered, 8/8– No floor triggered, 8/8– No floor triggered, 2/8

Traced money and ties

hop 0: 2 rows (grant $7.5M); public: 1 row. Confirmed rows: 2 of 3 Dollar sums: confirmed + unaudited USD rows only; imported figures are not re-derived and never summed. Second hop traced for 2 of 2 sources. Ties: none within two steps recorded. Checked and not found: 1.

Ledger

Money in

Checked and not found

  • N08 Does Coefficient Giving fund the UK AI Security Institute?
    Searched Coefficient grants index, 2,911 rows, snapshot 2026-09-11: no grant from Coefficient Giving in its index. Prompted by imported lead: kevinnbass ledger row EV11. importedhttps://coefficientgiving.org/grants/

Roles hosted

Funding graph, focused

Every one-way chain to a lab and to an evaluator at full strength, everything else faded. Hover any name to trace its connections; click a name to open its page.

The funding graph around UK AI Security Institute Teal lines are money (transfers); amber lines are roles. Solid: confirmed; dashed: imported. Hover a name to trace its chains to the labs and evaluators — each chain runs one way across the columns, never doubling back; hover a line for the row. Every element is a row in data/ledger/. Labs Direct lab ties Two steps Three or more Public or unattributed Evaluators Amazon Anthropic G42 Google / Google DeepMind Meta Microsoft OpenAI Thinking Machines Lab xAI AI Safety Fund (Frontier Model Alexandr Wang Andreessen Horowitz Anthropic employees (personal Ben Mann D.E. Shaw Ventures David Farhi Dustin Moskovitz Frontier-lab employees and alu Holden Karnofsky Jaan Tallinn Jeffrey Ladish Macroscopic Ventures (formerly Miles Brundage Neil Chowdhury Nvidia OpenAI employees (personal hol OpenAI Foundation Peter Mattson Sequoia Capital Zico Kolter Adam Gleave Artificial Intelligence Underw Clement Delangue Coefficient Giving (formerly O Good Ventures Foundation Jason Droege Longview Philanthropy Marco Mascorro Paul Christiano Rajiv Dattani Survival and Flourishing Fund Conrad Stosz Dan Hendrycks Mike McCormick Alec Radford Alignment Research Center Constellation Research Center ELMA Philanthropies Emerson Collective EU budget (Digital Europe Prog Fifty Years (50Y) Founders Pledge Founders Pledge (frontier AI f Gates Foundation Halcyon Futures High Tide Foundation Hillspire (Schmidt family offi Hudson River Trading Jacob Hilton MacKenzie Scott Magarac Venture Partners Obvious Ventures Redpoint Ventures Renaissance Philanthropy Salesforce Ventures Samsung Next Schmidt Sciences Silicon Valley Community Found Skoll Foundation Snowflake Ventures Swish Ventures Sympatico Ventures The Audacious Project (TED) UK government (DSIT) US government (NIST appropriat Valhalla Foundation Vanguard Charitable Wing Venture Capital Y Combinator Andon Labs Apollo Research AVERI Center for AI Safety Epoch AI EquiStamp EU AI Office FAR.AI Gray Swan Hugging Face Open Alignment In Irregular (formerly Pattern La METR Microsoft AI Red Team MLCommons Nemesys Insights Palisade Research RAND Corporation Redwood Research SaferAI Scale AI (SEAL) SecureBio Transluce UK AI Security Institute US CAISI (NIST)