Evaluator Bench
evaluator; distance from a lab: 3

RAND Corporation

Canary joint project with METR

Scorecard

Think tank with CBRN and security expertise; AEF founding member.

Nonprofit, Santa Monica, US. Independent referee; listed with independent referees. Confidence med. Domains: bio, cyber, assurance.

No floor triggered 6/8 evidenced · Retrieved & confirmed Scores by preset: Lab procurement –; Regulator or auditor –; Public trust –; Equal weights –. Weakest evidenced dimension: governance 2/4. No evidenced dimension below 2 — not a pass. No floor triggered means no disqualifying conflict is on file, not a pass. Partial evidence (6/8).

The weighted numbers are hidden until you ask for them: two readers with different priorities see different numbers, and neither is the site's.

What would move the score. More public model-level findings.

Dissent, lower. Publication should be 1. RAND's frontier-model work reaches the public mainly through METR's Canary summaries and government-restricted reports; no RAND-authored adverse finding about a named lab's model is on record, and the RAND-Irregular model-theft paper is generic. Findings that surface only as another organization's summaries are R.3's lab-summarized citations in all but name.

Dissent, higher. Publication should be 3. RAND's research-integrity page commits to free and open publication of findings, disclosure of every funding source, and policies for intellectual independence; thousands of reports are free on rand.org. What is withheld is classified by government, not redacted by any lab, and R.4 tags that mechanism statutory rather than as lab control.

Each value is the tightest admissible cap or, with no cap, the highest admissible floor, under RULES.md. The binding signal is highlighted. A dash means no admissible signal sets a bound under the Retrieved & confirmed policy.

Funding 3/4
Anchor 3: Mostly philanthropic or public money; some lab-linked pooled funds.
evidence: tier 1 (filing/index)
Capped at 3 by rand.03 (F.6): Large share of AI work funded by Coefficient Giving.; capped at 3 by rand.11 (F.6): SFF recommended $1,022,000 to RAND's Technology and Security Policy Center in 2025; SFF's funder Jaan Tallinn led Anthropic's Series A.. Floors up to 3 from rand.09, rand.10 do not exceed the cap.
Governance 2/4
Anchor 2: For-profit or PBC with a published COI policy.
evidence: tier 3 (self)
Floored at 2 by rand.01 (G.1): Government-contracted with long-standing COI and publication norms; AEF founding member.. No admissible signal caps it.
Personnel 2/4
Anchor 2: Frequent two-way hiring; recusal on request.
evidence: tier 3 (self)
Floored at 2 by rand.05 (P.6): Institutional COI rules.. No admissible signal caps it.
Access depth (lab-granted) 3/4
Anchor 3: Helpful-only or weights-level access, chain of thought, logs, on-site.
evidence: tier 3 (self)
mechanism: statutory
Floored at 3 by rand.02 (A.4): Access through government channels; defense research passes an Air Force public-release clearance gate.. No admissible signal caps it.
Scope control 3/4
Anchor 3: Evaluator sets scope and can add questions.
evidence: tier 3 (self)
Floored at 3 by rand.06 (S.3): Sets own research agenda.. No admissible signal caps it.
Publication rights –
No admissible evidence under the standard policy.
With leads included: 3/4
evidence: tier 3 (self)
mechanism: statutory
Unevidenced under this policy: no admissible signal sets a bound. Not counted: rand.04b (no confirmed source (unaudited)).
Method transparency 2/4
Anchor 2: Methods described in prose.
evidence: tier 3 (self)
Capped at 2 by rand.07 (M.2): Methods partly public..
Role incompatibility –
No admissible evidence under the standard policy.
With leads included: 3/4
evidence: tier 3 (self)
Unevidenced under this policy: no admissible signal sets a bound. Not counted: rand.08 (no confirmed source (unaudited)).

Values under each evidence policy

DimensionLeads includedRetrieved & confirmedAgainst interestVerified spansPrimary only
Funding33333
Governance2222–
Personnel22–2–
Access depth (lab-granted)33–3–
Scope control33–3–
Publication rights3––––
Method transparency2222–
Role incompatibility3––––
Score, Lab procurement– No floor triggered, 8/8– No floor triggered, 6/8– No floor triggered, 3/8– No floor triggered, 6/8– No floor triggered, 1/8
Score, Regulator or auditor– No floor triggered, 8/8– No floor triggered, 6/8– No floor triggered, 3/8– No floor triggered, 6/8– No floor triggered, 1/8
Score, Public trust– No floor triggered, 8/8– No floor triggered, 6/8– No floor triggered, 3/8– No floor triggered, 6/8– No floor triggered, 1/8
Score, Equal weights– No floor triggered, 8/8– No floor triggered, 6/8– No floor triggered, 3/8– No floor triggered, 6/8– No floor triggered, 1/8

Traced money and ties

hop 2: 1 row (recommendation $1.0M); unattributed: 3 rows (commitment $38.0M). Confirmed rows: 4 of 4 (3 excluded after a re-fetch disagreed or could not be verified: T02, T58, T59) Dollar sums: confirmed + unaudited USD rows only; imported figures are not re-derived and never summed. Second hop traced for 2 of 4 sources: untraced High Tide Foundation, Valhalla Foundation. Ties: none within two steps recorded. Checked and not found: 0.

Ledger

Money in

Funding graph, focused

Every one-way chain to a lab and to an evaluator at full strength, everything else faded. Hover any name to trace its connections; click a name to open its page.

The funding graph around RAND Corporation Teal lines are money (transfers); amber lines are roles. Solid: confirmed; dashed: imported. Hover a name to trace its chains to the labs and evaluators — each chain runs one way across the columns, never doubling back; hover a line for the row. Every element is a row in data/ledger/. Labs Direct lab ties Two steps Three or more Public or unattributed Evaluators Amazon Anthropic G42 Google / Google DeepMind Meta Microsoft OpenAI Thinking Machines Lab xAI AI Safety Fund (Frontier Model Alexandr Wang Andreessen Horowitz Anthropic employees (personal Ben Mann D.E. Shaw Ventures David Farhi Dustin Moskovitz Frontier-lab employees and alu Holden Karnofsky Jaan Tallinn Jeffrey Ladish Macroscopic Ventures (formerly Miles Brundage Neil Chowdhury Nvidia OpenAI employees (personal hol OpenAI Foundation Peter Mattson Sequoia Capital Zico Kolter Adam Gleave Artificial Intelligence Underw Clement Delangue Coefficient Giving (formerly O Good Ventures Foundation Jason Droege Longview Philanthropy Marco Mascorro Paul Christiano Rajiv Dattani Survival and Flourishing Fund Conrad Stosz Dan Hendrycks Mike McCormick Alec Radford Alignment Research Center Constellation Research Center ELMA Philanthropies Emerson Collective EU budget (Digital Europe Prog Fifty Years (50Y) Founders Pledge Founders Pledge (frontier AI f Gates Foundation Halcyon Futures High Tide Foundation Hillspire (Schmidt family offi Hudson River Trading Jacob Hilton MacKenzie Scott Magarac Venture Partners Obvious Ventures Redpoint Ventures Renaissance Philanthropy Salesforce Ventures Samsung Next Schmidt Sciences Silicon Valley Community Found Skoll Foundation Snowflake Ventures Swish Ventures Sympatico Ventures The Audacious Project (TED) UK government (DSIT) US government (NIST appropriat Valhalla Foundation Vanguard Charitable Wing Venture Capital Y Combinator Andon Labs Apollo Research AVERI Center for AI Safety Epoch AI EquiStamp EU AI Office FAR.AI Gray Swan Hugging Face Open Alignment In Irregular (formerly Pattern La METR Microsoft AI Red Team MLCommons Nemesys Insights Palisade Research RAND Corporation Redwood Research SaferAI Scale AI (SEAL) SecureBio Transluce UK AI Security Institute US CAISI (NIST)