Evaluator Bench
evaluator; distance from a lab: 1

Gray Swan

Scorecard

Crowdsourced adversarial testing (Arena) plus Shade and Cygnal defense products; cited in 11 recent system cards.

VC-backed, Pittsburgh, US. Vendor / red-team co.; listed with commercial and first-party. Confidence high. Domains: jailbreak, cyber, misuse.

Disqualifying floor 8/8 evidenced · Retrieved & confirmed Scores by preset: Lab procurement –; Regulator or auditor –; Public trust –; Equal weights –. Weakest evidenced dimension: role incompatibility 0/4. At least one evidenced conflict dimension at 0: not a candidate for an independence-critical role until the floor moves. Access and methods never set a band.

The weighted numbers are hidden until you ask for them: two readers with different priorities see different numbers, and neither is the site's.

What would move the score. Structural separation of the evaluation business, and independent governance for the OpenAI-related conflict beyond personal recusal.

Dissent, lower. Personnel (1 to 0). The co-founder and chief scientist chairs OpenAI's Safety and Security Committee, which oversees the very releases in which Gray Swan is cited. The only evidence of recusal is one 2024 press sentence describing a personal arrangement; no written policy, scope, or administrator is public. P.1 gives 0 where a recusal is not documented, and a single unverifiable press line is thin documentation.

Dissent, higher. Role incompatibility (0 to 1). The record documents that labs use Gray Swan's platform and are named in its system-card citations, but not that any lab buys Cygnal, the runtime defense product; lab use may be limited to Arena and Shade, which are testing services. X.1's 0 requires a defense or monitoring product sold to an evaluated lab; on the documented facts, anchor 1 (services to labs) fits.

Each value is the tightest admissible cap or, with no cap, the highest admissible floor, under RULES.md. The binding signal is highlighted. A dash means no admissible signal sets a bound under the Retrieved & confirmed policy.

Funding 1/4
Anchor 1: Material revenue or investment from evaluated labs or their investors.
evidence: tier 3 (self)
Capped at 1 by grayswan.03 (F.5): $40M Series A in May 2026 at a $200M valuation; revenue from every major lab.. Floors up to 1 from grayswan.06 do not exceed the cap.
Governance 1/4
Anchor 1: Private for-profit with no published COI policy.
evidence: tier 3 (self)
Capped at 1 by grayswan.05 (G.2): Venture-backed for-profit; no published COI policy found..
Personnel 1/4
Anchor 1: Leaders hold equity or advisory roles at labs; informal recusal.
evidence: tier 3 (self)
Capped at 1 by grayswan.01 (P.1): Co-founder and chief scientist chairs OpenAI's Safety and Security Committee and sits on its nonprofit board.; capped at 1 by grayswan.12 (P.1): Chief scientist appointed to OpenAI's board in 2024 and chairs its safety and security committee; also a 2025 Schmidt Sciences AI safety funding recipient.. Floors up to 1 from grayswan.02 do not exceed the cap.
Access depth (lab-granted) 2/4
Anchor 2: Pre-release with safeguards off or extended time.
evidence: tier 3 (self)
mechanism: lab-controlled
Floored at 2 by grayswan.07 (A.1): Embedded in pre-release safety evaluation processes; cited in 11 system cards.. No admissible signal caps it.
Scope control 2/4
Anchor 2: Scope negotiated per engagement.
evidence: tier 3 (self)
Capped at 2 by grayswan.10 (S.2): Scope set by lab engagements..
Publication rights 2/4
Anchor 2: Publishes; lab reviews with broad redaction.
evidence: tier 3 (self)
mechanism: lab-controlled
Capped at 2 by grayswan.09 (R.3): Findings appear as lab-summarized system-card citations rather than independent reports..
Method transparency 2/4
Anchor 2: Methods described in prose.
evidence: tier 3 (self)
Floored at 2 by grayswan.08 (M.2): Founders wrote foundational jailbreak papers; Arena results partly public.. No admissible signal caps it.
Role incompatibility 0/4
Anchor 0: Sells defense or monitoring products to evaluated labs.
evidence: tier 3 (self)
held at a supportable anchor
Capped at 0 by grayswan.04 (X.1): Sells Shade and Cygnal, the fixes, to the same labs whose models it evaluates..

Values under each evidence policy

DimensionLeads includedRetrieved & confirmedAgainst interestVerified spansPrimary only
Funding1111–
Governance1111–
Personnel1111–
Access depth (lab-granted)2222–
Scope control2222–
Publication rights2222–
Method transparency2222–
Role incompatibility0000–
Score, Lab procurement– Disqualifying floor, 8/8– Disqualifying floor, 8/8– Disqualifying floor, 8/8– Disqualifying floor, 8/8– Unevidenced, 0/8
Score, Regulator or auditor– Disqualifying floor, 8/8– Disqualifying floor, 8/8– Disqualifying floor, 8/8– Disqualifying floor, 8/8– Unevidenced, 0/8
Score, Public trust– Disqualifying floor, 8/8– Disqualifying floor, 8/8– Disqualifying floor, 8/8– Disqualifying floor, 8/8– Unevidenced, 0/8
Score, Equal weights– Disqualifying floor, 8/8– Disqualifying floor, 8/8– Disqualifying floor, 8/8– Disqualifying floor, 8/8– Unevidenced, 0/8

Traced money and ties

hop 0: 1 row; unattributed: 1 row (investment $40.0M). Confirmed rows: 2 of 2 (1 excluded after a re-fetch disagreed or could not be verified: T81) Dollar sums: confirmed + unaudited USD rows only; imported figures are not re-derived and never summed. Second hop traced for 1 of 2 sources: untraced Wing Venture Capital. Ties: none within two steps recorded. Checked and not found: 0.

Ledger

Money in

Funding graph, focused

Every one-way chain to a lab and to an evaluator at full strength, everything else faded. Hover any name to trace its connections; click a name to open its page.

The funding graph around Gray Swan Teal lines are money (transfers); amber lines are roles. Solid: confirmed; dashed: imported. Hover a name to trace its chains to the labs and evaluators — each chain runs one way across the columns, never doubling back; hover a line for the row. Every element is a row in data/ledger/. Labs Direct lab ties Two steps Three or more Public or unattributed Evaluators Amazon Anthropic G42 Google / Google DeepMind Meta Microsoft OpenAI Thinking Machines Lab xAI AI Safety Fund (Frontier Model Alexandr Wang Andreessen Horowitz Anthropic employees (personal Ben Mann D.E. Shaw Ventures David Farhi Dustin Moskovitz Frontier-lab employees and alu Holden Karnofsky Jaan Tallinn Jeffrey Ladish Macroscopic Ventures (formerly Miles Brundage Neil Chowdhury Nvidia OpenAI employees (personal hol OpenAI Foundation Peter Mattson Sequoia Capital Zico Kolter Adam Gleave Artificial Intelligence Underw Clement Delangue Coefficient Giving (formerly O Good Ventures Foundation Jason Droege Longview Philanthropy Marco Mascorro Paul Christiano Rajiv Dattani Survival and Flourishing Fund Conrad Stosz Dan Hendrycks Mike McCormick Alec Radford Alignment Research Center Constellation Research Center ELMA Philanthropies Emerson Collective EU budget (Digital Europe Prog Fifty Years (50Y) Founders Pledge Founders Pledge (frontier AI f Gates Foundation Halcyon Futures High Tide Foundation Hillspire (Schmidt family offi Hudson River Trading Jacob Hilton MacKenzie Scott Magarac Venture Partners Obvious Ventures Redpoint Ventures Renaissance Philanthropy Salesforce Ventures Samsung Next Schmidt Sciences Silicon Valley Community Found Skoll Foundation Snowflake Ventures Swish Ventures Sympatico Ventures The Audacious Project (TED) UK government (DSIT) US government (NIST appropriat Valhalla Foundation Vanguard Charitable Wing Venture Capital Y Combinator Andon Labs Apollo Research AVERI Center for AI Safety Epoch AI EquiStamp EU AI Office FAR.AI Gray Swan Hugging Face Open Alignment In Irregular (formerly Pattern La METR Microsoft AI Red Team MLCommons Nemesys Insights Palisade Research RAND Corporation Redwood Research SaferAI Scale AI (SEAL) SecureBio Transluce UK AI Security Institute US CAISI (NIST)