Evaluator Bench
evaluator; distance from a lab: 1

Gray Swan

Scorecard

Crowdsourced adversarial testing (Arena) plus Shade and Cygnal defense products; cited in 11 recent system cards.

VC-backed, Pittsburgh, US. Confidence high. Domains: jailbreak, cyber, misuse. Scores by preset: Lab procurement 40; Regulator or auditor 40; Public trust 35; Equal weights 38. Weakest dimension: role incompatibility 0/4.

What would move the score. Structural separation of the evaluation business, and independent governance for the OpenAI-related conflict beyond personal recusal.

Funding 1/4
Material revenue or investment from evaluated labs or their investors.
evidence: tier 3 (self)
Anchor 1 on funding given the cited signals.
Governance 1/4
VC-backed for-profit with no published COI policy.
evidence: tier 3 (self)
Anchor 1 on governance given the cited signals.
Personnel 1/4
Leaders hold equity or advisory roles at labs; informal recusal.
evidence: tier 3 (self)
Anchor 1 on personnel given the cited signals.
Access depth (lab-granted) 3/4
Helpful-only or weights-level access, chain of thought, logs, on-site.
evidence: tier 3 (self)
Anchor 3 on access given the cited signals.
Scope control 2/4
Scope negotiated per engagement.
evidence: tier 3 (self)
Anchor 2 on scope given the cited signals.
Publication rights 2/4
Publishes; lab reviews with broad redaction.
evidence: tier 3 (self)
Anchor 2 on publication given the cited signals.
Method transparency 2/4
Methods described in prose.
evidence: tier 4 (press)
Anchor 2 on methods given the cited signals.
Role incompatibility 0/4
Sells defense or monitoring products to evaluated labs.
evidence: tier 3 (self)
Anchor 0 on products given the cited signals.

Traced money and ties

hop 0: 1 row; unattributed: 1 row (investment $40.0M). Confirmed rows: 2 of 2 (1 quarantined: T81). Dollar sums: confirmed + unaudited USD rows only; imported figures are not re-derived and never summed. Second hop traced for 1 of 2 sources: untraced Wing Venture Capital. Ties: none within two steps recorded. Bounded negatives on file: 0.

Ledger

Money in

Roles hosted

One hop away

Anthropic, Hudson River Trading, Zico Kolter, Magarac Venture Partners, Obvious Ventures, Samsung Next, Snowflake Ventures, Wing Venture Capital

Funding graph, focused

Neighbours at full strength, everything else faded. Hover any name to move the focus; click a name to open its page.

The funding graph around Gray Swan Teal lines are money (transfers); amber lines are roles. Solid: confirmed; dashed: imported. Hover a name to isolate it and its neighbours; hover a line for the row. Every element is a row in data/ledger/. Labs Direct lab ties Two steps Three or more Public or unattributed Evaluators Amazon Anthropic G42 Google / Google DeepMind Meta Microsoft OpenAI Thinking Machines Lab xAI AI Safety Fund (Frontier Model Alexandr Wang Andreessen Horowitz Anthropic employees (personal Ben Mann D.E. Shaw Ventures David Farhi Dustin Moskovitz Frontier-lab employees and alu Holden Karnofsky Jaan Tallinn Jeffrey Ladish Macroscopic Ventures (formerly Miles Brundage Neil Chowdhury Nvidia OpenAI employees (personal hol OpenAI Foundation Peter Mattson Sequoia Capital Zico Kolter Adam Gleave Artificial Intelligence Underw Clement Delangue Coefficient Giving (formerly O Good Ventures Foundation Jason Droege Longview Philanthropy Marco Mascorro Paul Christiano Rajiv Dattani Survival and Flourishing Fund Conrad Stosz Dan Hendrycks Mike McCormick Alec Radford Alignment Research Center Constellation Research Center ELMA Philanthropies Emerson Collective EU budget (Digital Europe Prog Fifty Years (50Y) Founders Pledge Founders Pledge (frontier AI f Gates Foundation Halcyon Futures Hillspire (Schmidt family offi Hudson River Trading Jacob Hilton MacKenzie Scott Magarac Venture Partners Obvious Ventures Redpoint Ventures Renaissance Philanthropy Salesforce Ventures Samsung Next Schmidt Sciences Silicon Valley Community Found Skoll Foundation Snowflake Ventures Swish Ventures Sympatico Ventures The Audacious Project (TED) UK government (DSIT) US government (NIST appropriat Valhalla Foundation Vanguard Charitable Wing Venture Capital Y Combinator Andon Labs Apollo Research AVERI Center for AI Safety Epoch AI EquiStamp EU AI Office FAR.AI Gray Swan Hugging Face Open Alignment In Irregular (formerly Pattern La METR Microsoft AI Red Team MLCommons Nemesys Insights Palisade Research RAND Corporation Redwood Research SaferAI Scale AI (SEAL) SecureBio Transluce UK AI Security Institute US CAISI (NIST)