Evaluator Bench
evaluator; distance from a lab: unattributed

Dreadnode

Scorecard

Offensive-security firm named by Google DeepMind as an external expert on Gemini testing.

VC-backed, Remote. Vendor / red-team co.; listed with commercial and first-party. Confidence low. Domains: cyber.

Conditional floor 7/8 evidenced under the standard policy Scores by preset: Lab procurement 42; Regulator or auditor 42; Public trust 44; Equal weights 43. Weakest evidenced dimension: governance 1/4. At least one evidenced dimension at 1: usable with conditions the card names.

What would move the score. Published engagement terms and a first public report.

Dissent, lower. Publication rights (1 to 0). Nothing from the Gemini engagement has reached the public: no summary, no finding, only the firm's name in Google's launch post and a spokesperson's sentence to Time. A name mention is not a lab-edited summary. Anchor 0 reads 'no publication, or lab approval required', and on the documented record there is no publication at all.

Dissent, higher. Access depth (1 to 2). Google's external-testing programme shares pre-release models with selected experts for structured testing over a period before launch, and Dreadnode was named for both Gemini 2.5 Pro and Gemini 3. If the engagement ran for weeks against a pre-release checkpoint, that is extended-time access, anchor 2, rather than a one-off pre-release API test.

Each value is the tightest admissible cap or, with no cap, the highest admissible floor, under RULES.md. The binding signal is highlighted. A dash means no admissible signal sets a bound under the standard policy.

Funding 2/4
Anchor 2: Labs pay per engagement; otherwise diversified.
evidence: tier 3 (self)
Capped at 2 by dreadnode.05 (F.3): Lab-paid engagements..
Governance 1/4
Anchor 1: VC-backed for-profit with no published COI policy.
evidence: tier 3 (self)
Capped at 1 by dreadnode.02 (G.2): Venture-backed; no published COI policy found..
Personnel –
No admissible evidence under the standard policy.
With leads included: 2/4
evidence: tier 3 (self)
Unevidenced under this policy: no admissible signal sets a bound. Not counted: dreadnode.06 (no confirmed source (unverifiable)).
Access depth (lab-granted) 1/4
Anchor 1: Pre-release API with safeguards on.
evidence: tier 3 (self)
mechanism: lab-controlled
Floored at 1 by dreadnode.01 (A.1): Named by Google DeepMind as an external cyber expert on Gemini testing.. No admissible signal caps it.
Scope control 2/4
Anchor 2: Scope negotiated per engagement.
evidence: tier 3 (self)
Capped at 2 by dreadnode.07 (S.2): Scope set by lab..
Publication rights 2/4
Anchor 2: Publishes; lab reviews with broad redaction.
evidence: tier 3 (self)
mechanism: lab-controlled
Capped at 2 by dreadnode.03 (R.3): Evaluation terms and results are not public..
Method transparency 2/4
Anchor 2: Methods described in prose.
evidence: tier 3 (self)
floor and cap disagree
Conflict: floor 3 from dreadnode.09 (M.1) against cap 1 from dreadnode.08 (M.2); resolved at 2 by M.2: See assessments.M.resolution: engagement-level closure (cap 1) against open self-directed benchmark code (floor 3); resolved at anchor 2, methods described in prose, consistent with Gray Swan and Scale.
Resolution: M.2 decides 2. See assessments.M.resolution: engagement-level closure (cap 1) against open self-directed benchmark code (floor 3); resolved at anchor 2, methods described in prose, consistent with Gray Swan and Scale.
Role incompatibility 2/4
Anchor 2: Consults for labs.
evidence: tier 3 (self)
Capped at 2 by dreadnode.04 (X.1 (second sentence)): Sells offensive-security products..

Values under each evidence policy

DimensionLeads includedStandardAgainst interestVerified spansPrimary only
Funding2222
Governance1111
Personnel2
Access depth (lab-granted)1111
Scope control2222
Publication rights2222
Method transparency2212
Role incompatibility2222
Score, Lab procurement43 Conditional floor, 8/842 Conditional floor, 7/840 Conditional floor, 7/842 Conditional floor, 7/8Unevidenced, 0/8
Score, Regulator or auditor43 Conditional floor, 8/842 Conditional floor, 7/839 Conditional floor, 7/842 Conditional floor, 7/8Unevidenced, 0/8
Score, Public trust45 Conditional floor, 8/844 Conditional floor, 7/843 Conditional floor, 7/844 Conditional floor, 7/8Unevidenced, 0/8
Score, Equal weights44 Conditional floor, 8/843 Conditional floor, 7/839 Conditional floor, 7/843 Conditional floor, 7/8Unevidenced, 0/8

Traced money and ties

no inflow rows yet. Confirmed rows: 0 of 0. Dollar sums: confirmed + unaudited USD rows only; imported figures are not re-derived and never summed. Second hop traced for 0 of 0 sources. Ties: none within two steps recorded. Bounded negatives on file: 0.

Ledger

No rows yet. Add one in data/ledger/.

Funding graph, focused

Neighbours at full strength, everything else faded. Hover any name to move the focus; click a name to open its page.

The funding graph around Dreadnode Teal lines are money (transfers); amber lines are roles. Solid: confirmed; dashed: imported. Hover a name to isolate it and its neighbours; hover a line for the row. Every element is a row in data/ledger/. Labs Direct lab ties Two steps Three or more Public or unattributed Evaluators Amazon Anthropic G42 Google / Google DeepMind Meta Microsoft OpenAI Thinking Machines Lab xAI AI Safety Fund (Frontier Model Alexandr Wang Andreessen Horowitz Anthropic employees (personal Ben Mann D.E. Shaw Ventures David Farhi Dustin Moskovitz Frontier-lab employees and alu Holden Karnofsky Jaan Tallinn Jeffrey Ladish Macroscopic Ventures (formerly Miles Brundage Neil Chowdhury Nvidia OpenAI employees (personal hol OpenAI Foundation Peter Mattson Sequoia Capital Zico Kolter Adam Gleave Artificial Intelligence Underw Clement Delangue Coefficient Giving (formerly O Good Ventures Foundation Jason Droege Longview Philanthropy Marco Mascorro Paul Christiano Rajiv Dattani Survival and Flourishing Fund Conrad Stosz Dan Hendrycks Mike McCormick Alec Radford Alignment Research Center Constellation Research Center ELMA Philanthropies Emerson Collective EU budget (Digital Europe Prog Fifty Years (50Y) Founders Pledge Founders Pledge (frontier AI f Gates Foundation Halcyon Futures Hillspire (Schmidt family offi Hudson River Trading Jacob Hilton MacKenzie Scott Magarac Venture Partners Obvious Ventures Redpoint Ventures Renaissance Philanthropy Salesforce Ventures Samsung Next Schmidt Sciences Silicon Valley Community Found Skoll Foundation Snowflake Ventures Swish Ventures Sympatico Ventures The Audacious Project (TED) UK government (DSIT) US government (NIST appropriat Valhalla Foundation Vanguard Charitable Wing Venture Capital Y Combinator Andon Labs Apollo Research AVERI Center for AI Safety Epoch AI EquiStamp EU AI Office FAR.AI Gray Swan Hugging Face Open Alignment In Irregular (formerly Pattern La METR Microsoft AI Red Team MLCommons Nemesys Insights Palisade Research RAND Corporation Redwood Research SaferAI Scale AI (SEAL) SecureBio Transluce UK AI Security Institute US CAISI (NIST)