Evaluator Bench
evaluator; distance from a lab: 1

Nemesys Insights

Scorecard

Red-teaming firm led by the director of a university red-teaming center; paid assessor on Amazon's Nova model papers; subcontractor on the EU Lot 1 CBRN consortium. Paid contracting work for labs and governments makes this a vendor, not an independent referee.

Private company, capital structure undisclosed, Albany, US. Confidence low. Domains: bio, misuse, assurance. Scores by preset: Lab procurement 46; Regulator or auditor 46; Public trust 44; Equal weights 47. Weakest dimension: funding 1/4. Evidence-limited on 3 dimension(s): values held at the nearest supportable anchor until a live source is confirmed.

What would move the score. Funding disclosure and a published policy on lab clients.

Funding 1/4
Material revenue or investment from evaluated labs or their investors.
evidence: tier 1 (filing/index)
Anchor 1 from the cited rows; low confidence, imported evidence.
Governance 2/4
For-profit or PBC with a published COI policy.
evidence: tier 2 (ledger)
evidence-limited: held at a supportable value
Anchor 1 from the cited rows; low confidence, imported evidence. Evidence-limited: the cited sources are imported or unaudited only, so the value is held at 2 (the reading on the record would be 1) until a live source is confirmed.
Personnel 2/4
Frequent two-way hiring; recusal on request.
evidence: tier 2 (ledger)
Anchor 2 from the cited rows; low confidence, imported evidence.
Access depth (lab-granted) 2/4
Pre-release with safeguards off or extended time.
evidence: tier 2 (ledger)
Anchor 2 from the cited rows; low confidence, imported evidence.
Scope control 2/4
Scope negotiated per engagement.
evidence: tier 2 (ledger)
evidence-limited: held at a supportable value
Anchor 1 from the cited rows; low confidence, imported evidence. Evidence-limited: the cited sources are imported or unaudited only, so the value is held at 2 (the reading on the record would be 1) until a live source is confirmed.
Publication rights 2/4
Publishes; lab reviews with broad redaction.
evidence: tier 2 (ledger)
evidence-limited: held at a supportable value
Anchor 1 from the cited rows; low confidence, imported evidence. Evidence-limited: the cited sources are imported or unaudited only, so the value is held at 2 (the reading on the record would be 1) until a live source is confirmed.
Method transparency 2/4
Methods described in prose.
evidence: tier 2 (ledger)
Anchor 2 from the cited rows; low confidence, imported evidence.
Role incompatibility 2/4
Consults for labs.
evidence: tier 2 (ledger)
Anchor 2 from the cited rows; low confidence, imported evidence.

Traced money and ties

hop 0: 1 row; public: 1 row. Confirmed rows: 2 of 2. Dollar sums: confirmed + unaudited USD rows only; imported figures are not re-derived and never summed. Second hop traced for 2 of 2 sources. Ties: none within two steps recorded. Bounded negatives on file: 1.

Ledger

Money in

Bounded negatives

One hop away

Amazon, EU budget (Digital Europe Programme)

Funding graph, focused

Neighbours at full strength, everything else faded. Hover any name to move the focus; click a name to open its page.

The funding graph around Nemesys Insights Teal lines are money (transfers); amber lines are roles. Solid: confirmed; dashed: imported. Hover a name to isolate it and its neighbours; hover a line for the row. Every element is a row in data/ledger/. Labs Direct lab ties Two steps Three or more Public or unattributed Evaluators Amazon Anthropic G42 Google / Google DeepMind Meta Microsoft OpenAI Thinking Machines Lab xAI AI Safety Fund (Frontier Model Alexandr Wang Andreessen Horowitz Anthropic employees (personal Ben Mann D.E. Shaw Ventures David Farhi Dustin Moskovitz Frontier-lab employees and alu Holden Karnofsky Jaan Tallinn Jeffrey Ladish Macroscopic Ventures (formerly Miles Brundage Neil Chowdhury Nvidia OpenAI employees (personal hol OpenAI Foundation Peter Mattson Sequoia Capital Zico Kolter Adam Gleave Artificial Intelligence Underw Clement Delangue Coefficient Giving (formerly O Good Ventures Foundation Jason Droege Longview Philanthropy Marco Mascorro Paul Christiano Rajiv Dattani Survival and Flourishing Fund Conrad Stosz Dan Hendrycks Mike McCormick Alec Radford Alignment Research Center Constellation Research Center ELMA Philanthropies Emerson Collective EU budget (Digital Europe Prog Fifty Years (50Y) Founders Pledge Founders Pledge (frontier AI f Gates Foundation Halcyon Futures Hillspire (Schmidt family offi Hudson River Trading Jacob Hilton MacKenzie Scott Magarac Venture Partners Obvious Ventures Redpoint Ventures Renaissance Philanthropy Salesforce Ventures Samsung Next Schmidt Sciences Silicon Valley Community Found Skoll Foundation Snowflake Ventures Swish Ventures Sympatico Ventures The Audacious Project (TED) UK government (DSIT) US government (NIST appropriat Valhalla Foundation Vanguard Charitable Wing Venture Capital Y Combinator Andon Labs Apollo Research AVERI Center for AI Safety Epoch AI EquiStamp EU AI Office FAR.AI Gray Swan Hugging Face Open Alignment In Irregular (formerly Pattern La METR Microsoft AI Red Team MLCommons Nemesys Insights Palisade Research RAND Corporation Redwood Research SaferAI Scale AI (SEAL) SecureBio Transluce UK AI Security Institute US CAISI (NIST)