Evaluator Bench
evaluator; distance from a lab: 1

Microsoft AI Red Team

Scorecard

External red team for other labs' models; not independent of Big Tech.

Big Tech unit, Redmond, US. First-party lab team; listed with commercial and first-party. Confidence med. Domains: jailbreak, cyber, misuse.

Disqualifying floor 7/8 evidenced · Retrieved & confirmed Scores by preset: Lab procurement –; Regulator or auditor –; Public trust –; Equal weights –. Weakest evidenced dimension: governance 0/4. At least one evidenced conflict dimension at 0: not a candidate for an independence-critical role until the floor moves. Access and methods never set a band.

The weighted numbers are hidden until you ask for them: two readers with different priorities see different numbers, and neither is the site's.

What would move the score. Not a candidate for an independence-critical role; useful as a supplementary red team.

Dissent, lower. Governance (1 to 0). The Microsoft AI Red Team is an internal function formed in 2018 inside a frontier developer, described on Microsoft's own Learn hub and Security Blog; G.6 and F.1 place a business unit of a developer at 0. Only the unaudited status of two pages that load and say exactly this holds the value at 1; both are the organization's own admissions.

Dissent, higher. Publication rights (1 to 2). The team publishes under its own name: a whitepaper on lessons from red teaming more than 100 generative AI products, case studies, and the open-source PyRIT toolkit. R.3's second clause caps an organization that publishes its own reports on other work at 2, not 1, even where findings on other labs' models stay inside system cards.

Each value is the tightest admissible cap or, with no cap, the highest admissible floor, under RULES.md. The binding signal is highlighted. A dash means no admissible signal sets a bound under the Retrieved & confirmed policy.

Funding –
No admissible evidence under the standard policy.
With leads included: 1/4
evidence: tier 4 (press)
Unevidenced under this policy: no admissible signal sets a bound. Not counted: msft.01 (no confirmed source (unaudited)).
Curator: Anchor 0 on funding given the cited signals. Evidence-limited: the cited sources are imported or unaudited only, so the value is held at 1 (the reading on the record would be 0) until a live source is confirmed.
Governance 0/4
Anchor 0: Unit or subsidiary of a lab or a lab's investor.
evidence: tier 3 (self)
Capped at 0 by msft.02 (G.6): Business unit of a frontier developer.; capped at 0 by msft.09 (G.6): Microsoft's AI red team has operated since 2018 as an internal function and reports having red-teamed more than 100 generative AI products; it is separate from product teams, not from the developer..
Curator: Anchor 0 on governance given the cited signals.
Personnel 0/4
Anchor 0: Leaders hold governance roles at an evaluated lab, no recusal.
evidence: tier 3 (self)
Capped at 0 by msft.06 (P.7): Employees of a lab..
Access depth (lab-granted) 3/4
Anchor 3: Helpful-only or weights-level access, chain of thought, logs, on-site.
evidence: tier 3 (self)
mechanism: lab-controlled
held at a supportable anchor
Floored at 3 by msft.05 (A.5): Deep access when engaged.. No admissible signal caps it. Held: C16: a 4 needs a tier-1/2 source or two independent sources, one not self-published.
Scope control 2/4
Anchor 2: Scope negotiated per engagement.
evidence: tier 3 (self)
Capped at 2 by msft.07 (S.2): Scope set by engagement..
Publication rights 2/4
Anchor 2: Publishes; lab reviews with broad redaction.
evidence: tier 3 (self)
mechanism: lab-controlled
Capped at 2 by msft.03 (R.3): Findings for other labs are rarely published under the team's own name..
Method transparency 3/4
Anchor 3: Tasks or code partly open.
evidence: tier 3 (self)
Floored at 3 by msft.04 (M.1): Publishes methodology (PyRIT) openly.. No admissible signal caps it.
Role incompatibility 1/4
Anchor 1: Sells products or services other than the evaluation itself to labs or to their customers.
evidence: tier 3 (self)
Capped at 1 by msft.08 (X.2): Sells AI products..

Values under each evidence policy

DimensionLeads includedRetrieved & confirmedAgainst interestVerified spansPrimary only
Funding1––––
Governance0000–
Personnel0000–
Access depth (lab-granted)33–3–
Scope control222––
Publication rights2222–
Method transparency33–3–
Role incompatibility1111–
Score, Lab procurement– Disqualifying floor, 8/8– Disqualifying floor, 7/8– Disqualifying floor, 5/8– Disqualifying floor, 6/8– Unevidenced, 0/8
Score, Regulator or auditor– Disqualifying floor, 8/8– Disqualifying floor, 7/8– Disqualifying floor, 5/8– Disqualifying floor, 6/8– Unevidenced, 0/8
Score, Public trust– Disqualifying floor, 8/8– Disqualifying floor, 7/8– Disqualifying floor, 5/8– Disqualifying floor, 6/8– Unevidenced, 0/8
Score, Equal weights– Disqualifying floor, 8/8– Disqualifying floor, 7/8– Disqualifying floor, 5/8– Disqualifying floor, 6/8– Unevidenced, 0/8

Traced money and ties

hop 0: 1 row. Confirmed rows: 1 of 1 Dollar sums: confirmed + unaudited USD rows only; imported figures are not re-derived and never summed. Second hop traced for 1 of 1 sources. Ties: none within two steps recorded. Checked and not found: 0.

Ledger

Money in

One hop away

Microsoft

Funding graph, focused

Every one-way chain to a lab and to an evaluator at full strength, everything else faded. Hover any name to trace its connections; click a name to open its page.

The funding graph around Microsoft AI Red Team Teal lines are money (transfers); amber lines are roles. Solid: confirmed; dashed: imported. Hover a name to trace its chains to the labs and evaluators — each chain runs one way across the columns, never doubling back; hover a line for the row. Every element is a row in data/ledger/. Labs Direct lab ties Two steps Three or more Public or unattributed Evaluators Amazon Anthropic G42 Google / Google DeepMind Meta Microsoft OpenAI Thinking Machines Lab xAI AI Safety Fund (Frontier Model Alexandr Wang Andreessen Horowitz Anthropic employees (personal Ben Mann D.E. Shaw Ventures David Farhi Dustin Moskovitz Frontier-lab employees and alu Holden Karnofsky Jaan Tallinn Jeffrey Ladish Macroscopic Ventures (formerly Miles Brundage Neil Chowdhury Nvidia OpenAI employees (personal hol OpenAI Foundation Peter Mattson Sequoia Capital Zico Kolter Adam Gleave Artificial Intelligence Underw Clement Delangue Coefficient Giving (formerly O Good Ventures Foundation Jason Droege Longview Philanthropy Marco Mascorro Paul Christiano Rajiv Dattani Survival and Flourishing Fund Conrad Stosz Dan Hendrycks Mike McCormick Alec Radford Alignment Research Center Constellation Research Center ELMA Philanthropies Emerson Collective EU budget (Digital Europe Prog Fifty Years (50Y) Founders Pledge Founders Pledge (frontier AI f Gates Foundation Halcyon Futures High Tide Foundation Hillspire (Schmidt family offi Hudson River Trading Jacob Hilton MacKenzie Scott Magarac Venture Partners Obvious Ventures Redpoint Ventures Renaissance Philanthropy Salesforce Ventures Samsung Next Schmidt Sciences Silicon Valley Community Found Skoll Foundation Snowflake Ventures Swish Ventures Sympatico Ventures The Audacious Project (TED) UK government (DSIT) US government (NIST appropriat Valhalla Foundation Vanguard Charitable Wing Venture Capital Y Combinator Andon Labs Apollo Research AVERI Center for AI Safety Epoch AI EquiStamp EU AI Office FAR.AI Gray Swan Hugging Face Open Alignment In Irregular (formerly Pattern La METR Microsoft AI Red Team MLCommons Nemesys Insights Palisade Research RAND Corporation Redwood Research SaferAI Scale AI (SEAL) SecureBio Transluce UK AI Security Institute US CAISI (NIST)