evaluator; distance from a lab: 1
Irregular (formerly Pattern Labs)
Scorecard
Offensive-cyber evaluator cited in OpenAI and Anthropic system cards; SOLVE framework used by UK AISI. Pattern Labs and Irregular are the same company.
VC-backed, Tel Aviv, IL / San Francisco, US. Confidence high. Domains: cyber, misuse. Scores by preset: Lab procurement 47; Regulator or auditor 49; Public trust 40; Equal weights 44. Weakest dimension: funding 1/4.
What would move the score. A published COI policy, disclosure of lab revenue share, and a firewall between evaluations and the security-products business.
Funding 1/4
Material revenue or investment from evaluated labs or their investors.
evidence: tier 1 (filing/index)
Anchor 1: a $6.8M Coefficient Giving grant appears in the index under the former name Pattern Labs (irregular.11; ledger T09 marked differs, unreconciled). A name-search under ‘Irregular’ found nothing (irregular.12), which does not rebut the old-name row — the project treats the two names as the same company. Material lab-adjacent funding with disputed attribution.
- $80M raised in 2025 at a $450M valuation, led by Sequoia and Redpoint; Sequoia is also a major OpenAI investor.
Irregular raises $80M to secure frontier AI models (TechCrunch, 2025-09-17) tier 4 pressconfirmed Partnering with Irregular (Sequoia Capital, 2025-09-17) tier 3 selfconfirmed2026-09-14 - Millions in annual revenue from the labs it evaluates.
Irregular Raises $80 Million (Newswire, 2025-09-17) tier 4 pressconfirmed2026-09-14 - Government clients (UK) alongside labs.
Irregular Raises $80 Million (Newswire, 2025-09-17) tier 4 pressconfirmed2026-09-14 - A Coefficient Giving grant of about $6.8M appears in the index for a venture-backed company; purpose to be verified.
Coefficient Giving grants index (Coefficient Giving, 2026-09-11) tier 1 indeximported2026-09-11 - A search of Coefficient Giving's grants pages under the name Irregular found no grant (snapshot 2026-09-15); the imported row citing $6.8M under Pattern Labs is unreconciled and marked differs.
Coefficient Giving home (Coefficient Giving, 2026) tier 3 selfconfirmed evaluators.csv (24 evaluators: Coefficient and SFF totals, lab money, government contracts, leadership) (Kevin Bass (GitHub), 2026-09-14) tier 2 ledgerunverifiable2026-09-15 - Open: Re-run the Coefficient index search under both Irregular and Pattern Labs and record the snapshot.
Governance 1/4
VC-backed for-profit with no published COI policy.
evidence: tier 4 (press)
Anchor 1 on governance given the cited signals.
- Venture-backed for-profit; no published COI or recusal policy found.
Irregular raises $80M to secure frontier AI models (TechCrunch, 2025-09-17) tier 4 pressconfirmed2026-09-14
Personnel 2/4
Frequent two-way hiring; recusal on request.
evidence: tier 3 (self)
Anchor 2 on personnel given the cited signals.
- Markets itself as embedded with the labs; no recusal or cooling-off policy found.
Partnering with Irregular (Sequoia Capital, 2025-09-17) tier 3 selfconfirmed2026-09-14
Access depth (lab-granted) 3/4
Helpful-only or weights-level access, chain of thought, logs, on-site.
evidence: tier 3 (self)
Anchor 3 on access given the cited signals.
- Deep, repeated pre-deployment access at OpenAI, Anthropic and Google DeepMind; embedded with labs.
Partnering with Irregular (Sequoia Capital, 2025-09-17) tier 3 selfconfirmed2026-09-14
Scope control 2/4
Scope negotiated per engagement.
evidence: tier 3 (self)
Anchor 2 on scope given the cited signals.
- Scope set by lab engagements; no public account of evaluator-set scope.
Partnering with Irregular (Sequoia Capital, 2025-09-17) tier 3 selfconfirmed2026-09-14
Publication rights 2/4
Publishes; lab reviews with broad redaction.
evidence: tier 3 (self)
Anchor 2 on publication given the cited signals.
- Findings appear in system cards for o3, o4-mini, GPT-5 and Claude models.
Irregular raises $80M to secure frontier AI models (TechCrunch, 2025-09-17) tier 4 pressconfirmed Partnering with Irregular (Sequoia Capital, 2025-09-17) tier 3 selfconfirmed2026-09-14
Method transparency 2/4
Methods described in prose.
evidence: tier 3 (self)
Anchor 2 on methods given the cited signals.
- Publishes some method papers; SOLVE framework adopted by UK AISI and Anthropic.
Partnering with Irregular (Sequoia Capital, 2025-09-17) tier 3 selfconfirmed2026-09-14
Role incompatibility 1/4
Sells to labs and to their customers.
evidence: tier 4 (press)
Anchor 1 on products given the cited signals.
- Growth plan is to sell runtime security controls into the same customers it evaluates.
Irregular Raises $80 Million (Newswire, 2025-09-17) tier 4 pressconfirmed2026-09-14
Traced money and ties
hop 0: 1 row; hop 1: 1 row (investment $80.0M). Confirmed rows: 2 of 2 (1 quarantined: T09). Dollar sums: confirmed + unaudited USD rows only; imported figures are not re-derived and never summed. Second hop traced for 2 of 2 sources. Ties: Sequoia Capital (investor, distance 1, confirmed). Bounded negatives on file: 1.
Ledger
Money in
- T09 from Coefficient Giving (formerly Open Philanthropy): grant $6.80M; quarantined — excluded from sums, 2021-2025. cumulative differstier 1 indexhttps://coefficientgiving.org/
- T20 from Sequoia Capital: investment $80.00M; round total, not one investor's check, 2025-09. Series round with Redpoint and angels; $450M valuation confirmedtier 4 presshttps://techcrunch.com/2025/09/17/irregular-raises-80-million-to-secure-frontier-ai-models
- T25 from OpenAI: contract undisclosed, 2023-2025. paid evaluation engagements; millions in annual revenue across lab clients confirmedtier 4 presshttps://www.newswire.com/news/irregular-raises-80-million-to-set-the-security-standards-for-frontier-ai
Bounded negatives
- N19 no grant to Irregular or Pattern Labs found on Coefficient Giving's grants pages [coefficientgiving.org/grants and openphilanthropy.org/grants, name search, snapshot 2026-09-15] unauditedhttps://coefficientgiving.org/
Roles hosted
- R26 Sequoia Capital: investor, 2025-09. confirmedhttps://techcrunch.com/2025/09/17/irregular-raises-80-million-to-secure-frontier-ai-models
- R82 Redpoint Ventures: investor, 2025-09. research pass 2026-09-15; co-lead unauditedhttps://techcrunch.com/2025/09/17/irregular-raises-80-million-to-secure-frontier-ai-models/
- R83 Swish Ventures: investor, 2025-09. research pass 2026-09-15 unauditedhttps://techcrunch.com/2025/09/17/irregular-raises-80-million-to-secure-frontier-ai-models/
Funding graph, focused
Neighbours at full strength, everything else faded. Hover any name to move the focus; click a name to open its page.