Tech Meridian ← ENTITY INDEX
PROMY MERIDIAN RU

TOPIC · ENTITY #28243

cyber@collinear.ai

Related event timeline, sources and context from the news index.

EVENT TIMELINE

1

RESEARCH · 1 SOURCE · Hugging Face

Collinear AI publishes CWE-bench v2: 100 open tasks to evaluate LLM cyber defenses

Collinear AI released CWE-bench v2, an open public set of 100 deterministic Harbor tasks (Dockerized environments + verifiers) covering 91 CWEs for evaluating and training models on finding and fixing security weaknesses; the dataset, grader, and harness are open on Hugging Face and a held-out set is available on request (cyber@collinear.ai). Leaderboard results reported 11 evaluated models with Gemini 4 Argon leading (67.8% pass@1, 81.0% pass@4) narrowly ahead of Claude Opus 5.5, and cost/performance tradeoffs highlighted for DeepSeek V4.1 Flash, Opus, and Gemini.

7.0