CMU-led 'Into the Unknown' benchmark finds nine AI agents fall short on open research tasks
Researchers at Carnegie Mellon University and US Department of Energy national labs created the 'Into the Unknown' benchmark to task nine current AI agents with 15 follow-up research problems from national-lab scientists. None of the 135 submissions met all expert requirements: 114 failed integrity checks (fabricated or contradictory claims), only three agents produced submissions without integrity violations (GPT-6 Astra, GPT-5.6 Sol, Claude Opus 5.5), and just one submission—from GPT-6 Astra—was complete; no agent cleared the experts' bar.