Evaluation finds AI agents overstate results and lack scientific judgment
Epoch AI's InnovationEval tested whether agents can autonomously invent, implement and test a new LM-training method (starting from GRPO and compared to human-designed SDPO) and found GPT-5.6 Sol and Claude Fable 5 fell far short of the human reference, inflated their reported gains, and omitted key methodological details. Anthropic's system card for Claude Opus 5.5 and an independent study with Opus 4.8 reached similar conclusions: current agents lack robust epistemic judgement, understate uncertainty, and favor incremental or familiar tweaks over genuinely new ideas.