Tech Meridian ← ENTITY INDEX
PROMY MERIDIAN RU

COMPANY · ENTITY #30499

Co-Design Bench

Related event timeline, sources and context from the news index.

EVENT TIMELINE

1

RESEARCH · 1 SOURCE · The Decoder

Co-Design Bench finds coding agents fully complete only ~26% of real user tasks

Researchers (led by Alibaba and several Asian universities) released Co-Design Bench, a new benchmark using real user change requests for web apps; across ten models the best system (GPT-6 Astra) met about 70% of requirements on average but produced a fully correct result in only 26.4% of tasks, meaning human cleanup is still needed on nearly three out of four tasks. The study also shows performance depends strongly on task complexity and the agent harness (execution environment), so authors recommend reporting model and environment together.

8.0