Tech Meridian ← ENTITY INDEX
PROMY MERIDIAN RU

TOPIC · ENTITY #433

self-evolving harness

Related event timeline, sources and context from the news index.

EVENT TIMELINE

2

RESEARCH · 1 SOURCE · arXiv cs.AI

ArXiv preprint: agent edits its own harness via multi-task self-evolution

The paper (arXiv:2609.38372v1) proposes a framework in which a frozen language-model both solves tasks and, using the same harness, acts as a proposer that directly edits the harness that runs it; evolution draws tasks from five diverse benchmarks with strict train/held-out separation and evaluates on five additional out-of-distribution benchmarks. Starting from a 49-line seed harness and using multi-task pretraining followed by continual training, the evolved harness improves average scores by 4.48 points in-distribution and 12.64 points out-of-distribution, surpassing Codex in-distribution and matching it out-of-distribution; continued evolution on Claw-Eval raises that benchmark from 66.17 to 68.06, exceeding Codex; the paper analyzes emergent mechanisms such as output truncation, history compaction, and independent review.

6.0

RESEARCH · 1 SOURCE · arXiv cs.AI

Asclepius: adaptive harness improves long-horizon clinical LLM agents

This arXiv paper evaluates long-horizon failures of LLM agents in the Clinical Environment Simulator (CES) and identifies three coupled failure modes—instruction-adherence drift, treatment incompleteness, and a severity-equity timeliness gap. The authors introduce Asclepius, a scaffolding that includes a self-evolving harness, an external clinical skills library, and three subagents; on held-out batches it improves critical-action correctness by 22% (p = 0.024) and, across the full ten-batch set, reports up to 25% improvement on critical actions and 13% on timeliness while preserving diagnostic accuracy.

7.0