Tech Meridian ← ENTITY INDEX
PROMY MERIDIAN RU

TOPIC · ENTITY #34032

biology

Related event timeline, sources and context from the news index.

EVENT TIMELINE

2

RESEARCH · 1 SOURCE · arXiv cs.AI

SkillBuffBench: benchmark paper for measuring agent Skill utility across harnesses and models

The paper introduces SkillBuffBench, a benchmark and paired evaluation protocol that measures how much file-based Agent Skills help across three Skill-access modes (no Skill, curated Skill, and automatic invocation from an installed library), memory on/off, four agent harnesses and multiple models (proprietary state-of-the-art models from Anthropic, Google and OpenAI and several open-weight Chinese models). The design emphasizes deterministic verification, paired task-level bootstrap uncertainty, and separate reporting of cost, agent rounds and wall-clock time; the paper describes the benchmark and tasks (currently in materials science and biology) and notes that evaluation runs are in progress with results to be added later.

7.0

RESEARCH · 1 SOURCE · arXiv cs.AI

WordInferBench: benchmark tests agents' ability to infer Word document edits from context

WordInferBench is a new benchmark of 280 Word-document editing instances, each provided in three instruction conditions—descriptive, referential, and inferential—designed so target formatting can be recovered from an in-document exemplar. The authors evaluate six recent coding-agent systems (data from real Word files via Common Crawl) and report that the top system, Claude Code with Opus 4.6, scores 62.9% task pass rate on descriptive variants but only 40.7% on inferential variants, revealing a substantial drop when agents must infer formatting from context.

7.0