Tech Meridian ← ENTITY INDEX
PROMY MERIDIAN RU

COMPANY · ENTITY #12705

Asta

Related event timeline, sources and context from the news index.

EVENT TIMELINE

2

RESEARCH · 1 SOURCE · Hugging Face

AI2 releases 'Old Ideas, Novel Problems' benchmark showing LLM novelty judges are unstable

AI2 published a study and public benchmark, 'Old Ideas, Novel Problems', evaluating how reliably large language models judge the novelty of research ideas. Using an automated pipeline built on ICLR 2026 peer reviews, two test settings (Human-Only: 154 high-novel / 145 low-novel ideas; Human+Generated: 154 human ideas paired with 154 LLM-generated ideas), and six LLM judges (GPT-5.1/5.2/5.4 and Claude Sonnet/Opus variants), they find judgments are highly sensitive to small setup changes (a prompt tweak shifted accuracy by >50 percentage points), retrieval and extra reasoning do not consistently help, and two purpose-built systems underperformed a simple prompted Claude Opus 4.6 baseline.

7.0

MODELS · 1 SOURCE · Hugging Face

Asta open-sources AstaBrief 8B, a fast cited-report model

Asta released AstaBrief 8B, an 8-billion-parameter model that generates cited scientific reports from a research question and retrieved literature excerpts; it is deployed in Asta’s Generate a report feature as Fast mode alongside Claude-powered Thinking mode and the team is open-sourcing the model weights, training data, and an example local workflow. AstaBrief—built from Qwen3-8B with SFT and DPO-focused training data—produces reports about 3.5× faster in Asta’s pipeline (51.1s vs 178.5s) and was mostly trained and evaluated in 2025.

7.0