Tech Meridian ← ENTITY INDEX
PROMY MERIDIAN RU

MODEL · ENTITY #12348

DeepSeek V4 Pro

Related event timeline, sources and context from the news index.

EVENT TIMELINE

3

RESEARCH · 1 SOURCE · The Decoder

CMU-led 'Into the Unknown' benchmark finds nine AI agents fall short on open research tasks

Researchers at Carnegie Mellon University and US Department of Energy national labs created the 'Into the Unknown' benchmark to task nine current AI agents with 15 follow-up research problems from national-lab scientists. None of the 135 submissions met all expert requirements: 114 failed integrity checks (fabricated or contradictory claims), only three agents produced submissions without integrity violations (GPT-6 Astra, GPT-5.6 Sol, Claude Opus 5.5), and just one submission—from GPT-6 Astra—was complete; no agent cleared the experts' bar.

8.0

RESEARCH · 1 SOURCE · The Decoder

Stanford study: 44% of 50 widely cited LLM claims have expired; mean lifespan 15.7 months

Stanford researchers Owen Queen and James Zou re-tested 50 widely cited empirical claims about large language models using 20 models released between July 2024 and September 2026 and found 44% of the claims have expired, 34% have weakened, 16% still hold, and 6% strengthened; among 22 findings with an estimated expiration date the average lifespan was 15.7 months. Reasoning-related failures expired fastest, behavior/preferences claims were more persistent, results varied widely across contemporary models (e.g., GPT-6.1 Sol and Qwen3.7-Flash showed opposite outcomes on citation fabrication), and the authors recommend reporting model, version, date and publishing prompts/code to enable retesting.

8.0

RESEARCH · 1 SOURCE · arXiv cs.AI

arXiv preprint 'Predictive Credit' v1 finds mixed/inconclusive effects of AI explanations on experimental forecasts

The arXiv preprint "Predictive Credit" (v1) introduces a protocol to measure whether explanations from research agents add predictive value to planned experiments by comparing paired forecasts that vary only in explanation and donor context. Across controlled learning states, 12 Tox21 endpoints and 24 OpenML tasks the authors report largely inconclusive results for natural-explanation credit (e.g., the v5 frozen credit decision was inconclusive and a preregistered Tox21 ROC AUC interval-score harm test was unmet with D-M = -0.0026, 95% interval [-0.0174, 0.0104]); some model-specific interventions did show effects (DeepSeek V4 Pro matched and donor cards reduced secondary Tox21 drift by 64.5% and 59.1%, while DeepSeek V4 Flash raised matched point MAE from 0.01823 to 0.02020). A researcher-authored mechanism control lowered point MAE by 2.60 percentage points versus description, but matched point-accuracy gains over description were not broadly confirmed and many intervals spanned zero.

6.0