Tech Meridian ← ENTITY INDEX
PROMY MERIDIAN RU

MODEL · ENTITY #11642

Llama-3.1-8B

Related event timeline, sources and context from the news index.

EVENT TIMELINE

3

RESEARCH · 1 SOURCE · arXiv cs.AI

Long-context degradation is a sampling problem; top-nsigma prevents collapse at high temperature

An arXiv paper (arXiv:2611.22148v1) tests 29 open-weight models (1B–122B) on ten long-context benchmarks including retrieval out to one million tokens and finds that samplers which keep their candidate pool small as temperature rises (notably top-nsigma) retain accuracy, while samplers that admit many low-probability tokens (top-p, top-k, Top-H) collapse at high temperatures. The authors report that pool size predicts judged quality (Spearman −0.77), give examples on Llama-3.1-8B and Qwen3.5 (e.g., top-p/top-k/Top-H solve 0/100 GitHub issues at temperature 2 vs. top-nsigma 46–62) and release code and data.

7.0

RESEARCH · 1 SOURCE · arXiv cs.AI

Don't Pick a Winner (arXiv:2610.36169v1) — priors outperform fixed rules for RAG conflicts

The authors present a decision-theoretic analysis and experiments showing that fixed rules for resolving disagreements between a retrieval context and a model are generically suboptimal; resolving conflicts requires separate evidence about each source plus a prior on how often the context is correct. On the GRACE benchmark they implement notes with calibrated confidences, a two-voice reader, and a selector that applies a prior π; with π set to the true share of correct contexts the system raises overall scores to 45.3 (Qwen3.5-35B-A3B) and 35.0 (Llama-3.1-8B) versus best baselines of 29.4 and 27.5, and beats CK-PLUG and TCR on preregistered ClashEval by 12 and 26 points, while gains disappear where the model lacks the underlying knowledge.

7.0

RESEARCH · 1 SOURCE · arXiv cs.AI

NAQD-Env: benchmark for selective withdrawal in language agents

The paper (arXiv:2609.38460v1) introduces NAQD-Env, a synthetic deterministic benchmark that evaluates language-agent decisions to withdraw, preserve, and resume actions across 11 dependency families and explicit evidence/authorization inputs. Evaluating three open-weight instruction-tuned models (Qwen2.5-7B, Qwen2.5-3B, Llama-3.1-8B) under three prompt conditions on 350 scenarios (3,150 episodes) finds very low withdrawal recall (≤0.06), no valid resumptions at eligible opportunities, and only one episode matching the full reference policy; supervised fine-tuning raised Qwen2.5-3B decision accuracy from ~0.45–0.54 to ~0.83–0.92 but introduced other faults.

6.0