Tech Meridian ← ENTITY INDEX
PROMY MERIDIAN RU

COMPANY · ENTITY #10856

Gated DeltaNet

Related event timeline, sources and context from the news index.

EVENT TIMELINE

2

RESEARCH · 1 SOURCE · Hugging Face

StateBench: benchmark for long-context state tracking in language models

StateBench is a new benchmark that measures how well language models track evolving entity state across long documents, organized into four difficulty levels (r-trivial, aperiodic, soluble, general finite) corresponding to increasingly complex kinds of variable assignment. The authors report that recurrent and hybrid architectures (e.g., Gated DeltaNet) generalize farther than transformers on these tasks, while leading frontier models including Gemini 3.8 Flash, Claude Opus 5.5, and GPT-6 Sol/Luna still break down on the hardest, long-dependency cases.

7.0

RESEARCH · 1 SOURCE · arXiv cs.AI

SMat-Attention: structured causal masks that trade off routing complexity and efficiency

This arXiv preprint introduces Structured Matrix Attention (SMat-Attention), a family of causal attention masks whose row supports have VC-dimension d, letting d=1 recover the standard causal mask and larger d enable richer subset-routing. The paper gives chunkwise forward/backward algorithms for hardware efficiency, proves subquadratic prefill work O(T^{2-3/d}+T) for a prescribed family and constant-time per-token decoding after a distant prefix with O(T^{1-1/d}) cached states in fixed-horizon streaming, and reports experiments and learned-routing extensions to Mamba-2 and Gated DeltaNet showing improved recall and comparable small-scale LM performance.

7.0