Tech Meridian ← ENTITY INDEX
PROMY MERIDIAN RU

COMPANY · ENTITY #32481

State souping

Related event timeline, sources and context from the news index.

EVENT TIMELINE

1

RESEARCH · 1 SOURCE · Apple Machine Learning Research

Weighted State Souping for efficient long-context retrieval (PALM @ NeurIPS 2026)

The paper proposes weighted state souping, a method that learns query-dependent weights to compose cached state encodings from state space models (SSMs). The authors report substantial improvements on long-context tasks (single- and multi-hop QA, needle-in-a-haystack retrieval, variable tracking, tool use), present a sparse variant with near-constant encoding cost, and give theoretical analysis; the work was accepted to the PALM workshop at NeurIPS 2026.

7.0