Tech Meridian ← ENTITY INDEX
PROMY MERIDIAN RU

COMPANY · ENTITY #32485

Aryo Lotfi

Related event timeline, sources and context from the news index.

EVENT TIMELINE

2

RESEARCH · 1 SOURCE · Apple Machine Learning Research

On the Importance of Gating: how gating steers memorization vs in‑context learning in SSMs

Researchers show theoretically and empirically that the gating mechanism in state space models (SSMs) often drives training toward an in‑weights memorization solution and can delay or prevent convergence to correct in‑context learning, while also sometimes improving generalization to longer sequences. The paper analyzes how gating shapes both training dynamics and long‑sequence generalization in linear‑time sequence models.

7.0

RESEARCH · 1 SOURCE · Apple Machine Learning Research

Weighted State Souping for efficient long-context retrieval (PALM @ NeurIPS 2026)

The paper proposes weighted state souping, a method that learns query-dependent weights to compose cached state encodings from state space models (SSMs). The authors report substantial improvements on long-context tasks (single- and multi-hop QA, needle-in-a-haystack retrieval, variable tracking, tool use), present a sparse variant with near-constant encoding cost, and give theoretical analysis; the work was accepted to the PALM workshop at NeurIPS 2026.

7.0