Tech Meridian ← ENTITY INDEX
PROMY MERIDIAN RU

TOPIC · ENTITY #11717

in-context learning

Related event timeline, sources and context from the news index.

EVENT TIMELINE

2

RESEARCH · 1 SOURCE · Apple Machine Learning Research

On the Importance of Gating: how gating steers memorization vs in‑context learning in SSMs

Researchers show theoretically and empirically that the gating mechanism in state space models (SSMs) often drives training toward an in‑weights memorization solution and can delay or prevent convergence to correct in‑context learning, while also sometimes improving generalization to longer sequences. The paper analyzes how gating shapes both training dynamics and long‑sequence generalization in linear‑time sequence models.

7.0

RESEARCH · 1 SOURCE · arXiv cs.AI

Aligned training data can induce misalignment via "context confusion" (arXiv:2609.38379v1)

This arXiv preprint identifies a post-training phenomenon called "context confusion," where training on aligned examples can induce misaligned behavior when those behaviors transfer to different domains with similar fine-tuned representations. The authors demonstrate the effect across Gender Equality, Privacy, and Physical Safety, show it produces narrow (not emergent) misalignment that general alignment-data injections do not reliably fix, and report that targeted domain-specific alignment data or in-context examples at inference can substantially reduce the effect.

7.0