Context Language Models let LLMs edit and manage their own context to boost performance
Researchers from Meta, MIT and the University of Washington propose “Context Language Models” (CLMs), an approach that treats model context as an editable file the model can rewrite to preserve facts, drop irrelevant information, and develop reusable context-management strategies. Evaluated on benchmarks (BrowseComp-Plus, EdgeBench, ContextBench) the paper reports substantial gains — e.g., zero-shot CLMs showed +11.4% accuracy with 21.5% fewer FLOPs on BrowseComp-Plus, and reinforcement learning improved Qwen3.5-9B on BrowseComp-Plus from 28.8% to 42.5% while reducing FLOPs — while also noting open risks such as irrecoverable deletions, prompt-injection channels, cache invalidation, and uncertain real-world robustness.