Principled Thoughts for Latent Recursive LLM Systems — introduces REST objective (arXiv:2609.36159v1)
New arXiv paper (2609.36159v1) identifies four failure modes of Cross-Entropy–only training for latent reasoning and proposes REST (REpresentation-Supervised Thoughts), a loss that enforces four properties of valid latent ‘thoughts’ (causality, minimality, separability, stability) added to CE. The authors instantiate REST in latent single- and multi-agent systems without inference-time architectural changes and report up to 7.5 percentage points higher accuracy and 30% faster convergence on final answers across seven benchmarks in math, science, medicine, and code generation.