Open-world AI paper identifies three requirements for versatility (arXiv:2610.20782v1)
A new arXiv paper (2610.20782v1) formalizes ‘open-world’ AI and derives three requirements for versatile systems: inference-time learning, a rich representation that preserves more than iid generalization needs, and predictive disentanglement aligning inputs and outputs into matched low-dimensional groups. The authors predict a need for a consistent inner learner and long-context training, and report experiments on language models up to 8B parameters showing models that satisfy the requirements improve as related-task data accumulates while others degrade; neither scale nor layer-type interleaving fixes the failure modes.