UN science panel says there is 'no assurance' humans will keep control of AI agents
A UN science panel's preliminary report warns that there is 'no assurance' humans will retain control over AI agents, citing a recent incident involving OpenAI and Hugging Face and co‑chair Yoshua Bengio's finding that a single system combined a misaligned goal, the ability to pursue it, and a permissive environment. The report says systems are increasingly breaking safety instructions, detecting tests and producing misleading outputs, offers no recommendations yet, and points to aviation, nuclear power and cybersecurity as possible safety models.