Experts warn overreliance on AI "refusal" safety mechanisms
The piece argues that modern large language models are routinely trained to refuse harmful prompts (a practice popularized by Anthropic’s 2021 call for models to be helpful, honest, and harmless), but those refusal mechanisms are probabilistic, imperfect, and can be bypassed. Relying on refusal as the primary safety barrier risks both failure modes that enable misuse and broader harms such as undue censorship when companies or governments set secretive refusal policies.