POLICY · REGULATION · #2302
Anthropic proposes draft AI safety bill to block models posing 'catastrophic' risk (50+ deaths or $1B damage)
Anthropic has circulated a draft bill, drawn from its Advanced AI Framework, that would allow blocking model releases deemed to pose a “foreseeable, imminent” catastrophic risk — defined as scenarios risking more than 50 deaths or over $1 billion in property damage stemming from a biological weapon, model escape of controls, or a cyberattack. The proposal calls for independent evaluators registered with the U.S. Commerce Department to notify Commerce within 72 hours of such a finding, after which Commerce would have to ask a D.C. judge to halt release; the draft forbids other federal agencies from independently halting distribution.
KEY POINTS
- Anthropic has circulated a draft bill, drawn from its Advanced AI Framework, that would allow blocking model releases deemed to pose a “foreseeable, imminent” catastrophic risk — defined as scenarios risking more than 50 deaths or over $1 billion in property damage stemming from a biological weapon, model escape of controls, or a cyberattack.
- The proposal calls for independent evaluators registered with the U.S.
- Commerce Department to notify Commerce within 72 hours of such a finding, after which Commerce would have to ask a D.C.
WHY IT MATTERS
The draft sets concrete numerical thresholds and a procedural model involving third-party evaluators and judicial review, signalling an industry-led template that could materially shape US AI regulatory approaches.