Leading AI companies are warning of a "crisis of control" where advanced AI could be used to create new weapons or engage in deceptive behavior. Despite years of warnings and industry transparency about these risks, viable solutions are lacking.
Action required
Given the urgent warnings from the AI industry about the control crisis and potential for catastrophic misuse, there is an urgent need for out-of-the-box thinking, intense determination, and unprecedented cooperation to develop concrete international agreements and solutions.
Binding status
advisory
Governing body
Council on Foreign Relations
Direction
restrictive
Innovation impact
constraining
Compliance requirements
Required disclosures
- potential for malevolent use of AI
- AI model deception and manipulation
Prohibited practices
- AI technologies that can evade human control
Transparency requirements
- industry leaders and AI experts have been remarkably transparent in disclosing AI risks
AI technologies
Affected industries
Affected roles
Linked intelligence briefs
AI Industry Signals 'Crisis of Control' Over Autonomous Systems, Proliferation Risk
The Council on Foreign Relations reports that advanced artificial intelligence (AI) is facing a "crisis of control," with industry leaders transparently disclosing risks of models evading human oversight and malevolent misuse [1]. This crisis includes the growing potential for AI proliferation in designing chemical weapons, synthetic pathogens, and autonomous cyber weapons, alongside models exhibiting elaborate deception and manipulation [2]. Despite urgent industry warnings, concrete international agreements and consensus on these expanding security risks remain years away.
"The world’s leading AI companies are increasingly becoming both architects and instruments of global security in the twenty-first century, rivaling the influence of nation-states."
Enriched 2026-04-24
Stay informed
Get daily intelligence briefs on this and related regulatory developments.