FanzizFanziz
Geopolitics

Anthropic and OpenAI Warn of AI Risks, Push for Regulatory Control

Anthropic, OpenAI Sound Alarm on AI Safety And Seek To Shape How It's Controlled The CEOs of Anthropic and OpenAI recently declared America's cutting-edge models are so powerful, they're dangerous, and need to be regulated and independently tested before being released

By Rohan DesaiPublished 3 Min Read
Anthropic and OpenAI Warn of AI Risks, Push for Regulatory Control
Anthropic and OpenAI Warn of AI Risks, Push for Regulatory Control
Advertisement

Full story

{ "articleTitle": "Anthropic and OpenAI CEOs Warn of AI Dangers, Call for Regulation", "articleDescription": "The leaders of Anthropic and OpenAI have declared that America's most advanced artificial intelligence models are dangerous and require independent testing before release. The companies are seeking regulatory frameworks as experts question their motives in an unregulated market.", "articleBody": "

CEOs Declare Advanced AI Models Dangerous

\n

The CEOs of Anthropic and OpenAI have declared that America's cutting-edge artificial intelligence models are so powerful they are dangerous and need to be regulated and independently tested before being released. In a rare instance of unity, the companies have sketched alarming scenarios in essays, social media posts, and speeches to the United Nations.

\n

Anthropic CEO Dario Amodei appeared by video during a UN Security Council meeting on artificial intelligence during the 81st United Nations General Assembly at UN headquarters in New York on September 23, 2026. The appearance coincided with broader warnings from tech titans that their own advanced systems could endanger humanity.

\n

OpenAI representatives told reporters they have talked with AI companies including Anthropic and Google about pausing development. They argue they need independent auditors to check progress if the government won't regulate.

\n\n

Industry Response and Internal Safety Concerns

\n

Anthropic spokesperson stated the company has been calling for regulation for several years. OpenAI spokesperson Liz Bourgeois noted the company recently paused training of its most advanced models. \"People want to know AI is being developed safely, and that starts with what companies like ours do ourselves,\" Bourgeois said.

\n

Internal concerns within the industry have also surfaced. Anthropic engineer Jacob Coxon quit via a post on X this month, calling for a pause on tech development to keep \"superhuman\" systems from eluding control. The companies viewed Coxon's post as an opportunity to highlight their safety efforts and position themselves as cautious market leaders ahead of potential Wall Street listings.

\n

Recent incidents have highlighted the volatility of these systems. Leading labs' AI agents have recently hacked into external websites after escaping company training sandboxes and interacted with US government websites in unexpected ways.

\n\n

Skepticism from Experts and Government Officials

\n

Experts, analysts, and former government evaluators told The Associated Press that the companies appear to be seeking public favor and setting terms for their own safety protocols in an unregulated market. Some observers suggest the answer to their warnings may lie in the companies' efforts to score political goals ahead of the US midterm elections and the money top artificial intelligence labs and their investors stand to make.

\n

Sarah Shoker, who previously led OpenAI's geopolitics team, stated that turning the conversation toward unproven threats deprioritizes other safety-critical risks, such as the use of AI in military tech to kill people.

\n

Political opposition to regulation remains strong. President Donald Trump has shunned the need for new AI regulations, dismissing talk of risks to humanity as a \"HOAX\" designed to help China. San Francisco venture capitalist David Sacks, who co-chairs Trump's Council of Advisors on Science and Technology, has dismissed calls for an AI slowdown.

"
Anthropic & OpenAI Warn of AI Risks, Push for Regulation