OpenAI's chief has made comments detailing how AI safety frameworks and a slowdown could work, as the industry unites behind concerns.
OpenAI chief Sam Altman has made his most detailed comments yet on how artificial intelligence safety frameworks could work, after he joined Anthropic's Dario Amodei and Elon Musk in calling for an industry slowdown over the weekend.
Safety concerns over the technology have hit fever pitch since an Anthropic researcher quit last week, warning that those building it believed that it could "kill us all by the end of the decade" and prompting other employees at the lab and rival OpenAI to warn of catastrophic risks .
AI bosses have since shown a rare display of unity, with both Altman and Musk on Saturday backing an essay from Amodei that urged AI companies to slow how quickly they improve their most advanced models.
AI stocks were down Monday as investors digested the comments. U.S. President Donald Trump dismissed the CEOs' warning on Sunday, saying a slowdown was not needed and would jeopardize America's lead in AI over China.
"We welcome a federal framework that sets consistent safety requirements for frontier AI," Altman said in a post on X just after midnight on Monday, adding that "no amount of American competitive pressure should justify recklessness."
Altman warned of two ways AI progress could go "very badly," including losing "control of the future to AI" and too much power concentrating around a single person or company.
Meanwhile, lawmakers in Washington are scrambling to address calls for safeguards.
This all comes as Anthropic and OpenAI gear up for what's expected to be historic initial public offerings. Altman ruled out going public in 2026 in an interview with Fortune published Saturday .
Many AI safety fears revolve around models developing the ability to improve their own performance, a technique known as recursive self-improvement, or RSI.
"Since roughly this summer, AI has been advancing drastically faster, driven primarily by AI's growing ability to build the next generation of AI," said Amodei in his essay. "Left unchecked, it could outrun our ability to understand and control these systems, and so must be pursued very carefully, if at all."
Amodei proposed a three-step plan aimed at tempering the pace of development without "sacrificing commercial advantage or the United States' lead in AI."
The plan involves each frontier AI company giving "employee-like access" to external evaluators - which he said Anthropic was committing to now. Amodei also called for frontier AI labs to establish common safety standards, limit the rate of unchecked AI progress and attempt to coordinate efforts globally.
On Saturday, Altman said in a brief X post he agreed with Amodei that AI companies should "pace the frontier." He added that "committing to having independent evaluators with employee-like access is a great idea, and we will do the same."
"Consistent rules to manage frontier risk so that we can maximize the benefits are a good idea (and we are excited by ideas like independent auditors)," Altman said in his Monday post. But, he added, "When we talk about 'pacing,' we do not mean 'stopping.' Progress has been rapid and will continue to be."
"Pacing will be well worth this cost; no amount of American competitive pressure should justify recklessness, or let capabilities get ahead of alignment and monitoring," he concluded.
Reporting synthesized and verified under Nexvoro.tech editorial guidelines. Full primary records referenced via CNBC Top News.
OpenAI has formed a new independent mathematics advisory group hosted at the Institute for Advanced Study in Princeton following a surge in automated problem-solving. The move arrives amid mounting academic scrutiny regarding the rapid pace of artificial intelligence in advanced mathematical research.
As debate intensifies over the rapid acceleration of artificial intelligence, OpenAI has proposed a comprehensive framework for international safety standards, focusing heavily on alignment research and recursive self-improvement. The move follows recent high-profile departures and escalating concerns from industry insiders regarding humanity's long-term control over advanced frontier models.
As Washington fiercely debates artificial intelligence oversight, Nvidia CEO Jensen Huang has emerged as President Donald Trump's top confidant, successfully pushing back against growing regulatory pressures. While rival tech executives advocate for government slowdowns, the head of the world's most valuable chipmaker is charting a rapid course for American tech supremacy.
