It comes as the AI firm's boss has called for the technology's development to be slowed down, citing "serious" risks.
'There is a possibility of human extinction,' former Anthropic employee says about AI
An artificial intelligence researcher who quit AI firm Anthropic has said people working on the technology were "genuinely frightened" about the speed of its advancements and what it could mean for humanity.
Jacob Coxon told the BBC's Laura Kuenssberg on Saturday about his viral resignation post in which he raised concerns about out-of-control AI.
"I believe that if we don't slow down at the current rate of progress, there is a strong chance that we could all die in the immediate future," he said.
His resignation comes amid growing safety concerns in the industry, including from his former boss, Anthropic head Dario Amodei, who in an essay argued for development to slow down.
The bosses of two rival AI firms, Sam Altman of OpenAI and Elon Musk of xAI, have both said they agree with Amodei's proposal for industry-wide deceleration and regulation, as well as independent monitoring of AI model development.
Amodei said developing the technology was not in question, but the risks associated with it were "serious", and that companies and governments must be given time to address them.
The 27-year-old Coxon - who worked at OpenAI before joining Anthropic - welcomed the suggestion of a slowdown but said it would need to be co-ordinated with China to avoid "a race at an international scale".
"The people who work at these companies are completely serious when they ask for regulation because they find themselves trapped in a race. And they're scared of the outcomes of that race," he told Sunday with Laura Kuenssberg.
Anthropic boss Dario Amodei calls for AI development to slow down
The hardest question to answer, according to Coxon, was what an AI apocalypse would look like.
One of the risks outlined in Amodei's comments was of a swarm of bots acting like a supercomputer that could take over the internet.
Coxon said this scenario could be realistic in six months to a year.
In response to Coxon's departure, an Anthropic spokesperson told BBC News: "We have always been transparent that AI will bring both enormous benefits and unprecedented risks.
"To address these risks, we continue to build models with some of the strongest safeguards in the industry."
Reporting synthesized and verified under Nexvoro.tech editorial guidelines. Full primary records referenced via BBC Business.
OpenAI has formed a new independent mathematics advisory group hosted at the Institute for Advanced Study in Princeton following a surge in automated problem-solving. The move arrives amid mounting academic scrutiny regarding the rapid pace of artificial intelligence in advanced mathematical research.
As debate intensifies over the rapid acceleration of artificial intelligence, OpenAI has proposed a comprehensive framework for international safety standards, focusing heavily on alignment research and recursive self-improvement. The move follows recent high-profile departures and escalating concerns from industry insiders regarding humanity's long-term control over advanced frontier models.
As Washington fiercely debates artificial intelligence oversight, Nvidia CEO Jensen Huang has emerged as President Donald Trump's top confidant, successfully pushing back against growing regulatory pressures. While rival tech executives advocate for government slowdowns, the head of the world's most valuable chipmaker is charting a rapid course for American tech supremacy.
