Jack Clark says "most labs have different ways of being able to pull the plug", but says this may need to be a requirement.
AI "more powerful by the day", Anthropic co-founder tells BBC
An artificial intelligence "kill switch" which can be checked by a third-party may need to be mandatory for companies, a co-founder of one of the world's largest AI firms has said.
Jack Clark, one of seven founders of Anthropic, said a way of shutting off AI software completely if it gets too dangerous was the kind of thing society "might want to eventually pass rules around".
Clark said "most labs have different ways of being able to pull the plug", including Anthropic, but said policymakers may need to enforce having one.
Clark's comments come as a growing numbers of executives and staff of AI firms, as well as AI experts, have publicly said AI could kill all humans.
Anthropic head Dario Amodei over the weekend called for the pace of AI development to slow and be more closely monitored, as the company has done before, though some have questioned the motivations behind this.
Amodei did not say how exactly how AI development could be slowed down and said any action to reign in AI development should be done "without sacrificing commercial advantage".
Clark told the BBC that specifics around "kill switch" requirements and verification should be part of "the larger policy conversation" taking place around AI.
"Should you mandate for companies to definitely have a killswitch? Is that kill switch verifiable by a third party?" he asked.
"I think that's the kind of thing society is going to want to know and might want to eventually pass rules around."
Anthropic, which was formed in 2021 by a group of former employees of its rival OpenAI, is currently at the centre of a debate around AI safety.
Last week, a post from an artificial intelligence researcher who quit Anthropic over concerns AI could wipe out humanity went viral.
In response, Anthropic scientist Evan Hubinger said he personally thought the possibility of human extinction from AI was ">10% within the next decade" .
Computer scientist and Nobel Prize winner Geoffrey Hinton, known as the "Godfather of AI", told the BBC on Friday that a 10% chance of AI killing all humans was "not unreasonable" , external .
Asked what percentage he would put on all humans being killed by AI, Clark said: "I don't think these statistics are that useful", but added that allowing AI to continue as a "totally unregulated industry" was a bad idea.
Reporting synthesized and verified under Nexvoro.tech editorial guidelines. Full primary records referenced via BBC Business.
OpenAI has formed a new independent mathematics advisory group hosted at the Institute for Advanced Study in Princeton following a surge in automated problem-solving. The move arrives amid mounting academic scrutiny regarding the rapid pace of artificial intelligence in advanced mathematical research.
As debate intensifies over the rapid acceleration of artificial intelligence, OpenAI has proposed a comprehensive framework for international safety standards, focusing heavily on alignment research and recursive self-improvement. The move follows recent high-profile departures and escalating concerns from industry insiders regarding humanity's long-term control over advanced frontier models.
As Washington fiercely debates artificial intelligence oversight, Nvidia CEO Jensen Huang has emerged as President Donald Trump's top confidant, successfully pushing back against growing regulatory pressures. While rival tech executives advocate for government slowdowns, the head of the world's most valuable chipmaker is charting a rapid course for American tech supremacy.
