Anthropic said it measured AI-led research and development, oversight of AI agents and compute allocation within the company.
Anthropic is sharing three new metrics that it says could help artificial intelligence companies monitor the pace of development, days after CEO Dario Amodei rocked the industry by calling for a coordinated slowdown.
In a blog post on Thursday, the company said it measured AI-led research and development, oversight of AI agents and compute allocation within Anthropic, and it shared the methodologies to encourage other organizations to do the same. The metrics build on the three-step slowdown plan that Amodei published on Saturday, which was light on specifics about what a practical implementation would include.
"As the world considers pacing the frontier, we should do everything possible to minimize the gap between what frontier labs know and what the public knows," Anthropic said in Thursday's post. "This means better measuring the development of AI, reporting on it publicly, and giving society an opportunity to decide how to use this information."
Amodei's call for a slowdown over the weekend received support from industry leaders including OpenAI CEO Sam Altman , SpaceX CEO Elon Musk and Google DeepMind Chair Demis Hassabis, and it followed stark warnings from researchers about AI's growing potential to cause harm. Amodei said his plan aims to temper how quickly model capabilities improve without "sacrificing commercial advantage or the United States' lead in AI."
For its first metric, Anthropic said it determined its Claude models are "not operating fully autonomously" for any subset of the research and development work that it measured.
The second metric involved building a system to oversee and intervene in actions taken by AI agents. It determined that approximately 30,000 agents were doing research and engineering work across its most-used internal platform at any one time.
For its third metric, Anthropic measured a "snapshot" of how it used all of its compute from July 13 to July 20. The company said it found that roughly 6% of the compute that went to AI research and development was allocated toward safety. Roughly 12% of the compute allocated to "AI-driven" research and development went toward safety, the company said.
Anthropic said these metrics are best equipped to help showcase how models are built, and that they should complement capability evaluations, which showcase "what models can do." Taken together, Anthropic said third parties outside the lab should have a "starting point" to assess the pace of AI development.
"We hope to model that transparency by releasing these measurements, and we'll continue to do so," Anthropic said.
Get this delivered to your inbox, and more info about our products and services.
Data is a real-time snapshot *Data is delayed at least 15 minutes. Global Business and Financial News, Stock Quotes, and Market Data and Analysis.
Reporting synthesized and verified under Nexvoro.tech editorial guidelines. Full primary records referenced via CNBC Top News.
OpenAI has formed a new independent mathematics advisory group hosted at the Institute for Advanced Study in Princeton following a surge in automated problem-solving. The move arrives amid mounting academic scrutiny regarding the rapid pace of artificial intelligence in advanced mathematical research.
As debate intensifies over the rapid acceleration of artificial intelligence, OpenAI has proposed a comprehensive framework for international safety standards, focusing heavily on alignment research and recursive self-improvement. The move follows recent high-profile departures and escalating concerns from industry insiders regarding humanity's long-term control over advanced frontier models.
As Washington fiercely debates artificial intelligence oversight, Nvidia CEO Jensen Huang has emerged as President Donald Trump's top confidant, successfully pushing back against growing regulatory pressures. While rival tech executives advocate for government slowdowns, the head of the world's most valuable chipmaker is charting a rapid course for American tech supremacy.
