That would radically speed up development of frontier models, but it could also «accelerate beyond our ability to understand and control the resulting systems.»
The petition is signed by top names, including Anthropic boss Dario Amodei, followed by chief scientists from OpenAI, Anthropic, Meta and Google DeepMind along with over 1,100 other employees from frontier labs. Even OpenAI’s Sam Altman is agreeing, though he doesn’t sign petitions, and official X accounts for Anthropic and OpenAI have posted in support.
The petition’s main point is that industry, government and the society at large needs more time to «address emerging risks, develop security measures, and strengthen oversight.»
That means finding a method to «pace automated AI development,» it says, for laws to catch up — and it needs to be an international effort for it to relieve competitional incentives for the labs themselves.
The recurring theme from those who chose to comment is on the riveting ascent of top AI models, going from barely understanding human interactions in 2023 to doing original research on the toughest math problems in 2026 and to now being on the cusp of recursive self-improvement.
— AI is progressing at a rate that our society might not be ready for, writes Shengjia Zhao, Chief Scientist at Meta AI, adding that we are close to «AI that can exceed even the best people on almost every metric of intelligence.»
Read more: Pacing the Frontier: A statement. Writeups on NBC News, The Verge, Reuters and TechCrunch. Discussion on r/Singularity and Hacker News.