Dario Amodei’s article here:
We Must Pace the Frontier — from darioamodei.com

But like many technologies before it, AI brings risks, and because it is such a powerful technology, these risks are serious. I’ve written a lot about them too. They include the risk of losing control of AI systemsmisuse of AI for cyberattacks and bioterrorism, and serious economic disruption. A race to the bottom, spurred by commercial incentives, can make these risks more acute.

Along with my co-founders and employees, I have grappled with this duality of risk and benefit since the beginning of Anthropic.


Also relevant/see:


[GIFTED ARTICLE]
Anthropic CEO calls for the AI industry to slow down — from washingtonpost.com by Ted Hesson, Ian Duncan, and Gerrit De Vynck
Anthropic CEO Dario Amodei said he was worried about the ability to control self-improving AI models.

Three of the nation’s leading artificial intelligence executives endorsed slowing down the blistering pace of technological advancement, revealing the growing unease with its potential dangers at the industry’s very highest levels.

The call was first made in an essay Anthropic chief executive Dario Amodei posted online Saturday. The idea has gained ground in recent weeks as AI companies have struggled in some cases to keep their creations under control, even as they usher in an age in which AI systems themselves can build the more powerful next generation of the technology.


[GIFTED ARTICLE]
For years, they warned AI could kill all humans. Now people are listening. — from washingtonpost.com by Nitasha Tiku
A doomsaying community once on the periphery of the tech industry has gained influence, as AI “agents” perform amazing and alarming feats.

But when Hubinger issued a similar warning this week in a post on X, his message was viewed tens of millions of times, prompting state and federal lawmakers to echo his concern. Now he spoke as a team lead at Anthropic, developer of the chatbot Claude and a company set to go public at a valuation of over $1 trillion.

“AI could kill all humans … I personally think it is >10% within the next decade,” Hubinger wrote, in response to the resignation of his colleague Jacob Coxon, who accused Anthropic of racing ahead despite the dangers.
.