Dario Amodei sends a superintelligence warning to the world in 38-page essay

Artificial General Intelligence wil be so powerful, it will create supercompanies that take over the world, Amodei warns. (Picture: generated)
The Anthropic CEO, already building the next generation of AI, warns the world that we might not be ready for its awesome power:

— Humanity is about to be handed almost unimaginable power, and it is deeply unclear whether our social, political, and technological systems possess the maturity to wield it, he writes.

He imagines a «country» of Nobel-level geniuses living in a data center, able to outpace, outwit and outcompete everyone else — and warns of lone wolf terror attacks becoming increasingly powerful due to AI.

— If the exponential continues — which is not certain, but now has a decade-long track record supporting it — then it cannot possibly be more than a few years before AI is better than humans at essentially everything, he writes.

Then there are massive job losses, the danger of authoritarian AI use (which terrifies him), entire companies run by AI, and the danger that AI corporations could become superhuman — sucking up trillions of dollars in the process.

— Humanity needs to wake up, and this essay is an attempt — a possibly futile one, but it’s worth trying — to jolt people awake, he concludes.

Read the essay here and see Axios and Gizmodo.