
— Humanity is about to be handed almost unimaginable power, and it is deeply unclear whether our social, political, and technological systems possess the maturity to wield it, he writes.
He imagines a «country» of Nobel-level geniuses living in a data center, able to outpace, outwit and outcompete everyone else — and warns of lone wolf terror attacks becoming increasingly powerful due to AI.
— If the exponential continues — which is not certain, but now has a decade-long track record supporting it — then it cannot possibly be more than a few years before AI is better than humans at essentially everything, he writes.
Then there are massive job losses, the danger of authoritarian AI use (which terrifies him), entire companies run by AI, and the danger that AI corporations could become superhuman — sucking up trillions of dollars in the process.
— Humanity needs to wake up, and this essay is an attempt — a possibly futile one, but it’s worth trying — to jolt people awake, he concludes.
Read the essay here and see Axios and Gizmodo.