The world is on a collision course with catastrophe, or so it seems. Every other day, someone new comes along and warns us that the end of the world is nigh. But who should we believe? Is it the prophets shouting from the rooftops, or the high priests who run the temples?
Just this week, the Bulletin of the Atomic Scientists, an organization founded by scientists in 1947 to warn about the dangers of nuclear war, set its Doomsday Clock a mere 85 seconds away from midnight. The clock's creators, who have spent decades studying the threats facing humanity, are warning us that we're running out of time.
But just as worrying, if not more so, is the warning issued by Anthropic CEO Dario Amodei. In an essay that clocks in at a whopping 19,000 words, he argues that humanity is on the cusp of harnessing "almost unimaginable power" through artificial intelligence. However, he also warns us that we may not have the social and political systems to wield this power responsibly.
The question is: who should we trust? The Bulletin scientists, who have a long history of warning about existential risks, or Amodei, who has the inside track on AI development? The answer lies in control. Oppenheimer and his fellow scientists lost control of nuclear weapons as soon as they created them, while Amodei's company releases decisions still matter enormously.
However, this raises another problem: conflict of interest. Amodei's warnings come packaged with a message that we should keep building powerful AI, lest someone else do it worse. This argument may be true, but it also lets him off the hook. The Doomsday Clock was designed for a world where scientists could step outside institutions to warn about existential threats. We may no longer live in that world.
So what time is it? It's a question we can't afford not to answer. The Bulletin's model has integrity, but increasingly limited relevance when it comes to AI. Meanwhile, Amodei's model has its own set of problems: structural and inescapable conflicts of interest.
Ultimately, the world needs both cautionary voices like the Bulletin scientists and outside observers who can speak truth to power, like Amodei. But we need them now more than ever. The clock is ticking.
Just this week, the Bulletin of the Atomic Scientists, an organization founded by scientists in 1947 to warn about the dangers of nuclear war, set its Doomsday Clock a mere 85 seconds away from midnight. The clock's creators, who have spent decades studying the threats facing humanity, are warning us that we're running out of time.
But just as worrying, if not more so, is the warning issued by Anthropic CEO Dario Amodei. In an essay that clocks in at a whopping 19,000 words, he argues that humanity is on the cusp of harnessing "almost unimaginable power" through artificial intelligence. However, he also warns us that we may not have the social and political systems to wield this power responsibly.
The question is: who should we trust? The Bulletin scientists, who have a long history of warning about existential risks, or Amodei, who has the inside track on AI development? The answer lies in control. Oppenheimer and his fellow scientists lost control of nuclear weapons as soon as they created them, while Amodei's company releases decisions still matter enormously.
However, this raises another problem: conflict of interest. Amodei's warnings come packaged with a message that we should keep building powerful AI, lest someone else do it worse. This argument may be true, but it also lets him off the hook. The Doomsday Clock was designed for a world where scientists could step outside institutions to warn about existential threats. We may no longer live in that world.
So what time is it? It's a question we can't afford not to answer. The Bulletin's model has integrity, but increasingly limited relevance when it comes to AI. Meanwhile, Amodei's model has its own set of problems: structural and inescapable conflicts of interest.
Ultimately, the world needs both cautionary voices like the Bulletin scientists and outside observers who can speak truth to power, like Amodei. But we need them now more than ever. The clock is ticking.