The Age of Wonders and Terrors


My position on AI is merely the conservative, skeptical position of 2006, updated with intellectual honesty for the reality of late 2026. And that position, if you need me to spell it out, is as follows:

AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA

It seems to me that the Singularity has already started; it’s just wildly unevenly distributed. Yes, I still unload the dishwasher and clip my toenails. On the other hand, in whatever years I have left, I don’t expect that I’ll ever again prove a theorem because I’m actually needed to prove it. If I do, it will only be for my or others’ enjoyment or edification.

The test is this: if we took the news of these past few weeks and sent it back in time twenty years, would I agree that it looked like the beginning of an AI Singularity? The intellectually honest answer is: yes, absolutely. But then that’s all we need. No backsies.

I feel like it would be healthy for everyone to stop grinding their ideological axes, their sentiments about Dario Amodei or Sam Altman, for long enough simply to acknowledge that the wonders and terrors are here. They couldn’t be here more clearly if the sky had turned reddish-orange like in the Matrix movies.

It’s here clearly enough that, when I put my kids to sleep at night, I now feel it in the pit of my stomach: what sort of future can they possibly have? What could they learn today that could possibly be relevant to that future? (Yesterday, my 13-year-old daughter joked unprompted that, if she wants to become a mathematician, it now looks like she has maybe two more weeks.) Certainly when my grad students want to discuss what sort of careers might await them on graduation, I no longer have any clue what to tell them.

…For anyone who says AI doom sounds like an apocalyptic religion, that the rationalists/Singulatarians seem like a Bay Area cult, that Eliezer Yudkowsky gives off the vibes of a messianic prophet: yes, yes, and yes. But crucially, today you’re no longer being asked to believe in arguments and extrapolations, but only in the front-page news. Accepting the reality of the coming machine god after it’s solved Navier-Stokes and dozens of other longstanding open math problems (while dramatically ramping up in capability every month), is sort of like accepting Jesus after he’s returned to earth on the gleaming cloud. It’s the epistemic bare minimum.

Yes, there’s still enormous uncertainty about what the rest of our lives will look like, but as far as I can tell, there’s no longer any real uncertainty that it’ll all mostly revolve around AI, and the extent to which we succeed or fail at directing its power toward human flourishing.

By any accounting that doesn’t stack the deck, Eliezer Yudkowsky was right about what the greatest challenge facing civilization in our lifetimes was going to be, and you and I were wrong about it. Why I was wrong is a question I’ll ask myself every day in whatever time remains. But, you know, at least I updated once the prophesied wonders and terrors actually started arriving! If you haven’t done likewise, why haven’t you?



Source link

  • Related Posts

    Will AI models achieve the ability to improve autonomously? Leading labs say the scenario is near

    Once a distant ambition for technology researchers, the prospect of artificial intelligence models teaching themselves autonomously to be more efficient and capable appears ever closer to reality. As the technology…

    Continue reading
    U.S. import ban on Canadian molasses highlights sticky sugar industry feud

    A U.S. ban on Canadian molasses imports has resurfaced allegations of sugar smuggling and an industry battle involving a company with a major refinery in Hamilton, Ont. Spats over dairy,…

    Continue reading

    Leave a Reply

    Your email address will not be published. Required fields are marked *

    You Missed

    Batman Producers Reveal Warner Bros. Told Them to Burn a Criminal’s Face Off

    Batman Producers Reveal Warner Bros. Told Them to Burn a Criminal’s Face Off

    Learning another language may be one of the best ways to keep your brain healthy

    Learning another language may be one of the best ways to keep your brain healthy

    Will AI models achieve the ability to improve autonomously? Leading labs say the scenario is near

    Will AI models achieve the ability to improve autonomously? Leading labs say the scenario is near

    Texans vs. Bengals: What to know about Houston’s chances for a win without Nico Collins

    Texans vs. Bengals: What to know about Houston’s chances for a win without Nico Collins

    Forget the AI Slowdown—the Vulnerability Explosion Is Already Happening

    Forget the AI Slowdown—the Vulnerability Explosion Is Already Happening

    Nearly 400 pre-trial detainees to be transferred from private prison in Georgia in move critics call “a catastrophe”

    Nearly 400 pre-trial detainees to be transferred from private prison in Georgia in move critics call “a catastrophe”