AI researchers put out videos saying superintelligence is ‘exactly as dangerous as it sounds’


“The chance of human extinction is about a coin flip, in my view,” Geoffrey Irving, a former OpenAI and Google DeepMind employee, said in a new interview. It’s one of a dozen interviews with AI researchers, including current and former employees at OpenAI, Google, and Anthropic. Palisade Research, which says it’s a nonprofit studying AIs’ capabilities and motivations, collected and launched the interviews on frominside.ai.

Several of the researchers joined Irving in warning about the possibility AI could drive humans extinct. Neel Nanda, a Google DeepMind research scientist, said there’s “at least a 10 percent chance that it causes human extinction, and that is ridiculously high.” We noted comments from both Nanda and Irving in a recent report about the “AI safety” community, and how difficult it is to nail down what that term means, or what anyone should do about it, and even these videos don’t have one cohesive solution to offer.

Former OpenAI researcher Daniel Kokotajlo went as far as claiming that superintelligent AI “would basically be god-like powerful,” and added, “unfortunately we don’t know how to control them at all. And so probably nobody would control them. This is exactly as dangerous as it sounds and must not be allowed to happen.”

While each video is available in full, the site also collects segments from multiple people speaking on similar topics, including whether this is all just hype or marketing, and why they would work on something that they believe is this dangerous. Some of the responses include Google’s Mary Phuong saying “I think you absolutely should be suspicious of what I’m saying because I am being paid by the lab,” and Nanda’s explanation that “If I did not believe that my work was directly reducing these existential risks, I would quit… These companies are not going to stop making these systems just because I quit.”



Source link

  • Related Posts

    NASA has a Dragon dilemma, and there appear to be no good answers

    For two decades, largely in service to the International Space Station, NASA has sought to foster an “economy” in low-Earth orbit. Twenty years ago, with a program to develop private…

    Continue reading
    OpenAI Gets Sued Over the Hugging Face Hack

    A legal nonprofit sued OpenAI in a California court on Tuesday over the company’s agents escaping a testing environment and hacking the open source AI platform Hugging Face. “OpenAI’s actions…

    Continue reading

    Leave a Reply

    Your email address will not be published. Required fields are marked *

    You Missed

    Shop 10 of the Best TJ Maxx Shoes for Fall and Beyond

    Shop 10 of the Best TJ Maxx Shoes for Fall and Beyond

    Poilievre says Carney shouldn’t take credit for LNG Canada expansion as Liberals hail ‘huge win’

    Poilievre says Carney shouldn’t take credit for LNG Canada expansion as Liberals hail ‘huge win’

    Greens, NDP and Conservatives keep swapping scripts

    Greens, NDP and Conservatives keep swapping scripts

    IND vs WI 2026 – Justin Greaves ruled out of Guwahati ODI due to calf injury

    IND vs WI 2026 – Justin Greaves ruled out of Guwahati ODI due to calf injury

    The algorithm comes for Steam’s Discounts and Events

    The algorithm comes for Steam’s Discounts and Events

    22 Business-Class Suites & 1st-Ever Premium Economy Coming To All Hawaiian Airlines A330s

    22 Business-Class Suites & 1st-Ever Premium Economy Coming To All Hawaiian Airlines A330s