More than 1 in 10 chance AI ‘could kill all humans,’ says Anthropic safety lead after colleague quits 


A senior Anthropic safety researcher has said there is more than a 10 percent chance artificial intelligence “could kill all humans” by the end of the decade, just hours after a colleague resigned over fears the AI lab and its rivals are carelessly racing to build “superhuman systems” they cannot control.

In a post on X announcing his departure, Jacob Coxon, a researcher who has trained AI systems at Anthropic, said he had quit the company over its lax approach to safety. Coxon, who previously trained systems for OpenAI, accused the two AI companies of “racing straight to self-improving superintelligence and gambling with our lives,” even though “the people building AI earnestly believe that it could kill us all by the end of the decade.”

Industry insiders have long expressed concerns about the potential dangers of self-improving AI systems, which they warn could spiral out of human control in a runaway loop often described as recursive self-improvement. While not yet realized, companies are actively pursuing this goal and much of today’s AI code is written with the help of AI.

In a direct response, Evan Hubinger, who leads one of Anthropic’s AI safety teams, said he worries about self-improving AI, adding that it “is happening faster than we thought.” He also agreed with Coxon’s characterization. “We really do earnestly believe AI could kill all humans,” he said, personally estimating the chances to be greater than one in 10 “within the next decade.”

Despite this, Hubinger said Anthropic does “not yet have a plan” for ensuring advanced AI remains safe and aligned with human values and “are not clearly on track to” develop one either. Coxon says the companies are “locked in a race” to develop advanced systems first so are pushing ahead “despite the risk.”

Coxon’s departure marks one of the most high profile examples of an employee leaving Anthropic, a company founded by former OpenAI members following concerns over safety at the company. In recent years, multiple researchers have cited safety concerns as motivating their decision to leave OpenAI.



Source link

  • Related Posts

    Batteries just broke another record in the US

    Massive, utility-scale systems are leading the way; they’re responsible for most of the record-setting quarter. Seven new gigascale battery installations (those with a capacity of over one gigawatt-hour) came online…

    Continue reading
    The Coolest Thing I Saw at IFA 2026: The Coolest, Quietest, Thinnest Laptop Concept

    Some concepts on display at trade shows are simply bald attempts at garnering attention on a noisy and crowded show floor. And then there are others that provide actual glimpses…

    Continue reading

    Leave a Reply

    Your email address will not be published. Required fields are marked *

    You Missed

    England v Pakistan Third Test: Ollie Robinson removes Saim Ayub for his 100th Test wicket

    England v Pakistan Third Test: Ollie Robinson removes Saim Ayub for his 100th Test wicket

    Oil prices climb over $100 per barrel as US war in Iran continues

    Oil prices climb over $100 per barrel as US war in Iran continues

    Morning Bid: Tit for tat

    Morning Bid: Tit for tat

    Batteries just broke another record in the US

    Batteries just broke another record in the US

    Richemont Names Anton Rupert Co-deputy Chairman of the Board

    Richemont Names Anton Rupert Co-deputy Chairman of the Board

    LEGO’s Mario Kart Bowser’s Castle Set Plummets to Lowest Price Yet at Amazon

    LEGO’s Mario Kart Bowser’s Castle Set Plummets to Lowest Price Yet at Amazon