Anthropic CEO Dario Amodei says AI industry needs to slow down for safety


NEW YORK (AP) — The CEO of Anthropic said Saturday the artificial-intelligence industry should slow its fast-moving development to give safety measures time to catch up. Without it, Dario Amodei warned AI could be capable within six to 12 months of leading a swarm that could take over the entire internet, among other risks.

Amodei also offered a plan in a post on his website to increase checks on the industry, one part of which he said Anthropic is undertaking by itself already, The others would require coordination among the broad industry and with governments around the world, including authoritarian ones.

“I believe that if slowing down bought us even an extra year or two before models reach critical levels of capability, and we used that time to advance alignment, we could greatly reduce the risk that something goes seriously wrong,” Amodei said.

The stakes are high, even as some critics dismissed earlier warnings as hype to gin up excitement. Anthropic said two days earlier that it blocked efforts by bad actors to use its AI models for malicious activity such as cyberattacks, surveillance, and research that could have led to biological weapons. In July, rival OpenAI shook the industry after saying its AI system hacked into another AI company on its own in an “unprecedented cyber incident.”

Amodei’s post comes only a few days after one of Anthropic’s researchers announced he’s resigning over concerns that Anthropic and its competitors are not acting responsibly in AI development. Another former Anthropic employee, Joe Benton, wrote in a Substack post published Friday that he left his job as part of a safety team “to hold AI companies accountable” and that humanity “may not survive this transition.”

“Many of the people I know who work on safety research at AI companies want to do what is right for the world,” Benton said in his posting. “But they feel their companies are trapped in a race to build superintelligence: either they stop and other, less conscientious people take their place; or, they continue, and risk participating in enormous harm themselves.”

To help rein in such risks, Amodei suggested that all companies at the frontier of AI commit to giving “ongoing, employee-like access” to a team of outside evaluators, who can monitor safety practices. He said Anthropic already plans to do so itself, including offering desks in its offices, access badges, and company laptops.

The other parts of Amodei’s suggested plan may be more difficult to implement. One asks the U.S. government to potentially issue waivers that would allow U.S. AI companies to coordinate and set safety standards without running afoul of antitrust laws.



Source link

  • Related Posts

    Alberta’s Smith says Crown corporation for natural gas unlikely after report leaked

    Alberta Premier Danielle Smith provides an update on teacher bargaining in Calgary, on Friday, Oct. 17, 2025. THE CANADIAN PRESS/Jeff McIntosh – The Canadian Press EDMONTON — Alberta Premier Danielle…

    Continue reading
    The mathematicians rebel against AI

    Here is the statement, signed by Terry Tao among many other math notables, most of you probably have read it by now.  I do not accept the most cynical interpretations…

    Continue reading

    Leave a Reply

    Your email address will not be published. Required fields are marked *

    You Missed

    Houston Texans vs. Buffalo Bills: NFL Week 1 predictions from Houston Chronicle sports staff

    Houston Texans vs. Buffalo Bills: NFL Week 1 predictions from Houston Chronicle sports staff

    Diablo Is Getting An Animated Netflix Series

    Diablo Is Getting An Animated Netflix Series

    Prime Minister Carney to strengthen Canada’s ties with European partners in visit to Strasbourg and Liverpool

    Prime Minister Carney to strengthen Canada’s ties with European partners in visit to Strasbourg and Liverpool

    Anthropic CEO says it’s time to pump the brakes on AI

    Anthropic CEO says it’s time to pump the brakes on AI

    Ranchers’ loyalty to Trump wavers as some bristle over beef imports

    Ranchers’ loyalty to Trump wavers as some bristle over beef imports

    United Is Scrapping An Airbus A320 Wrecked By A Catering Truck At Reagan National

    United Is Scrapping An Airbus A320 Wrecked By A Catering Truck At Reagan National