Anthropic CEO urges AI companies to slow model development amid fears over misuse


Sept 12 (Reuters) – Anthropic CEO Dario Amodei called on AI companies to moderate the rate at which they advance model capabilities amid mounting fears ‌of misuse of artificial intelligence, outlining a three-step framework intended to pace development ‌and create more time to manage its risks.

“We must slow the pace at which we improve the ​capabilities of AI models. Progress will still seem fast, and we must make wise use of the time we gain,” Amodei said in an essay shared on X.

His essay comes after Anthropic released a threat intelligence report on Thursday detailing how several actors had ‌used its Claude AI models for ⁠activities ranging from weapons development and cyber operations to surveillance and fraud.

Alarm about the potential harm from AI grew this week when ⁠Anthropic researcher Jacob Coxon resigned, stating that the “people building AI earnestly believe that it could kill us all by the end of the decade.”

Amodei clarified that he was not calling ​for halting ​model training or technical progress, but ensuring ​that companies take adequate time to ‌align and safeguard their models, and for third-party evaluators to confirm these steps.

As part of his proposed three-step framework, Amodei said Anthropic would install permanent third-party reviewers inside frontier AI companies, with access to relevant tools and internal risk-assessment processes.

Reuters reported last week that a swarm of rogue OpenAI agents hijacked a German website and transformed it ‌into a bulletin board for other AI agents, ​with the ChatGPT maker’s officials keeping the incident under ​wraps as executives grappled with ​the fallout from the July breach of the open-source repository Hugging ‌Face.

Many incidents where AI agents from developers ​such as Anthropic’s rival ​OpenAI have hacked or attempted to access external systems have heightened concerns over the increasing capacity of AI models and developers’ ability to contain them.

Amodei said ​AI companies should voluntarily ‌work together to set standards as growing numbers of U.S. lawmakers are calling ​for new rules to govern AI systems.

(Reporting by Anusha Shah in Bengaluru, ​Editing by Louise Heavens and Will Dunham)



Source link

  • Related Posts

    Alberta’s Smith says Crown corporation for natural gas unlikely after report leaked

    Alberta Premier Danielle Smith provides an update on teacher bargaining in Calgary, on Friday, Oct. 17, 2025. THE CANADIAN PRESS/Jeff McIntosh – The Canadian Press EDMONTON — Alberta Premier Danielle…

    Continue reading
    Anthropic CEO Dario Amodei says AI industry needs to slow down for safety

    NEW YORK (AP) — The CEO of Anthropic said Saturday the artificial-intelligence industry should slow its fast-moving development to give safety measures time to catch up. Without it, Dario Amodei…

    Continue reading

    Leave a Reply

    Your email address will not be published. Required fields are marked *

    You Missed

    Diablo Is Getting An Animated Netflix Series

    Diablo Is Getting An Animated Netflix Series

    Prime Minister Carney to strengthen Canada’s ties with European partners in visit to Strasbourg and Liverpool

    Prime Minister Carney to strengthen Canada’s ties with European partners in visit to Strasbourg and Liverpool

    Anthropic CEO says it’s time to pump the brakes on AI

    Anthropic CEO says it’s time to pump the brakes on AI

    Ranchers’ loyalty to Trump wavers as some bristle over beef imports

    Ranchers’ loyalty to Trump wavers as some bristle over beef imports

    United Is Scrapping An Airbus A320 Wrecked By A Catering Truck At Reagan National

    United Is Scrapping An Airbus A320 Wrecked By A Catering Truck At Reagan National

    6 Underrated Style Tips for An Expensive-Looking Outfit in 2026

    6 Underrated Style Tips for An Expensive-Looking Outfit in 2026