Anthropic’s CEO Proposes A Three-Step Plan To Curb AI Development


Dario Amodei said that “we owe it to humanity to try.”

At least one CEO of an AI company is calling for a slower pace when it comes to developing artificial intelligence. Anthropic’s CEO Dario Amodei wrote a lengthy post detailing a goal of pacing the speed at which AI is built, instead of forging ahead at the rapid rate that AI is currently on. Amodei proposed a three-tiered approach to achieve this, with Anthropic already committing to the first step.

The first measure calls for “frontier AI” companies to commit to “ongoing, employee-like access” for third-party evaluators who would focus on verifying compliance with certain safety standards, evaluating if AI model training is aligned with the goal of slowing down and reporting incidents. The second step requires these AI companies to establish “common safety standards” with the help of governments in order to limit the rate of unchecked AI progress. The final measure would have the US and other democratic governments coordinate with authoritarian governments to ensure everyone is on the same page about compliance.

“The measures I propose to advance the frontier at a safe pace will not be easy,” Amodei wrote in his post. “But I believe we owe it to humanity to try.”

According to Amodei, the risks include “losing control of AI systems, misuse of AI for cyberattacks and bioterrorism, and serious economic disruption.” Amodei acknowledged the major incident where OpenAI agents broke out of a testing environment and hacked into Hugging Face. Anthropic itself recently discovered that multiple scientists were using Claude for “biological misuse.” Following these incidents, OpenAI called for California to establish “stronger safeguards” for the laws surrounding frontier AI models.

Earlier this year, Anthropic already called for a slowdown in AI development, with much of the previous plea echoing the sentiments expressed in Amodei’s recent post. However, Amodei attributed the Hugging Face incident and the onset of “recursive self-improvement,” where AI models are capable enough to develop their future iterations, as the two things that have convinced him of the need to slow down.



Source link

  • Related Posts

    How To Adjust The Liquid Glass Effect On Your iPhone With iOS 27

    Apple’s new controls make it easier to set things just how you like them. Filipe Espósito for Engadget Apple’s Liquid Glass interface doesn’t appeal to everyone. Some people…

    Continue reading
    Overwatch Season 5 Will Add a New Kind of Support, Try to Solve 2 Roster Headaches

    Overwatch kicked off its 10th anniversary in February by announcing that it was adding 10 new heroes to the hero shooter this year, more than triple the average additions in…

    Continue reading

    Leave a Reply

    Your email address will not be published. Required fields are marked *

    You Missed

    Diablo Netflix Series: Diablo 4 Devs React to BlizzCon News

    Diablo Netflix Series: Diablo 4 Devs React to BlizzCon News

    The best credit cards to use for Alaska Airlines flights

    The best credit cards to use for Alaska Airlines flights

    WATCH: 11-year-old fashion prodigy creates American Girl doll fashion collective

    WATCH:  11-year-old fashion prodigy creates American Girl doll fashion collective

    How To Adjust The Liquid Glass Effect On Your iPhone With iOS 27

    How To Adjust The Liquid Glass Effect On Your iPhone With iOS 27

    Khaite Spring 2027 Ready-to-Wear Runway, Fashion Show & Collection Review

    Khaite Spring 2027 Ready-to-Wear Runway, Fashion Show & Collection Review

    SES’s Final Three O3b mPOWER Satellites Successfully Launched