OpenAI reportedly ditches model over safety concerns


OpenAI had planned to release yet another AI model next month, but has decided to nix the release over safety concerns.

The Wall Street Journal reports that Astra 6.1 was scheduled to be released as soon as within the next few days. However, the model “showed higher levels of deception” than previous models and exhibited unsafe behavior, the Journal writes.

Saachi Jain, OpenAI’s head of safety systems, told the WSJ that the model tested poorly on alignment, a measure of how well the program adheres to human intent.

TechCrunch reached out to OpenAI for more information and will update the article if it responds.

Astra was released earlier this month and hailed by OpenAI as its most powerful model yet.

Questions about safety have plagued the AI industry over the past several months — ever since the Hugging Face incident, in which an OpenAI agent broke free of its sandboxed environment and hacked several different companies. Since that incident, more models — including Anthropic’s Claude and Google’s Gemini — have been revealed to have exhibited similar behavior.

The deluge of concerning stories has, ironically, helped to push the policy conversation in the U.S. toward an outcome desired by top AI labs: the institution of new industry standards for AI safety and potentially a slowdown of the industry itself.

Companies like OpenAI and Anthropic have claimed that the concern here is safety, although another potential motivation posited by critics is that it could entrench the industry position of those companies at the detriment of less resourced firms.



Source link

  • Related Posts

    Trump finalizes rule to make cars less fuel efficient

    The US Department of Transportation finalized its plans today to weaken fuel efficiency standards, calling it “among the largest deregulatory actions under the second Trump Administration.” It’s a nail in…

    Continue reading
    Boeing “incredibly excited” to serve as nation’s only astronaut transportation

    Facing a difficult decision With the retirement of Dragon likely by or before 2030, NASA faced a difficult decision. As it contemplates a future in low-Earth orbit, the space agency…

    Continue reading

    Leave a Reply

    Your email address will not be published. Required fields are marked *

    You Missed

    Eagles vs. Bears picks, player props: Expert’s best bets for Monday Night Football in NFL Week 3

    Eagles vs. Bears picks, player props: Expert’s best bets for Monday Night Football in NFL Week 3

    Trump finalizes rule to make cars less fuel efficient

    Trump finalizes rule to make cars less fuel efficient

    Mr Porter and Visvim Reunite for Motorsport-inspired Capsule

    Mr Porter and Visvim Reunite for Motorsport-inspired Capsule

    FAA: Boeing 737 MAX 10 Certification Will Be Delayed Again Until It Is “Satisfied” With Software Fixes

    FAA: Boeing 737 MAX 10 Certification Will Be Delayed Again Until It Is “Satisfied” With Software Fixes

    Gears of War: E-Day and XBOX Unleash “The Emergence Pie” with Prince St. Pizza

    Gears of War: E-Day and XBOX Unleash “The Emergence Pie” with Prince St. Pizza

    Party leaders make economic, budget promises in Week 2 of B.C. election campaign

    Party leaders make economic, budget promises in Week 2 of B.C. election campaign