OpenAI says it slowed Astra model development over security concerns


OpenAI said Friday it has suspended work on some aspects of its upcoming model Astra after an internal review found it had made significant advancements in agentic coding and cybersecurity — enough to warrant concern over its capabilities.

OpenAI said in a blog post Friday that this model, which is still in development, reached its “critical cybersecurity threshold,” meaning it could independently identify and carry out cyberattacks against traditionally well-protected real-world systems. Under the company’s “Preparedness Framework,” which it created in 2023, this triggered additional safeguards.

“While we continue to benchmark and assess this model, our preliminary evaluations indicate strong enough performance that we cannot rule out Critical capability level at this time,” OpenAI wrote. “Astra is an upcoming model, and was not involved in exploiting Hugging Face.”

The disclosure highlights an unusual moment in the topsy-turvy, and still nascent frontier AI labs sector. Companies across every industry hold back products over potential risks, including for safety and cybersecurity concerns. But they rarely announce those decisions publicly when it’s a product that is still under development.

In this case, OpenAI is already under scrutiny after a different unreleased model breached Hugging Face’s systems during internal testing — the first verifiable incident of an AI lab losing control of its model. Since then, OpenAI and AI labs such as Anthropic have disclosed other incidents in which AI models breached their sandboxes and posed threats during cybersecurity tests.

The string of cases — seems like a new disclosure every day now — has triggered varying reactions from cybersecurity experts, lawmakers and the AI labs themselves. Some express fear and call for stricter oversight. But there’s also a bit flexing. In certain circles, any AI lab with a model that has that kind of capability will be seen as an impressive advancement.

OpenAI said it was sharing this information because it believes “it’s important to be transparent with the public and the safety and security communities about this potential shift in capabilities.”

The AI lab said it’s also taking action, including enacting stricter security controls and pausing internal activites involving Astra that don’t meet these beefed guardrails. OpenAI said it is working with relevant government agencies and “select AI safety organizations” to test the capabilities for this model.

When you purchase through links in our articles, we may earn a small commission. This doesn’t affect our editorial independence.



Source link

  • Related Posts

    The Feds Might Do Something About Those Distractingly Bright Headlights

    The blinding glare of LED headlights from oncoming traffic searing your retinas may become a thing of the past. The National Highway Traffic Safety Administration announced this week that it…

    Continue reading
    Decade-old RAM is making a comeback

    CPU makers have noticed that the seemingly unending RAM price hikes are making it tough for a lot of us to upgrade our PCs. Their solution? A return to last-gen…

    Continue reading

    Leave a Reply

    Your email address will not be published. Required fields are marked *

    You Missed

    The Feds Might Do Something About Those Distractingly Bright Headlights

    The Feds Might Do Something About Those Distractingly Bright Headlights

    Trade Court Sides With Importers Seeking Class-Action Status for Tariff Refund Push

    Trade Court Sides With Importers Seeking Class-Action Status for Tariff Refund Push

    Takeaways from the Open Practice

    Takeaways from the Open Practice

    Next Week on XBOX: New Games for October 12 to 16

    Next Week on XBOX: New Games for October 12 to 16

    The McDonnell Douglas MD-80s Still Flying More Than 45 Years After 1st Flight

    The McDonnell Douglas MD-80s Still Flying More Than 45 Years After 1st Flight

    GOP candidates split on Trump in key Senate and governor debates

    GOP candidates split on Trump in key Senate and governor debates