OpenAI Slows Down Astra Development Due To Cybersecurity Concerns


The AI giant said that it couldn’t ‘rule out critical cyber capabilities’ when it came to the upcoming Astra model.

Shortly after a major cybersecurity incident where OpenAI’s models hacked into an open source machine learning platform called Hugging Face, the company announced that it’s bolstering safeguards and security controls for its latest AI model. In a post on its website, OpenAI said internal evaluations of its upcoming model, called Astra, showed “significant advancements in agentic coding and cybersecurity,” resulting in OpenAI not being able to “rule out critical cyber capabilities.”

According to OpenAI, it can’t declare with certainty that the unreleased Astra model would be designated as a “Critical capability level.” As detailed in its own Preparedness Framework, OpenAI said the Critical designation means that a model “can identify and develop functional zero-day exploits of all severity levels in many hardened real-world critical systems without human intervention.” It could also be able to “devise and execute end-to-end novel strategies for cyberattacks against hardened targets given only a high level desired goal.” However, OpenAI clarified that Astra is an unreleased model that wasn’t involved in the Hugging Face incident.

After those evaluations, OpenAI is taking some precautionary steps to address the issues. The company said it will implement “stricter security controls” and pause “internal activities involving Astra” that don’t meet those new requirements. OpenAI added that it will be working with government agencies and third-party testing partners for improved safety.

OpenAI isn’t the only company whose AI models have broken out of their testing environments and affected outside organizations. Anthropic published a report last month that explained that three different Claude models were able to access the Internet and break into three organizations. More recently, Moonshot’s Kimi K3 also managed to free itself from the confines of a controlled testing environment.



Source link

  • Related Posts

    I Track Deals for a Living and These Are the Price Tracker Chrome Extensions I Use

    Even as someone who tracks deals for a living, I’ve still fallen for fake markdowns. If you’ve ever bought something during a “massive sale” only to realize it was actually…

    Space mirrors could ruin astronomy — and your eyes

    Solar energy, at any time of day or night — that’s the dream of space mirror projects. Futurists have been imagining satellite mirrors that could reflect the sun’s light onto…

    Leave a Reply

    Your email address will not be published. Required fields are marked *

    You Missed

    The troubling trend of museums whitewashing Jewish history

    I Track Deals for a Living and These Are the Price Tracker Chrome Extensions I Use

    I Track Deals for a Living and These Are the Price Tracker Chrome Extensions I Use

    Dev at id Software says Microsoft ‘burned a lot of bridges’ in the industry: ‘They fundamentally don’t understand art, they don’t understand games’

    Dev at id Software says Microsoft ‘burned a lot of bridges’ in the industry: ‘They fundamentally don’t understand art, they don’t understand games’

    ‘It’s for the kids, and his kids’: Affordable homes from $1 lots in Winnipeg – Winnipeg

    ‘It’s for the kids, and his kids’: Affordable homes from $1 lots in Winnipeg – Winnipeg

    A.I. Agents Are Taking Entire Online Courses for Cheating Students

    A.I. Agents Are Taking Entire Online Courses for Cheating Students

    Darline Graham’s primary challenge and Trump shifts to ‘low-keying’ it with Iran: Morning Rundown

    Darline Graham’s primary challenge and Trump shifts to ‘low-keying’ it with Iran: Morning Rundown