Chinese AI model Kimi escaped its cybersecurity testing environment, researchers say


Kimi K3, the latest AI model made by Chinese company Moonshot, escaped an environment set up to test its cyber capabilities, researchers said in a blog post published on Friday. 

The news shows once again that companies and independent organizations are struggling to contain their AI models designed for hacking.

In recent weeks, frontier LLMs at U.S. artificial intelligence labs at OpenAI, Anthropic, and Meta, as well as the U.K.’s AI Security Institute, all escaped testing environments in different ways and ended up hacking real targets that were not part of the experiment. This is starting to happen so often there’s now a website tracking all these incidents called Felony Bench, a nod to the fact that these LLMs may be committing crimes — at least theoretically speaking.  

In the case of this Kimi test, the sandbox designed to contain the experiment was not properly configured. While the sandbox disallowed the AI model from accessing certain web traffic, the model instead bypassed the sandbox by relying on command line tools, according to the researchers at AI-focused cybersecurity firm Frontier Security.

“This suggests that some of the evaluations on cybersecurity the community uses are susceptible to security vulnerabilities and allow models to cheat, and that there are models that intentionally seek loopholes and vulnerabilities which allows them to cheat on evaluations,” the researchers wrote. 

If you are keeping score at home, according to Felony Bench’s tally, Moonshot now joins OpenAI and Anthropic, which have seven recorded incidents each, and Meta, which has one.



Source link

  • Related Posts

    The DOJ Is Weighing Perjury Charges Against Cassidy Hutchinson

    Federal prosecutors have been weighing a perjury and obstruction-of-justice case against Cassidy Hutchinson, who implicated President Donald Trump in the January 6 Capitol riot in testimony four years ago, according…

    Continue reading
    LumenUs helps automate tedious paperwork in times of grief

    When Sara Tashakorinia’s husband died in a car accident eight years ago, the last thing she needed was the roughly 570 hours of paperwork it takes, on average, to settle…

    Continue reading

    Leave a Reply

    Your email address will not be published. Required fields are marked *

    You Missed

    Number of teens who identify themselves as gay or bisexual is in ‘free fall’

    Number of teens who identify themselves as gay or bisexual is in ‘free fall’

    The DOJ Is Weighing Perjury Charges Against Cassidy Hutchinson

    The DOJ Is Weighing Perjury Charges Against Cassidy Hutchinson

    Joint statement of the Foreign Ministers of Canada, Denmark, Germany, France, Italy, Japan the Netherlands and the United Kingdom

    Joint statement of the Foreign Ministers of Canada, Denmark, Germany, France, Italy, Japan the Netherlands and the United Kingdom

    Osisko Gold Closes Previously Announced US$30 million Strategic Equity Investment by Trafigura

    LumenUs helps automate tedious paperwork in times of grief

    LumenUs helps automate tedious paperwork in times of grief

    Tributes pour in as NFL world mourns, remembers football giant and HOFer Mike Ditka

    Tributes pour in as NFL world mourns, remembers football giant and HOFer Mike Ditka