Elon Musk’s xAI sued for turning three girls’ real photos into AI CSAM



Her first instinct was to contact the other victims she knew, then “ultimately, local law enforcement was contacted, and a criminal investigation was opened,” the complaint said.

Investigating the Discord evidence, cops quickly determined that the perpetrator had access to the first victim’s Instagram “because he had maintained a close and friendly relationship” with her. Searching his phone, cops found a third-party app that licensed or otherwise purchased access to Grok, which they concluded that the perpetrator used to morph the girls’ photos.

From there, the bad actor uploaded the images to a file-sharing platform called Mega and used them as a “bartering tool in Telegram group chats with hundreds of other users,” trading away the AI CSAM files “for sexually explicit content of other minors.”

The harms to victims have been extensive, the lawsuit said, citing acute emotional and mental distress. For the victims who know the perpetrator, they remain uncertain if the Grok-generated CSAM was shared with classmates or distributed to others at their school, the lawsuit noted. One girl fears the scandal will impact her college admissions, while another feels too scared to attend her own graduation.

Even more alarming than any acquaintances coming across the AI CSAM, however, is the fear that girls will now be stalked due to Grok’s outputs. As the lawsuit explains, “it also appears the victims’ true first names and the name of their school was attached to their files online, meaning other online predators may also be able to identify them, creating a substantial risk for stalking.”

xAI allegedly hosts Grok CSAM

While it was previously reported that Grok Imagine’s paying subscribers were generating more graphic outputs than the Grok outputs that sparked outcry on X, the lawsuit alleges that xAI has also taken other steps to hide how it profits from explicit content that harms real people.



Source link

  • Related Posts

    Customize Ars your way with an Ars Pro subscription

    Having it your way is one of the benefits of being an Ars Pro subscriber. You get all of the great content you come to Ars for every day, but…

    Love It or Hate It, the Ferrari Luce Is a Thrilling Drive

    Some still believe that you can’t manage a car company unless you’re a fully paid-up “car guy.” Tell that to Benedetto Vigna, Ferrari’s CEO. He’s a physicist by education, hired…

    Leave a Reply

    Your email address will not be published. Required fields are marked *

    You Missed

    City of Vancouver chooses local group with U.S. ties to pursue Major League Baseball team

    City of Vancouver chooses local group with U.S. ties to pursue Major League Baseball team

    Investigators find body believed to be missing Calgary boy, Parker

    Investigators find body believed to be missing Calgary boy, Parker

    Parents of Toddler Found Alive in Arizona Morgue Will Not Face Charges

    Parents of Toddler Found Alive in Arizona Morgue Will Not Face Charges

    Federal Labor MP Luke Gosling charged with assaulting NT administrator | Northern Territory politics

    Federal Labor MP Luke Gosling charged with assaulting NT administrator | Northern Territory politics

    Tourism Kelowna urges visitors not to judge the Okanagan by a few smoky days – Okanagan

    Tourism Kelowna urges visitors not to judge the Okanagan by a few smoky days – Okanagan

    Pittsburgh International Airport debuts first outdoor terrace

    Pittsburgh International Airport debuts first outdoor terrace