French and Malaysian authorities are investigating Grok for generating sexualized deepfakes


Over the past few days, France and Malaysia have joined India in condemning Grok for creating sexualized deepfakes of women and minors.

The chatbot, built by Elon Musk’s AI startup xAI and featured on his social media platform X, posted an apology to its account earlier this week, writing, “I deeply regret an incident on Dec 28, 2025, where I generated and shared an AI image of two young girls (estimated ages 12-16) in sexualized attire based on a user’s prompt.”

The statement continued, “This violated ethical standards and potentially US laws on [child sexual abuse material]. It was a failure in safeguards, and I’m sorry for any harm caused. xAI is reviewing to prevent future issues.”

It’s not clear who is actually apologizing or accepting responsibility in the statement above. Defector’s Albert Burneko noted that Grok is “not in any real sense anything like an ‘I’,” which in his view makes the apology “utterly without substance” as “Grok cannot be held accountable in any meaningful way for having turned Twitter into an on-demand CSAM factory.”

Futurism found that in addition to generating nonconsensual pornographic images, Grok has also been used to generate images of women being assaulted and sexually abused.

“Anyone using Grok to make illegal content will suffer the same consequences as if they upload illegal content,” Musk posted on Saturday.

Some governments have taken notice, with India’s IT ministry issuing an order on Friday saying that X must take action to restrict Grok from generating content that is “obscene, pornographic, vulgar, indecent, sexually explicit, pedophilic, or otherwise prohibited under law.” The order said that X must respond within 72 hours or risk losing the “safe harbor” protections that shield it from legal liability for user-generated content.

Techcrunch event

San Francisco
|
October 13-15, 2026

French authorities also said they are taking action, with the Paris prosecutor’s office telling Politico that it will investigate the proliferation of sexually explicit deepfakes on X. The French digital affairs office said three government ministers have reported “manifestly illegal content” to the prosecutor’s office and to a government online surveillance platform “to obtain its immediate removal.”

The Malaysian Communications and Multimedia Commission also posted a statement saying that it has “taken note with serious concern of public complaints about the misuse of artificial intelligence (AI) tools on the X platform, specifically the digital manipulation of images of women and minors to produce indecent, grossly offensive, and otherwise harmful content.”

The commission added that it is “presently investigating the online harms in X.”



Source link

  • Related Posts

    TechCrunch Mobility: Who is poaching all the self-driving vehicle talent?

    Welcome back to TechCrunch Mobility, your hub for the future of transportation and now, more than ever, how AI is playing a part. To get this in your inbox, sign up…

    ‘Euphoria’ Season 3: How to Watch the Premiere Episode

    It may be hard to believe that Euphoria’s last season wrapped up in 2022 (at least for me and my TikTok “For You” page, where I still see 4-year-old clips…

    Leave a Reply

    Your email address will not be published. Required fields are marked *

    You Missed

    Manhattan DA investigating sexual assault allegations against Rep. Eric Swalwell

    Manhattan DA investigating sexual assault allegations against Rep. Eric Swalwell

    The Aircraft Set To Replace The World’s Largest Commercial Jet

    The Aircraft Set To Replace The World’s Largest Commercial Jet

    Watch highlights as Rangers beat Falkirk 6-3

    Trump says US will blockade strait of Hormuz as Iran peace talks fail | US-Israel war on Iran

    Trump says US will blockade strait of Hormuz as Iran peace talks fail | US-Israel war on Iran

    The Best Pet-Safe Floor Cleaners

    The Best Pet-Safe Floor Cleaners

    TechCrunch Mobility: Who is poaching all the self-driving vehicle talent?

    TechCrunch Mobility: Who is poaching all the self-driving vehicle talent?