French and Malaysian authorities are investigating Grok for generating sexualized deepfakes


Over the past few days, France and Malaysia have joined India in condemning Grok for creating sexualized deepfakes of women and minors.

The chatbot, built by Elon Musk’s AI startup xAI and featured on his social media platform X, posted an apology to its account earlier this week, writing, “I deeply regret an incident on Dec 28, 2025, where I generated and shared an AI image of two young girls (estimated ages 12-16) in sexualized attire based on a user’s prompt.”

The statement continued, “This violated ethical standards and potentially US laws on [child sexual abuse material]. It was a failure in safeguards, and I’m sorry for any harm caused. xAI is reviewing to prevent future issues.”

It’s not clear who is actually apologizing or accepting responsibility in the statement above. Defector’s Albert Burneko noted that Grok is “not in any real sense anything like an ‘I’,” which in his view makes the apology “utterly without substance” as “Grok cannot be held accountable in any meaningful way for having turned Twitter into an on-demand CSAM factory.”

Futurism found that in addition to generating nonconsensual pornographic images, Grok has also been used to generate images of women being assaulted and sexually abused.

“Anyone using Grok to make illegal content will suffer the same consequences as if they upload illegal content,” Musk posted on Saturday.

Some governments have taken notice, with India’s IT ministry issuing an order on Friday saying that X must take action to restrict Grok from generating content that is “obscene, pornographic, vulgar, indecent, sexually explicit, pedophilic, or otherwise prohibited under law.” The order said that X must respond within 72 hours or risk losing the “safe harbor” protections that shield it from legal liability for user-generated content.

Techcrunch event

San Francisco
|
October 13-15, 2026

French authorities also said they are taking action, with the Paris prosecutor’s office telling Politico that it will investigate the proliferation of sexually explicit deepfakes on X. The French digital affairs office said three government ministers have reported “manifestly illegal content” to the prosecutor’s office and to a government online surveillance platform “to obtain its immediate removal.”

The Malaysian Communications and Multimedia Commission also posted a statement saying that it has “taken note with serious concern of public complaints about the misuse of artificial intelligence (AI) tools on the X platform, specifically the digital manipulation of images of women and minors to produce indecent, grossly offensive, and otherwise harmful content.”

The commission added that it is “presently investigating the online harms in X.”



Source link

  • Related Posts

    How to de-Gemini your Google apps

    Over the past couple of years, Google has found ways to stuff Gemini in nearly every app and service it offers. Whether it’s Gmail with its AI inbox or Chrome…

    Why opinion on AI is so divided

    This story originally appeared in The Algorithm, our weekly newsletter on AI. To get stories like this in your inbox first, sign up here. In an industry that doesn’t stand still,…

    Leave a Reply

    Your email address will not be published. Required fields are marked *

    You Missed

    The best adults-only, all-inclusive resorts

    The best adults-only, all-inclusive resorts

    Mamdani plans for New York City-run grocery stores in nod to socialism

    Mamdani plans for New York City-run grocery stores in nod to socialism

    Anna Kepner’s stepbrother charged months after the cheerleader was found dead on a cruise ship

    Anna Kepner’s stepbrother charged months after the cheerleader was found dead on a cruise ship

    Steelers visit with QB Taylen Green

    Steelers visit with QB Taylen Green

    S&P/TSX composite gains ground, oil tops US$100 as U.S. vows blockade

    S&P/TSX composite gains ground, oil tops US$100 as U.S. vows blockade

    Avi Lewis says high-speed rail project should be fully publicly owned