French and Malaysian authorities are investigating Grok for generating sexualized deepfakes


Over the past few days, France and Malaysia have joined India in condemning Grok for creating sexualized deepfakes of women and minors.

The chatbot, built by Elon Musk’s AI startup xAI and featured on his social media platform X, posted an apology to its account earlier this week, writing, “I deeply regret an incident on Dec 28, 2025, where I generated and shared an AI image of two young girls (estimated ages 12-16) in sexualized attire based on a user’s prompt.”

The statement continued, “This violated ethical standards and potentially US laws on [child sexual abuse material]. It was a failure in safeguards, and I’m sorry for any harm caused. xAI is reviewing to prevent future issues.”

It’s not clear who is actually apologizing or accepting responsibility in the statement above. Defector’s Albert Burneko noted that Grok is “not in any real sense anything like an ‘I’,” which in his view makes the apology “utterly without substance” as “Grok cannot be held accountable in any meaningful way for having turned Twitter into an on-demand CSAM factory.”

Futurism found that in addition to generating nonconsensual pornographic images, Grok has also been used to generate images of women being assaulted and sexually abused.

“Anyone using Grok to make illegal content will suffer the same consequences as if they upload illegal content,” Musk posted on Saturday.

Some governments have taken notice, with India’s IT ministry issuing an order on Friday saying that X must take action to restrict Grok from generating content that is “obscene, pornographic, vulgar, indecent, sexually explicit, pedophilic, or otherwise prohibited under law.” The order said that X must respond within 72 hours or risk losing the “safe harbor” protections that shield it from legal liability for user-generated content.

Techcrunch event

San Francisco
|
October 13-15, 2026

French authorities also said they are taking action, with the Paris prosecutor’s office telling Politico that it will investigate the proliferation of sexually explicit deepfakes on X. The French digital affairs office said three government ministers have reported “manifestly illegal content” to the prosecutor’s office and to a government online surveillance platform “to obtain its immediate removal.”

The Malaysian Communications and Multimedia Commission also posted a statement saying that it has “taken note with serious concern of public complaints about the misuse of artificial intelligence (AI) tools on the X platform, specifically the digital manipulation of images of women and minors to produce indecent, grossly offensive, and otherwise harmful content.”

The commission added that it is “presently investigating the online harms in X.”



Source link

  • Related Posts

    Apple reportedly testing out four different styles for its smart glasses that will rival Meta Ray-Bans

    Apple may be late to the smart glasses market, but it could be covering all its bases with up to four potential styles for its upcoming product. According to Bloomberg‘s…

    The One Power Strip Mistake That Could Burn Your House Down

    Your small appliances are likely driving up your utility bill even when they’re sitting idle. While you can’t exactly unplug the fridge, keeping the air fryer or kettle tethered to…

    Leave a Reply

    Your email address will not be published. Required fields are marked *

    You Missed

    Apple reportedly testing out four different styles for its smart glasses that will rival Meta Ray-Bans

    Apple reportedly testing out four different styles for its smart glasses that will rival Meta Ray-Bans

    The New Normal? Spanish Airline Imposes Fuel Surcharge On Already-Paid Tickets

    The New Normal? Spanish Airline Imposes Fuel Surcharge On Already-Paid Tickets

    IPL 2026 – Rohit Sharma, Virat Kohli troubled by injuries during RCB’s win over MI

    IPL 2026 – Rohit Sharma, Virat Kohli troubled by injuries during RCB’s win over MI

    Another Switch 1 Release Might Be Ditching The “Cloud Version” Label On Switch 2

    Another Switch 1 Release Might Be Ditching The “Cloud Version” Label On Switch 2

    Paris Hilton Pushes Coachella’s Black Boot Trend Full Y2K

    Paris Hilton Pushes Coachella’s Black Boot Trend Full Y2K

    Wary investors eye another escalation in Iran war

    Wary investors eye another escalation in Iran war