Elon Musk’s Grok AI posted CSAM image following safeguard ‘lapses’


Elon Musk’s Grok AI has been allowing users to transform photographs of woman and children into sexualized and compromising images, Bloomberg reported. The issue has created an uproar among users on X and prompted an “apology” from the bot itself. “I deeply regret an incident on Dec. 28, 2025, where I generated and shared an AI image of two young girls (estimated ages 12-16) in sexualized attire based on a user’s prompt,” Grok said in a post. An X representative has yet to comment on the matter.

According to the Rape, Abuse & Incest National Network, CSAM includes “AI-generated content that makes it look like a child is being abused,” as well as “any content that sexualizes or exploits a child for the viewer’s benefit.”

Several days ago, users noticed others on the site asking Grok to digitally manipulate photos of women and children into sexualized and abusive content, according to CNBC. The images were then distributed on X and other sites without consent, in possible violation of law. “We’ve identified lapses in safeguards and are urgently fixing them,” a response from Grok reads. It added that CSAM is “illegal and prohibited.” Grok is supposed to have features to prevent such abuse, but AI guardrails can often be manipulated by users.

It appears X has yet to reinforced whatever guardrails Grok has to prevent this sort of image generation. However, the company has hidden Grok’s media feature which makes it harder to either find images or document potential abuse. Grok itself acknowledged that “a company could face criminal or civil penalties if it knowingly facilitates or fails to prevent AI-generated CSAM after being alerted.”

The Internet Watch Foundation recently revealed that AI-generated CSAM has increased by an increase orders of magnitude in 2025 compared to the year before. This is in part because the language models behind AI generation are accidentally trained on real photos of children scraped from school websites and social media or even prior CSAM content.



Source link

  • Related Posts

    Microsoft launches ‘vibe working’ in Word, Excel, and PowerPoint

    Microsoft is rolling out a new Agent Mode inside Office apps like Word, Excel, and PowerPoint this week. Previously described by Microsoft as “vibe working,” the Agent Mode is a…

    Microsoft issues emergency update for macOS and Linux ASP.NET threat

    Microsoft released an emergency patch for its ASP.NET Core to fix a high-severity vulnerability that allows unauthenticated attackers to gain SYSTEM privileges on devices that use the Web development framework…

    Leave a Reply

    Your email address will not be published. Required fields are marked *

    You Missed

    What Review Score Would You Give Pragmata?

    What Review Score Would You Give Pragmata?

    Iran Attacks and Seizes Several Ships as Tensions Escalate

    Iran Attacks and Seizes Several Ships as Tensions Escalate

    Microsoft launches ‘vibe working’ in Word, Excel, and PowerPoint

    Microsoft launches ‘vibe working’ in Word, Excel, and PowerPoint

    Former boss at Lucy Letby’s hospital arrested on suspicion of perverting course of justice | UK news

    Former boss at Lucy Letby’s hospital arrested on suspicion of perverting course of justice | UK news

    Brazil's VP Alckmin, a negotiator of the Mercosur-EU deal, sees it as relief in a turbulent world

    Brazil's VP Alckmin, a negotiator of the Mercosur-EU deal, sees it as relief in a turbulent world

    Your pint could come with a surprising health benefit

    Your pint could come with a surprising health benefit