AI chatbot Grok used to create child sexual abuse imagery, watchdog says | Grok AI


Online criminals are claiming to have used Elon Musk’s Grok chatbot to create sexual imagery of children, as a child safety watchdog warned the AI tool risked bringing such material into the mainstream.

The UK-based Internet Watch Foundation (IWF) said users of a dark web forum boasted of using Grok Imagine to create sexualised and topless imagery of girls aged between 11 and 13. IWF analysts said the images would be considered child sexual abuse material (CSAM) under UK law.

“We can confirm our analysts have discovered criminal imagery of children aged between 11 and 13 which appears to have been created using the tool,” said Ngaire Alexander, the head of the IWF’s hotline, which investigates reports of CSAM from members of the public.

X, Elon Musk’s social media platform, has been deluged with images of women and children whose clothes have been digitally removed by the Grok tool, sparking public outcry and condemnation from politicians.

Meanwhile, on Wednesday, the House of Commons women and equalities committee said it would no longer use X for its communications, saying it was no longer appropriate to do so given preventing violence against women and girls was among its key policy areas.

The decision marks the first significant move by a Westminster organisation to exit X in response to the misuse of Grok. While the decision concerned only the committee’s account, some individual members, including the Labour chair, Sarah Owen, have already stopped using X. Another, the Liberal Democrat MP Christine Jardine, said she was leaving the platform, calling the images generated by Grok “the last straw”.

Alexander said the imagery viewed by the IWF has been used to create even more extreme material – known as Category A, which includes penetrative sexual activity – using a different AI tool.

“We are extremely concerned about the ease and speed with which people can apparently generate photo-realistic child sexual abuse material. Tools like Grok now risk bringing sexual AI imagery of children into the mainstream. That is unacceptable,” Alexander added.

Musk’s xAI, which owns Grok and X, has been approached for comment.

Downing Street said “all options were on the table”, including a boycott of X as ministers backed the UK regulator, Ofcom, to take action.

On Wednesday, the prime minister’s official spokesperson said: “X needs to deal with this urgently and Ofcom has our full backing to take enforcement action wherever firms are failing to protect UK users.

“It already has the power to issue fines of up to billions of pounds and even stop access to a site that is violating the law.”

Requests for Grok to manipulate images of women to “put her in a bikini” continued to flood in on X on Wednesday. Despite the warnings of EU and UK regulatory action, there was no evidence that the platform had installed tighter safeguards, and pictures of teenage girls continue to be stripped down digitally at the request of X users, to show them in small, revealing items of underwear, or positioned in sexually explicit poses.

Some users have demanded more extreme content, asking the chatbot to decorate bikinis with swastikas, or requesting alterations to photographs of women so they appear to be victims of abuse. The chatbot has obliged by adding cigarette burns, facial bruising, and blood to some images of women.

The UK’s data watchdog – the Information Commissioner’s Office (ICO) – said it had contacted X and xAI “to seek clarity on the measures they have in place to comply with UK data protection law and protect individuals’ rights”, adding people have “a right to use social media knowing their personal data is being handled lawfully and with respect”.

X has said it takes action against illegal content, including child sexual abuse material, “by removing it, permanently suspending accounts, and working with local governments and law enforcement as necessary”.



Source link

  • Related Posts

    Ukraine gets US$106B loan package from EU after Hungary changes vote – National

    The European Union on Thursday approved a massive loan package to help Ukraine meet its economic and military needs for the next two years, the bloc’s Cypriot presidency said, after…

    Five things we learned from Cat Little’s evidence to MPs about the Mandelson saga | Politics

    In more than 90 minutes of evidence to the foreign affairs select committee about the Peter Mandelson scandal, Cat Little, the head civil servant in the Cabinet Office, was low…

    Leave a Reply

    Your email address will not be published. Required fields are marked *

    You Missed

    Chinese hackers are using everyday devices to hack UK firms, warns watchdog | Cybercrime

    Chinese hackers are using everyday devices to hack UK firms, warns watchdog | Cybercrime

    Content Creator Completes Record-Breaking Charity Stream, But Viewers Still Find Something To Complain About

    Content Creator Completes Record-Breaking Charity Stream, But Viewers Still Find Something To Complain About

    Europe’s resistance to Chinese investment has stalled

    Ukraine gets US$106B loan package from EU after Hungary changes vote – National

    Ukraine gets US$106B loan package from EU after Hungary changes vote – National

    Patriots’ Mike Vrabel to seek counseling, will not be with team for Day 3 of the NFL Draft

    Patriots’ Mike Vrabel to seek counseling, will not be with team for Day 3 of the NFL Draft

    State-licensed medical marijuana reclassified as less dangerous drug

    State-licensed medical marijuana reclassified as less dangerous drug