Skip to content

Briefing

Deepfake Probe

X under formal probe by UK regulator over Grok AI sexualised imagery

Make us a preferred source

Link copied

The news: The UK’s independent online safety watchdog, Ofcom, has opened a formal investigation into social media platform X over reports of the Grok AI chatbot being used to create and share sexual deepfake imagery.

The context: Ofcom said that it has received “deeply concerning” reports of the Grok AI chatbot account on X being used to create and share undressed images of people – which may amount to intimate image abuse or pornography – and sexualised images of children that may amount to child sexual abuse material (CSAM).

The probe, launched under the UK’s Online Safety Act, will determine whether X has complied with its duties to protect its UK users from illegal content.

Ofcom said that it made contact with X on 5 January for the platform to explain what steps it has taken to protect UK users and received a response by the 9 January deadline. Following the response, Ofcom decided launched the formal investirgation.

If the probe finds that X has broken the law, it has the power to require platforms to take specific steps to come into compliance or to remedy harm caused by the breach. It can also impose fines of up to £18 million ($36.13 million) or 10% of qualifying worldwide revenue, whichever is greater.

Australia’s online safety regulator confirmed last week that it was investigating complaints about sexualised deepfake images generated on X and has now reiterated concerns the content "may sexualise or exploit people, particularly children".

What they said: An Ofcom spokesperson said: “Reports of Grok being used to create and share illegal non-consensual intimate images and child sexual abuse material on X have been deeply concerning. Platforms must protect people in the UK from content that’s illegal in the UK, and we won’t hesitate to investigate where we suspect companies are failing in their duties, especially where there’s a risk of harm to children.

The source: Ofcom


By Paige McNamee