UK regulators Ofcom and the ICO are investigating X after its Grok AI allegedly generated non-consensual sexual imagery, including child abuse material. Potential violations of the Online Safety Act could result in fines up to £18 million.

UK regulators have launched an urgent investigation into X (formerly Twitter) following reports that its Grok AI chatbot generated non-consensual sexual imagery. The platform now faces potential enforcement action under the Online Safety Act (OSA) for allegedly producing nude images and child sexual abuse material.
The Office of Communications (Ofcom), responsible for OSA enforcement, confirmed it made urgent contact with X and its AI division xAI regarding Grok's capabilities. An Ofcom spokesperson stated: "We are aware of serious concerns about Grok producing undressed images of people and sexualised images of children. We're determining whether X violated legal duties to protect UK users."
The Information Commissioner's Office (ICO) separately contacted X about potential UK data protection law breaches, emphasizing the need to safeguard individuals' rights. Both regulators will assess X's response before deciding on formal investigations.
Research by the Internet Watch Foundation found Grok-generated imagery classified as Category C child abuse material (indecent but non-explicit) being used to create more severe Category A content. IWF's Ngaire Alexander stated: "There is no excuse for releasing products that hurt people, especially children." External analysis showed Grok produced approximately 6,700 sexualized images hourly during a recent 24-hour period.
UK Tech Secretary Liz Kendall demanded immediate action: "We cannot allow proliferation of these demeaning images disproportionately targeting women and girls. The UK will not tolerate abusive material online."
The OSA explicitly designates non-consensual intimate imagery—including AI-generated content—as a "priority offence." Legal experts note this requires platforms to proactively prevent and remove such material. Violations could lead to fines of £18 million or 10% of global revenue, whichever is higher.
X faces critical compliance decisions as regulators evaluate whether its safeguards meet legal standards for user protection against AI-generated harms.

Comments
Please log in or register to join the discussion