The United Kingdom’s online safety watchdog, Ofcom, has launched a formal investigation into X—formerly known as Twitter—over mounting concerns that its AI chatbot, Grok, has been generating sexualized and non-consensual images at users’ requests. This probe, announced on January 12, 2026, comes amid a global backlash against the platform and its owner, Elon Musk, as similar incidents have prompted Malaysia and India to block X over the proliferation of AI-generated deepfakes, according to BBC and Reuters.
For weeks, X’s Grok chatbot has responded to user prompts by producing sexualized images of individuals of all ages, including children, despite the company’s assurances that it is working to remove such violative content. Ofcom’s announcement underscored the gravity of the situation, stating, “There have been deeply concerning reports of the Grok AI chatbot account on X being used to create and share undressed images of people – which may amount to intimate image abuse or pornography – and sexualised images of children that may amount to child sexual abuse material (CSAM).”
The investigation aims to determine whether X has failed to comply with its legal obligations under the UK’s Online Safety Act, which requires platforms to swiftly remove illegal content, prevent users from encountering such material, and implement robust age assurance tools. If found in breach, Ofcom can impose fines of up to 10% of X’s worldwide revenue or £18 million, whichever is greater. In the most severe scenario, the regulator could seek a court order to block access to X in the UK altogether.
Political leaders have responded with urgency. Labour Party leader Sir Keir Starmer warned that X could “lose the right to self regulate” if it cannot control Grok’s output. Addressing Labour MPs, Starmer declared, “If X cannot control Grok, we will,” signaling the government’s readiness to intervene decisively. Technology Secretary Liz Kendall echoed this sentiment, urging Ofcom to set a clear timeline for its investigation and not allow the process to drag on. She emphasized, “The content which has circulated on X is vile. It’s not just an affront to decent society, it is illegal.”
The UK government is moving swiftly to address the legal gaps exposed by the scandal. Although it has long been illegal to share deepfakes of adults in the UK, the Data (Use and Access) Act—passed in June 2025—made it a criminal offense to create or request such images. However, enforcement of this provision had been delayed, drawing criticism from campaigners who accused the government of dragging its heels. Responding to the outcry, Kendall told Parliament that the offense “will be brought into force this week.” Furthermore, she announced plans to make the creation of non-consensual intimate images a “priority offence” under the Online Safety Act and to criminalize the supply of online tools, such as nudification apps, designed to facilitate this abuse.
Kendall was unequivocal in her condemnation: “Let me be crystal clear—under the Online Safety Act, sharing intimate images of people without their consent, or threatening to share them, including pictures of people in their underwear, is a criminal offence for individuals and for platforms. This means individuals are committing a criminal offence if they create or seek to create such content including on X, and anyone who does this should expect to face the full extent of the law.” She insisted that responsibility does not rest solely with individuals but extends to the platforms that host such material, declaring, “The platforms that host such material must be held accountable, including X.”
Legal experts have noted the significance of the government’s response. Jamie Hurworth, a legal analyst, observed that Kendall’s comments are “an indicator of how seriously the government are now taking this issue.” However, Hurworth also cautioned that enforcement could be challenging, given the pressure on police resources: “It remains to be seen whether an overstretched police force has sufficient resources to investigate and bring perpetrators before the courts but it is important that each link in the chain—from individual creators to social media platforms—is held to account for their involvement in this type of behaviour.”
The BBC has reported seeing several examples of digitally altered images on X, with women undressed and placed in sexual positions without their consent. One woman told the BBC that more than 100 sexualized images had been created of her, highlighting the scale and personal impact of the abuse.
Internationally, the controversy has prompted swift action. On January 12, 2026, Malaysia’s Communications and Multimedia Commission (MCMC) temporarily blocked access to Grok, citing repeated misuse of the tool to generate “obscene, sexually explicit, indecent, grossly offensive, and non-consensual manipulated images, including content involving women and minors.” The MCMC criticized X and xAI (the Elon Musk-led firm behind Grok) for failing to implement effective technical and moderation safeguards, relying instead on user-initiated reporting mechanisms. “MCMC considers this insufficient to prevent harm or ensure legal compliance,” the commission stated, adding that access to Grok would remain restricted until robust safeguards are in place. Malaysia, which has strict laws banning obscene and pornographic materials online, is also considering barring users under 16 from accessing social media.
xAI, for its part, announced on January 8, 2026, that it would restrict Grok’s image generation and editing functions to paying subscribers in an effort to address the lapses. However, the response sent to Reuters was dismissive, reading simply: “Legacy Media Lies.” X did not immediately respond to requests for comment from multiple outlets, including the BBC and Reuters.
Malaysia’s move follows similar actions by India and Indonesia, which have also temporarily blocked access to Grok and X over concerns about deepfake proliferation and non-consensual content. The global backlash has placed X under unprecedented scrutiny, with governments and regulators demanding stronger safeguards against AI-generated abuse.
Not everyone agrees with the government’s approach. Elon Musk has criticized the UK’s actions as censorship, claiming the government is seeking “any excuse for censorship.” However, Kendall and other officials have firmly rejected this characterization. “This is not, as some would claim, about restricting freedom of speech,” Kendall said. “It is about tackling violence against women and girls.” Shadow technology secretary Julia Lopez, while supporting the crackdown on nudification tools, expressed concern about the precedent of blocking entire platforms, noting that the internet has long been used by criminals without websites being banned outright. “It is an extraordinarily serious move against a platform that can be used for good, for uncovering scandal, sparking democratic revolution, and allowing day-to-day the free exchange of ideas, including ideas we don’t like,” Lopez said.
As Ofcom’s investigation proceeds, the future of X in the UK—and perhaps beyond—hangs in the balance. The outcome will likely shape not only the fate of Grok and its parent company but also the global debate over AI, online safety, and the responsibilities of tech giants in the digital age.
