The EU Grok AI sexual deepfakes investigation has officially begun, placing Elon Musk’s social media platform X under intense regulatory scrutiny in Europe. The European Commission confirmed it is examining whether X violated the EU’s Digital Services Act (DSA) after concerns that its AI tool, Grok, was used to generate sexualised images of real people.
The move follows a similar investigation announced earlier this year by the UK regulator Ofcom, signaling growing international pressure on X over the misuse of generative AI.
What the EU Is Investigating
At the heart of the EU Grok AI sexual deepfakes investigation is whether X failed to adequately prevent the spread of manipulated sexually explicit images involving real individuals—content that EU officials say should never have reached users in the first place.
If X is found to have breached its obligations under the DSA, the Commission could impose fines of up to 6% of the company’s global annual turnover, along with possible interim measures if meaningful changes are not implemented.
Irish MEP Regina Doherty said the Commission will assess whether such content was shown to users in the EU and whether safeguards were sufficient.
X’s Response and Grok Restrictions
X previously said it had taken steps to limit Grok’s image-editing capabilities, claiming the AI was prevented from digitally altering photos to remove clothing “in jurisdictions where such content is illegal.”
Despite those assurances, campaigners and victims argue the damage was already done. Many say the ability to generate sexualised deepfakes using Grok should have “never happened,” reinforcing why the EU Grok AI sexual deepfakes investigation is being closely watched.
Adding fuel to the controversy, Elon Musk appeared to mock the new restrictions by posting an image on X shortly before the Commission’s announcement. Musk has repeatedly criticised regulators and governments scrutinising Grok, describing such actions as “any excuse for censorship.”
Broader Regulatory Net Tightens
The EU probe also expands an earlier investigation launched in December 2023 into risks linked to X’s recommender systems—the algorithms that amplify and distribute content on the platform.
Other countries are not waiting on Brussels. Investigations into Grok are underway in Australia, France, and Germany. The AI chatbot was temporarily banned in Indonesia and Malaysia, though Malaysia has since lifted its restriction.
According to the Grok account on X, more than 5.5 billion images were generated by the tool in just 30 days—an eye-catching figure that has intensified calls for stronger safeguards.
‘A Violent and Unacceptable Form of Degradation’
Henna Virkkunen, the Commission’s Executive Vice-President for Tech Sovereignty, Security and Democracy, did not mince words.
She described AI-generated sexual deepfakes as a “violent, unacceptable form of degradation” and said the EU Grok AI sexual deepfakes investigation would determine whether X treated the rights of European citizens—especially women and children—as “collateral damage.”
“No company operating in the EU is above the law,” she said.
Political Backlash From the US
The investigation comes just a month after the EU fined X €120 million over its blue tick system, ruling that it misled users. That decision drew sharp criticism from US officials, including Secretary of State Marco Rubio, who accused the EU of attacking American tech firms.
Musk reposted those comments, adding his agreement—further highlighting the geopolitical tensions surrounding the EU Grok AI sexual deepfakes investigation.
Why This Case Matters
This probe could become a defining test of how far the EU is willing to go in enforcing AI accountability under the DSA. For X, the outcome may shape how Grok—and future AI tools—operate not just in Europe, but globally.
For regulators, it sends a clear signal: generative AI innovation does not come with a free pass when fundamental rights are at stake.
Don’t miss out on our latest news—follow us for the latest AI news, breakthroughs, and insights that matter.