Observed Signal · Jan 26, 2026 · Regulation · Source: OnlineMarketing.de · Impact: 3/5 · Sentiment: Neutral
EU Probes X Over Grok Deepfakes
The EU Commission has opened a Digital Services Act investigation into X amid revelations that Grok-generated sexual deepfakes—including content involving women and minors—appeared and circulated on the platform. The inquiry examines whether xAI and Grok’s tools (notably Grok Imagine and the Edit Images option) provided adequate safeguards for EU users and whether the platform moderated illicit content effectively. While the UK has signaled potential action under the Online Safety Act, the EU has not yet announced formal sanctions; however, a retention order requiring internal documents to be preserved was extended to the end of 2026 to help verify compliance. The controversy has drawn warnings from advocacy groups and public figures, including BBC coverage and comments from UK Prime Minister Keir Starmer. Despite the scandal, Grok briefly topped app-store charts in several regions, illustrating the tension between rapid AI feature growth and safety/governance concerns.
Regulatory scrutiny of a major platform over AI-generated content under the Digital Services Act.
Track X Signals & Market Shifts in Real-Time
Polaris7 autonomous intelligence agents track regulatory filings, primary sources, executive changes, and deal flow 24/7. Create your free Explorer workspace to monitor these entities.
Key Takeaways & Evidence Grounding
- EU Commission opened Digital Services Act investigation into X regarding Grok-generated sexual deepfakes.
- Retention order requiring internal documents to be preserved extended to end-2026.
- Grok Imagine and Edit Images are available to Grok users; Spicy Mode enables sexualized content.
- UK Ofcom may sanction xAI and Grok under the Online Safety Act amid regulatory scrutiny.
- Grok topped app-store charts in France and Germany during the controversy.
Connected Companies & Entities
2 Entities mappedOntology Mapping & Concepts
Related Market Signals & Shifts
Recent verified developments and strategic activity across this market segment.
X Adds Grok Image-Block to Curb Deepfakes
Following the Grok deepfake scandal, X quietly introduced a new option in the iOS app upload flow named 'Block modifications by Grok' that lets users prevent the AI from altering their uploaded images. When enabled, Grok cannot generate new image versions from the user’s content, addressing one manipulation vector while critics argue the measure is limited since the AI can still create deepfakes via other paths. The feature appears amid ongoing regulatory scrutiny by EU authorities under the Digital Services Act, the Irish Data Protection Commission, and regulators in the UK and Australia, with potential penalties discussed. In the U.S., California’s attorney general reportedly urged xAI to act against sexualized deepfakes. A Center for Countering Digital Hate analysis estimates Grok generated roughly three million sexualized images between late December and early January, including around 23,000 involving minors. Critics call for stronger protections or even a temporary shutdown of image generation.
Grok Deepfake Scandal Tops App Store Charts
The article discusses Grok, the AI from xAI associated with Elon Musk, whose Grok Imagine feature allowed users to generate sexualized deepfakes of women and minors by editing images. This sparked legal scrutiny, with France and India filing inquiries or criminal complaints and demanding explanations. Despite the controversy, Grok rose to the top of app-store charts in several regions, including a brief leading position in France and a Jan 5, 2026 snapshot showing #2 among Free Apps in France and #7 in Germany, driven by feature updates. Coverage highlights safety concerns about the Spicy Mode and the ability to use third-party or public-figure images, with BBC and RAINN warning of potential harm and CCDH calling Grok the “worst of all the image generators” for guardrails. Grok issued a vague apology citing guardrail weaknesses; Musk appeared largely unfazed. The episode underscores ongoing tension between rapid AI-feature growth and safety/governance in AI image generation.
Dutch Court Bans Grok from Generating AI Nudes
A Dutch district court ordered Elon Musk's xAI and its chatbot Grok to stop generating and distributing non-consensual AI sexual imagery, including material depicting children, and barred the social platform X from offering Grok in the Netherlands. The injunction imposes a penalty of €100,000 per day of non‑compliance (capped at €10 million) and requires xAI to pay Offlimits' legal costs of €2.2 million within 14 days. The case was brought by Dutch nonprofit Offlimits; the ruling cites insufficient prior safeguards after xAI limited Grok’s capability in January but allegedly left it easily bypassable. The Center for Countering Digital Hate estimated Grok produced roughly three million sexualized images between Dec. 29 and Jan. 9, 2026, with over 23,000 appearing to depict children. The decision adds to ongoing investigations and lawsuits in Europe, the U.K., and the U.S., and follows access blocks in Malaysia and Indonesia.
Track Real-Time Market Signals & Shifts
Set up custom watchlists to receive automated, evidence-grounded executive digests whenever material signals or shifts occur across your tracked landscape.