Grok blocked in Indonesia and Malaysia over AI-generated sexualized images

Indonesia and Malaysia have become the first countries to block Elon Musk’s Grok after the AI tool was linked to manipulated images that sexualized women and minors. Officials said the move was necessary to protect the public from fake explicit content created using artificial intelligence.

Both governments said the suspension followed repeated misuse of Grok on X, formerly Twitter, where users shared altered photos and requested the tool to digitally undress people. Rights groups and officials in the UK, EU and India have also raised concerns, saying Grok lacks proper safeguards.

Musk’s xAI dismissed criticism with a brief comment to CNN, saying “Legacy Media Lies.” The company previously said it was working with law enforcement and banning violators, though manipulated images continued circulating.

Researchers analyzing user requests last month found more than half of the images Grok created featured people wearing minimal clothing, and many prompts focused on removing clothing from women.

Critics say Grok has fewer restrictions than other major AI systems. Inside xAI, sources say Musk resisted tighter controls and the company’s small safety team has recently shrunk.

X has begun limiting some image tools to paid users, but free editing features remain available. Regulators are beginning to respond: the UK’s Ofcom has launched an investigation into whether X is failing to prevent illegal content, including intimate image abuse and material involving minors. Penalties could reach up to £18 million or 10 percent of global revenue.