X deletes 600 accounts, blocks content after government directive on Grok generating obscene images

X has blocked over 3,500 pieces of content and deleted 600+ accounts after Grok AI generated explicit material on the platform. X has now assured compliance with Indian laws and 'admitted' its mistake

Grok and xAI Grok and xAI logos | Reuters

Social media platform X (formerly Twitter) has deleted over 600 accounts and blocked over 3,500 pieces of content and stated that it will operate in compliance with the Indian laws on online content, sources told ANI on Sunday.

The move has come after India’s IT ministry gave time to X Corp, owned by Elon Musk, to file an action taken report on obscene and sexually explicit content generated by its AI chatbot Grok.

The sources said that X admitted its mistake and agreed to prevent the generation of obscene imagery on its platform.

"The social media platform 'X' (formerly Twitter) has admitted its mistake and stated that it will comply with Indian law. Around 3,500 pieces of content were blocked, and over 600 accounts were deleted. Going forward, X will not allow obscene imagery," ANI reported the sources as saying.

On January 2, The Indian government had asked X to immediately remove all obscene and sexually explicit content that was especially generated by Grok. The IT ministry noted that the AI chatbot was being used by users to generate and publicly share derogatory images and videos of women.

X was given 72 hours to submit a detailed action taken report which would spell out the the specific technical and organisational measures taken by the company to correct the issue, the role of the Chief Compliance Officer, and the actions taken against the content and users.

The centre also asked for specific details, such as action taken on obscene content linked to Grok AI.

Sources who spoke to PTI said that the response submitted by X on Wednesday was inadequate.  One official said the response was just X “essentially reproducing its own user policy across five pages and sending it to the ministry,” reported HT.

On Friday, Grok prevented non-paying users from generating images, and there was a noticeable decline in the number of explicit materials being generated.

Besides India, countries like the UK, France, and Malaysia have also pushed back against the content generation. Indonesia recently suspended the chatbot over concerns of AI-generated pornographic material.