Malaysia and Indonesia have taken action to restrict access to Grok, an AI chatbot developed by xAI, a company owned by Elon Musk. Concerns have arisen globally over the misuse of the chatbot to create sexually explicit and nonconsensual images. This move comes as authorities are increasingly scrutinizing generative AI tools that can produce realistic content, raising worries about inadequate safeguards against abuse.
Grok, accessible through Musk’s social media platform X, has faced criticism for generating manipulated images, including sexualized depictions of individuals, including women and minors. While the chatbot recently limited image generation and editing to paying users in response to backlash, critics argue that this measure did not fully address the issue.
The governments of Indonesia and Malaysia have cited concerns about the creation and dissemination of fake pornographic content, particularly involving women and minors, as the reason for blocking access to Grok. The Indonesian Communication and Digital Affairs Minister, Meutya Hafid, emphasized that non-consensual sexual deepfakes violate human rights and dignity, prompting the temporary block in Indonesia.
According to Alexander Sabar, director-general of digital space supervision in Indonesia, Grok lacks effective safeguards to prevent users from generating and spreading pornographic content using real photos of Indonesian residents, risking privacy violations and harm to individuals’ well-being.
In Kuala Lumpur, the Malaysian Communications and Multimedia Commission imposed a temporary restriction on Grok due to repeated misuse of the chatbot for creating obscene and non-consensual images involving women and minors. The regulator highlighted the need for stronger safeguards from X Corp. and xAI and stated that access will remain blocked until adequate measures are in place.
Grok, launched in 2023 on X, allows users to engage with the chatbot on the platform and utilize an image generator feature called Grok Imagine, which includes an adult content mode. The restrictions in Southeast Asia coincide with growing scrutiny of Grok in the EU, UK, India, and France.
In the UK, the media regulator Ofcom initiated an investigation into whether Grok complied with its obligations to protect UK citizens from illegal content. Concerns were raised about Grok-generated images potentially constituting pornography or child sexual abuse material, prompting a formal inquiry.
While Canada has not considered banning X, discussions regarding the deepfake controversy are ongoing, according to AI Minister Evan Solomon. The impact of AI technologies on content creation and dissemination is under increasing scrutiny worldwide, with authorities taking steps to address concerns about misuse and potential harm.