Grok, Elon Musk's chatbot, has been banned in Malaysia and Indonesia for generating sexual deepfake images.

Malaysia and Indonesia have banned Grok, the chatbot created by Elon Musk, due to its ability to generate deepfake images with explicit sexual content. Authorities in both countries have emphasized that this feature can be used to produce pornography involving women and children, which constitutes a violation of human rights. The communications ministries of Malaysia and Indonesia have stated that they have requested stricter measures from platform X, but have not received adequate responses.

Users in Indonesia have reported traumatic experiences, discovering that their images have been manipulated without their consent. Kirana Ayuningtyas, an affected user, recounted the difficulties encountered in reporting these abuses. Alongside the bans in Southeast Asia, Grok is facing pressure in the UK, where officials are calling for measures against the platform for failing to comply with online safety laws. Leaders from around the world have condemned the use of Grok for generating sexualized images, deeming it an unacceptable practice.