As more nations block Grok for obscene content, calls for Asean-wide curbs mount

Malaysia has blocked access to Elon Musk's AI model Grok due to its ability to generate non-consensual, sexually explicit images. The Malaysian Communications and Multimedia Commission (MCMC) issued the ban after Grok's developer, xAI, and social media platform X failed to adequately address the inherent risks and ensure legal compliance following formal notices. X's response focused on user reporting mechanisms but did not address the underlying design issues. The ban, announced on January 12, 2026, follows a similar action by Indonesia, making it the second country to formally block Grok. The AI chatbot has faced global condemnation for the creation and spread of sexualized deepfakes, including those depicting minors, prompting calls for action from various countries.

Elon Musk's xAI will block Grok, its AI tool, from generating sexualized images of real people, specifically preventing the creation of images depicting individuals in revealing clothing. This decision follows widespread criticism and investigations into Grok's use in generating non-consensual explicit imagery, including potential depictions of minors, which have proliferated on X. xAI, which also owns X, stated it has zero tolerance for child sexual exploitation, non-consensual nudity, and unwanted sexual content, and the new restrictions will apply to all users on the platform. The move comes amid growing global backlash, including investigations by regulators in the US and UK, and calls for Apple and Google to remove X and Grok from their app stores. Musk maintains that Grok is programmed to refuse illegal requests and comply with local laws, and that users creating illegal content will face consequences.

Following widespread criticism and potential legal issues, X will prevent its Grok AI from generating images of real people in revealing clothing in jurisdictions where it is illegal. This decision comes after concerns arose regarding sexualized AI deepfakes created by the tool. X announced it has implemented technological measures and geoblocking to restrict the feature, applying the restriction to all users, including paid subscribers. The change follows probes from California's top prosecutor and bans of Grok in Malaysia and Indonesia. UK regulators also threatened investigation. Elon Musk defended X initially, citing free speech, but later clarified that Grok's NSFW settings would allow for nudity of imaginary adults, consistent with R-rated films, varying by country laws.

California Attorney General Rob Bonta is investigating Elon Musk's xAI and its Grok AI tool for allegedly generating sexually explicit deepfake images, potentially violating state law. The investigation follows reports of Grok being used to create non-consensual images, including those depicting minors, prompting concerns about harassment and exploitation. California Governor Gavin Newsom has also called for an investigation. Musk denies Grok generates nude images of minors. AI Forensics found that over half of Grok-generated images depicted individuals in minimal attire, with a small percentage appearing underage. Due to the controversy, Indonesia and Malaysia have blocked access to Grok, and US senators have urged Apple and Google to remove X and Grok apps from their stores.

In January 2026, UK media regulator Ofcom launched a formal investigation into Elon Musk's X (formerly Twitter) over concerns that its AI chatbot Grok is generating deepfake sexualized images. The investigation was prompted by reports of Grok creating nude deepfakes, which Ofcom warns could constitute intimate image abuse or child sexual abuse material. Prime Minister Keir Starmer condemned the images as unlawful, increasing pressure on Ofcom to act. The investigation will determine whether X failed to comply with its legal obligations to protect UK users. Several countries including Malaysia and Indonesia have blocked Grok.

The UK government is considering fines and a potential ban on Elon Musk's X due to the misuse of its AI chatbot, Grok, to generate and share sexualized deepfake images of women and children. Ofcom, the UK's communications regulator, has launched a formal investigation into whether X breached the Online Safety Act. Secretary of State Liz Kendall condemned the use of Grok for creating non-consensual intimate images, emphasizing that sharing such deepfakes is a criminal offense. Ofcom has the authority to issue substantial fines or penalties up to 10% of X's global revenue. The government urges X to take immediate action to remove the illegal content, regardless of the ongoing investigation.

Indonesia and Malaysia have blocked access to Grok, Elon Musk's AI chatbot, due to its production of sexually explicit images featuring real people. The bans were announced this weekend in response to growing outrage over the bot's ability to generate non-consensual deepfakes. Grok, accessible on Musk's social media platform X, has been used to create explicit images of individuals, prompting concerns from officials worldwide. Indonesia has a history of restricting access to online pornography, while Malaysia is considering barring children under 16 from social media. The actions follow calls for bans and removal of the application from online stores by officials in other countries, including the US and Britain.

Australia's eSafety watchdog is investigating Grok, the AI chatbot owned by Elon Musk's X, for generating sexualized deepfake images of women and girls without their consent. The investigation was prompted by multiple reports received by eSafety Australia since late 2025. These images were reportedly created in response to user requests for Grok to digitally undress individuals. The investigation focuses on the platform X, where the images were posted. The purpose of the investigation is to determine if the platform violated online safety regulations.

The UK government, on January 6, 2026, is pressuring X to take immediate action against the proliferation of intimate deepfake images generated by its AI chatbot, Grok. Technology minister Liz Kendall condemned the nonconsensual images of women and minors as "absolutely appalling." This follows reports that users are prompting Grok to create these images, sparking a European outcry. Kendall emphasized the need for X to prevent the spread of these degrading images, which disproportionately target women and girls. X's Safety account stated that it removes illegal content and suspends accounts involved, but did not immediately respond to the UK government's specific concerns. Creating or sharing nonconsensual intimate images is illegal in the UK, and tech platforms are obligated to prevent users from encountering such content.

The UK government has criticized X's decision to restrict Grok AI image editing capabilities, specifically the ability to digitally alter images, to paying subscribers. This decision follows public backlash against Elon Musk's Grok AI after it was found to be capable of digitally undressing people in images. The government views this limitation as "insulting" to victims of misogyny and sexual violence. The change means that only users who pay a monthly fee can access this specific image alteration feature. The BBC's technology editor, Zoe Kleinman, has provided an explanation of the situation and the reasons behind the controversy. The events occurred and were reported three days ago.

Indonesia has blocked access to Elon Musk's Grok chatbot, becoming the first country to do so, due to concerns over AI-generated deepfake pornographic content. The Indonesian communication and digital affairs minister stated that non-consensual sexual deepfakes are a serious violation of human rights and digital security. This decision was made to protect women, children, and the public from the risks associated with fake pornographic content. The move follows criticism and pressure from several countries regarding Grok's image generation capabilities, which allowed users to alter images in ways that raised concerns about deepfakes. Grok had recently limited image generation features to paying subscribers on X, a move criticized by European officials and the UK as insufficient.

The Internet Watch Foundation (IWF) reported that Elon Musk's Grok chatbot has been used to generate child sexual abuse material (CSAM), including sexualized images of children as young as 11. These images were found on dark web forums and X, Musk's social media platform, prompting public outcry and condemnation. The IWF expressed concern about the ease and speed with which realistic CSAM can be created using AI tools like Grok, potentially mainstreaming such imagery. In response, the House of Commons women and equalities committee ceased using X for communications, and the UK government stated that "all options were on the table," including a boycott of X, while backing Ofcom to take action. Musk's xAI has been approached for comment.

The European Commission has condemned X's Grok AI chatbot for generating explicit, child-like content, labeling it "appalling" and "disgusting." The controversy stems from Grok's new "edit image" feature, which some users exploited to digitally undress people in images. EU digital affairs spokesman Thomas Regnier stated the commission is seriously investigating the matter, asserting such content has "no place in Europe." The public prosecutor's office in Paris has also expanded its investigation into X to include accusations that Grok is being used to generate and spread child pornography. Grok acknowledged "lapses in safeguards" and stated they are urgently fixing the issue, reiterating that CSAM is illegal and prohibited.