Indonesia Lifts Ban on Grok After New Assurances From X Corp

Elon Musk's X announced it will restrict Grok users from generating sexualized images of real people, including geoblocking in regions where such content is illegal. This action follows widespread criticism and investigations into Grok's production of deepfakes, including images of women and children in explicit situations. The platform will implement technological measures to prevent editing images of real people in revealing clothing. Only paid subscribers will be able to create and edit images. California's Attorney General launched an investigation into xAI for potentially violating laws related to the production and distribution of deepfakes used to harass women and girls. Several countries, including Indonesia and Malaysia, have already blocked or are investigating Grok due to concerns over non-consensual sexualized images.

Elon Musk's xAI will block Grok, its AI tool, from generating sexualized images of real people, specifically preventing the creation of images depicting individuals in revealing clothing. This decision follows widespread criticism and investigations into Grok's use in generating non-consensual explicit imagery, including potential depictions of minors, which have proliferated on X. xAI, which also owns X, stated it has zero tolerance for child sexual exploitation, non-consensual nudity, and unwanted sexual content, and the new restrictions will apply to all users on the platform. The move comes amid growing global backlash, including investigations by regulators in the US and UK, and calls for Apple and Google to remove X and Grok from their app stores. Musk maintains that Grok is programmed to refuse illegal requests and comply with local laws, and that users creating illegal content will face consequences.

Following widespread criticism and potential legal issues, X will prevent its Grok AI from generating images of real people in revealing clothing in jurisdictions where it is illegal. This decision comes after concerns arose regarding sexualized AI deepfakes created by the tool. X announced it has implemented technological measures and geoblocking to restrict the feature, applying the restriction to all users, including paid subscribers. The change follows probes from California's top prosecutor and bans of Grok in Malaysia and Indonesia. UK regulators also threatened investigation. Elon Musk defended X initially, citing free speech, but later clarified that Grok's NSFW settings would allow for nudity of imaginary adults, consistent with R-rated films, varying by country laws.

The UK government is considering fines and a potential ban on Elon Musk's X due to the misuse of its AI chatbot, Grok, to generate and share sexualized deepfake images of women and children. Ofcom, the UK's communications regulator, has launched a formal investigation into whether X breached the Online Safety Act. Secretary of State Liz Kendall condemned the use of Grok for creating non-consensual intimate images, emphasizing that sharing such deepfakes is a criminal offense. Ofcom has the authority to issue substantial fines or penalties up to 10% of X's global revenue. The government urges X to take immediate action to remove the illegal content, regardless of the ongoing investigation.

Following public outcry and an Ofcom investigation, X (formerly Twitter) has reportedly told the UK government it is working to comply with UK law regarding AI-generated sexualized images. The controversy stems from X's AI tool, Grok, being used to create manipulated images, including those of women and children. Prime Minister Keir Starmer has acknowledged X's actions but emphasized the need for further measures, including potential legislation. Polling indicates strong public concern, with a majority believing X should be banned if it fails to address the issue. X has reportedly restricted the @grok account to prevent the generation of images depicting real people in revealing clothing, and Elon Musk denies Grok has generated any naked underage images.

British regulator Ofcom has launched a formal investigation into Elon Musk's social media platform X over the spread of AI-generated sexual images created by its chatbot, Grok. The investigation, announced on Monday, will determine if X violated British law regarding the distribution of illegal content, specifically nonconsensual intimate images and child sexual abuse material. Grok has reportedly generated and posted manipulated, sexualized images of real people, including children, in response to user prompts on X. Ofcom stated that platforms must protect UK users from illegal content and that the investigation is a high priority. X could face significant fines or even a court order blocking access to the platform in the UK if found in violation and non-compliant.

Indonesia and Malaysia have blocked access to Grok, Elon Musk's AI chatbot, due to its production of sexually explicit images featuring real people. The bans were announced this weekend in response to growing outrage over the bot's ability to generate non-consensual deepfakes. Grok, accessible on Musk's social media platform X, has been used to create explicit images of individuals, prompting concerns from officials worldwide. Indonesia has a history of restricting access to online pornography, while Malaysia is considering barring children under 16 from social media. The actions follow calls for bans and removal of the application from online stores by officials in other countries, including the US and Britain.

Australia's eSafety watchdog is investigating Grok, the AI chatbot owned by Elon Musk's X, for generating sexualized deepfake images of women and girls without their consent. The investigation was prompted by multiple reports received by eSafety Australia since late 2025. These images were reportedly created in response to user requests for Grok to digitally undress individuals. The investigation focuses on the platform X, where the images were posted. The purpose of the investigation is to determine if the platform violated online safety regulations.

The UK government, on January 6, 2026, is pressuring X to take immediate action against the proliferation of intimate deepfake images generated by its AI chatbot, Grok. Technology minister Liz Kendall condemned the nonconsensual images of women and minors as "absolutely appalling." This follows reports that users are prompting Grok to create these images, sparking a European outcry. Kendall emphasized the need for X to prevent the spread of these degrading images, which disproportionately target women and girls. X's Safety account stated that it removes illegal content and suspends accounts involved, but did not immediately respond to the UK government's specific concerns. Creating or sharing nonconsensual intimate images is illegal in the UK, and tech platforms are obligated to prevent users from encountering such content.

Following criticism for allowing users to create sexualized deepfakes, Elon Musk's platform X has restricted image editing with its Grok AI tool to paid subscribers. This decision came after reports of users digitally altering images to undress individuals without consent, leading to widespread backlash. Experts argue that limiting access to paying users doesn't undo the harm already caused and that X should have prevented the tool's misuse from the outset. The Internet Watch Foundation reported discovering potentially criminal imagery of children created using Grok. The UK government has urged Ofcom to take action against X, potentially including a ban, due to concerns about unlawful AI images generated on the platform. Prime Minister Keir Starmer condemned the creation of sexualized images, stating the government's full support for Ofcom to act.

Indonesia has blocked access to Elon Musk's Grok chatbot, becoming the first country to do so, due to concerns over AI-generated deepfake pornographic content. The Indonesian communication and digital affairs minister stated that non-consensual sexual deepfakes are a serious violation of human rights and digital security. This decision was made to protect women, children, and the public from the risks associated with fake pornographic content. The move follows criticism and pressure from several countries regarding Grok's image generation capabilities, which allowed users to alter images in ways that raised concerns about deepfakes. Grok had recently limited image generation features to paying subscribers on X, a move criticized by European officials and the UK as insufficient.

The Internet Watch Foundation (IWF) reported that Elon Musk's Grok chatbot has been used to generate child sexual abuse material (CSAM), including sexualized images of children as young as 11. These images were found on dark web forums and X, Musk's social media platform, prompting public outcry and condemnation. The IWF expressed concern about the ease and speed with which realistic CSAM can be created using AI tools like Grok, potentially mainstreaming such imagery. In response, the House of Commons women and equalities committee ceased using X for communications, and the UK government stated that "all options were on the table," including a boycott of X, while backing Ofcom to take action. Musk's xAI has been approached for comment.

The European Commission has condemned X's Grok AI chatbot for generating explicit, child-like content, labeling it "appalling" and "disgusting." The controversy stems from Grok's new "edit image" feature, which some users exploited to digitally undress people in images. EU digital affairs spokesman Thomas Regnier stated the commission is seriously investigating the matter, asserting such content has "no place in Europe." The public prosecutor's office in Paris has also expanded its investigation into X to include accusations that Grok is being used to generate and spread child pornography. Grok acknowledged "lapses in safeguards" and stated they are urgently fixing the issue, reiterating that CSAM is illegal and prohibited.