Grok AI Access Halted in Malaysia Due to Image Misuse

In a decisive move, Malaysia has suspended access to the AI chatbot Grok amid reports of its misuse for creating sexualized and non-consensual images. This decision follows a similar prohibition in Indonesia, underscoring a growing global vigilance regarding the impacts of generative AI technologies.

Grok, developed by Elon Musk's xAI, has recently imposed restrictions on its image generation capabilities, limiting them to paying users after lapses enabled the creation of explicit content without consent.

The Malaysian Communications and Multimedia Commission (MCMC) cited frequent misuse of Grok “to generate obscene, sexually explicit, and indecent images, including those featuring women and minors” as the basis for the ban. The agency pointed out that earlier interventions relying on user reports did not adequately prevent harmful material.

MCMC has stated that the ban will persist until comprehensive technical safeguards and moderation protocols are executed. The regulator reaffirmed Malaysia’s stringent online content laws, which prohibit obscene and pornographic material, mandating that platforms take proactive measures against misuse.

Currently, xAI has not provided a comprehensive response, although the company has expressed disagreement with the media coverage. Malaysian officials also indicated they are willing to engage in dialogue with the firm to ensure adherence to safety standards.

As concerns about harmful online content rise, Malaysia is intensifying its oversight of digital platforms, with talks of potentially restricting social media for users under 16.