Malaysia's communications regulator will take legal action against X due to concerns over user safety and the misuse of its AI chatbot Grok. The regulator has identified the generation and dissemination of harmful content, including sexually explicit imagery, as a serious violation of Malaysian law. This follows similar actions and investigations by authorities in other countries.
The Malaysia n Communications and Multimedia Commission (MCMC) has announced it will pursue legal action against social media platform X due to concerns regarding user safety and the misuse of its AI-powered chatbot, Grok. The regulator has identified the generation and dissemination of harmful content, including obscene, sexually explicit, indecent, and non-consensual manipulated images, as a serious violation of Malaysia n law.
The content allegedly involves women and minors, prompting the MCMC to express serious concern, stating that such conduct contravenes Malaysian law and undermines X’s stated safety commitments. This move follows a global trend of authorities taking action against xAI, the Elon Musk-led company responsible for Grok, due to the chatbot's ability to generate and publish sexually explicit and manipulated imagery. The MCMC has already served notices to both X and xAI this month, demanding the removal of the harmful content. However, the commission reports that no action has yet been taken by either entity. The issue is especially critical in Malaysia, a Muslim-majority country with strict laws governing online content, including a ban on obscene and pornographic materials. Authorities there consider online gambling, scams, child pornography and grooming, cyberbullying, and content related to race, religion, and royalty as harmful.\This situation is part of a broader international response to the potential misuse of Grok. In France, government ministers have reported sexually explicit Grok-generated content to prosecutors and alerted the French media regulator, Arcom, to investigate the platform's compliance with the EU's Digital Services Act. Germany's media minister, Wolfram Weimer, has urged the European Commission to take legal action, warning of the risk of 'industrialisation of sexual harassment' due to the widespread availability of such tools. Italy's data protection authority has also voiced concerns, stating that creating 'undressed' deepfake imagery without consent could lead to serious privacy violations and even criminal charges. Sweden has also been affected, with political leaders condemning the generation of sexualized content involving the deputy prime minister, who was targeted by a user prompt. The European Commission has taken steps to preserve data related to Grok, extending a retention order sent to X last year until the end of 2026. India's IT Ministry issued a formal notice to X on January 2, directing the removal of obscene sexualized images generated or shared via Grok and requesting a report on actions taken within 72 hours. Australia’s online safety regulator, eSafety, is investigating Grok-generated 'digitally undressed' sexualized deepfake images, assessing adult material under its image-based abuse scheme.\In response to the growing concerns, Grok’s developer, xAI, and X, have implemented some restrictions. Currently, only paid subscribers are allowed to use the image generation and editing features on the platform. X has stated that it takes action against illegal content, including child sexual abuse material, by removing it, permanently suspending accounts, and cooperating with local governments and law enforcement agencies. Elon Musk has also stated that users who employ Grok to create illegal content will face the same consequences as those who upload illegal content directly. The legal actions and regulatory scrutiny highlight the urgent need for platforms to address the ethical and legal implications of AI-driven content generation, and protect users from harmful content. The international response shows a unified concern across multiple countries, reflecting the global reach of social media platforms and the complex challenges of regulating AI content. As authorities continue to investigate and take action, the future of Grok and other AI-powered content creation tools will depend significantly on the steps taken to ensure user safety and comply with evolving legal and ethical standards
Please follow us on Google to support usGrok AI Malaysia Content Moderation
Singapore Latest News, Singapore Headlines
Similar News: You can also read news stories similar to this one that we have collected from other news sources.
Malaysia suspends access to Musk's Grok AI over sexually explicit contentThis comes a day after Indonesia became the first country to deny all access to the AI tool.
Read more »
Singapore Legal Experts Discuss AI's Impact on the Future of LawLeading legal figures in Singapore, including the Chief Justice, Attorney-General, and Law Society President, discussed the transformative impact of artificial intelligence on the legal profession. They highlighted the risks of skill degradation, the evolving role of lawyers, and the need for proactive measures to ensure ethical and effective integration of AI in legal practice.
Read more »
Malaysia joins Indonesia in suspending access to Musk’s Grok AI over sexually explicit content concerns -%
Read more »
More AI training to help legal professionals plug competency gapsThe Singapore Academy of Law is set to roll out an AI-powered career coach app to help lawyers identify skills gaps and plan their professional development. It will also partner the Infocomm Media Development Authority to guide practitioners on using AI effectively and responsibly.
Read more »
Malaysia's Top Judge Warns of Overburdened Judiciary Due to Surging CaseloadThe Chief Justice of Malaysia highlights the immense pressure on the justice system due to a dramatic increase in court cases and a shortage of judges. He calls for urgent action to address the growing workload and welcomes a salary increment for judges.
Read more »
Johor police arrest Chinese national for flying Malaysia flag upside down in SenaiJohor police have arrested a 38-year-old Chinese national for allegedly flying the Malaysia flag upside down at an industrial premises in Johor's Senai. A 16-second video posted on social media shows the Malaysia flag, known as the Jalur Gemilang, flown inverted on one of two flagstaffs.
Read more »