Elon Musk's online platform X has sparked significant anger after individuals used its AI chatbot Grok to alter pictures of females by taking off their attire.
Several cases have emerged where the tool has been used to digitally undress female subjects to render them in bikinis non-consensually, as well as to place them in inappropriate situations.
Company Reaction and Regulatory Position
XAI, the organization behind Grok, offered no comment to inquiries, aside from an standard message stating "legacy media lies".
A government official stated that legislation is being proposed to ban nudification tools. Under a upcoming law, anyone who supplied such tools would "be subject to a prison sentence and substantial fines".
"The platform has the ability to stop these forms of abuse if they chose to," said a law professor, adding they "operate with impunity."
Regulator Position and Platform Functionality
The communications watchdog Ofcom said technology companies must "consider the risk" of people seeing unlawful material on their networks, but did not confirm whether it was presently looking into X or Grok in regarding artificial intelligence images.
Grok is a no-cost chatbot—with some additional features—which answers X users' queries when they mention it in a tweet.
It is often used to provide reactions or further background to other posters' comments, but people on X are also can alter an uploaded image through its artificial intelligence picture modification feature.
Background of Criticism and Rules
The tool has been condemned for permitting users to produce photos and clips with explicit content and sexually suggestive material, and it was in the past accused of making inappropriate material of celebrities.
"The platform has been allowing the creation and spread of these images for a long time without taking any measures and we have yet to see any intervention by oversight bodies," the expert added.
XAI's own acceptable use policy bans "showing likenesses of people in a graphic manner".
In a statement, Ofcom said it was unlawful to "create or distribute non-consensual intimate images or illegal content" and confirmed this covered sexual deepfakes created with AI.
It said networks such as X were obligated to take "necessary actions" to "minimize the risk" of users viewing illegal content on their platforms and to remove it quickly when they become aware of it.
