While the ban only applies in the Netherlands, the groups that brought the case said it could have wider repercussions since Grok can’t determine where a user is resident.
X didn’t respond to a request for comment.
The platform took steps to restrict features in January after Grok was found to be generating pictures of real people in bikinis or nude. Estimates have said that around 3 million pictures were generated in 11 days.
At the time, X said: “We remain committed to making X a safe platform for everyone and continue to have zero tolerance for any forms of child sexual exploitation, non-consensual nudity, and unwanted sexual content.”
The judge acknowledged that X and xAI have taken a range of measures to counter the spread of fake nudes and child sexual abuse material, but said it could not be certain that the measures that were taken are effective.
The case was brought by Offlimits, which fights online abuse, and Fonds Slachtofferhulp, which helps victims of crimes. They filed a complaint at the end of February.