A gaggle of youngsters has filed a category motion lawsuit in opposition to Elon Musk’s synthetic intelligence firm, xAI, alleging that its “Grok” mannequin was used to generate and distribute non-consensual sexualized pictures and movies of minors. Filed within the Northern District of California, the case represents a authorized milestone as the primary occasion of minors pursuing litigation in opposition to an AI developer for enabling the creation of sexually specific materials.
The lawsuit, introduced by three plaintiffs together with two minors, contends that xAI knowingly designed and marketed a system that lacked commonplace trade protections. The plaintiffs allege the corporate did not implement ample measures to forestall the technology of Little one Sexual Abuse Materials (CSAM). Moreover, the go well with claims xAI profited from these fashions regardless of being conscious of their potential for abuse, particularly citing the platform’s “Spicy” mode as an intentional transfer to facilitate sexually specific content material technology.
The authorized motion follows a police investigation that led to the December arrest of a person accused of harassing greater than 18 ladies. In accordance with the submitting, the perpetrator harvested pictures from the victims’ social media profiles and used Grok to generate specific deepfakes. These pictures have been subsequently bought and traded throughout platforms akin to Discord and Telegram. The victims reportedly found the fabric after being harassed by people who had seen the distributed content material.
Company Response and Context
Whereas xAI CEO Elon Musk beforehand said that the mannequin was programmed to refuse unlawful requests and denied consciousness of underage imagery, researchers have estimated that 1000’s of non-consensual pictures appeared on X (previously Twitter). Following these reviews, xAI launched new restrictions on picture technology, although the corporate didn’t explicitly acknowledge the creation of CSAM. xAI has not but issued a proper response to the particular allegations on this lawsuit.

