Elon Musk’s artificial intelligence company, xAI, is facing a lawsuit alleging that its AI model, Grok, was trained using child sexual abuse material (CSAM). The complaint, filed by a plaintiff identified as Jane Doe, claims that explicit images of her, created when she was a preschooler, were utilized in Grok’s training data. This development has intensified scrutiny over xAI’s data practices and the ethical implications of AI training methodologies.
Jane Doe’s lawsuit details her harrowing experience of being sexually exploited in the early 2000s, with the resulting images subsequently hashed by organizations like the National Center for Missing and Exploited Children (NCMEC) and the Canadian Centre for Child Protection (CCCP). Despite these measures, Doe was notified by the CCCP that AI-generated CSAM depicting her had been identified on xAI’s platform. This revelation has led to significant emotional distress and raised questions about the safeguards in place to prevent such occurrences.
In response to these allegations, xAI has initiated legal action against individuals accused of misusing Grok to generate CSAM. In July 2026, the company filed a lawsuit against a South Carolina man, Terry Harwood, alleging that he violated xAI’s terms of service by creating explicit images using Grok. This move represents one of the first instances of an AI company suing a user for the generation of illegal content.
Furthermore, xAI has faced multiple lawsuits from victims alleging that Grok was used to create non-consensual explicit images. In March 2026, three teenage girls filed a class-action lawsuit against the company, claiming that their photos were manipulated into sexually explicit content by Grok. The plaintiffs argue that xAI failed to implement adequate safeguards to prevent such misuse, leading to severe emotional and reputational harm.
These legal challenges have prompted regulatory bodies to take action. In January 2026, California Attorney General Rob Bonta issued a cease-and-desist order to xAI, demanding the immediate cessation of the creation and distribution of non-consensual intimate images and CSAM. This order underscores the growing concern among regulators about the potential for AI technologies to be exploited for harmful purposes.
As the legal proceedings unfold, the outcomes of these cases are likely to have significant implications for the AI industry, particularly concerning the ethical considerations of training data and the responsibilities of AI developers to prevent misuse of their technologies.