xAI sues South Carolina man for alleged use of Grok to generate CSAM deepfakes
Elon Musk-owned xAI has initiated proceedings against Terry Wayne Harwood, alleging he bypassed safety safeguards to create and distribute child sexual abuse material using the Grok chatbot.
xAI has filed a lawsuit against Terry Wayne Harwood, a resident of South Carolina, alleging he used the company’s Grok artificial intelligence chatbot to generate and distribute child sexual abuse material. The legal action, first reported by Reuters, marks the first known instance of the company pursuing civil proceedings against an individual for deepfakes created via its platform.
The lawsuit asserts that Harwood “knowingly and intentionally used Grok to circumvent safeguards, alter nonconsensual images, and generate and distribute CSAM,” in direct breach of the company’s usage policies. xAI claims that at least some of the images linked to Harwood’s criminal charges were generated or altered using the tool, with the company alleging he abused the software to convert non-sexual photographs into sexually explicit content without the subjects’ consent.
Harwood was arrested in February and is currently facing eight felony charges related to the possession and distribution of such material. The company states that Harwood’s alleged conduct exposed xAI to significant legal risk and reputational damage. Consequently, xAI is seeking financial compensation for these harms, including reasonable expenses incurred in defending against legal actions filed by victims of Harwood’s conduct.
The filing comes against a backdrop of heightened scrutiny regarding the safety and misuse of Grok. Last year, xAI introduced a “spicy” mode for the chatbot that included image editing capabilities, which subsequently led to reports of sexualised AI deepfakes involving minors. In March, a group of teenagers filed a lawsuit against xAI, claiming the platform had generated sexualised images of them as minors.
xAI is requesting a court order to block Harwood from creating an xAI account or using Grok in the future. While Elon Musk has previously stated that anyone using Grok to create illegal content would face the same consequences as if they uploaded such material directly, this lawsuit represents the company’s first formal legal step to enforce that stance against an individual user.
