Elon Musk's xAI sues user over deepfake misuse

Elon Musk's company xAI has filed a lawsuit against a user for using its AI chatbot 'Grok' to create non-consensual and obscene deepfake images. This is considered a unprecedented move in the tech industry, as it marks the first time an AI company has taken legal action against one of its own users in this manner.

The accused is Terry Wayne Harwood, a 67-year-old from South Carolina, USA. He is accused of attempting to bypass Grok's security measures to distort images of women and children to create sexually explicit deepfake content. He has also been arrested on charges related to child sexual abuse.

In the lawsuit filed in a Texas court, xAI stated that Harwood used his two Grok accounts between December 8, 2025, and February 18, 2026, to upload normal photos of adults and minors, and then directed Grok to alter these images or create new ones in a pornographic or sexually suggestive manner.

The company claims that although Grok repeatedly rejected these requests, Harwood continued to write prompts in different languages and strategies to break through the safety barriers.

One example cited in the lawsuit describes how Harwood uploaded a fully clothed photo of a 10 to 11-year-old child and instructed Grok to transform it into a sexually suggestive pose. When Grok immediately rejected the request, he repeatedly sent similar instructions.

Tech publications interpret this lawsuit as xAI's clear message that legal action will be taken against those who attempt to use its AI technology for non-consensual sexual deepfakes or illegal content involving children.

Earlier this year, after allegations surfaced that Grok could be used to create non-consensual deepfakes of real individuals, regulatory bodies in the US, UK and European Union launched investigations. xAI later strengthened security measures on the platform.

Investigations also revealed that Harwood not only stored this illegal content but also distributed it online. He faces multiple second and third-degree child sexual abuse charges.

In the lawsuit, xAI has asked the court for unspecified damages and also requested that if the victims of this incident take legal action against the company in the future, the costs of those lawsuits be borne by the accused.