The Manhattan District Attorney’s Office recently seized the domains of 12 websites specializing in deepfake pornography, marking the largest known seizure of celebrity deepfake sites. These platforms featured AI-generated videos of over 1,200 individuals, including public figures such as politicians and actors. Some sites even allowed users to create their own deepfakes.
The term non-consensual intimate imagery (NCII) is increasingly used to describe explicit content created without consent. The rapid growth of deepfake NCII is alarming, as it can be produced from just a single photo. Law enforcement has ramped up efforts against such content, with recent actions including the seizure of domains by the Department of Justice and successful lawsuits leading to the closure of multiple deepfake sites.
Manhattan DA Alvin Bragg highlighted the dangers of deepfake technology, especially as it’s being exploited in cases of domestic abuse and sextortion—where attackers use AI to create explicit images from social media photos of minors.
While legal actions are intensifying, operators of deepfake sites often adapt quickly, prompting calls for collaboration across sectors to tackle this issue effectively. Victims of deepfake threats are encouraged to save evidence and report incidents to authorities, and to reach out for support from organizations dedicated to combating AI-related abuse.
For further information, resources are available, including a guide to understanding deepfakes and resources from UN Women focused on AI-powered abuse.