LAHORE (Daily Point) — A mother and her 14-year-old daughter are at the forefront of a campaign for enhanced protections for victims in the wake of AI-generated explicit images circulating among students at a high school in Westfield, New Jersey. Simultaneously, authorities on the opposite side of the country are investigating a similar incident involving a teenage boy using AI to create and disseminate explicit images of fellow students in a suburban Seattle, Washington high school.
These distressing cases have once again drawn attention to the alarming proliferation of explicit AI-generated content, disproportionately affecting women and children, and spreading online at an unprecedented rate. Independent researcher Genevieve Oh’s findings reveal that over 143,000 new deepfake videos have been posted online this year, surpassing the total for all previous years combined.
Families impacted by these incidents are urgently calling on lawmakers to establish robust safeguards for victims whose images are manipulated using new AI models or various apps and websites openly advertising such services. Advocates and legal experts are also pushing for federal regulations that can provide uniform protections nationwide and send a clear message to potential perpetrators.
Dorota Mani, whose daughter was a victim in Westfield, emphasized, “We’re fighting for our children. They are not Republicans, and they are not Democrats. They just want to be loved, and they want to be safe.”
Although the issue of deepfakes is not new, experts argue that it is escalating as the technology to create it becomes more accessible and user-friendly. This year, researchers have been sounding alarms about the surge of AI-generated child sexual abuse material, using depictions of real victims or virtual characters. In June, the FBI warned about an increasing number of reports from victims, both minors and adults, whose photos or videos were manipulated to create explicit content shared online.
Several states have enacted their own laws over the years to combat the problem, but the scope varies. Texas, Minnesota, and New York recently passed legislation criminalizing nonconsensual deepfake porn, joining Virginia, Georgia, and Hawaii. Some states, such as California and Illinois, only empower victims to sue perpetrators for damages in civil court.
Several other states are contemplating their own legislation, including New Jersey, where a bill is in progress to ban deepfake porn and impose penalties on those who disseminate it. State Sen. Kristin Corrado, a Republican, expressed optimism about the bill’s passage, citing the heightened attention due to the Westfield incident.
The Westfield event occurred in the summer and was reported to the high school on Oct. 20. The AI-generated images were allegedly circulated among a group of friends on Snapchat. The school has not disclosed disciplinary actions, and authorities have not commented.
Details about the incident in Washington state, under investigation since October, have not been disclosed. Authorities have obtained search warrants, and the information is subject to change as the probe continues.
If the New Jersey incident leads to prosecution, current state laws against the sexual exploitation of minors may apply. However, Mary Anne Franks, a law professor at George Washington University, advocates for federal legislation providing consistent nationwide protections and penalties for organizations profiting from products and apps facilitating deepfake creation.
President Joe Biden’s October executive order calls for barring the use of generative AI to produce child sexual abuse material or non-consensual intimate imagery. It also directs the federal government to issue guidance for labeling and watermarking AI-generated content.
Dorota Mani and her daughter have taken proactive steps, creating a website and charity to aid AI victims. They are actively engaging with state lawmakers and planning a trip to Washington to advocate for stronger protections. Mani emphasizes the importance of support systems for affected children, saying, “Not every child, boy or girl, will have the support system to deal with this issue, and they might not see the light at the end of the tunnel.”