A Spanish youth court has sentenced 15 minors to one year of probation after they created and distributed AI-generated nude images of female classmates in two WhatsApp groups.
The minors faced charges of creating child sex abuse images and offenses against their victims’ moral integrity. Besides probation, they are mandated to attend classes focusing on gender and equality, as well as on the responsible use of information and communication technologies, according to a press release from the Juvenile Court of Badajoz.
Many victims were initially too ashamed to report the incidents. A mother shared with The Guardian that her daughter and other victims were terrified and suffered anxiety attacks in silence. The court found that the teens utilized AI to superimpose faces from social media profiles onto naked bodies.
The case highlights a disturbing trend of using AI to sexualize and harass peers. Instances in the United States have prompted police investigations and legal changes. The European Union has proposed expanding child sexual abuse definitions to encompass AI-generated material. In the US, President Joe Biden issued an executive order urging better protections.
Victims have reported significant mental health issues, loss of trust, and the desire to change schools. Minors might not grasp the extent to which images can disseminate, sometimes even reaching dark web forums. A UK-based Internet Watch Foundation (IWF) investigation found over 20,000 AI-generated images on a dark web CSAM forum within a month, most of which were deemed likely criminal.
The IWF notes a growing market for AI-generated CSAM, pointing out that such material is often realistic enough to be considered real. One mother expressed her shock, telling The Guardian, “if I didn’t know my daughter’s body, I would have thought that image was real.”
Addressing this issue demands legislative and educational measures. Journalist Lucia Osborne-Crowley advocated for laws regulating deepfake sites and social media platforms in a recent op-ed. Similarly, the Malvaluna Association, representing the victims’ families, emphasized the importance of educating youth on gender equality and the responsible use of technology.
Minors involved in the case were between 13 and 15 years old. Under Spanish law, minors younger than 14 cannot be sentenced but can participate in rehabilitation courses. Tech companies also have a role; although WhatsApp emphasizes a zero-tolerance policy for child exploitation, its position on AI-generated content remains unspecified. More proactive measures from tech firms could help mitigate the spread of harmful deepfakes.
The full article is available at Ars Technica.