AI-generated deepfakes are actively disrupting classrooms and damaging reputations today. Students are targeting their classmates, and some are fabricating explicit media of teachers. In response, school districts are trying to update their cyberbullying guidelines. Recent federal enforcement and local policy changes show that communities must address this digital risk immediately.
What Happened
Educators and students are vulnerable to malicious generative artificial intelligence. In Iowa, the North Polk Community School District upheld a year-long suspension for a student who used AI to generate graphic, defamatory videos targeting 15 staff and board members. The problem is global. Teachers in Scotland have faced a surge in AI-generated pornography and violent clips created by students.
Students are also targeting their classmates. At Westfield High School in New Jersey, student Francesca Mani and other girls had their likenesses morphed onto nude photos and distributed on Snapchat. This incident prompted strict legal reform in New Jersey to penalize nonconsensual synthetic media. It showed how quickly explicit content can spread through a school, causing severe psychological harm.
The Bigger Picture
The federal government is holding online platforms accountable. The Federal Trade Commission (FTC) recently began enforcing Section 3 of the Take It Down Act, which requires online platforms to remove reported intimate images and digital forgeries within 48 hours. The FTC has already sent warning letters to major tech companies like TikTok, Meta, and Snapchat to ensure compliance.
At the local level, schools are finding that older cyberbullying policies do not work for AI. Districts are writing new rules to address generative technology. For example, Palm Beach County schools approved a policy banning the creation and promotion of deepfakes. Boston Public Schools proposed similar strict restrictions. In Pennsylvania, the Radnor Township School District is rewriting its procedures to protect students during investigations following parent backlash.
What This Means for Families
The legal and emotional stakes are high for families. Since anyone can generate deepfakes easily, any public photo is vulnerable. Technology providers like GoGuardian and Lightspeed Systems are building AI-driven nudity detection and monitoring tools, but software cannot solve a cultural problem. Families must realize that creating or sharing these images can lead to juvenile delinquency charges or long-term suspensions, even if the student claims it was a joke.
What You Can Do
- Talk to your child about the legal and social consequences of creating synthetic media. Remind them that digital content is permanent.
- If a child is targeted, use the official portal at TakeItDown.ftc.gov to demand that platforms remove the explicit images immediately.
- Advocate for clear school district policies that ban AI-generated harassment and establish safe investigative protocols.