Technology

Four students sue school after AI gun alert triggers trauma

Four students are suing a school district and Omnilert after an AI gun alert triggered by a Doritos bag caused trauma. An investigation found no bias in the Omnilert system but suggested the school's delegation of authority to automated alerts failed the students.

Four students sue school after AI gun alert triggers trauma

A failure of human oversight

On October 20, 2025, an AI gun alert triggered by a Doritos bag caused trauma for four students. I find the school’s decision to allow an automated alert to dictate student safety without better human verification to be the most glaring error in this process. The Omnilert system sends images to staff to avoid missing a real weapon. In this case, the school’s designated safety staff reviewed the alert and canceled it within about two minutes, and they notified everyone who received the notice to ensure that the canceled alert stayed canceled. Mitchell said the company is reviewing the complaint. He noted that the OIG investigation found no bias in the Omnilert system but suggested that the school’s authority delegation failed the students. He also said, "What these four students went through on October 20, 2025 should not have happened, and we are truly sorry for the fear they and their families experienced."

The four students are suing the school and police because they want the school district and Omnilert to acknowledge that what happened to them was "unacceptable." Len Kamdang, who represents the teens for the Lawyers’ Committee, told The New York Times that this case is about how human beings allowed AI to substitute for their judgment. Kamdang stated that for a Black student, especially a young Black man in America, this situation is a "life-or-death situation." He also told the newspaper that for anyone with children, this is a "scary, scary situation." Frieda Winfield, the mother of one student, said she was shocked and felt angry. She told a local news outlet that her son’s caution "saved their lives in my opinion" because she taught him to be cautious around police. Because they are young Black men at school, Winfield said they did not understand why this happened to them. The Lawyers’ Committee is pushing for police reform because they believe accuracy is essential in life-and-death situations where officials might blindly trust AI-powered technology positioned as a public safety solution. They also noted that this injustice raises a broader concern regarding the reliability of AI-powered technology in public safety where accuracy is essential.