Lesley Mathis is aware that her daughter’s statement was incorrect. She didn’t anticipate that the 13-year-old girl would be arrested for it, though.
The school’s monitoring software was activated when the adolescent girl made an unpleasant joke while interacting with her peers online.
The Tennessee eighth grader was arrested before the morning was even done. According to her mother, she spent the night in a detention cell, was subjected to strip searches, and was questioned.
Even though the kid is not Mexican, her companions had labeled her “Mexican” and made fun of her tanned skin earlier in the day. She responded, “On Thursday we kill all the Mexico’s,” in response to a buddy who inquired about her plans.
Although Mathis called the remarks “wrong” and “stupid,” the context made it clear that they posed no danger.
I wondered, “Is this the America we live in?” About the arrest of her daughter, Mathis remarked. Additionally, the technology was really dumb, picking up words at random without considering context.
Students’ writing on school accounts and gadgets is being increasingly monitored by surveillance technology in American schools. Gaggle and Lightspeed Alert are two examples of the software that thousands of school districts employ nationwide to monitor children’s online behavior for indications that they might harm themselves or others. Artificial intelligence has made it possible for technology to intercept internet discussions and instantly alert law law enforcement and school administrators.
The technology has saved lives, according to educators. However, detractors caution that it may prosecute minors for irresponsible speech.
According to Elizabeth Laird, a director at the Center for Democracy and Technology, “it has routinized law enforcement access and presence in students’ lives, including in their home.”
Schools increase their level of danger awareness
Some states have taken a tougher stance on threats to schools in a nation tired of school shootings. One such state is Tennessee, which enacted a zero-tolerance policy in 2023 mandating that any threat of widespread violence against a school be reported right away to law authorities.
The 13-year-old girl detained in August 2023 had been chatting with classmates using a chat facility linked to her school email at Fairview Middle School, which utilizes Gaggle to monitor student accounts. (To preserve the girl’s privacy, the Associated Press has withheld her name. The school district did not reply to a request for comment.
According to a complaint filed against the school system, the youngster was taken to jail, interrogated and strip-searched, and her parents were not permitted to speak with her until the next day. She wasn’t sure why her parents weren’t there.
“She told me later, ‘I thought you hated me.’ Mathis, the girl’s mother, remarked, “That kind of haunts you.”
A judge ordered the girl to spend 20 days at an alternate school, get a psychological examination, and be under home arrest for eight weeks.
According to Jeff Patterson, CEO of Gaggle, the school system did not use Gaggle as planned. Finding early warning indicators and taking action before issues get serious enough to involve law enforcement is the goal, he added.
According to Patterson, “I wish that was treated as a teachable moment, not a law enforcement moment.”
Private student talks receive unexpected scrutiny
According to Shahar Pasch, a Florida education lawyer, students frequently are unaware that they are being watched as they interact with peers in private.
One of the adolescent girls she represented joked in a private Snapchat story about school shootings. The girl was detained on school property within hours after Snapchat’s automatic detection software picked up the comment and notified the FBI.
Alexa Manganiotis, 16, expressed her surprise at the speed at which monitoring software operates. Her school, Dreyfoos School of the Arts in West Palm Beach, tried a monitoring software last year called Lightspeed Alert. Alexa found out that two students had once created a threatening article about a teacher on a school computer and then erased it while interviewing the instructor for her school newspaper. Alexa stated that once Lightspeed picked it up, “they were taken away like five minutes later.”
According to Alexa, the penalties for what teenagers post online are worse than those for adults.
“If an adult makes a super racist joke that’s threatening on their computer, they can delete it, and they wouldn’t be arrested,” she told.
Understaffed schools may “be proactive rather than punitive” by using the software to spot early warning signals of bullying, self-harm, violence, or abuse, according to Amy Bennett, head of staff for Lightspeed Systems.
Law enforcement may respond to mental health emergencies using the technology as well. During four years, the school safety program in Florida’s Polk County Schools—a system with over 100,000 students—received about 500 Gaggle alarms, officers said at public Board of Education sessions. As a result, 72 cases of involuntary hospitalization occurred under the Baker Act, a state statute that permits authorities to force people to undergo mental health assessments against their will if they are a risk to themselves or others.
Sam Boyd, a lawyer with the Southern Poverty Law Center, stated that a substantial number of children who have involuntary examinations recall it as a very stressful and harmful experience — not something that aids in their mental health treatment. West Palm Beach and Polk school districts did not comment.
False alarms are prevalent, according to a research
Unless schools monitor the data themselves, technology corporations hold a close hold on information that may help them evaluate the software’s efficacy, such as the frequency of false warnings.
Over the course of the last 10 months, Gaggle has reported over 1,200 occurrences to the school system in Lawrence, Kansas. But according to an Associated Press study of data obtained through a public information request, school administrators determined that almost two-thirds of those warnings were not problems, including more than 200 false alarms from student assignments.
A photography class’s students were summoned to the principal’s office because of worries that Gaggle had discovered nudity. The students’ Google Drives had automatically erased the photographs, but those who kept copies of the flagged images on their own devices demonstrated that the warning was false. Later, district officials claimed, they changed the software’s settings to lower the number of false alarms.
Graduating in 2024, Natasha Torkzaban said she was flagged for revising a friend’s college essay which contained the term “mental health.”
The deep-rooted problem of teen mental health and the suicide rates in America is not something that should ideally be addressed with a new and shiny AI solution, but that’s where we are at the moment, Torkzaban stated. She was one of a group of Lawrence High School student journalists and artists who sued the school system last week, claiming Gaggle exposed them to unlawful surveillance.
Although school administrators have stated that they take Gaggle’s worries seriously, they also claim that the technology has identified dozens of impending threats of violence or suicide.
Anne Costello, a member of the Board of Education, stated at a July 2024 board meeting that “sometimes you have to look at the trade for the greater good.”
Mathis said that her daughter is doing better two years after their trauma, although she is still “terrified” of bumping across one of the school policemen who detained her. She cited her daughter’s alternative school’s instructors’ compassion as one positive aspect. Without passing judgment, they made time each day to listen to the children’s emotions and frustrations.
“It seems like we only want children to be these little soldiers, but they’re not,” Mathis said. “They are just human.”
