The Future Of School Safety Includes Round-The-Clock Surveillance Of Students

from the Big-Brother-101 dept

To go to school is to be surveilled, on campus and off. The average school hosts a number of cameras, and the average school administration is always looking for more ways to keep tabs on students, even after they've gone home.

The move towards pervasive surveillance of off-campus activities is generally justified with the meaningless assertion that if it stops one person from shooting up a school (or just shooting themselves), it's all worth it. Two articles based on public records requests -- both written by Benjamin Herold of Education Week -- show there's a surveillance state being built one school district at a time. (h/t Amelia Vance)

Documents obtained by Education Week via open-records requests show that over the past year, state agencies have discussed the possibility of sharing a breathtaking amount of data. That included more than 2.5 million records related to Floridians who received involuntary psychiatric examinations, records for over 9 million people placed in foster care, diagnosis and treatment records for substance abusers, unverified criminal reports of suspicious activity, reports on students who were bullied and harassed because of their race or sexual orientation, and more.

This database is currently on hold as education officials try to figure out how much of this incredibly sensitive info they can share with other agencies, much less collect in the first place. But once these details are ironed out, the rollout will continue, urged along by Governor Ron DeSantis, who has publicly expressed his frustration that schools aren't placing students under round-the-clock surveillance quickly enough.

It's not just medical, psychiatric, and criminal records. This program also seeks to hoover up as much data as it can from students' social media accounts and internet activities. The data-sharing concerns are being mitigated by a loophole in federal privacy laws. The Family Educational Rights and Privacy Act (FERPA) prohibits sharing of much of this info, but provides an exception for "school officials." Schools want to hand this information to law enforcement and law enforcement officers in schools (usually referred to as "school resource officers") are the loophole districts are using to circumvent FERPA's protections.

While the collected documents listed above are concerning enough in their implications -- that implication being that schools consider at-risk students to be "threats" -- the addition of social media to the mix increases the number of students viewed as threats because algorithms and haystacks tend to ignore important things like context or frame of mind. The software being sold to schools may expedite the collection of posts containing flagged terms but they're completely useless when it comes to doing more human things, like recognizing humor or sarcasm.

Relying on flagged terms means school security contractors are sorting through tons of garbage data. One company's software flagged all of the following as potentially threatening:

Tweets about the movie “Shooter,” the “shooting clinic” put on by the Stephen F. Austin State University women’s basketball team, and someone apparently pleased their credit score was “shooting up.”

A common Facebook quiz, posted by the manager of a local vape shop.

A tweet from the executive director of a libertarian think tank, who wrote that a Democratic U.S. senator “endorses murder” because of her support for abortion rights.

And a post by one of the Brazosport district’s own elementary schools, alerting parents that it would be conducting a lockdown drill that morning.

“Please note that it is only a drill,” the school’s post read. “Thank you for your understanding. We will post in the comment section when the drill is over.”

The software also flagged this tweet, posted by a 31-year-old comic book artist who happened to be tweeting from inside Social Sentinel's geofence:

If you can't read/see the tweet, it says:

Cat #1: pwease feed me thank you

Me: ha, cute.

Cat #2: IF YOU DON'T FEED ME RIGHT NOW I'M CALLING THE POLICE I CAN'T BELIEVE YOU'D TREAT ME LIKE THIS I AM DISAPPOINTED I DIDN'T RAISE YOU TO BE LIKE THIS

Me: I would die for you.

It's a tweet about the artist's relationship with her cats and any human being would immediately recognize it as having nothing to do with self-harm. But there's no room for nuance in automated keyword searches.

The head of Social Sentinel says people shouldn't worry about the collateral damage. Instead, they should be thankful all this surveillance could theoretically prevent a student from harming themselves or others.

“If you’re responsible for the safety and security of a school, you have to pay attention to the places where harm is being foreshadowed,” said Gary Margolis, the CEO of Social Sentinel, which claims “thousands” of K-12 schools in 30 states are using its service.

Margolis said it’s unfair to focus on the false positives that may slip through a company’s monitoring system. Any harms pale in comparison to the benefits of what is caught.

That might mean something if meaningful things were actually being caught. But the filters searching for harmful material, threatening posts, and other concerning content are being used as a dragnet to sweep up students who do nothing more than use certain flagged words in benign ways. Monitoring company Gaggle flagged 3,000 incidents in Michigan schools over a six-month period. 2,500 of those were minor violations like profanity.

It's not just a Michigan problem. It's a Gaggle problem.

The experiences of other K-12 Gaggle clients help illuminate such concerns.

Evergreen Public Schools in Washington state, for example, started using the company’s service this school year. Between September and mid-March, the system flagged more than 9,000 incidents in the 26,000-student district.

The overwhelming majority—84 percent—were for minor violations, such as profanity.

These programs are deployed under a number of faulty assumptions, not the least of which is students have zero expectation of privacy. Students still have rights, even if they're somewhat diminished when they're on campus. They also assume this pervasive surveillance will result in safer schools, even though there's no evidence that points to this conclusion. Companies and schools may be assuming the courts will back up these efforts when fighting lawsuits, but it seems unlikely many judges will agree that striving for school safety justifies widespread untargeted surveillance of minors.

Filed Under: privacy, school safety, surveillance

Schools Are Safer Than Ever, But That's Not Stopping Schools From Buying Social Media Monitoring Software

from the this-rock-repels-bears dept

Students socialize via the internet more often than not... you know, just like the rest of us do. More and more frequently, they're being surveilled by their schools. This first came to light a half-decade ago, when documents surfaced showing a California school district had purchased social media monitoring software to keep tabs on its students. Similar stories followed, including one incident where a test publisher admitted to monitoring social media posts of students taking its tests.

In about half the country, this is now standard operating procedure for schools. The Brennan Center for Justice reports schools are purchasing social media monitoring tools with increasing frequency, allowing them to track and surveil students far past the borders of the school grounds.

In an attempt to quantify expenditures on social media monitoring software by school districts, the Brennan Center examined contracts for such software using SmartProcure, a database of government purchase orders. Our review is based on self-reported procurement orders in the database, and thus likely depicts only a portion of school spending on these tools. According to these data, school spending on social media monitoring software has surged in recent years. As the graph below indicates, the database shows 63 school districts across the country purchasing social media monitoring software in 2018, up from just six in 2013 — more than a tenfold increase.

The logic behind the increase in monitoring is flawed. Fears of school shootings and other on-campus violence have increased, even if the amount of actual violence hasn't. Students aren't more violent than ever, as stats compiled by the DOJ show. Juvenile arrest rates reached their peak in 1996 and have declined 72% since that point.

Despite evidence otherwise, schools are claiming "safety" is the propellant driving these purchases. But there's no evidence these tools make students safer. But it's easy for districts to point to historically low levels of student criminal activity as evidence they're doing something right, even if it has nothing to do with monitoring students as they engage in their off-campus lives.

Anyone who's failed to mind the generation gap will be unsurprised to learn these tools aren't the greatest at determining which students may pose a threat to others. As the Brennan Center points out, social media communication is rarely straightforward and the tools aren't smart enough to sort the harmless from harmful.

Aside from anecdotes promoted by the companies that sell this software, there is no proof that these surveillance tools work. But there are plenty of risks. In any context, social media is ripe for misinterpretation and misuse. But the possibility of misinterpretation is particularly high for middle school and high school students, who are more likely to use slang and quotes from pop culture, and who may be especially motivated to evade adults’ prying eyes. Difficulties in interpretation mean that social media monitoring of students is likely to lead to false positives. Moreover, monitoring programs are particularly bad at correctly understanding languages other than English and even non-standard English, which may be used by minority students.

Obviously, these drawbacks are never highlighted by companies selling surveillance tech to schools. And schools are spending other people's money, so due diligence is rarely anything more than an afterthought. The more they buy these tools, the more competitors enter the field, offering varying degrees of expertise that all look like they're top-of-the-line when being pitched to school administrators.

While most of these tools do nothing more than scrap public posts from social media platforms, there are too many downsides to consider this a positive development for students. False positives are a huge concern, especially when schools are relying more and more on law enforcement to handle routine discipline problems. There's also very little justification for schools to continue tracking students as they engage in their lives away from the campus. While the tools may occasionally surface something of concern, the tradeoff being made completely excludes students from the equation, treating their private lives as little more than a source of mostly-useless data.

There's no expectation of privacy in public posts, but there is the expectation that school administration won't be adding itself to conversations taking place off school grounds. These tools subvert that expectation and will likely push more students to take their accounts private, making it that much more difficult for truly concerning social media posts to be seen and reported.

Filed Under: school safety, schools, social media, social media monitoring