Data-Driven Policing Still Problematic; Now Being Used By Government Agencies For Revenue Generation
from the defined-by-the-data-you-generate,-rather-than-the-person-you-are dept
Data, even lots of it, can be useful. But it also leads to erroneous conclusions and questionable correlations. Ever been baffled by the content of a "targeted" ad? Just imagine the fun you'll have when "lol 'targeted' ad" is replaced with nearly-incessant "interactions" with law enforcement.
The American Civil Liberties Union, citing reports that the Chicago Police Department used a computer analysis to create a “heat list” that unfairly associated innocent people with criminal behavior, has warned about the dangers of the police using big data. Even companies that make money doing this sort of work warn that it comes with civil rights risks.
“We’re heading to a world where every trash can has an identifier. Even I get shocked at the comprehensiveness of what data providers sell,” said Courtney Bowman, who leads the privacy and civil liberties practice at Palantir Technologies, a company in Palo Alto, Calif., that sells data analysis tools. He has lectured on the hazards of predictive policing and the need to prove in court that predictive models follow understandable logic and do not reinforce stereotypes.
When even the companies gathering the data are concerned about the implications, there's a problem. (One issue being: why don't they stop?) Anything that can be obtained (preferably in bulk) without a warrant will be. And it gets funneled into predictive policing software that attempts to mold disparate info into a usable whole. Lost in the shuffle are the individuals now represented by data points and algorithms. A data point located in the "wrong" neighborhood could result in surveillance backed by nothing resembling reasonable, articulable suspicion.
It's not all bad, though. There are uses for aggregate data that don't create privacy concerns or fears of ever more biased policing. As the New York Times article points out, the collected data frees up resources to deal with more serious crime by contributing to traffic management and reducing the amount of data entry needed to complete routine paperwork.
On the other hand, the desire to obtain any data available without a warrant is resulting in some very twisted uses of third-party records. In places like Chicago, the data-driven "wrong side of the tracks" can result in many innocent people being treated as inherently suspect. In Seattle, government agencies are hoovering up third-party records to maximize rent-seeking.
The county's animal services recently sent out loads of threatening letters to pet-owning residents, warning them that failing to get their pets properly licensed could lead to $250 fines. The county was going extract money from them either way.
But how did the county know who owned pets if they weren't licensed? It turns out they got their mitts on direct mail lists from stores that tracked customer purchasing habits through membership cards and the like. For the stores and the private retail environment, they're tools to more directly market consumers with goods they may want or need. In the hands of government, it becomes a lot more sinister. A woman who no longer owned a pet received one of these threatening letters and wondered what was going on.
The plan: compare these third-party mailing lists to pet registrations and send threatening letters to anyone on List A but not on List B. Sure, the county claims it won't be doing any follow-up enforcement -- like in-person visits from animal control officers with their hands out -- but the damage has already been done. People who no longer have pets are being hit with letters and plenty of unregistered pet owners will never even know the county is digging through third-party data in hopes of sniffing them out.
Once such government behavior becomes viewed as acceptable -- or not troublesome enough to result in losable lawsuits or massive public backlash -- it becomes the new normal. Today, the government comes for your unregistered pets. Tomorrow, it could be your children.
How about a threatening letter from Child Protective Services noting that your grocery purchases suggest you are not feeding your kids with foods the government deems the most healthy, and if you don't change your behavior, you may have a little visit? It's not an absurd idea, given we're seeing food nannies in the school system meddling with lunches parents are providing to their kids.
The solution would appear to be to prevent retailers from gathering so much data about their customers. But it isn't. Retailers can send as much garbage mail as they like in hopes of more sales, but all they can do is hint and beg. The government, on the other hand, has plenty of enforcement options to make unsolicited direct mail campaigns much more effective in separating people from their money. Or their pets. Or their kids. Or whatever.
Thank you for reading this Techdirt post. With so many things competing for everyone’s attention these days, we really appreciate you giving us your time. We work hard every day to put quality content out there for our community.
Techdirt is one of the few remaining truly independent media outlets. We do not have a giant corporation behind us, and we rely heavily on our community to support us, in an age when advertisers are increasingly uninterested in sponsoring small, independent sites — especially a site like ours that is unwilling to pull punches in its reporting and analysis.
While other websites have resorted to paywalls, registration requirements, and increasingly annoying/intrusive advertising, we have always kept Techdirt open and available to anyone. But in order to continue doing so, we need your support. We offer a variety of ways for our readers to support us, from direct donations to special subscriptions and cool merchandise — and every little bit helps. Thank you.
–The Techdirt Team
Filed Under: asset forfeiture, data, data driven policing, policing, revenue
Reader Comments
The First Word
“Oh, $urely thi$ i$n't $u¢h a hard que$tion to an$wer ¢orre¢tly...
Subscribe: RSS
View by: Time | Thread
Not to mention the 'threatening without proof' example is almost the same thing as the copyright shakedown companies like Rightshaven. Facts, truth, proof and innocence be damned - none of those are relevant when money can be collected.
[ link to this | view in chronology ]
Re:
[ link to this | view in chronology ]
Re: no surprise yet
A friend, a UCLA psychiatrist was on call every other weekend for years. When her 'Boss' called her in and ask why she was in Santa Barbra on a Sunday, she cut up her ATM card in 1976.
You guys are lucky, here in Southcentral, Animal Control walks yard to yard looking for any State owned un-licenced 'pets'. Outdoor un-neutered cats are a $300 fine for the person in possession of the animal.
LA county has outlawed ALL un-neutered dogs except those with pedigree papers, Darwin be damned.
[ link to this | view in chronology ]
It's not that they sent it out to everyone, they actually did a merge and removed existing licensed people and only sent it to people who did not have pet licenses. Unfortunately if you bought a pet product for a friend you are now officially in their cross-hairs. But in doing so they established their own database of individuals who they suspect and harass without cause.
I have two dogs, both are licensed and have been since we adopted them. But the idea of using what you purchased to aggressively peruse individuals is over the line of government duty. The laws provide fines for those who do not license pets, but, it doesn't mandate that they threaten those who do not have pets.
Our local newspaper reported on this along with all of our local news sources: http://www.seattletimes.com/life/pets/your-grocery-bill-may-help-king-county-track-unlicensed-pets/
[ link to this | view in chronology ]
Re:
[ link to this | view in chronology ]
Re: Re:
/s
[ link to this | view in chronology ]
[ link to this | view in chronology ]
A question about the 'unlicensed pets' example...
Or, as suggested above in the article, assume that you're buying pet products for a friend, maybe because you have a discount.
If the state notices and sends you a threatening letter to pay up for your 'unlicensed pet', what are you supposed to do about it? Can you be fined for not licensing your pet if you have no pet at all?
[ link to this | view in chronology ]
By the way, about that set of baby clothes you bought last year, I can't help but notice that there doesn't seem to be a baby here, we'll be taking you in for questioning.
[ link to this | view in chronology ]
We could call it, oh I dunno, does 'warrant' sound about right?
[ link to this | view in chronology ]
Re:
The government shot that idea down with it's "third party doctrine" excuse.
[ link to this | view in chronology ]
Re: Re:
[ link to this | view in chronology ]
Re: Re: Re:
They do not give a shit about anyone else, this they have demonstrated over and over again - and yet we continue to elect these assholes into positions of power and influence - wtf!
[ link to this | view in chronology ]
Already a problem - see the UK
There is a welfare benefit called "Tax Credits" I won't explain further as it is feindishly complicated and boring. Anyway one of the groups of people it is paid to is single parents on low/no incomes. "Compliance checking" was outsourced to a company called Concentrix. Basically they would write to some of the recipients with a letter that basically said: "We think you are livng with someone, you have a month to prove to us you aren't or we will stop your tax credits" They didn't tell them who they were supposed to be living with - you had to call them to find out. Then they didn't staff their call center so lots of people couldn't get through, and it appears that a number of the letters didn't get sent out properly.
Chaos ensues! The reason this is related to this bulk collection of data and computers processing it is this - some of the "people" that others were supposedly living with:
The local shop - with the name R.S. McColl
The housing association that they rented their home from - called Joseph Rowntree Foundation
Former tenants of the home - some of them dead.
Former partners of women fleeing domestic violence.
a "new adult" in the home - this was a child who had just turned 18.
Basically it was the sort of thing that should have been sorted out before threatening letters were sent out, or could have been resolved by a simple 10 minute phone call.
http://www.democraticaudit.com/2016/09/20/justice-outsourced-why-concentrixs-tax-credit-mistake s-matter/
https://www.theguardian.com/money/2016/sep/13/reign-of-terror-tax-credit-company-loses-hmrc -contract
[ link to this | view in chronology ]
Re: Already a problem - see the UK
Sounds like the "tax credit" was put in place in order to justify the eavesdropping spy bullshit they seem to drool over.
[ link to this | view in chronology ]
Re: Re: Already a problem - see the UK
[ link to this | view in chronology ]
Re: Re: Re: Already a problem - see the UK
Buzz word alert. You meant "political pile of bullshit" right?
[ link to this | view in chronology ]
Re: Re: Re: Re: Already a problem - see the UK
It is a low income benefit which is paid out four weekly or in special circumstances weekly, but it is calculated annually. If your income varies too much at the end of the year you can either be hit by an "overpayment" which will reduce your amount next year not just because your income has gone up but also by a further figure to pay back your "overpayment".
There are also payments that can be made to meet the costs of childcare - but only if the childcare is "Qualifying" and only if the costs are "reasonable".
Trying to work out how much you are entitled to is almost impossible by hand because of all the different parts of it, taper rates etc - basically you need a computer programme to actually do it.
Then there are the actual rules - all complicated.
If you have a job where your earnings are variable, or even worse you are self-employed then it just gets even more complex.
[ link to this | view in chronology ]
Re: Re: Re: Re: Re: Already a problem - see the UK
I am not a fan of welfare to begin with, but if it going to be available, it needs to NOT be complex. Complexity only increases the folds in which corrupt can and WILL hide. Those that do need the welfare need to easily get it.
When it comes to politics, the more complex it becomes the higher the bullshit is piled.
[ link to this | view in chronology ]
Re: Re: Re: Re: Re: Already a problem - see the UK
[ link to this | view in chronology ]
[ link to this | view in chronology ]
Re:
is the code word for "we are in bed with the government"
They may not be in bed willingly, but they have just made it clear that they have no intention of resisting the corruption that demands things of them. Well UNTIL it starts hitting their bottom line or there is a perceived threat to their business model.
No matter what any business says or does they have zero fucking reason to put "when required by law" in any legal ease because everyone already know that if the law requires it, then it supersedes the contract or agreement to begin with.
Most others will tell you that it is there for CYA purposes, which is true, but just the short translation for everything I just said but I believe mine places it into better context!
[ link to this | view in chronology ]
This is not going to end well for the store.
I mean eventually somebody is going to FOIA this, and/or leak it. After which everytime the notice goes out, I imagine a few of them are going to get folded into nice little baggies, and deposited at the appropriate doorsteps filled with flaming poo.
[ link to this | view in chronology ]
I never thought we'd see 1984 in America. Surprise surprise.
[ link to this | view in chronology ]
Oh, $urely thi$ i$n't $u¢h a hard que$tion to an$wer ¢orre¢tly...
[ link to this | view in chronology ]
Extortion business model
The government just wants its shot at some of the same quick income.
[ link to this | view in chronology ]