US Government Admits: Data Mining For Terrorists Doesn't Work
from the oops dept
Over the last few years, you probably have noticed multiple attempts by state and federal government agencies to collect more data on people and to share that data more widely. This is troubling for a variety of reasons, often having to do with privacy and questions concerning the quality of data, but those concerns are almost always pushed aside by claims that this data is necessary for fighting terrorism. There's this myth out there that if we just had more data, somehow we'd be able to stop terrorists. The problem is that this is untrue. More data often makes it even harder to find the important data, and now a detailed government report has basically confirmed that data mining doesn't help in finding terrorists.The report was put together by a bunch of well-respected academics, industry insiders and law enforcement officials on behalf of the National Research Council, and finds that the idea of plugging all this data into a machine and popping out terrorist identities is a myth. The report then lists out a variety of recommendations, concerning the use of any data mining systems, and how to make sure that individual privacy is protected. One key finding that will never be implemented: when using any such system, systematic reviews should be done to see if the systems are actually effective. If there's one thing we've seen with government programs over the years, such attempts to actually review something they've put in place to see if it actually worked are almost never done.
Thank you for reading this Techdirt post. With so many things competing for everyone’s attention these days, we really appreciate you giving us your time. We work hard every day to put quality content out there for our community.
Techdirt is one of the few remaining truly independent media outlets. We do not have a giant corporation behind us, and we rely heavily on our community to support us, in an age when advertisers are increasingly uninterested in sponsoring small, independent sites — especially a site like ours that is unwilling to pull punches in its reporting and analysis.
While other websites have resorted to paywalls, registration requirements, and increasingly annoying/intrusive advertising, we have always kept Techdirt open and available to anyone. But in order to continue doing so, we need your support. We offer a variety of ways for our readers to support us, from direct donations to special subscriptions and cool merchandise — and every little bit helps. Thank you.
–The Techdirt Team
Filed Under: data mining, government, research, terrorism
Reader Comments
Subscribe: RSS
View by: Time | Thread
[ link to this | view in chronology ]
Re:
http://www.newscientist.com/article/mg19025556.200.html
[ link to this | view in chronology ]
Re: Re:
Those that have met me know I have the best intentions, but what real emotion can be created and shared through a computer screen? It's always subject to the receptiveness to recieving side. If someone wants to defame me based on data mined political or social views, fine. Want to see who I donate to? Go for it. Chances are, you are probably close enough to me to just pick up the fucking phone and ask.
You, sir, are the coward. So have fun watching me as I have fun exploring the world and interwebs. Maybe you'll learn something too.
[ link to this | view in chronology ]
Reality Has A Liberal Bias
I don't buy all this "research" and "evidence" baloney. Look for the "truth", and you're always going to come up with a "true" conclusion. And what is "truth", but just another kind of namby-pamby pinko liberal bias?
No, the way to come up with the right, God-fearing answer, is to leave no stone unturned in your determination to turn up that answer. If these researchers had the balls to do that, they would have seen the light, that what the Government is doing is the only sane way to make sure the TERRRISTS don't take over this country.
[ link to this | view in chronology ]
Re: Reality Has A Liberal Bias
[ link to this | view in chronology ]
Re: Re: Reality Has A Liberal Bias
You new to the internets AC?
[ link to this | view in chronology ]
Re: Reality Has A Liberal Bias
[ link to this | view in chronology ]
no way!
[ link to this | view in chronology ]
Failure will continue...
They've tried this a few times- Enron was the first iteration (learning about what's necessary for business buy-in) The current financial collapse was the second iteration (where personal information was used to determine and mitigate credit risk)
If this doesn't stop, and return to fundamentals... think about it.
Who are "The smartest guys in the room"?
[ link to this | view in chronology ]
really?
[ link to this | view in chronology ]
Uhmn, as a government worker...
I guess I shouldn't be surprised the general public doesn't know this, but the OIG and GAO are institutions created to specifically perform such reviews on a constant basis.
And I assure you, they are VERY thorough. In my agency, the operating budget is less than 2% of our total outlays, basically unheard of anywhere, government or private, except for some non-profit orgs. Efficiency? Large government may not be the MOST efficient method, but a large part of the cost is the intervening layers filtering from a national system down to the local level. And that is where most of the problems, trickery, etc. come into play.
All-in-all, I agree though; it would be very hard to determine the effectiveness of such a data filtration system.
If test returns a negative result, it might just be that the data you are looking for doesn't exist, rather than a problem with the aggregator/filter.
[ link to this | view in chronology ]
Do not worrry...
>then all that data could be analyzed well enough to
>ferret out the terrorists.. but I guess they aren't
>worried about terrorism. Maybe it plays into their hands?
Not to worry... SkyNet will engage itself!
[ link to this | view in chronology ]
VOTE McCain 2008 - He's gonna go all Maverick on Government!
[ link to this | view in chronology ]
Under optimal conditions is almost impossible...
BTW, yes, you can model human behavior with math. Just not as well as Wal-Mart would like to be able to do.
[ link to this | view in chronology ]
Re: Under optimal conditions is almost impossible...
Did you see this one?
http://www.youtube.com/watch?v=SniNbnoc8Lw
[ link to this | view in chronology ]
Next...
[ link to this | view in chronology ]
Re: Next...
[ link to this | view in chronology ]
Other Purposes
Heavy surveillance of the domestic population (.. especially political opponents & non-cooperative citizens) is greatly aided by data-mining.
Extending political control is always the objective of all government actors.
Assuming that anti-terrorism is the only objective of data-mining... is a HUGE mistake.
[ link to this | view in chronology ]
[ link to this | view in chronology ]
[ link to this | view in chronology ]