Twitter Cuts Off Firehose Access To DHS Fusion Centers

from the you-can-hear-Sen.-McCain's-teeth-gritting-from-here dept

Earlier this year, Twitter pulled the plug on some of Dataminr's customers, specifically the intelligence agencies it was selling its firehose access to. Twitter made it clear Dataminr's access to every public tweet wasn't to be repurposed into a government surveillance tool.

That being said, everything swept up by Dataminr was public. There was no access to direct messages or tweets sent from private accounts. And Twitter seemingly is doing nothing to prevent Dataminr from selling this same access to the FBI, an agency that's far more an intelligence agency than a law enforcement agency these days -- one that thinks it should be allowed to do everything the CIA does, if not more.

Presumably, the FBI pinned its law enforcement badge to its chest when hooking up with Dataminr because Twitter has had nothing to say about the partnership. And it's not as though Twitter is fine with just anyone selling analytic tools to law enforcement. It, along with Facebook, yanked Geofeedia's access to APIs simply because it didn't like how Geofeedia pitched its tweet-grabbing front end. In sales materials, the company strongly hinted that law enforcement agencies could use its software to stay "one step ahead" of citizens engaged in First Amendment-protected activity.

Twitter's standards are malleable, to say the least. But it does seems to be serious about refusing to let its service become just another government surveillance tool. The ACLU is reporting that Twitter has just cut off Dataminr access to the dozens of DHS "fusion centers" scattered across the country.

As of this week, Twitter has made sure that federally funded fusion centers can no longer use a powerful social media monitoring tool to spy on users. After the ACLU of California discovered the domestic spy centers had access to these tools, provided by Dataminr (a company partly owned by Twitter), Dataminr was forced to comply with Twitter’s clear rule prohibiting use of data for surveillance.

Twitter sent a letter to the ACLU of California this week confirming that Dataminr has terminated access for all fusion center accounts. The letter also makes clear that Dataminr will no longer provide social media surveillance tools to any local, state, or federal government customer.

Once again, the DHS and its local partners are still free to eyeball as many public tweets as they like, but without the robust front-end that hauls in hundreds of millions of tweets every day and sorts them into easily-surveillable categories. This is probably just as well, considering the DHS's "fusion centers" are underperforming boondoggles tasked mainly with fielding ridiculous complaints from Americans who actually believe "see something, say something™" helps the nation fight terrorism, rather than simply put more government boots on the Bill of Rights' neck.

Twitter's statement says it will continue to "work with" Dataminr to further limit its pool of government customers. Dataminr, on the other hand, says there's really nothing to worry about. It may be directly attached to the Twitter firehose, but its customers aren't.

Datatminr’s product does not provide any government customers with their own direct firehose access or features to export data; the ability to search raw historical Tweet archives or to target or profile users; conduct geospatial analysis; or any form of surveillance.

Well, sure. Not now. From the third-hand discussions of conversations between Twitter and Dataminr, it appears the company will only be able to offer a highly-filtered version of its firehose to government end users. If this results in less lucrative contracts, so be it. After all, Dataminr did itself no favors by marketing its software to law enforcement with the same sort of pitches that ended Geofeedia's relationship with the social media company.

Through a public records request, the ACLU of California discovered that the Los Angeles area fusion center, JRIC, was using Dataminr and had access to the company’s powerful Geospatial Analysis Application that enables keyword searches and location-based tracking. Settings in the Geospatial App even allowed the government to focus on monitoring journalists and organizations. Using Dataminr, fusion centers like JRIC could search billions of real-time and historical public tweets and then potentially share information with the federal government.

In an email to the Los Angeles Police Department, Dataminr also highlighted how its products could be customized to track protests by drawing from the complete Twitter “firehose” of public tweets. In a separate brochure, Dataminr touted the Geospatial App’s use to surveil a student protest.

None of this shows much in the way of consistency or integrity on Twitter's end. If Geofeedia's marketing materials bothered Twitter enough to completely yank its access, the sales pitches by Dataminr should have been equally concerning. But Dataminr is still hooked up to Twitter's hose and Geofeedia has been left to wander off somewhere into the software wilderness and die. Both marketed access to law enforcement using surveillance of First Amendment-protected activity, but only one is still allowed to do so.

Hide this

Thank you for reading this Techdirt post. With so many things competing for everyone’s attention these days, we really appreciate you giving us your time. We work hard every day to put quality content out there for our community.

Techdirt is one of the few remaining truly independent media outlets. We do not have a giant corporation behind us, and we rely heavily on our community to support us, in an age when advertisers are increasingly uninterested in sponsoring small, independent sites — especially a site like ours that is unwilling to pull punches in its reporting and analysis.

While other websites have resorted to paywalls, registration requirements, and increasingly annoying/intrusive advertising, we have always kept Techdirt open and available to anyone. But in order to continue doing so, we need your support. We offer a variety of ways for our readers to support us, from direct donations to special subscriptions and cool merchandise — and every little bit helps. Thank you.

–The Techdirt Team

Filed Under: data, dhs, firehose, fusion centers, homeland security, law enforcement, social media
Companies: dataminr, twitter


Reader Comments

Subscribe: RSS

View by: Time | Thread


  1. identicon
    Anonymous Coward, 19 Dec 2016 @ 4:23am

    quote: the company will only be able to offer a highly-filtered version of its firehose to government end users
    /quote

    so... my guess is that those filters will be:
    -one filter for "a"
    -one filter for "e"
    -one filter for "i"
    -one filter for "o"
    -one filter for "u"

    oh...and a separate filter for "Trump" :p

    link to this | view in thread ]

  2. icon
    JohnnyRotten (profile), 19 Dec 2016 @ 6:59am

    Smoke Screen

    Publically, Dataminr and Twitter will talk about how the fed no longer has access.

    Of course, this is a smoke screen.

    There are only four outcomes here:

    The Fed is/will just pull directly from Twitter through an agreement that makes Twitter serious $$$.

    If Twitter balks at this then:

    The Fed will continue to pull through Dataminr, but without telling the public or Twitter.

    The Fed will use a broad National Security letter and the kangaroo FISA court to "force" Dataminr or Twitter to turn over the information. I use quotes in the Austin Power sense.

    The Fed will contract through one of Dataminr's customers for the same data, thus giving Dataminr cover for it's claims as stated today.

    Privacy and the constitution are long dead.

    link to this | view in thread ]

  3. identicon
    Anonymous Coward, 19 Dec 2016 @ 7:45am

    Do your part to stop mass surveillance

    Don't tweet!

    link to this | view in thread ]

  4. identicon
    Capt ICE Enforcer, 19 Dec 2016 @ 8:16am

    Bye bye fire hose

    Bye bye fire hose. Now they have optimized the feed to more of a river worth of information instead of a the smaller outdated fire hose information feed. You're welcome..

    link to this | view in thread ]

  5. identicon
    Anonymous Coward, 19 Dec 2016 @ 8:52am

    "only one is still allowed to do so"

    The one partly owned by Twitter itself, of course.

    link to this | view in thread ]

  6. identicon
    Anonymous Coward, 19 Dec 2016 @ 11:31am

    Wait ... now DHS will not have access to the Trump Tweets, how will they know what the Big Cheese wants them to do?

    link to this | view in thread ]

  7. icon
    Coyne Tibbets (profile), 19 Dec 2016 @ 12:19pm

    Intelligence agency lament

    This is the BIG one, Elizabeth; the whole web is going dark. I'm coming to join you, Elizabeth. It's dark all around...!

    [whisper] Except for the secret feed, Elizabeth! The light is coming back, Elizabeth!

    link to this | view in thread ]

  8. identicon
    Anonymous Coward, 20 Dec 2016 @ 4:14pm

    Re: Do your part to stop mass surveillance

    That's like saying "don't speak because you are under surveillance".

    link to this | view in thread ]


Follow Techdirt
Essential Reading
Techdirt Deals
Report this ad  |  Hide Techdirt ads
Techdirt Insider Discord

The latest chatter on the Techdirt Insider Discord channel...

Loading...
Recent Stories

This site, like most other sites on the web, uses cookies. For more information, see our privacy policy. Got it
Close

Email This

This feature is only available to registered users. Register or sign in to use it.