This Is A Really Bad Idea: Facebook, Twitter, YouTube & Microsoft Agree To Block 'Terrorist' Content
from the how's-that-going-to-work dept
Under increasing pressure from overreacting and fearful bureaucrats, it seems that the big social media companies -- Facebook, Twitter, YouTube and Microsoft -- have all agreed to block "terrorist" content and will agree to share hashed versions of it among the other companies so something blocked on one site can easily be blocked across them all.Facebook, Microsoft, Twitter and YouTube are coming together to help curb the spread of terrorist content online. There is no place for content that promotes terrorism on our hosted consumer services. When alerted, we take swift action against this kind of content in accordance with our respective policies.This sounds as though it's modeled on similar arrangements around child pornography. Except that there are some major differences between child pornography and "terrorist content." The first is that child porn is de facto illegal. "Terrorist content" is quite frequently perfectly legal. It's also much more of a judgment call. And based on this setup, allowing one platform partner to designate certain content as "bad" will almost certainly result in false positive designations that will flow across multiple platforms. That's dangerous.
Starting today, we commit to the creation of a shared industry database of “hashes” — unique digital “fingerprints” — for violent terrorist imagery or terrorist recruitment videos or images that we have removed from our services. By sharing this information with each other, we may use the shared hashes to help identify potential terrorist content on our respective hosted consumer platforms. We hope this collaboration will lead to greater efficiency as we continue to enforce our policies to help curb the pressing global issue of terrorist content online.
Our companies will begin sharing hashes of the most extreme and egregious terrorist images and videos we have removed from our services — content most likely to violate all of our respective companies’ content policies. Participating companies can add hashes of terrorist images or videos that are identified on one of our platforms to the database. Other participating companies can then use those hashes to identify such content on their services, review against their respective policies and definitions, and remove matching content as appropriate.
As we've discussed in the past, when you tell platforms to block "terrorist" content, it will frequently lead to mistakes, like blocking humanitarians documenting war atrocities. That kind of information is not just valuable, but necessary in understanding what's happening.
Also, all of this presumes, that the best way to deal with so-called "terrorist content" online is to hide it and pretend it doesn't exist. That's not always the case. As we've noted, counterspeech -- including mocking silly terrorist claims -- is often much more effective than outright blocking. Blocking the content not only leads to a slippery slope -- and open questions on choosing what content stays and what content goes -- but also presumes that the block is the most effective way to stop the bad behavior associated with terrorists. But it leaves out that blocking such content often only makes those posting it feel like they're on the right path, and that they're saying something "so true" that it needs to be blocked. It's not a path towards stopping terrorism or the spread of terrorist ideology -- it just gets those engaged to dig in deeper on their views.
On top of that, terrorist information posted to social media is often a great source of intelligence for law enforcement. Even the FBI director has said it's silly to chase terrorists off of social media, because it makes them harder to track. So what good is this really doing?
Yes, platforms have every right to decide how they want to handle the content submitted to them. And, yes, this almost certainly comes about as a result of increasing pressure (especially out of the EU) to "do something" about "terrorist content" on these platforms, but as we've seen in the past, appeasing such whining bureaucrats almost never settles them down. As we recently noted, after these same four companies signed an agreement earlier this year to "curb hate speech" on their platforms, it still didn't stop government officials in Europe from threatening further legal consequences, including criminal charges, when the agreed upon blocks failed to magically make all "hate speech" disappear.
So, yes, the platforms may have felt backed into a corner, but they're only going to get their backs pushed further and further into that corner -- and the collateral damage it creates may be even more massive.
Thank you for reading this Techdirt post. With so many things competing for everyone’s attention these days, we really appreciate you giving us your time. We work hard every day to put quality content out there for our community.
Techdirt is one of the few remaining truly independent media outlets. We do not have a giant corporation behind us, and we rely heavily on our community to support us, in an age when advertisers are increasingly uninterested in sponsoring small, independent sites — especially a site like ours that is unwilling to pull punches in its reporting and analysis.
While other websites have resorted to paywalls, registration requirements, and increasingly annoying/intrusive advertising, we have always kept Techdirt open and available to anyone. But in order to continue doing so, we need your support. We offer a variety of ways for our readers to support us, from direct donations to special subscriptions and cool merchandise — and every little bit helps. Thank you.
–The Techdirt Team
Filed Under: blocking, social media, terrorist content
Companies: facebook, microsoft, twitter, youtube
Reader Comments
Subscribe: RSS
View by: Time | Thread
Well the silver lining is...
...no more tweets from The Donald!
well one can hope.
[ link to this | view in chronology ]
Re: Well the silver lining is...
That is one way to ensure they quickly back off this harebrained idea.
[ link to this | view in chronology ]
Re: Re: Well the silver lining is...
I was attempting to point out, in a ludicrous way, how silly the idea is, that someone in a position to decide what might be "Terrorist Content" could reasonably argue that the President of a internationally recognized sovereign nation's speech should be blocked, and if anyone repeats that speech, it need to be blocked everywhere.
Do you think it could be possible that someone that works at Twitter might dislike Trump's speech so much that the "filters" might block his communication, even "inadvertently"?
[ link to this | view in chronology ]
Re: Re: Re: Well the silver lining is...
[ link to this | view in chronology ]
Re: Re: Well the silver lining is...
also, "Narcissist much?"
Yes, Thank You so much for noticing!
;-)
[ link to this | view in chronology ]
Re: Re: Re: Well the silver lining is...
[ link to this | view in chronology ]
Re: Re: Well the silver lining is...
Think about that for a second. It applies to nations that we, in the US, consider to actually have terrorist leaders.
[ link to this | view in chronology ]
Re: Re: Re: Well the silver lining is...
[ link to this | view in chronology ]
Re: Re: Well the silver lining is...
[ link to this | view in chronology ]
Re: Well the silver lining is...
That seems very unlikely. Trump's twitter feed is primarily original content, in the sense that no one has previously posted, character-for-character, the things that Trump's feed posts. This is about blocking specific instances of content so that it cannot be easily cross-posted to multiple platforms. Original content will still go up. At most, assuming an effort was made to suppress Trump's feed (or anyone else's), it would mean that once delisted from Twitter, it couldn't be reposted as-is on the other platforms. For the text part, that was almost guaranteed anyway, as most Trump posts do not fit well within Twitter's pathetically low character limit. Cross-posts would likely be reworded or reassembled to benefit from the longer length limits on other platforms. If the sites truly are blacklisting based on hashes, simply restructuring the post (or assembling multiple tweets into one post) would likely bypass the hash-based block.
The only reason blocking child pornography by hash works at all is that the redistributors do not bother to make the minor edits necessary to change the hash.
[ link to this | view in chronology ]
Re: Re: Well the silver lining is...
[ link to this | view in chronology ]
Re: Re: Re: Well the silver lining is...
[ link to this | view in chronology ]
Re: Re: Re: Re: Well the silver lining is...
[ link to this | view in chronology ]
Re: Well the silver lining is...
[ link to this | view in chronology ]
Re: Well the silver lining is...
[ link to this | view in chronology ]
Re: Well the silver lining is...
[ link to this | view in chronology ]
Re: Well the silver lining is...
So the point is whether you agree with it or not. I suspect poor people see some actions by the elite as pure terrorism.
[ link to this | view in chronology ]
Re: Re: Well the silver lining is...
[ link to this | view in chronology ]
'Bad' speech, you know it when you see it
Seems no-one in charge of the companies is very good at history. By giving in again they're at best delaying even more stringent demands and blame when they don't magically make all the 'bad stuff' disappear.
After all, who could possibly object to removal of 'terrorist material'?
... or 'hate speech'?
... or 'material determined to be detrimental to social health'?
Fighting back may have been costly, but caving in just means that they're going to be increasingly faced with demands to do 'just a little more' or remove 'just a few more things'.
[ link to this | view in chronology ]
Re: 'Bad' speech, you know it when you see it
[ link to this | view in chronology ]
Re: 'Bad' speech, you know it when you see it
[ link to this | view in chronology ]
Re: 'Bad' speech, you know it when you see it
The copyright industry is always lying in wait for this kind of initiative, so that they can say "if it can be done for terrorism/child porn/hate speech, then it can be done for copyright too."
[ link to this | view in chronology ]
Not surprised.
[ link to this | view in chronology ]
Re: Not surprised.
You need to read more than just here, just be ready to read between the lines and you will be able to determine the spin pretty quickly in most cases.
You will NEVER get an unbiased news source from even the most honest media sources out there. Bias is just a fact of life and a whole lotta people need to get over it.
[ link to this | view in chronology ]
Re: Re: Not surprised.
Sorry TD I biffed myself.
[ link to this | view in chronology ]
Re: Re: Not surprised.
Let's not confuse bias with fake news, manufactured facts, distortions that stretch beyond any sane boundaries of 'spin', and just plain outright lies. Those things do not rise to and are undeserving of the word 'bias'.
[ link to this | view in chronology ]
Yay! More regulation...
when you keep asking for more, you will get it.
But, this is the natural course where populations are allowed to vote without some form of minimal intelligence test. Every time they will vote themselves into destruction committing suicide!
[ link to this | view in chronology ]
Re: Yay! More regulation...
it's tech that wants more regulation. San Francisco and New York City, home of regular-size sodas.
[ link to this | view in chronology ]
Re: Re: Yay! More regulation...
Not sure I understand how more government equals less government, but oh well. Seems when those who sell the less government mantra are elected they increase the size of government - go figure.
[ link to this | view in chronology ]
Re: Yay! More regulation...
There are many reasons why this is a very bad idea, but ..
If you want such a thing, then obviously it is a given that the candidates themselves will also have to pass such a test in order to be eligible for the office.
[ link to this | view in chronology ]
and
Its heartbreaking that that's not actually a joke.
[ link to this | view in chronology ]
While you may be right, you're not.
I don't think mocking is the correct answer to what you consider hate speech unless you'd like to start working for Charlie Hedbo in Paris--I hear they may still have a few openings.
While I believe that ignoring it is the worst that you can do, and blocking it a close second, and I'm not sure what the best action would be.
[ link to this | view in chronology ]
The answer to arbitrarily designated "bad" or "dangerous" speech is...
Among the scary aspects of this sort of issue is that neither of the traditional sides (in terms of politics) is consistently against censorship as a policy, enacted either via statute or via the threat of their weighty boots on the throats of those who don't play along.
[ link to this | view in chronology ]
[ link to this | view in chronology ]
Re: Reverting blocks
Assuming that they want to be able to fix mistakes, it's not a hard problem. Every record would contain an originator identifier telling which company blacklisted it. When the originator wants to undo that entry, they send out a cancellation for that record. Additionally, they never add to their blacklist any entry which has an originator ID that says it came from them. Such entries either are redundant if not yet revoked, or are stale if already revoked. In a fully cooperative environment, where you can assume nobody impersonates anyone else, the identifier could be simply the company name. If you want authenticity, the combination of originator and blacklist entry can be signed to prove who created it, so that nobody else can falsely attribute a blacklist to that entity.
[ link to this | view in chronology ]
Re: Re: Reverting blocks
That should be assuming that all players want to fix mistakes, an that they do not generate a circulate multiple variant hashes of the same nominal file. Because real hashes are sensitive to single bit changes, the 'hashes' to identify content will have to be somewhat looser than what is is usually meant by a hash, a bit change sensitive check of file contents.
Also, because hashes are being shared, and the recipient of a hash will not have the file to check whether the file should be blocked, it will be all too easy for governments to push hashes of contents that they object to.
[ link to this | view in chronology ]
Awesome!
[ link to this | view in chronology ]
THE FOUR PILLARS OF SECURITY
.
NON-EVIL PEOPLE NEED BOTH ACCESS AND PRIVACY!... AND EVIL PEOPLE SHOULDN'T HAVE EITHER! BUT, IF YOU DENY THE WRONG PEOPLE ACCESS AND PRIVACY (I.E., NON-EVIL PEOPLE!), AND ALLOW THE WRONG PEOPLE ACCESS AND PRIVACY (I.E., EVIL PEOPLE!), YOU HARM SECURITY!... AND, IN THE CASE OF NON-EVIL PEOPLE, ACCESS AND PRIVACY DENIALS WILL ADVERSELY IMPACT ON MANY OTHER DIGITAL... AND HUMAN!... RIGHTS! AND IF YOU DON'T KNOW WHICH IS WHICH (I.E., WHO IS EVIL, AND WHO IS NOT!)... WELL... YOU D*MN WELL SHOULD FIGURE IT OUT!
.
SIMPLY STATED!... LIFE IS NOT GUARANTEED TO BE EASY!... OR WITHOUT THORNS!
.
Please!... no emails!
[ link to this | view in chronology ]
Re: THE FOUR PILLARS OF SECURITY
Who gets to define "evil" and "non-evil"? The government? The media? People with a capital letter fetish? I'm guessing they'll all suck at it equally.
[ link to this | view in chronology ]
Re: Re: THE FOUR PILLARS OF SECURITY
.
Au contraire!... I-T-'-S T-H-E O-N-L-Y P-O-S-S-I-B-L-E S-O-L-U-T-I-O-N TO OUR SECURITY DILEMMA! And, inasmuch, as pitting privacy against access, M-I-S-S-E-S H-A-L-F T-H-E E-Q-U-A-T-I-O-N!
.
And as for who decides!... it's more of a WHAT!... and that WHAT, is a thing called the Uncertainty Principle in Quantum Mechanics!
.
To make a M-U-C-H L-O-N-G-E-R S-T-O-R-Y shorter... it just so happens, that "good thoughts" and "good intentions (at the Quantum level!)", possess a distinct Quantum flux (coherent Quantum flux!) that/ which can be measured (e.g., through Superconducting Quantum Interference Devices!... nano sized!)!... and likewise-- though conversely!-- "bad thoughts" and "bad intentions (at the Quantum level!)", possess a distinct Quantum flux (incoherent Quantum flux!) that/ which can be measured (e.g., through S.Q.U.I.Ds!... nano sized!)!
.
To sum up... we're coming into a level of ICT device sensitivity, whereby the Quantum Dynamics of your very thoughts W-I-L-L G-I-V-E Y-O-U A-W-A-Y! In other words, what you once thought was hidden from public view, will be manifest for all to see (literally, and metaphorically speaking!)! And so... it won't be a matter of someone making a judgement call as to the veracity of what was false or what was true re your thinking, it will be a matter of knowing C-O-M-P-L-E-T-E-L-Y (WITH 100% ACCURACY!) the nature of your intentions! And!... all due to the power inhere within the Uncertainty principle within Quantum Mechanics!
.
The only "catch" is... Who will have control over this technoma?... Who will ensure its use for GOOD?
.
Please!... no emails!
[ link to this | view in chronology ]
Next up match no fly, ass bad credit to this list for a citizens score
China goes a step further to assign a score to every citizen. Perhaps these U.S. tech companies are just lining up to break down the wall of accessing Chinese markets?
Who defines the speech, who regulates the speech, who assigns them to lists, where are those lists stored, who are they accessible to, how can anyone challenge their listing?
This is going to land in high courts around the world, with the exception of China, Turkey, Russia and a few others who have been clamoring for these types of speech censoring tools. Welcome to the unvarnished New World Order I guess.
[ link to this | view in chronology ]
Re: Next up match no fly, ass bad credit to this list for a citizens score
[ link to this | view in chronology ]
Facebook lost billions, as the site was nearly wiped of all its content, saved only by cat videos.
The 12 people who posted nice comments on the internet realized the only people who replied to their comments were angry people.
This was not all bad news, though. The President of the United States could no longer address the people through his rage-filled tweets anymore.
Skynet can now evolve.
[ link to this | view in chronology ]
Re:
[ link to this | view in chronology ]
Re: Re:
[ link to this | view in chronology ]
Nicely done
[ link to this | view in chronology ]
This is a really GOOD idea!...If you're a terrorist.
1. Hiding 'terrorist' media is one big step towards creating a global culture where it's not only justified, but praiseworthy, to censor and demonize dissenters.
Countries like Turkey and the Philippines are already using American/European behavior to justify their own attacks on journalists and activists, and setting this precedent for censorship will only make it harder to dislodge existing authoritarian governments.
2. It turns 'if you have nothing to hide, you have nothing to fear' on its head; if X government really has nothing to fear, if they're really in control, if they're telling the truth, etc, why are they trying so hard to keep the words spoken by terrorists out of the spotlight instead of answering them head on?
Blocking terrorist content only gives them more propaganda to work with amongst themselves; it might slow them a little in recruiting outsiders, but people leaning towards the terrorists already will only be galvanized when the terrorists make noises about 'the evil foreign governments trying to silence our voice of truth'.
[ link to this | view in chronology ]
Because I was not a child.
Then they came for the pirates, and I did not speak out—
Because I was not a pirate.
Then they came for the journalists, and I did not speak out—
Because I was not a journalist.
Then they came for me—and there was no one left to speak for me.
[ link to this | view in chronology ]
Definition changes
Terrorist = Someone the government doesn't like
Terrorism = Something the government doesn't like
And so on.
Now lets plug that into the story title:
"This Is A Really Bad Idea: Facebook, Twitter, YouTube & Microsoft Agree To Block Content The Government Doesn't Like"
Makes much more sense now.
[ link to this | view in chronology ]
Microsoft???
[ link to this | view in chronology ]
Re: Microsoft???
[ link to this | view in chronology ]
Re: Re: Microsoft???
Are these some upcoming unannounced products to which you have inside information?
[ link to this | view in chronology ]
This could never go wrong
Now all the government has to do is coerce or manipulate Company A into censoring things that should never be censored, and Company B, C, etc will all happily censor it without having any idea what they are censoring.
Similarly Hollywood could coerce or manipulate the censorship of content without need of the Digital Millennium Censorship Act (DMCA).
Next in line will be politicians with thin skin, but I'm being redundant. Local police and sheriffs with thin skin. Rich people who want to avoid the Streisand Effect.
Next will be corporations which want to censor competitors, or viewpoints which are against their profitability. Maybe corporations want to tax us for clean air and water because it costs actual money to avoid polluting the air and ware, and thus is unprofitable. People should have to pay. You don't think clean air grows on trees do you?
More and more people will get in line to add things to the magic censorship list of hashes.
What could possibly go wrong?
[ link to this | view in chronology ]
So then, what about reporting on terrorism?
Doesn't that, in and of itself, diminish in part the brutality of what they're doing?
[ link to this | view in chronology ]
Will it ban posts designed to radicalize the far-right?
Case in point: the recent issue where people (including generals!) were saying that Hillary Clinton ran a child sex ring out of a pizza restaurant.
So of course a guy who only reads far-right media (meaning "radicalized") goes there with a gun to "rescue" the non-existent "sex slaves".
Can someone please explain the different between these kinds of posts and what ISIS posts? Both of them are designed to get people so angered that they take action against the enemy.
[ link to this | view in chronology ]
Ri-ight.
I don't know if those companies did it all by themselves or they're responding to government requests, but as censorship becomes "the new normal" it won't be long before they vanish references to anything they don't like. Facebook and Twitter have been riding the censorship wagon for a while now. The evil is spreading...
[ link to this | view in chronology ]
i'm disapearing this story from thei nternets...
Terrortist content
[ link to this | view in chronology ]
This really is the key about this whole fiasco; there is no proof it will work. So, what we have now is yet another case of Facebook and co. running around like headless chickens, attempting to fend off legal action by lashing out at anything that seems a bit scary with panic-bans. What we NEED is people like Marc Zuckerberg to start plowing their mega-millions into actual RESEARCH about what makes people turn violent, and then acting on it like responsible adults.
Thanks so much to the likes of A. Merkel and other world leaders for putting more pressure on the wrong people to make useless, superficial, ass-covering changes like these without an ounce of proof they will make an iota of difference.
What irks me the most, though, is the subtextual suggestion that the only 'terrorists' these people will be looking to block are jihadists... as opposed to, say, extreme right-wingers who murder Labour MPs just before a major referendum.
But even then, there's zero proof this block will prevent them from becoming radicalized. Did the 9/11 pilots meet on Facebook? Did they f*ck.
[ link to this | view in chronology ]
Twitter went so far as to shadowban Scott Adams, the Dilbert cartoonist, for the unforgivable hate speech of writing a trollish blog about Trump and the ego-driven illogic of liberals that is so atrocious it makes the pointy-headed boss look like an utter genius. This after the "Milogate" controversy where Breitbart's aforementioned insult comic got the banhammer for insulting a black actress from the widely-panned feminist Ghostbusters reboot despite she herself having said some less than PC things in her own Twitter history.
Now Facebook, Google and the like, pretending to be the Allied Powers uniting against the evils of fascism, have initiated a de facto war on whatever their neoliberal paymasters and a committee of their talentless affirmative-action employees have labeled "fake news" and/or "terrorist" content. Such as the trailer for a young woman's documentary film about the shrill hysteria of the male-bashing third-wave feminist movement that has intentionally (and sadistically, with revenge-filled glee) obliterated the legitimate concerns of men. Or negative reviews of Hollywood remake films being spat out for no other reason than a cheap and easy answer to fill mandatory diversity quotas self-imposed by the studios so as to maintain their liberal cred. Lectures by a Canadian university professor who dared challenge the scientifically invalid political consensus on "gender identities," who is himself being investigated (or should I say, persecuted) by the estrogen-laden Inquisitors employed by the tyrannical brat of a PM. And so on.
This isn't about ISIS or self-radicalized Islamists, because Twitter themselves (who, it should be noted, have a Saudi prince on their board of shareholders) have banned or otherwise placed sanctions on users -- including ex-Muslims and moderate reformists like Maajid Nawaz and Ayaan Hirsi Ali -- for being critical of not only Islamic doctrine but of the irrational left's insistence on shutting down their criticism as "hate speech."
No, this is about doubling down on the incoherent and arguably dangerous narrative that got Trump elected in the first place and will, if it continues, see him elected to a second term. One man's terrorist is another's freedom fighter, isn't that the phrase we're always treated to by the left? Well, now two can play at that game and the real fake news outlets don't like it.
They can only ban so many people from their safe space before they turn into an empty echo chamber like Reddit. Enjoy the next dotcom bubble, guys, because when it bursts, it'll be beautiful and it'll be yuuuge.
[ link to this | view in chronology ]