Twitter Suspends Reporter's Account... After He Gets Targeted By Russian Twitter Bots
from the nice-work,-geniuses dept
Over the last few weeks, we've written a number of times about how systematically bad internet platforms are at determining how to deal with abuse online. This is not to mock the platforms, even though many of the decisions are comically bad, but to note that this is inevitable in dealing with the scale of these platforms -- and to remind people that this is why it's dangerous to demand that these companies be legally liable for policing speech on their platforms. It won't end well. Just a few weeks ago, we wrote about how Twitter suspended Ken "Popehat" White for posting an email threat he'd received (Twitter argued he was violating the privacy of the guy threatening him). From there, we wrote about a bunch of stories of Facebook and Twitter punishing people for documenting abuse that they had received.
But this latest story is even slightly crazier, as it appears that abusers were taking advantage of this on purpose. In this case, the story involves Russian Twitter bots. First, the Atlantic Council wrote about Russian Twitter trolls trying to shape a narrative after the Nazi event in Charlottesville. In response, those very same Twitter bots and trolls started bombarding the Twitter feeds of the researchers. And here's where the story gets even weirder. When Joseph Cox, writing for The Daily Beast, wrote about this (at the link above), those same Twitter bots started targeting him too.
And... that caused Twitter to suspend his account. No, really.
“Caution: This account is temporarily restricted,” a message on my account read Tuesday. “You’re seeing this warning because there has been some unusual activity from this account,” it continued.
Again, it's not hard to see how this happened. Cox's Twitter account suddenly took on a bunch of bot followers, many of whom started retweeting him. From Twitter's perspective, it's easy to see how that looks like someone gaming the system -- possibly buying up fake followers and fake retweets. But, here, it appears to have been done to target the user, rather than to fake boost him. After all, it's completely understandable why Twitter would have a system that would seek out situations where a ton of fake followers were suddenly following someone and retweeting them. That would be a clear pattern indicating spam or something nefarious. And, in designing the system, you might think that such a thing would never be used to harm someone -- but by building in the mechanism to recognize this is happening and to suspend the account, you're now creating a weapon that will be gamed.
Cox eventually got his account back and got an apology ("for the inconvenience") from Twitter. But, once again, for everyone out there demanding that these platforms be more forceful in removing users, or (worse) arguing that there should be legal liability on them if they fail to kick off people expeditiously, be careful what you wish for. You may get it... and not like the results.
Thank you for reading this Techdirt post. With so many things competing for everyone’s attention these days, we really appreciate you giving us your time. We work hard every day to put quality content out there for our community.
Techdirt is one of the few remaining truly independent media outlets. We do not have a giant corporation behind us, and we rely heavily on our community to support us, in an age when advertisers are increasingly uninterested in sponsoring small, independent sites — especially a site like ours that is unwilling to pull punches in its reporting and analysis.
While other websites have resorted to paywalls, registration requirements, and increasingly annoying/intrusive advertising, we have always kept Techdirt open and available to anyone. But in order to continue doing so, we need your support. We offer a variety of ways for our readers to support us, from direct donations to special subscriptions and cool merchandise — and every little bit helps. Thank you.
–The Techdirt Team
Filed Under: fraud, joseph cox, moderation, russian bots, trust & safety, twitter bots
Companies: twitter
Reader Comments
Subscribe: RSS
View by: Time | Thread
So, Twitter acting stupidly completely refutes common law?
Your leap there doesn't even require more than the question.
This problem has long grown without action is much
of the problem. They let trolls run wild on the
notion a platform has NO responsibilty, and now
you're saying it's a mess and nothing can be done.
Fine. We'll just let the Rooskis win, then.
At least they're logical.
[ link to this | view in chronology ]
Re: So, Twitter acting stupidly completely refutes common law?
[ link to this | view in chronology ]
Re: Re: So, Twitter acting stupidly completely refutes common law?
Well, 'splain it to me, then! In detail, but use
short words, please.
Until you do, I'll stick with notion that common law
requires efforts against vile ad hom. -- Though I admit
is some elided in my comment: the base problem with
Twitter, though, is made NO efforts to control the
"platform" until too much bad going on. THEN, Twitter
takes STUPID actions against innocents -- a point
which I hold common law forbids.
This piece is premised on Twitter doing wrong in going after the wrong parties.
Wouldn't you agree that if someone in a bar starts
yelling at you, that the bouncer should make some
effort to determine who started it and does all the bad?
-- OH, you DO agree? Then I know SOMETHING true
about common law, don't I? You are refuted, TROLL.
[ link to this | view in chronology ]
Re: Re: Re: So, Twitter acting stupidly completely refutes common law?
Th’fuck kind of relevance does “common law” have in regards to the bot problem on Twitter?
[ link to this | view in chronology ]
Re: Re: Re: Re: So, Twitter acting stupidly completely refutes common law?
As far as I can tell they seem to think it's the magic 'I win' phrase, where all they have to do is claim 'common law' and automatically win an argument without providing anything beyond that. Likewise with accusing anyone who they disagree with of being a troll.
Unfortunately for them they aren't the government, and while that trick may work with 'national security' and judges it's not very effective in comment sections.
[ link to this | view in chronology ]
Re: Re: Re: So, Twitter acting stupidly completely refutes common law?
Which part of common law? Can you name it? If you can't name it, can you explain how you know that common law forbids it?
[ link to this | view in chronology ]
Re: Re: Re: So, Twitter acting stupidly completely refutes common law?
So cite it, then. Don't just make a vague claim. Cite the principle of common law that requires what you say it does.
[ link to this | view in chronology ]
The Most Intelligent People Make the Simplest Fools
[ link to this | view in chronology ]
Twitter's run by ignorant newbies
Twitter is being beaten like a drum by script kiddies who understand far more about the tactics and strategies of abuse than anyone working for Twitter. Some of us -- who are most definitely NOT ignorant or newbies -- have tried to explain this to them and help them get a clue. Hasn't worked: they're not only incompetent, they're too arrogant to admit that they're incompetent.
This particular problem is obvious because it's being done in heavy-handed fashion. There are far worse problems at Twitter that aren't nearly so obvious.
[ link to this | view in chronology ]
Re: Twitter's run by ignorant newbies
Twitter is not run by ignorant newbies. After all, Twitter management cares more about the high-ranking, high-activity “verified” accounts than it does everyone else.
No, Twitter is run by a group of people who want to sell the company as soon as possible and thus have little incentive to curb massive amounts of Twitter activity that bots, Nazis, general scumbags, and a combination of all three—better known as Donald Trump—generate on a daily basis. Only if that activity threatens to drive down the sale price does Twitter management care; even then, they care only enough to make half-hearted gestures toward “fixing” problems that have long plagued the service.
[ link to this | view in chronology ]
This actually sounds like Twitter was fairly sensible.
It's not that unreasonable to temporarily suspend the account while looking into that. Key word being 'temporarily', since otherwise it'd be easy for trolls to get someone kicked off Twitter by framing them for botspam.
[ link to this | view in chronology ]
Re: This actually sounds like Twitter was fairly sensible.
If you're going to invest the time and manpower to investigate anyway, why suspend first?
"Investigate, then if you find something wrong, suspend" doesn't take any more effort or any more manpower than "suspend, then investigate, then if you find nothing wrong, revoke the suspension" - but the latter unfairly penalizes people who did nothing wrong, while the former only postpones penalizing people who did do something wrong.
[ link to this | view in chronology ]
And amusingly, the solution passes through a human reviewing it, not an algorithm.
[ link to this | view in chronology ]