Content Moderation Case Study: Handling Off Platform Harassment On Platform (June 2020)
from the how-far-does-it-go? dept
Summary: Dealing with harassment of users is always a challenge for internet platforms -- and that is especially true for platforms that are focused on live streaming. For many years there have been accusations around sexual harassment problems for female Twitch streamers. Going all the way back to 2012 when a Twitch streamer argued that sexual harassment was part of the culture of streaming (saying ““this is a community that’s, you know, 15 or 20-years-old and the sexual harassment is part of a culture”) there have been ongoing questions about how Twitch should deal with such behavior both on and off the platform.
Not surprisingly, there have been many reports of on-platform harassment for Twitch streamers to the point that some reporters have noted it is quite easy to seek out harassment and find it on the platform. In 2018, Twitch put in place new rules for dealing with harassment on the platform and it also provides a variety of tools for managing harassment within Twitch’s chat feature.
More recently, another issue has been raised: how should Twitch handle harassment that occurs off-platform? Some users started collecting reports of harassment and sexual abuse that were occuring connected to Twitch, and it was notable that many of them were not happening directly on the platform. According to an article at The Verge many of the reported claims of harassment and abuse were people who met via Twitch or were popular Twitch users, who were accused of using their position of power to harass others.
It is difficult enough to deal with harassment in real time on a streaming platform (where the incidents come and go), but figuring out how to deal with harassment that happens off-platform is even more fraught. However, in June of 2020, many Twitch streamers engaged in a 24-hour blackout in protest over what they felt was Twitch’s failure to act regarding many of the accusations.
Decisions to be made by Twitch:
- How should it handle credible claims and accusations of abuse and sexual harassment that occur off-platform between users of Twitch?
- How much responsibility should Twitch take in dealing with off-platform behavior?
- What resources are necessary for investigating off-platform behavior?
- How should serious claims be verified?
- Is it proper for conduct outside of an internet platform to impact usage of that platform?
- Will serious accusations against “popular” users of a platform reflect poorly on the platform?
- Will widespread accusations of sexual abuse among users of the platform create an unwelcoming environment?
- Can on-platform policies impact off-platform behavior?
We want to provide an update on our investigations into the recent allegations of sexual abuse and harassment involving Twitch streamers and actions we’re taking. We are reviewing each case that has come to light as quickly as possible, while ensuring appropriate due diligence as we assess these serious allegations. We’ve prioritized the most severe cases and will begin issuing permanent suspensions in line with our findings immediately. In many of the cases, the alleged incident took place off Twitch, and we need more information to make a determination. In some cases we will need to report the case to the proper authorities who are better placed to conduct a more thorough investigation. For those who’ve come forward and would like to share additional information, and to anyone who hasn’t shared their experience and wants to do so, you can report confidentially through the reporting tools on each streamer’s channel page.
The company also promised to continue to improve the tools on-platform for combating harassment and abuse. Twitch’s founder and CEO Emmett Shear also sent an email to the entire company about the issue and the importance of building “an experience that is community-centered, safe and positive for all.”
Days later, the company banned a popular user who was accused of harassing other Twitch streamers as well as some other users who had been similarly accused. At least one suspended user has since insisted that he was innocent and suggested he was working with lawyers to appeal the suspension.
Thank you for reading this Techdirt post. With so many things competing for everyone’s attention these days, we really appreciate you giving us your time. We work hard every day to put quality content out there for our community.
Techdirt is one of the few remaining truly independent media outlets. We do not have a giant corporation behind us, and we rely heavily on our community to support us, in an age when advertisers are increasingly uninterested in sponsoring small, independent sites — especially a site like ours that is unwilling to pull punches in its reporting and analysis.
While other websites have resorted to paywalls, registration requirements, and increasingly annoying/intrusive advertising, we have always kept Techdirt open and available to anyone. But in order to continue doing so, we need your support. We offer a variety of ways for our readers to support us, from direct donations to special subscriptions and cool merchandise — and every little bit helps. Thank you.
–The Techdirt Team
Filed Under: content moderation, harassment, off-platform
Companies: twitch
Reader Comments
Subscribe: RSS
View by: Time | Thread
Business idea
It seems like someone could make a business of specializing in content moderation for online platforms...
[ link to this | view in chronology ]
Yeah, Maz, we know: moderation is tough! But censorship is easy.
Moderation is tough because edge cases and general.
Censorship is easy: ideas that you don't want to spread are usually clear, and anyone who even spreads them is just permanently labeled "bad".
If I wasn't censored here, disadvantaged visibly and in hidden ways, constantly HARASSED by off-topic little kids, I'd run the site, you all KNOW it! You have NO ideas that anyone reasonable will adopt. Proved by the steep decline in just last year.
[ link to this | view in chronology ]
And you wanting to force your speech on others by legal dictate, that’s reasonable to you?
[ link to this | view in chronology ]
Of course either is just deciding whether suits your agenda
to allow certain speech.
Control over speech is now KEY element of Silicon Valley esp here on Techdirt, nearly all that you write of. You're alarmed that control could be taken away with changes to CDA S230.
Your tactic is very simple: try to keep discussion on whether censoring, while stating that have every right to do so.
[ link to this | view in chronology ]
As with Facebook and Twitter today, in a panic because
Truth about the Bidens came out. So stop it spreading and remove the original publishing, because it's clear danger to your/their leftist political agenda.
WAY back, you censoring weenies used to trot out the "may not agree with but will defend to the death your right to say it". You didn't mean it then, just suited your purposes. But now, at best, you add: "just not anywhere it can be seen".
[ link to this | view in chronology ]
The article is still on the NY Post website, where it was originally published. It’s still linked to on the front page of that site, too.
[ link to this | view in chronology ]
Re: As with Facebook and Twitter today, in a panic because
"remove the original publishing"
Nobody's done that. Yet again, you're so interested in ranting rambling nonsense against phantoms of your own imagination, you can't even get the basic of the story you're whining about correct.
"WAY back, you censoring weenies used to trot out the "may not agree with but will defend to the death your right to say it""
We still say that. We just don't agree with your attempt to hijack other peoples' private property to do it.
[ link to this | view in chronology ]
Leftists then go on to state it's GOOD to stop the spread
of dangerous disinformation! Meaning The Truth because you always LIE. At best, leftists never trust people to come to the correct conclusion, especially on questions about your globalist agenda.
Masnick has stated he's not upset by "literal Nazis" being "de-platformed". He didn't speak up when Alex Jones was taken off by a dozen platforms and payment systems all at once, in obvious coordination. Right here on the very "blog" over which he has total control, the "report" button is de facto censoring, disadvantaging certain viewpoints without EVER "moderating" the nasty fanboys. Masnick gives no details how that works, won't even admit there's an Administrator, just LIES that it's somehow "the community" without any Administrator decision at all.
And then has the sheer effrontery to keep claiming he's for "free speech".
You leftists only win when lie, cheat, and sneak around out of sight. Your ideas can't stand dissent. Your actions can't stand being openly stated. -- And you've long since overcome any "moral" qualms, besides think victory is within sight, so keep getting worse.
[ link to this | view in chronology ]
Re: Leftists then go on to state it's GOOD to stop the spread
[Projects facts not in evidence]
[ link to this | view in chronology ]
Yes or no, Blue Balls: Should I have the absolute unimpeachable right to use your private property as my personal soapbox?
[ link to this | view in chronology ]
Re: Leftists then go on to state it's GOOD to stop the spread
"He didn't speak up when Alex Jones was taken off by a dozen platforms and payment systems all at once, in obvious coordination"
No, he didn't speak up when the man who has inspired multiple real-life acts of violence and harassment of the parents of murder victims was told he was no longer welcome to use some other peoples' private property to do such things, especially since he has his own property to speak from. What's your problem with this?
"Your ideas can't stand dissent."
Yet, here you are, dissenting like a raving moron without reprisal..
[ link to this | view in chronology ]
Re: Leftists then go on to state it's GOOD to stop the spread
Well Blue, it's interesting to watch all of your inane comments like this one. You say things like it to get a rise out of people. It must be a compulsion, since you won't stop. You make such lovely strawmen. Please, continue...
[ link to this | view in chronology ]
I don't think it's at all appropriate for a company to conduct "investigations" into its customers' personal lives.
[ link to this | view in chronology ]