Content Moderation Case Study: Yelp Attempts To Tackle Racism On Its Platform (2020)

from the a-challenge dept

Summary: Running a site that relies on third-party content means having to deal with the underside of human existence. While most people engage in good faith, a small minority of people engage with the sole purpose of disparaging others.

Yelp is no exception. Designed to provide potential customers with useful information about goods and services, the site's popularity lent itself to brigading (negative reviews delivered en masse in response to current outrages) and the lowest common denominators of the general public: bigots.

The potential to ruin a business's reputation over their views on immigration policy, their employment of minorities, or other perceived slights made it possible for the most-respected review site to be weaponized by racists.

Yelp recognized this inevitability. Moderators patrol the site to limit the spread of bigoted content that skew review scores based on the racist predilections of reviewers.

Communities have always turned to Yelp in reaction to current events at the local level. As the nation reckons with issues of systemic racism, we’ve seen in the last few months that there is a clear need to warn consumers about businesses associated with egregious, racially-charged actions to help people make more informed spending decisions. Yelp’s User Operations team already places alerts on business pages when we notice an unusual uptick in reviews that are based on what someone may have seen in the news or on social media, rather than on a first-hand experience with the business. Now, when a business gains public attention for reports of racist conduct, such as using racist language or symbols, Yelp will place a new Business Accused of Racist Behavior Alert on their Yelp page to inform users, along with a link to a news article where they can learn more about the incident.

This move may have seemed laudable but it lent itself to subjective interpretations of decisions made by businesses, as well as individual actions by employees. Employing a racist person is not the same as running a racist business, but Yelp's blanket policy seemed to indicate both were equally racist.

Further comments by Yelp clarified some of its employees would make the final determination on alleged racism by businesses or business owners. Any company flagged for racist behavior would be sheltered from further comment until a determination was made.

Decisions to be made by Yelp:

• Does allowing users to unilaterally declare businesses to be "racist" thwart monetization efforts by Yelp?
• Is it wise to succumb to the "wisdom of the crowd," especially when Yelp feels an interstitial warning is an acceptable replacement for due diligence?

• Does Yelp's reliance on income from businesses seeking to expand their reach conflict with allegations of racism by business owners/employees?
• Do policies like this actually encourage bad faith behavior by hiding reviews behind an ominous warning that suggests the complaints are legitimate?

Originally posted on the Trust & Safety Foundation website.

Thank you for reading this Techdirt post. With so many things competing for everyone’s attention these days, we really appreciate you giving us your time. We work hard every day to put quality content out there for our community.

Techdirt is one of the few remaining truly independent media outlets. We do not have a giant corporation behind us, and we rely heavily on our community to support us, in an age when advertisers are increasingly uninterested in sponsoring small, independent sites — especially a site like ours that is unwilling to pull punches in its reporting and analysis.

While other websites have resorted to paywalls, registration requirements, and increasingly annoying/intrusive advertising, we have always kept Techdirt open and available to anyone. But in order to continue doing so, we need your support. We offer a variety of ways for our readers to support us, from direct donations to special subscriptions and cool merchandise — and every little bit helps. Thank you.

–The Techdirt Team

Filed Under: content moderation, racism, reviews
Companies: yelp