The Guardian was recently able to get its hands on some content moderation training manuals and other materials, that show just how difficult it is for Facebook to moderate its content.
I report a lot of stuff on Facebook on a daily basis. A LOT! So, I do get annoyed when I get the canned response that Facebook will not remove the content in question, as it doesn’t go against any specific guidelines. The Guardian recently got its hands on “more than 100 internal training manuals, spreadsheets and flowcharts,” offering an insight into the processes involved in moderating content on Facebook.
In a recent article Nick Hopkins reported that content moderators have an overwhelming workload of having to deal with over 6.5 million FNRP (fake, not real person”) reports alone, every day. This allows them only around 10 seconds to process content and to make a decision based on the site’s guidelines. Also, he explained that sexual content could easily be the most “inconsistent, complex and confusing.”
A massive challenge is of course context. So, for example, while content can violate specific policies in one context, it could be ok in others. Facebook‘s head of global policy management, Monika Bickert, who spoke to Hopkins, explained
[quote]We have a really diverse global community, and people are going to have very different ideas about what is OK to share. No matter where you draw the line, there are always going to be some grey areas. For instance, the line between satire and humor and inappropriate content is sometimes very grey.[/quote]
As Hopkins explains in his analysis of the leaked materials, “Someone shoot Trump,” should be deleted, as the POTUS is in a “protected category.” However, saying “To snap a bitch’s neck, make sure to apply all your pressure to the middle of her throat,” would not be seen as a credible threat. Similarly, some videos of violent deaths, may just be marked as disturbing and not be deleted, as Facebook says they can generate awareness of certain issues.
Also, as long as certain images or videos are not sadistic or celebratory in their violence, they may not be deleted. Finally, things like animal abuse is allowed on the site, except for what Facebook calls “disturbing” imagery which is extremely upsetting. You can find the entire cache of leaked documents, here.
Facebook acknowledges that its moderators face a “challenging and difficult job.” That in itself is an understatement, as the “high turnover of moderators, who say they suffer from anxiety and post-traumatic stress” shows just how much of a problem their job can be for their mental state.
You might also like
More from Facebook
Facebook Gaming Partners will now be able to play copyrighted music in the background during their live streams without fear.
Following changes to its Platform Terms and Developer Policies, Facebook is announcing the broad launch of Data Use Checkup for …
Facebook now lets you use its data portability tool to transfer your photos and videos to Dropbox and Koofr - …
Facebook NPE has updated its Whale app with private meme groups, support for GIF memes, and new top meme templates.
Apple blocked a Facebook update because its new feature called out Apple on the 30% App Store tax the company …