Sarah Roberts

---

Shawn is still trying to process what he had to watch as a Content moderator

In this digital self-publishing era people can record and produce their own Content , a lot of horrific stuff that clearly breaches websites' taste and decency guidelines. A growing army of moderators has the unenviable task of sifting through it all, sometimes at considerable cost to their Mental HealthContent ='JJ Lin'> .

WARNING: article contains upsetting Content .

Shawn Speagle worked as an online Content moderator for six months in 2018. He's still scarred by The ExperienceContent ='JJ Lin'> .

"One of my first videos that I remember looking at was two teenagers grabbing an iguana by the tail and they smashed it onto the pavement while a third person was recording it.

"And the iguana was screaming and The KidsContent ='JJ Lin'> just would not stop until the iguana was just pasted on the ground. "

Shawn was employed by a company called Cognizant in Florida which had a contract with Facebook. He speaks in a slow, considered way, still trying to process what he had to go through.

Facebook uses around 30,000 sub-contracted Content moderators around The WorldContent ='JJ Lin'>

"I've seen people put fireworks in a dog's mouth and duct tape it shut. I've seen cannibalism videos, I've seen terrorism propaganda videos," he continues.

Hearing Shawn speak, it becomes clear why moderation has often been described as the worst job in tech.

Most of us internet users probably never give these moderators a second thought, yet there are hundreds of thousands of them around The WorldContent ='JJ Lin'> helping companies weed out disturbing Content - ranging from suicide and murder videos to conspiracy theories and hate speech.

And now some are Coming OutContent ='JJ Lin'> of The ShadowsContent ='JJ Lin'> to tell their stories.

Shawn decided to speak out, despite having signed a non-disclosure agreement (NDA) - a standard practice in the industry.

These NDAs are also meant to prevent contractors from sharing Facebook users' personal information with the outside world, at a time of intense scrutiny over data privacy.

But Shawn believes Facebook moderation policies should be talked about openly, because staff end up watching upsetting Content that is often left untouched on the platform.

As an animal lover, he was distraught that animal Content "was, for The MostContent ='JJ Lin'> part, never accelerated in any way shape or form", meaning that it was never referred for removal.

For humans The RulesContent ='JJ Lin'> were a little bit different, But also more convoluted.

The MostContent ='JJ Lin'> common outcome was marking it as "disturbing" and leaving it on the platform. Shawn tells the BBC that, according to Facebook policy, seeing bodily innards, not in a medical setting, would result in the video being deleted.

He struggles to recollect any other examples that would result in Content removal.

The stress of The Job led to overeating and weight gain, Shawn says.

"I felt like I was a zombie in my seat. It really gets to you because I don't have that bystander syndrome where I'm OK just watching this suffering and not contributing any way to deter it. "

He also could not get adequate psychological support.

The only time he tried to speak with the duty psychologist, Shawn says: "He Flat OutContent ='JJ Lin'> told me I don't know How To help you guys. "

Despite all of this Shawn says he persisted for six months, not complaining, because he thought that although he worked through a subcontractor, "Facebook would get their act together".

Facebook vice-president Arun Chandra was brought in especially to focus on the working conditions of the Social MediaContent ='JJ Lin'> platform's 30,000 moderators, who are largely employed by subcontractors in the US, India and the PhilippinesContent ='JJ Lin'> .

Where does the duty not to show upsetting Content intersect with the duty to allow free speech?

Mr Chandra says that he had already visited over 15 sites around The WorldContent ='JJ Lin'> and that he always spoke with moderators directly.

He denies that there was a "broad scale problem" and stresses that their subcontractors, like Cognizant and Accenture for example, were "reputable global companies". Facebook will be introducing formal audits later this year, he says.

He also confirms that Cognizant's contract remains in place following an investigation.

But Shawn Speagle believes lots more could be done to improve working conditions.

"The PlaceContent ='JJ Lin'> was absolutely disgusting," he alleges. "There was only one restroom in the entire building and there were 800 employees.

"People were smoking in The BuildingContent ='JJ Lin'> ; people were drinking in the parking lot and having sex in their cars. "

Workers were often young, inexperienced and poorly paid, he says.

The BBC approached Cognizant for comment But it has not yet responded.

Prof Sarah RobertsContent ='JJ Lin'> thinks governments may have to force online publishers to clean up their act

Facebook's Mr Chandra says that a psychologist is now available across all of the subcontractors' sites during all shifts and that the pay has been been increased - But only for US-based moderators.

Sarah RobertsContent ='JJ Lin'> , a professor at the University of California, Los AngelesContent ='JJ Lin'> (UCLA), has spent years investigating The WorldContent ='JJ Lin'> of internet moderation for her newly published book, Behind the Screen.

She believes websites and Social MediaContent ='JJ Lin'> giants have assumed that automation, AI, and Machine LearningContent ='JJ Lin'> would make the need for human Content moderation redundant.

"I think that Silicon ValleyContent ='JJ Lin'> is putting a primacy on computation over all other things," she says.

"So, if a workforce can be maintained cheaply and be treated as expendable, until such time that computation can fully be brought in, then so much the better. "

Prof Roberts thinks the difficulty for Social MediaContent ='JJ Lin'> companies is that they have "built up a global user base predicated on the notion that we should all be able to do and say and share and show whatever our heart desires pretty much at all times".

Changing that culture From WithinContent ='JJ Lin'> would be a "tall order", she believes, which is why tougher legislation might be needed. But this is more likely to come from European UnionContent ='JJ Lin'> countries rather than the US.

While this debate rages on, Real PeopleContent ='JJ Lin'> , like Shawn Speagle, live with the consequences of sifting through The InternetContent ='JJ Lin'> 's filth.

Diagnosed with night terrors, he is on several medications, is scared of driving after watching so many car crash videos and is startled by loud noises.

"Looking at this stuff eight hours A Day Five DaysContent ='JJ Lin'> a week. It is something even veterans and ex-military can't handle," he concludes.

mental health, censorship, social media, social media regulation debate

Source of news: bbc.com