A digital illustration of a person sat in front of a computer screen. Their head is pixelated, and floating above the shape of the head. The colours of the head match TikTok branding.
20.10.22 Big Tech

Behind TikTok’s boom: A legion of traumatised, $10-a-day content moderators

Content warning: This story contains description of extreme and disturbing violence, suicide, child abuse and cruelty to animals.

Luis, a 28-year-old student from Colombia, works through the night moderating videos for TikTok. During the day, he tries to get some sleep, but sometimes the videos haunt his dreams.

He remembers one video taken at a party, with two people holding what initially looked like pieces of meat. When they turned around, it appeared they were holding skin and gristle which had been flayed off human faces. “The worst thing was that the friends were playing games and started using the human faces as masks,” he said.

Luis reeled off a list of the kind of content he sees on a regular basis: “Murder, suicide, paedophilic, pornographic content, accidents, cannibalism.”

For Carlos, a former TikTok moderator, it was a video of child sexual abuse that gave him nightmares. The video showed a girl of five or six years old, he said. “She was dancing, like pointing her back to the camera, it was so close.”

It hit him particularly hard, he said, because he’s a father himself. He hit pause, went outside for a cigarette, then returned to the queue of videos a few minutes later.

Horrific videos such as these are part and parcel of everyday work for TikTok moderators in Colombia. They told the Bureau of Investigative Journalism about widespread occupational trauma and inadequate psychological support, demanding or impossible performance targets, punitive salary deductions and extensive surveillance. Their attempts to unionise to secure better conditions have been opposed repeatedly.

TikTok’s rapid growth in Latin America – it has an estimated 100 million users in the region – has led to the hiring of hundreds of moderators in Colombia to fight a never-ending battle against disturbing content. They work six days a week on day and night shifts, with some paid as little as 1.2 million pesos (£235) a month, compared to about £2,000 a month for content moderators based in the UK.

The workers interviewed by the Bureau worked on TikTok content, but were contracted through Teleperformance, a multinational services outsourcing company that has more than 42,000 workers in Colombia, making it one of the country’s largest private employers. The nine moderators could only speak anonymously for fear they might lose their jobs, or undermine their future employment prospects.

Neither TikTok nor Teleperformance responded to detailed lists of allegations for this story. Both issued statements saying they were committed to the wellbeing of their employees.

Human Labour: ‘Cheaper than AI’

TikTok’s recommendation algorithm is widely considered to be one of the most effective applications of artificial intelligence (AI) in the world. With almost alarming accuracy, it learns what an individual user finds funny or appealing, and serves them more content that they are likely to enjoy.

But TikTok’s AI expertise only goes so far. The company uses human workers alongside AI to help keep its platform scrubbed of harmful content. And when content moderators at TikTok and other platforms mark a piece of content for removal, they are not just taking it down. They are also collecting data about the specific policies it violates – data that can be used to train the platform’s machine learning systems to better identify such content in the future.

Some social media platforms struggle with even relatively simple tasks, such as detecting copies of terrorist videos that have already been removed. But their task becomes even harder when they are asked to quickly remove content that nobody has ever seen before. “The human brain is the most effective tool to identify toxic material,” said Roi Carthy, the chief marketing officer of L1ght, a content moderation AI company. Humans become especially useful when harmful content is delivered in new formats and contexts that AI may not identify.

“There’s nobody that knows how to solve content moderation holistically, period,” Carthy said. “There’s no such thing.”

The existence of a low-paid, insecure global workforce may be exacerbating the problem, Carthy said. More computing power is required to analyse videos, which are more complex than photos and text. This means creating AI for moderating video is especially expensive.

“If you’re looking at this from a monetary perspective, then content moderation AI can’t compete with $1.80 an hour,” Carthy said, referring to a typical wage for content moderators based in the global south. “If that’s the only dimension you’re looking at, then no content moderation AI company can compete with that.”

Psychological support ‘just for show’

Claudia, a current TikTok moderator, told the Bureau she felt anxious and panicked at work after watching successive videos of people eating live animals. These trending videos were impossible to escape and triggered a phobia of hers. “I would just cover my screen and wait for 10 seconds to pass,” she said.

Claudia requested support through the Teleperformance scheme, which had to be approved by a supervisor, but she did not receive any help for two months. When the company’s mental health support staff finally did get in touch, they said they were unable to help her and told her to seek out support through the Colombian healthcare system.

The mental harms of content moderation work are well-documented, and the moderators the Bureau spoke to reported many symptoms caused or exacerbated by their work, including depression, anxiety, loneliness, tremors and sleep loss.

A slick PR video produced by Teleperformance promotes the psychological support it offers. “Some call them angels,” the voiceover says, describing its moderators while vaguely melancholic classical music plays in the background. “We know them as our friends, members of our family.”

However, several moderators said the company’s mental health support scheme was woefully inadequate.

Just one of those interviewed, a former moderator, felt Teleperformance did care about the mental health of its employees. Daniela said the company was particularly concerned about those who, like her, worked on the R1 team dealing with the most extreme content – although she personally had never felt the need to use the support.

But Luis, the man haunted by the video of flayed faces, said the in-house offering was “just for show”. He also works on R1, but ended up seeking psychological support outside of work, through the Colombian healthcare system.

Missing the metric

The TikTok moderation system described by these moderators is built on exacting performance targets. If workers did not get through a huge number of videos, or were late back from a break, they could lose out on a monthly bonus worth up to a quarter of their salary.

It is easy to lose out on the much-needed extra cash. Álvaro, a current TikTok moderator, has a target of 900 videos per day, with about 15 seconds to view each video. He works from 6am to 3pm, with two hours of break time, and his base salary is 1.2m pesos a month, only slightly higher than Colombia’s minimum salary. All the moderators interviewed by the Bureau were based in the capital Bogotá when they were working for TikTok, where rent and living expenses are above the national average.

For Álvaro, hitting his productivity, timekeeping, and accuracy targets could be worth an extra 300,000 pesos (£60). But he said he usually earned closer to his base salary of 1.2m pesos.

A single slip up can be enough. He once received a disciplinary notice known internally as an “action form” for only managing to watch 700 videos in a shift, which was considered “work avoidance”. Once a worker has an action form, he said, they cannot receive a bonus that month.

Álvaro worries these disciplinary actions will affect any future reference and hamper his job prospects. “If I put this work in my work experience, they’re gonna say I was avoiding work, not getting the metric, being a bad worker.”

He added: “You have to just work like a computer. You pick the policies, no more. Don’t say anything, don’t go to bed, don’t go to the restroom, don’t make a coffee, nothing.”

Other moderators who spoke to the Bureau also had daily targets of 900-1,000 videos, while another who worked on longer videos of up to a minute reported targets of 200-250 per shift.

While some said they usually received their bonus, others said they only received it some of the time, and one moderator described it as impossible to attain. Two said they felt they had unfairly missed out despite meeting their targets or being a top performer in their department.

Mark Pfeiffer, a Teleperformance spokesperson, said: “Teleperformance is committed to employee wellbeing and staff diversity, equity and inclusion. People care has been, is and will continue to be a global top priority for our business.”

Home surveillance

Teleperformance, based in Paris, has become a market leader in content moderation services, with more than 7,000 of these types of workers around the world, according to analysis by Market Research Future. It sees Colombia – where moderators told the Bureau it worked with Meta, Discord and Microsoft as well as TikTok – as a key hub for cementing this position of dominance.

During the pandemic, business was booming. Last year, Teleperformance reported record revenues of £6bn and nearly £500m in profits.

The Bureau newsletter

Subscribe to the Bureau newsletter, and hear when our next story breaks.

The widespread shift to working from home was partly behind this huge rise in profits, as companies contracted Teleperformance to help them manage their newly remote workforce, according to Aarti Dhapte, a senior analyst with Market Research Future.

At the same time, a large proportion of Teleperformance’s own staff were shifted to remote work, cutting the cost of office maintenance. Teleperformance says that 70% of its global workforce is now remote, as were most of the moderators interviewed by the Bureau.

To reassure clients that this shift would not lead to a drop in standards, Teleperformance rolled out extensive surveillance systems, using both proprietary and third-party software to monitor its employees. NBC news revealed last year that Teleperformance workers in Colombia, including those subcontracted to Apple and Uber, had been pressured to sign contracts giving the company the right to install cameras in their homes.

Carolina, a former TikTok moderator who worked remotely for Teleperformance between June and September 2020, said supervisors asked her to be on camera continuously during her night shift. She was also warned that nobody else should be in view of the camera, and that her desk should be empty, apart from a drink in a transparent cup.

“That was terrible, because my family lives in my house as well,” Carolina said. “So I felt very guilty telling them, ‘Please don’t pass behind the camera because I could be fired’. Teleperformance is especially paranoid with people seeing what we do.”

Current moderators did not say they had to work on camera, but they do have to clock in and out and log any breaks on an app called Timekeeper. When Álvaro was once a few minutes back from the break on his overnight shift, his supervisor subsequently contacted him and put him on an action form.

A TikTok spokesperson said: “We strive to promote a caring working environment for our employees and contractors. Our Trust and Safety team partners with third party firms on the critical work of helping to protect the TikTok platform and community, and we continue to expand on a range of wellness services so that moderators feel supported mentally and emotionally.”

Union busting

Outsourcing moderation to countries in the global south like Colombia works for businesses because it is cheap, and workers are poorly protected. Carolina, who left Teleperformance two years ago, said: “It’s very important for people to get to know that this is abusive, and they’re just companies taking advantage of the terrible economical situation that we’ve got for young people in Latin America.”

Utraclaro, a Colombian union which represents IT and call centre workers, has been trying to organise Teleperformance staff – including TikTok moderators – for more than two years. It has been a slow and laborious process, with pushback from the company at every stage.

The union’s key demands are that the company must allow workers to form a union without intimidation and that union reps are allowed access to the workplace to talk to their colleagues. Teleperformance did not comment on specific allegations of union-busting in Colombia.

Eyewitnesses who asked to remain anonymous said they had seen union organisers harassed several times by security staff while trying to speak to Teleperformance workers at a business park in Bogotá.

When organisers gave out flyers or attempted to speak to workers taking their breaks outside the Teleperformance offices, the park’s private security guards followed them and told them to stop. One person said she had seen a Teleperformance worker watch the organisers, and then speak with the security guards. After this, more security guards were watching them.

On another occasion, the guards called the police after arguing with the organisers about their right to be there.

“Even if you’re in a public area they don’t care, they will harass you, they’ll call the police,” said another source. “And because it’s a big company, the police also will be in their favour.”

After Utraclaro officially notified Teleperformance of its demands in August 2021, Teleperformance filed a legal claim at a labour court in Bogotá, alleging Utraclaro did not follow the proper processes when ratifying its bargaining demands.

The lawsuit was an attempt to intimidate workers, said UNI Global Union, an international trade union federation which is supporting Utraclaro in their dispute

Teleperformance’s lawyers have sought the “suspension, dissolution, liquidation and cancellation of the union registration,” public court records show.

Change, however, may be on the horizon. There has been some progress in discussions between Utraclaro and Teleperformance in recent weeks. “The union in Colombia still has a frivolous lawsuit hanging over its head but at least there are some ongoing discussions which could potentially move things forward,” said Christy Hoffman, secretary of UNI Global Union.

If Teleperformance reaches a deal with the union, it would be a significant moment for the outsourcing sector, which has historically been hostile to labour organising.

“I’ve been in this kind of business since 2013,” said one Teleperformance customer service employee, “I can tell you that if you say that word [sindicato, Spanish for trade union], you will be out the next day. Sindicato? You can’t say that.”

Claudia said she had joined the union to win a better salary and improved mental health support. Luis also hoped staff would get a pay rise, and that the intense pressure on moderators would be reduced.

Álvaro, who lives alone in Bogotá and worked six days a week for the whole of last December after a holiday request was denied, said he just wanted to spend Christmas with his family this year.

For now, however, TikTok’s low-paid moderators will keep working to their gruelling targets, sifting through some of the internet’s most nightmarish content.

All the names of the moderators the Bureau spoke with have been changed

Reporters: Niamh McIntyre, Rosie Bradbury and Billy Perrigo
Tech editor: Jasper Jackson
Global Editor: James Ball
Bureau Editor: Meirion Jones
Production: Frankie Goodway and Emily Goddard
Fact Checker: Alice Milliken
Illustrations: Anson Chan

Our reporting on Big Tech is funded by Open Society Foundations. None of our funders have any influence over the Bureau's editorial decisions or output.