Whilst automated tools can help on this, there is a heckton of human labour to be done in training those tools, or in reviewing moderation decisions that require a human’s eye. I think that in a world where we can’t eradicate that need, the least we can do is ensure that people are paid well, in non-exploitative conditions, with additional support to cope.
Actually securing these things in a way that’s more than just lipservice is part of that battle— I remember a harrowing article a while back about content moderators in Kenya, working for Sama, which was contracted to work for Facebook. There were so many layers of exploitation in that situation that it made me sick. If the “mental health support” you have access to is an on-site therapist who guilt trips you into going back to work asap, and you’re so hurried and stressed that you don’t have time to even take a breather after seeing something rough — conditions like that are going to cause a disproportionate amount of preventable human harm.
Even if we can’t solve this problem entirely, there’s so much needless harm being done, and that’s part of what this fight is about now.
Whilst automated tools can help on this, there is a heckton of human labour to be done in training those tools, or in reviewing moderation decisions that require a human’s eye. I think that in a world where we can’t eradicate that need, the least we can do is ensure that people are paid well, in non-exploitative conditions, with additional support to cope.
Actually securing these things in a way that’s more than just lipservice is part of that battle— I remember a harrowing article a while back about content moderators in Kenya, working for Sama, which was contracted to work for Facebook. There were so many layers of exploitation in that situation that it made me sick. If the “mental health support” you have access to is an on-site therapist who guilt trips you into going back to work asap, and you’re so hurried and stressed that you don’t have time to even take a breather after seeing something rough — conditions like that are going to cause a disproportionate amount of preventable human harm.
Even if we can’t solve this problem entirely, there’s so much needless harm being done, and that’s part of what this fight is about now.