A ‘polluted public sphere’ is bad for democracy, but who decides what should get the thumbs down? (Photograph: Facebook)
Move Fast, Zuckerberg, or Hate Will Kill Facebook
[dropcap]M[/dropcap]ove fast and break things”, was the exhortation that Facebook’s founder Mark Zuckerberg originally issued to his developers. It’s a typical hacker’s mantra: while the tools and features they developed for his platform might not be perfect, speed was the key aspiration, even if there were some screw-ups on the way.
In 2016, we began to realise that one of the things that might get broken in Mr Zuckerberg’s quest for speed is democracy. Facebook became one of the favourite platforms for disseminating “fake news” and was the tool of choice for micro-targeting voters with personalised political messages. It also became a live broadcasting medium for those engaging in bullying, rape, inflicting grievous bodily harm and, in one case, murder.
One way of thinking about the internet is that it holds up a mirror to human nature. All human life is there and much of what we see reflected on it is banal (Lolcats, for example), harmless, charming, enlightening and life-enhancing. But some of what we see is horrifying: it is violent, racist, hateful, spiteful, cruel, misogynistic and worse.
There are about 3.4bn users of the internet worldwide. Facebook has now nearly 2bn users, which comes to around 58% of all the people in the world who use the network. It was inevitable therefore that it too would become a mirror for human nature – and that people would use it not just for good purposes, but also for bad. And so they have.
The Chinese government employs ‘tens of thousands’ to monitor its social media
Zuckerberg and co were slow to realise that they had a problem. And when it finally dawned on them their initial responses were robotically inept. The first line of defence was that Facebook is merely a conduit, a channel, an enabler of free speech and “community building” and so has no editorial responsibility for what people post on it. The next tactic was to shift responsibility (and work) on to Facebook users: if anyone spotted objectionable content, then all they had to do was flag it and the company would deal with it.
But that didn’t work either, so the next response was an announcement that Facebook was working on a technological fix for the problem: AI programs would find the objectionable stuff and snuff it out. This, however, turns out to be beyond the capabilities of any existing AI, so the company has now resorted to employing a small army (3,000) of human monitors who will examine all the nasty stuff and decide what to do with it.
In a spectacular scoop, the Guardian has obtained copies of the guidelines these censors will apply. They make for sobering reading. Moderators have only about 10 seconds to make a decision. Should something like “someone shoot Trump” be deleted? (Yes, because he’s a head of state.) But what about “to snap a bitch’s neck, make sure to apply all your pressure to the middle of her throat”? (Apparently that’s OK, because it’s not “a credible threat”.) “Let’s beat up fat kids” is also OK, it seems. Videos of violent deaths, while marked as disturbing, do not always have to be deleted because “they can help create awareness of issues such as mental illness”. And so on.
As one digs into these training manuals, guidelines and slide-decks, the inescapable thought is that this approach looks doomed to fail – for two reasons. One is the sheer scale of the problem: 1.3m new posts every minute, 4,000 new photographs uploaded every second and God knows how many video clips. The second reason is that Facebook’s prosperity depends on this “user engagement”, so radical measures that might rein it in will undermine its business model. But even if only a fraction of the resulting content is unacceptable, dealing with it is a sisyphean task – way beyond the capacity of 3,000 people. (The Chinese government employs “tens of thousands” to monitor its social media.) If Zuckerberg continues down this path, he’s on track to be remembered as Canute 2.0.
This is Facebook’s problem, but it’s also ours, because so much public discourse now happens on that platform. And a polluted public sphere is very bad for democracy. What we’ve learned from the Guardian’s scoop is that Facebook’s baroque, unworkable, ad hoc content-moderation system is unfit for purpose. If we discovered that the output of an ice-cream factory included a small but measurable quantity of raw sewage we’d close it in an instant. Message to Zuckerberg: move quickly and fix things. Or else.
This article was originally published by The Guardian. Read the original article.