Pick your own filter, the way email does: Charles Duan on content moderation
Every argument about content moderation this year has ended in the same place. Someone inside Facebook or Twitter makes a call, and half the people watching are furious about it. Facebook's new Oversight Board began taking cases in October, which is a serious attempt to make those calls more legitimate. It is still one company's board deciding what that company's users get to see.
I put the problem to Charles Duan, senior fellow for technology and innovation policy at R Street, about as bluntly as I could. Facebook decides what you see and what you don't, and from the outside it is mystery meat. We are asked to trust that the company is delivering what we want and not making a judgment call on our behalf.
Charles started further back than I did. Moderation is an old problem. The early internet already accepted that platforms needed some way to take things down or flag them, because people want different things. What changed is concentration. Anyone can start a platform tomorrow, but most people use one or two of a handful, and whoever runs that handful sets the policy for nearly everyone. There will always be people unhappy with that policy, he said, and asking the platforms to make everybody happy has not worked for at least the last couple of years.
So stop asking one company to make the call. Facebook is a single unified whole. It controls the back end, where the posts and the friendships are stored, and the front end, the pages that decide what to show you. Separate the two, let different companies build different front ends on top of the same back end, and the decision about what you see moves to the person doing the seeing. If you want more, or less, or a different slant, you pick a different front end.
It turns out that we actually have a very good system that does this already, and that's email. You have all of these back-end servers from which you receive email, and then you have your own email client, be that Apple Mail or Gmail or Microsoft Outlook, which contains spam filters and other sorts of content moderation tools.
The comparison stayed with me after we stopped recording. Spam filtering is content moderation at enormous scale, and almost nobody argues about it in public. Nobody asks Congress who should decide what counts as spam. Your client decides, you can tune it, and if you hate it you switch clients and keep your address and your mail. The power is real, but it is spread out, so it never becomes a political fight.
What makes that possible is the glue. Mail moves between servers on SMTP, a protocol that dates to 1982, and the idea underneath it is simple: one computer tells another that it has a message waiting. Because the back end and the front end talk in a way each can predict, they can be built by different people. That, Charles said, is all interoperability really is. Facebook has no such separation because it does not let anyone else display Facebook's data the way your mail client displays mail from any server.
I asked what the Facebook equivalent of SMTP would look like. In outline, a front end that asks Facebook's servers for your list of friends or your most recent posts, and then decides for itself how to show them. Underneath that outline sits a great deal of complexity, and who should write that protocol is its own question. We spent the second half of the conversation on it, and I have written it up separately: not the government, not Facebook.
Pieces of this already exist. A year ago Twitter announced Bluesky, a small independent team asked to design an open, decentralized standard for social media that Twitter would eventually use itself. Mastodon runs on ActivityPub, a standard the W3C published in 2018. Neither is Facebook-sized, but both show that the split between back end and front end can be built.
What I like about Charles's version is that it changes the question. The current fight is about who decides. His question is who builds, and a filter you chose is one you can change.
From Lincoln Shorts, the interview series I hosted for Lincoln Network, recorded 5 December 2020.
