The classic trilemma goes: "Fast, cheap or good, pick any two." The Moderator's Trilemma goes, "Large, diverse userbase; centralized platforms; don't anger users - pick any two." The Moderator's Trilemma is introduced in "Moderating the Fediverse: Content Moderation on Distributed Social Media," a superb paper from @[email protected] U of Minnesota Law, forthcoming in the journal *Free Speech Law*, available as a prepub on SSRN:

https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4213674#maincontent

1/

If you'd like an essay-formatted version of this thread to read or share, here's a link to it on pluralistic.net, my surveillance-free, ad-free, tracker-free blog:

https://pluralistic.net/2023/03/04/pick-all-three/#agonism

2/

Pluralistic: Solving the Moderator’s Trilemma with Federation (04 Mar 2023) – Pluralistic: Daily links from Cory Doctorow

Rozenshtein proposes a solution (of sorts) to the Moderator's Trilemma: federation. De-siloing social media, breaking it out of centralized walled gardens and recomposing it as a bunch of small servers run by a diversity of operators with a diversity of #ContentModeration approaches. The #Fediverse, in other words.

3/

In Albert Hirschman's classic treatise *Exit, Voice, and Loyalty,* stakeholders in an institution who are dissatisfied with its direction have two choices: #voice (arguing for changes) or #exit (going elsewhere). Rozenshtein argues that Fediverse users (especially users of #Mastodon, the most popular part of the Fediverse) have more voice *and* more #FreedomOfExit:

https://en.wikipedia.org/wiki/Exit,_Voice,_and_Loyalty

4/

Exit, Voice, and Loyalty - Wikipedia

Large platforms - think #Twitter, #Facebook, etc - are very unresponsive to users. Most famously, Facebook polled its users on whether they wanted to be spied on. Faced with overwhelming opposition to commercial surveillance, Facebook ignored the poll result and cranked the #surveillance dial up to a million:

https://www.nbcnews.com/tech/tech-news/facebook-ignores-minimal-user-vote-adopts-new-privacy-policy-flna1c7559683

5/

Facebook ignores 'minimal' user vote, adopts new privacy policy

NBC News

A decade later, Musk performed the same stunt, asking users whether they wanted him to fuck all the way off from the company, then ignored the #VoxPopuli, which, in this instance, was not #VoxDei:

https://apnews.com/article/elon-musk-twitter-inc-technology-business-8dac8ae023444ef9c37ca1d8fe1c14df

Facebook, Twitter and other #WalledGardens are designed to be sticky-traps, relying on high #SwitchingCosts to keep users locked within their garden walls which are really prison walls.

6/

Elon Musk Twitter poll ends with users seeking his departure

Millions of Twitter users asked Elon Musk to step down as head of Twitter in a poll the billionaire created and promised to abide by. But by Monday afternoon there was no word from Musk on whether he'll step aside or who a new leader might be. Twitter has grown more chaotic and confusing under Musk’s leadership with rapidly vacillating policies that are withdrawn or altered. Many of the votes for Musk to step down likely came from Tesla investors, who have grown tired of the 24/7 Twitter chaos, which they say has distracted the eccentric CEO from the electric car company, his main source of wealth.

AP News

Internal memos from the companies reveal that this strategy is deliberate, designed to keep users from defecting even as the service degrades:

https://www.eff.org/deeplinks/2021/08/facebooks-secret-war-switching-costs

By contrast, the Fediverse is designed for ease of exit. With one click, users can export the list of the accounts they follow, block and mute, as well as the accounts that follow *them*.

7/

Facebook’s Secret War on Switching Costs

Update, October 1, 2021: The original version of this essay incorrectly stated that Metcalfe's Law dictated that the number of connections in a network doubled with each new user; that has been corrected, below.When the FTC filed its amended antitrust complaint against Facebook in mid-August, we...

Electronic Frontier Foundation

With one more click, users can import that data into any other Fediverse server and be back up and running with almost no cost or hassle:

https://pluralistic.net/2022/12/23/semipermeable-membranes/

Last month, "Nathan," the volunteer operator of mastodon.lol, announced that he was pulling the plug on the server because he was sick of his users' arguments about the new #HarryPotter game.

8/

Pluralistic: What the fediverse (does/n’t) solve (23 Dec 2022) – Pluralistic: Daily links from Cory Doctorow

Commentators called this a mark against federation: "You can't rely on random, thin-skinned volunteer sysops for your online social life!"

https://mastodon.lol/@nathan/109836633022272265

But the mastodon.lol saga demonstrates the *strength* of federated social media, not its weakness. After all, 450 million Twitter users are also at the mercy of a thin-skinned sysop - but when he #enshittifies his platform, they can't just export their data and re-establish their social lives elsewhere in two clicks:

9/

Nathan 🏳️‍🌈 (@[email protected])

Mastodon.lol will shut down on May 9, 2023, 3 months from today. Information on how to migrate to a different server: https://docs.joinmastodon.org/user/moving/ I'm not doing this anymore. It's not worth it. Personal attacks calling me of all people a Nazi, a TERF, an antisemite... Congrats on destroying something I cared so deeply about. I hope you're happy. One last message before anyone tries to further assassinate my character: Fuck Nazis. Fuck TERFs. J.K. Rowling can die in a fire for all I care.

Mastodon.lol

Mastodon.lol shows us how, if you don't like your host's content moderation policies, you can exercise voice - even to the extent of making him so upset that he shuts off his server - and where voice fails, exit steps in to fill the gap, providing a soft landing for users who find the moderation policies untenable:

https://doctorow.medium.com/twiddler-1b5c9690cce6

10/

Twiddler - Cory Doctorow - Medium

Tracking Exposed is a scrappy European nonprofit that attempts to understand how online recommendation algorithms work. They comine data from volunteers who install a plugin with data acquired…

Medium

Traditionally, centralization has been posed as beneficial to content moderation. As Rozenshtein writes, a company that can "enclose" its users and lock them in has an incentive to invest in better user experience, while companies whose users can easily migrate to rivals are less invested in those users.

11/

And centralized platforms are more nimble. The operators of centralized systems can add hundreds of knobs and sliders to their back end and #twiddle them at will. They act unilaterally, without having to convince other members of a federation to back their changes.

Centralized platforms claim that their most powerful benefit to users is extensive content moderation.

12/

As @tarleton writes, “Moderation is central to what platforms do, not peripheral... [it] is, in many ways, the commodity that platforms offer":

https://yalebooks.yale.edu/book/9780300261431/custodians-of-the-internet/

Centralized systems claim that their enclosure keeps users safe - from bad code and bad people. Though Rozenshtein doesn't say so, it's important to note that this claim is wildly oversold. Platforms routinely fail at preventing abuse:

https://www.nbcnews.com/nbc-out/out-news/sexual-assault-harassment-bullying-trans-students-say-targeted-school-rcna7803

13/

Custodians of the Internet

A revealing and gripping investigation into how social media platforms police what we post online—and the large societal impact of these decisions Most use...

Yale University Press

And they also fail at blocking malicious code:

https://www.scmagazine.com/news/threats/apple-bugs-ios-macos_new_class

But even where platforms *do* act to "keep users safe," they fail, thanks to the Moderator's Trilemma. Setting speech standards for millions or even billions of users is an impossible task. Some users will *always* feel like speech is being underblocked - while others will feel it's overblocked (and both will be right!):

https://www.eff.org/deeplinks/2021/07/right-or-left-you-should-be-worried-about-big-tech-censorship

14/

New class of Apple bugs found in iOS, MacOS

Researchers found a new class of escalation bugs in macOS and iOS based on how the previously uncovered Pegasus Malware worked.

SC Media

And platforms play very fast and loose with their definition of "malicious code" - as when #Apple blocked #OGApp, an #Instagram ad-blocker that gave you a simple feed consisting of just the posts from the people you followed:

https://pluralistic.net/2023/02/05/battery-vampire/#drained

To resolve the Moderator's Trilemma, we need to embrace #subsidiarity: "decisions should be made at the lowest organizational level capable of making such decisions."

https://pluralistic.net/2023/02/07/full-stack-luddites/#subsidiarity

15/

Pluralistic: When Facebook came for your battery, feudal security failed (05 Feb 2023) – Pluralistic: Daily links from Cory Doctorow

For Rozenshtein, "content-moderation subsidiarity devolves decisions to the individual instances that make up the overall network." The fact that users can leave a server and set up somewhere else means that when a user gets pissed off enough about a moderation policy, they don't have to choose between leaving social media or tolerating the policy - they can simply choose another server that's part of the same federation.

16/

Rozenshtein asks whether Reddit is an example of this, because moderators of individual subreddits are given broad latitude to set their own policies and anyone can fork a subreddit into a competing community with different modeations norms. But Reddit's devolution is a matter of *policy*, not *architecture* - subreddits exist at the sufferance of Reddit's owners.

17/

Reddit is poised to go public, meaning those owners will include activist investors and large institutions that might not care about your little community.

You might be happy about Reddit banning /r_TheDonald, but if they can band that subreddit, they can ban *any* subreddit. Policy works well, but fails badly.

18/

By moving subsidiarity into technical architecture, rather than human policy, the fediverse can move from *antagonism* (the "zero-sum destructiveness" that dominates current online debate) to #agonism, where your opponent isn't an enemy - they are a "political adversary":

https://www.yalelawjournal.org/article/the-administrative-agon

Here, Rozenshtein cites @320x200 and @rra's "Seven Theses On The Fediverse And The Becoming Of Floss":

https://test.roelof.info/seven-theses.html

19/

The Administrative Agon: A Democratic Theory for a Conflictual Regulatory State

Scholars have long debated whether the administrative state is a democratic institution. This Article offers a new framework for analyzing this question—one drawn from agonistic democratic theory. It argues that agonism provides new grounding for the legitimacy of administrative agencies while also pointing to new horizons for reform.

> For this to happen, different ideologies must be allowed to materialize via different channels and platforms. An important prerequisite is that the goal of political consensus must be abandoned and replaced with conflictual consensus...

So your chosen Mastodon server "may have rules that are far more restrictive than those of the major social media platforms."

20/

But the whole Fediverse "is substantially more speech protective than are any of the major social media platforms, since no user or content can be permanently banned from the network and anyone is free to start an instance that communicates both with the major Mastodon instances and the peripheral, shunned instances."

21/

A good case-study here is #Gab, a Fediverse server by and for far-right cranks, conspiratorialists and white nationalists. Most Fediverse servers have defederated (that is, blocked) Gab, but Gab is still there, and Gab has actually defederated from many of the remaining servers, leaving its users to speak freely - but only to people who want to hear what they have to say.

22/

@pluralistic it was a non-fediverse server, it added federation, it was harassed completely off the fediverse by "dark fedi" servers like freespeechextremist by flooding its users mentions with femboy porn. there was an anti-gab organizing fedi account on the Mastodon, it took them nine months to realize gab already left because they had nothing to do with gab leaving, so they declared "put simply, we won" lol. gab has been completely off the fediverse since then.
@pluralistic btw the mastodon.lol admin didn't shut down his server bc of harry potter arguments. he complained about harry potter arguments in a bad post, got dogpiled and called transphobic and maybe a nazi, reacted badly to the dogpiling as people do since it's kind of cruel no matter who is doing it. i'll assume you didn't know that but the wording kinda feels like minimizing abuse.