#ContentModeration is fundamentally about making social media work better, but there are two other considerations that determine how social media *fails*: #EndToEnd (#E2E), and #FreedomOfExit. These are much neglected, and that's a pity, because how a system fails is every bit as important as how it works.

If you'd like an essay-formatted version of this thread to read or share, here's a link to it on pluralistic.net, my surveillance-free/ad-free, tracker-free blog:

https://pluralistic.net/2022/12/19/better-failure/#let-my-tweeters-go

1/

Pluralistic: Better failure for social media (19 Dec 2022) – Pluralistic: Daily links from Cory Doctorow

Of course, commercial social media sites don't want to be *good*, they want to be *profitable*. The unique dynamics of social media allow the companies to uncouple quality from profit, and more's the pity.

Social media grows thanks to #NetworkEffects - you join Twitter to hang out with the people who are there, and then other people join to hang out with you. The more users Twitter accumulates, the more users it *can* accumulate.

2/

But social media sites stay big thanks to high #SwitchingCosts: the more you have to give up to leave a social media site, the harder it is to go:

https://www.eff.org/deeplinks/2021/08/facebooks-secret-war-switching-costs

Nature bequeaths some in-built switching costs on social media, primarily the #CoordinationProblem of reaching consensus on where you and the people in your community should go next.

3/

Facebook’s Secret War on Switching Costs

Update, October 1, 2021: The original version of this essay incorrectly stated that Metcalfe's Law dictated that the number of connections in a network doubled with each new user; that has been corrected, below.When the FTC filed its amended antitrust complaint against Facebook in mid-August, we...

Electronic Frontier Foundation

The more friends you share a social media platform with, the higher these costs are. If you've ever tried to get ten friends to agree on where to go for dinner, you know how this works. Now imagine trying to get *all* your friends to agree on where to go for dinner, for the rest of their lives!

But these costs aren't insurmountable. Network effects, after all, are a double-edged sword.

4/

Some users are above-average draws for others, and if a critical mass of these important nodes in the network map depart for a new service - like, say, #Mastodon - that service becomes the presumptive successor to the existing giants.

When that happens - when Mastodon becomes "the place we'll all go when Twitter finally becomes unbearable" - the downsides of network effects kick in and the double-edged sword begins to carve away at a service's user-base.

5/

It's one thing to argue about which restaurant we should go to tonight, it's another to ask whether we should join our friends at the new restaurant where they're already eating.

Social media sites who want to keep their users' business walk a fine line: they can simply treat those users well, showing them the things they ask to see, not spying on them, paying to police their service to reduce harassment, etc.

6/

But these are costly choices: if you show users the things they *ask* to see, you can't charge businesses to show them things they *don't* want to see. If you don't spy on users, you can't sell targeting services to people who want to force them to look at things they're uninterested in.

7/

Every moderator you pay to reduce harassment draws a salary at the expense of your shareholders, and every catastrophe that moderator prevents is a catastrophe you can't turn into monetizable attention as gawking users flock to it.

So social media sites are always trying to optimize their mistreatment of users, mistreating them (and thus profiting from them) right up to the point where they are ready to switch, but without actually pushing them over the edge.

8/

One way to keep dissatisfied users from leaving is by extracting a penalty from them for their disloyalty. You can lock in their data, their social relationships, or, if they're "creators" (and disproportionately likely to be key network nodes whose defection to a rival triggers mass departures from their fans), you can take their audiences hostage.

The dominant social media firms all practice a low-grade, tacit form of hostage-taking.

9/

Facebook downranks content that links to other sites on the internet. Instagram prohibits links in posts, limiting creators to "#LinksInBio." Tiktok doesn't even allow links. All of this serves as a brake on high-follower users who seek to migrate their audiences to better platforms.

10/

But these strategies are unstable. When a platform becomes worse for users (say, because it mandates nonconsensual surveillance and ramps up advertising), they may actively seek out other places on which to follow each other, and the creators they enjoy. When a rival platform emerges as the presumptive successor to an incumbent, users no longer face the friction of knowing which rival they should resettle to.

11/

When platforms' #enshittification strategies overshoot, users flee in droves, and then it's time for the desperate platform managers to abandon the pretense of providing a #PublicSquare. Yesterday, #ElonMusk's #Twitter rolled out a policy prohibiting users from posting links to rival platforms:

https://web.archive.org/web/20221218173806/https://help.twitter.com/en/rules-and-policies/social-platforms-policy

This policy was explicitly aimed at preventing users from telling each other where they could be found after they leave Twitter:

https://web.archive.org/web/20221219015355/https://twitter.com/TwitterSupport/status/1604531261791522817

12/

Promotion of Alternative Social Platforms Policy | Twitter Help

This, in turn, was a response to many users posting regular messages explaining why they were leaving Twitter and how they could be found on other platforms. In particular, Twitter management was concerned with departures by high-follower users like @taylorlorenz, who was *retroactively* punished for violating the policy, though it didn't exist when she violated it:

https://deadline.com/2022/12/washington-post-journalist-taylor-lorenz-suspended-twitter-1235202034/

13/

Washington Post Journalist Taylor Lorenz Suspended From Twitter

Controversial Washington Post reporter Taylor Lorenz says she has been suspended from Twitter upon order of its owner, Elon Musk. Lorenz made the claim in a Substack post, adding that she did not a…

Deadline

As Elon Musk wrote last spring: "The acid test for two competing socioeconomic systems is which side needs to build a wall to keep people from escaping? That's the bad one!"

https://twitter.com/elonmusk/status/1533616384747442176

This isn't particularly insightful. It's obvious that any system that requires high walls and punishments to stay in business isn't serving its users, whose presence is attributable to coercion, not fulfillment.

14/

Elon Musk on Twitter

“The acid test for any two competing socioeconomic systems is which side needs to build a wall to keep people from escaping? That’s the bad one!”

Twitter

Of course, the people who operate these systems have all manner of rationalizations for them.

The Berlin Wall, we were told, wasn't there to keep East Germans *in* - rather, it was there to keep the teeming hordes clamoring to live in the workers' paradise *out*. In the same way, platforms will claim that they're not blocking #outlinks or #sideloading because they want to prevent users from defecting to a competitor, but rather, to protect those users from external threats.

15/

This rationalization quickly wears thin, and then new ones step in. For example, you might claim that telling your friends that you're leaving and asking them to meet you elsewhere is like "giv[ing] a talk for a corporation [and] promot[ing] other corporations":

https://mobile.twitter.com/mayemusk/status/1604550452447690752

16/

Maye Musk on Twitter

“This makes absolute sense. When I give a talk for a corporation, I don’t promote other corporations. If I did, I would be fired on the spot and never booked again. Is that hard to understand?”

Twitter

Or you might claim that it's like "running Wendy's ads [on] McDonalds property," rather than turning to your friends and saying, "The food at McDonalds sucks, let's go eat at Wendy's instead":

https://twitter.com/doctorow/status/1604559316237037568

The truth is that any service that won't let you leave isn't in the business of serving you, it's in the business of harming you.

17/

Cory Doctorow (see pluralistic.net) on Twitter

“tfw you are so pilled you can't tell the difference between a ban on handing out fliers for a rival restaurant and a ban on diners saying to one another, "The food here sucks, let's go somewhere else."”

Twitter

The only reason to build a wall around your service - to impose *any* switching costs on users- is so that you can fuck them over without risking their departure.

The platforms want to be #Anatevka, and we the villagers of #FiddlerOnTheRoof, stuck plodding the muddy, Cossack-haunted roads by the threat of losing all our friends if we try to leave:

https://doctorow.medium.com/how-to-leave-dying-social-media-platforms-9fc550fe5abf

18/

How to Leave Dying Social Media Platforms - Cory Doctorow - Medium

In the opening scenes of the 1971 film adaptation of Fiddler on the Roof, the narrator, Tevye, introduces us to his village of Anatevka, which is a pretty fraught place where people are unhappy and…

Medium

That's where freedom of exit comes in. The public should have the right to leave, and companies should not be permitted to make that departure burdensome. Any burdens we permit companies to impose is an invitation to abuse of their users.

19/

This is why governments are handing down new #interoperability mandates: the EU's #DigitalMarketsAct forces the largest companies to offer APIs so that smaller rivals can plug into them and let users #walkaway from Big Tech into new kinds of platforms - small businesses, co-ops, nonprofits, hobby sites - that treat them better.

20/

These small players are overwhelmingly part of the #fediverse: the #federated social media sites that allow users to connect to one another irrespective of which server or service they use.

21/

The creators of these platforms have pledged themselves to freedom of exit. Mastodon ships with a "Move Followers" and "Move Following" feature that lets you quit one server and set up shop on another, without losing any of the accounts you follow or the accounts that follow *you*:

https://codingitwrong.com/2022/10/10/migrating-a-mastodon-account.html

This feature is as yet obscure, because the exodus to Mastodon is still young.

22/

Migrating a Mastodon Account

The Mastodon instance I’ve been using, mastodon.technology, is shutting down in a few months, so I’ve migrated my Mastodon account to a new server. I wanted to share the steps I went through in case the details are helpful to anyone, especially others migrating off that instance–especially a warning about when you lose access to your old account. I don’t know if these are the best steps to follow, but they worked for me.

CodingItWrong.com

Users who flocked to servers without knowing much about their managers have, by and large, not yet run into problems with the site operators. The early trickle of horror stories about petty authoritarianism from Mastodon sysops conspicuously fail to mention that if the management of a particular instance turns tyrant, you can click two links, export your whole social graph, sign up for a rival, click two more links and be back at it.

23/

This feature *will* become more prominent, because there is nothing about running a Mastodon server that means that you are *good* at running a Mastodon server. Elon Musk isn't an evil genius - he's an ordinary mediocrity who lucked into a lot of power and very little accountability. Some Mastodon operators will have Musk-like tendencies that they will unleash on their users, and the difference will be that those users can click two links and move elsewhere. Bye-eee!

24/

Freedom of exit isn't just a matter of the human right of movement, it's also a labor issue. Online creators constitute a serious draw for social media services. All things being equal, these services would rather coerce creators' participation - by holding their audiences hostage - than persuade creators to remain by offering them an honest chance to ply their trade.

25/

Platforms have a variety of strategies for chaining creators to their services: in addition to making it harder for creators to coordinate with their audiences in a mass departure, platforms can use DRM, as #Audible does, to prevent creators' customers from moving the media they purchase to a rival's app or player.

26/

Then there's #FreedomOfReach: platforms routinely and deceptively conflate *recommending* a creator's work with *showing that creator's work to the people who explicitly asked to see it*.

https://pluralistic.net/2022/12/10/e2e/#the-censors-pen

When you follow or subscribe to a feed, that is not a "signal" to be mixed into the recommendation system. It's an *order*: "Show me this." Not "Show me things like this."

Show.

Me.

This.

27/

Pluralistic: Freedom of reach IS freedom of speech (10 Dec 2022) – Pluralistic: Daily links from Cory Doctorow

But there's no money in showing people the things they tell you they want to see. If Amazon showed shoppers the products they searched for, they couldn't earn $31b/year on an "ad business" that fills the first six screens of results with rival products who've paid to be displayed over the product you're seeking:

https://pluralistic.net/2022/11/28/enshittification/#relentless-payola

28/

Pluralistic: How monopoly enshittified Amazon/28 Nov 2022 – Pluralistic: Daily links from Cory Doctorow

If Spotify played you the albums you searched for, it couldn't redirect you to playlists artists have to shell out #payola to be included on:

https://pluralistic.net/2022/09/12/streaming-doesnt-pay/#stunt-publishing

And if you only see what you ask for, then product managers whose #KPI is whether they entice you to "discover" something else won't get a bonus every time you fatfinger a part of your screen that navigates you away from the thing you specifically requested:

https://doctorow.medium.com/the-fatfinger-economy-7c7b3b54925c

29/

Pluralistic: 12 Sep 2022 Spotify is a ripoff, a Spotify exclusive – Pluralistic: Daily links from Cory Doctorow

Musk, meanwhile, has announced that you won't see messages from the people you follow unless they pay for Twitter Blue:

https://www.wired.com/story/what-is-twitter-blue/

And also that you will be nonconsensually opted into seeing more "recommended" content from people you don't follow (but who can be extorted out of payola for the privilege):

https://www.socialmediatoday.com/news/Twitter-Expands-Content-Recommendations/637697/

30/

Twitter Blue Explained: What Is It? How Much Does It Cost?

The relaunch of Twitter’s subscription service is pretty confusing. Here’s what users get for their money.

WIRED

Musk sees Twitter as a publisher, not a social media site:

https://twitter.com/elonmusk/status/1604588904828600320

Which is why he's so indifferent to the collateral damage from this payola/hostage scam. Yes, Twitter is a place where famous and semi-famous people talk to their audiences, but it is primarily a place where those audiences talk to each other - that is, a #PublicSquare.

31/

Elon Musk on Twitter

“@stillgray Exactly. Twitter should be easy to use, but no more relentless free advertising of competitors. No traditional publisher allows this and neither will Twitter.”

Twitter

This is the #Facebook death-spiral: charging to people to follow to reach you, and burying the things they say in a torrent of payola-funded spam. It's the vision of someone who thinks of other people as things to use - to pump up your share price or market your goods to - not worthy of consideration.

As #TerryPratchett's #GrannyWeatherwax put it: "Sin is when you treat people like things. Including yourself. That's what sin is."

32/

Mastodon isn't perfect, but its flaws are neither fatal nor permanent. The idea that centralized media is "easier" surely reflects the hundreds of billions of dollars that have been pumped into refining social media #RoachMotels ("users check in, but they don't check out").

33/

Until a comparable sum has been spent refining decentralized, federated services, any claims about the impossibility of making the fediverse work for mass audiences should be treated as unfalsifiable, motivated reasoning.

Meanwhile, Mastodon has gotten two things right that no other social media giant has even seriously *attempted*:

34/

@pluralistic This long thread's domination of my timeline illustrates your point about the dangers on monopoly.
@dangreaney you should definitely absolutely unfollow this account if you don't like long threads. That is the only reason it exists. If you would like to read these articles some other way see pluralistic.net for links
@pluralistic I love a lot of this thread, but I'm frustrated that you keep repeating this as though it describes how things are rather than how you think it should be. People's choices of who-to-follow are not extricable from what they expect will happen and how those followed choose to post, all of this at the individual and ecosystem level. This is important because we risk misunderstanding why people seem to prefer non-chronological presentation. https://maya.land/responses/2022/02/18/facebook-feed-algorithm-is-still-bad.html
no, the facebook feed algorithm is still bad

…ugen’s documents to the public.) Turning off the News Feed ranking algorithm, the researcher found, led to a worse experience almost across the board. People spent more time scrollin…

maya.land
@pluralistic We can (and I think should!) move things back to less mediated follow-relationships, or at least having a clearer option for them – but expressing this imprecisely leaves us real vulnerable to "well, when I follow YTers on RSS, the stuff I wanted to see is drowned out by all the spammy interview clips they post that I don't care about" – because the YTers are posting in an ecosystem where they don't have to curate uploads because the algo will.
@pluralistic This makes people think that choosing non-mediated follows creates a sucky experience, like an individual choice with an inevitable impact, when actually what's going on is beyond that first-order technical level.
@pluralistic Can you let me know why most servers I have been on and I hope it isn't true of this one bans journahost? Like social bans journahost. Most others do too. I hope this server doesn't. If I can't get on a serve that I can SEE journahost on, I have no reason to be on Mastodon. I am here to see NEWS. Mostly NEWS. If I can't see NEWS from JOURNALISTS I don't see what the point is of bothering. The abusers and stalkers and harmers won if I am unable to see what I want to.
@Amy There are plenty of journalists (probably the reputable ones!) not on journahost, but on other Mastodon instances. And some publications are starting to self-host, as bylines.social is doing.

@pluralistic

It was not any close to an original thought either.