#ContentModeration is fundamentally about making social media work better, but there are two other considerations that determine how social media *fails*: #EndToEnd (#E2E), and #FreedomOfExit. These are much neglected, and that's a pity, because how a system fails is every bit as important as how it works.

If you'd like an essay-formatted version of this thread to read or share, here's a link to it on pluralistic.net, my surveillance-free/ad-free, tracker-free blog:

https://pluralistic.net/2022/12/19/better-failure/#let-my-tweeters-go

1/

Pluralistic: Better failure for social media (19 Dec 2022) – Pluralistic: Daily links from Cory Doctorow

Of course, commercial social media sites don't want to be *good*, they want to be *profitable*. The unique dynamics of social media allow the companies to uncouple quality from profit, and more's the pity.

Social media grows thanks to #NetworkEffects - you join Twitter to hang out with the people who are there, and then other people join to hang out with you. The more users Twitter accumulates, the more users it *can* accumulate.

2/

But social media sites stay big thanks to high #SwitchingCosts: the more you have to give up to leave a social media site, the harder it is to go:

https://www.eff.org/deeplinks/2021/08/facebooks-secret-war-switching-costs

Nature bequeaths some in-built switching costs on social media, primarily the #CoordinationProblem of reaching consensus on where you and the people in your community should go next.

3/

Facebook’s Secret War on Switching Costs

Update, October 1, 2021: The original version of this essay incorrectly stated that Metcalfe's Law dictated that the number of connections in a network doubled with each new user; that has been corrected, below.When the FTC filed its amended antitrust complaint against Facebook in mid-August, we...

Electronic Frontier Foundation

The more friends you share a social media platform with, the higher these costs are. If you've ever tried to get ten friends to agree on where to go for dinner, you know how this works. Now imagine trying to get *all* your friends to agree on where to go for dinner, for the rest of their lives!

But these costs aren't insurmountable. Network effects, after all, are a double-edged sword.

4/

Some users are above-average draws for others, and if a critical mass of these important nodes in the network map depart for a new service - like, say, #Mastodon - that service becomes the presumptive successor to the existing giants.

When that happens - when Mastodon becomes "the place we'll all go when Twitter finally becomes unbearable" - the downsides of network effects kick in and the double-edged sword begins to carve away at a service's user-base.

5/

It's one thing to argue about which restaurant we should go to tonight, it's another to ask whether we should join our friends at the new restaurant where they're already eating.

Social media sites who want to keep their users' business walk a fine line: they can simply treat those users well, showing them the things they ask to see, not spying on them, paying to police their service to reduce harassment, etc.

6/

But these are costly choices: if you show users the things they *ask* to see, you can't charge businesses to show them things they *don't* want to see. If you don't spy on users, you can't sell targeting services to people who want to force them to look at things they're uninterested in.

7/

@pluralistic But the spying is wrong when what they are targeting to sell you is not good for you. I am being targeting by trolls to kill myself, for instance. That's not a good thing to sell, but the abusers make more money than me so the algorithms and targeting aid them not me.