#ContentModeration is fundamentally about making social media work better, but there are two other considerations that determine how social media *fails*: #EndToEnd (#E2E), and #FreedomOfExit. These are much neglected, and that's a pity, because how a system fails is every bit as important as how it works.

If you'd like an essay-formatted version of this thread to read or share, here's a link to it on pluralistic.net, my surveillance-free/ad-free, tracker-free blog:

https://pluralistic.net/2022/12/19/better-failure/#let-my-tweeters-go

1/

Pluralistic: Better failure for social media (19 Dec 2022) – Pluralistic: Daily links from Cory Doctorow

Of course, commercial social media sites don't want to be *good*, they want to be *profitable*. The unique dynamics of social media allow the companies to uncouple quality from profit, and more's the pity.

Social media grows thanks to #NetworkEffects - you join Twitter to hang out with the people who are there, and then other people join to hang out with you. The more users Twitter accumulates, the more users it *can* accumulate.

2/

But social media sites stay big thanks to high #SwitchingCosts: the more you have to give up to leave a social media site, the harder it is to go:

https://www.eff.org/deeplinks/2021/08/facebooks-secret-war-switching-costs

Nature bequeaths some in-built switching costs on social media, primarily the #CoordinationProblem of reaching consensus on where you and the people in your community should go next.

3/

Facebook’s Secret War on Switching Costs

Update, October 1, 2021: The original version of this essay incorrectly stated that Metcalfe's Law dictated that the number of connections in a network doubled with each new user; that has been corrected, below.When the FTC filed its amended antitrust complaint against Facebook in mid-August, we...

Electronic Frontier Foundation

The more friends you share a social media platform with, the higher these costs are. If you've ever tried to get ten friends to agree on where to go for dinner, you know how this works. Now imagine trying to get *all* your friends to agree on where to go for dinner, for the rest of their lives!

But these costs aren't insurmountable. Network effects, after all, are a double-edged sword.

4/

Some users are above-average draws for others, and if a critical mass of these important nodes in the network map depart for a new service - like, say, #Mastodon - that service becomes the presumptive successor to the existing giants.

When that happens - when Mastodon becomes "the place we'll all go when Twitter finally becomes unbearable" - the downsides of network effects kick in and the double-edged sword begins to carve away at a service's user-base.

5/

It's one thing to argue about which restaurant we should go to tonight, it's another to ask whether we should join our friends at the new restaurant where they're already eating.

Social media sites who want to keep their users' business walk a fine line: they can simply treat those users well, showing them the things they ask to see, not spying on them, paying to police their service to reduce harassment, etc.

6/

But these are costly choices: if you show users the things they *ask* to see, you can't charge businesses to show them things they *don't* want to see. If you don't spy on users, you can't sell targeting services to people who want to force them to look at things they're uninterested in.

7/

Every moderator you pay to reduce harassment draws a salary at the expense of your shareholders, and every catastrophe that moderator prevents is a catastrophe you can't turn into monetizable attention as gawking users flock to it.

So social media sites are always trying to optimize their mistreatment of users, mistreating them (and thus profiting from them) right up to the point where they are ready to switch, but without actually pushing them over the edge.

8/

One way to keep dissatisfied users from leaving is by extracting a penalty from them for their disloyalty. You can lock in their data, their social relationships, or, if they're "creators" (and disproportionately likely to be key network nodes whose defection to a rival triggers mass departures from their fans), you can take their audiences hostage.

The dominant social media firms all practice a low-grade, tacit form of hostage-taking.

9/

@pluralistic Yes I was deleted completely from a server on mastodon, but it was a good thing I didn't have much there. I left two others. am ready to delete the one not this one. This will be the only one I will use and if I can't see journahost on it I need to know so will just delete this one too and stop going to mastodon and know that the servers get paid by abusers to harm me and I have no safety here on mastodon and I hope that isn't the case.