Algorithms aren't the enemy. Chronological feeds don't scale and the signal-to-noise ratio will plummet if this ever gets popular. The real problems with today's algorithmic feeds are non-transparency, lack of choice, and optimizing for engagement instead of healthy discourse.

Open-source is a perfect opportunity to fix all this. Have there been any efforts to create a Mastodon instance with a (community governed) ranking algorithm? Is that technically feasible? Or is the idea simply anathema?

Update: it turns out that lots of people have similar views and Simon willison is exploring building something along these lines.
https://fedi.simonwillison.net/@simon/109289663684761988

Responses to some frequent comments:

* I'm certainly not suggesting that algorithmic feeds should be imposed on everyone! Choice is great. I recognize that many, perhaps most current Mastodon users like chronological feeds.

* "Reverse chronological" is an algorithm, albeit a simple one. It's currently the only option. Chronological feeds are not normatively neutral. There is, unfortunately, no neutral way to design social media. https://mastodon.social/@randomwalker/109308664849924122

* "Mastodon doesn't need to become popular." Sure. But like it or not, it's getting more popular, and many of the newcomers have a different culture and expectations. Eugen Rochko: "People who are arriving now have as much right to be here and bring their own culture as the ones who came before them." https://mastodon.social/@Gargron/109323118267580967

Again, all I'm suggesting is choice, and I thought Mastodon is all about choice.

* What do I mean by chronological feeds don't scale? A few things.

1. There's a lot of social pressure to follow people (especially people you know). Old-timers here are comfortable with following a small set of people, but most newcomers aren't. For those people, pretty soon the feed becomes a firehose.

2. Even in a mostly-chronological feed, some ranking would be really nice. *Not* necessarily by popularity, but if there are 15 posts by the same person I don't want those to be the first 15.

3. As an academic, I use(d) Twitter to keep track of new research that's relevant to my interests. I found this much easier to do after I (reluctantly) switched to the algorithmic feed. Again, I recognize that this might not be everyone's experience, but I know I'm not the only one.

Amusingly, this thread is getting boosted a lot today, a couple of weeks after I first posted it. That's another difference between chronological feeds and Twitter's algorithm (which heavily emphasizes immediacy).

But—and this is the point of the thread—imagine all the interesting things you could do with a tunable algorithm. You could even let the recency preference depend on the type of content! You could customize it to show you news only if recent, but educational content regardless of age.

@randomwalker some kind of "code blob" that allows you to send your filterset/tunables to somebody else for temporary use/revision/adoption/etc would be extremely cool
@Aranjedeath @randomwalker A highly configurable algorithm that could be shared to others with similar interests has been on my mind for a while. Configurations could be forked and refined by the community to improve them over time. Feels like it would give users much more control over what they are shown.
@randomwalker I wish algorithms were better at that. Instagram in particular loves showing me time sensitive posts 2-3 days after they stopped being relavent.

@randomwalker These are important points, and I agree with most of them. My Twitter engagement was better under reverse-chronological sorting, but you rightly point out that that's still suboptimal.

When I say "the algorithm" for Twitter, I mean the machine learning recommendation engine. Reverse-chronological is an algorithm, but it's deterministic.

Having worked in various AI-related fields for years, I think it's important for the algorithm we use here to be predictable and understandable.

@randomwalker hi! Reverse timeline fan here -- not bc it's the best, but bc the alternative was much much worse in my case.

You're suggesting users should tune the algorithm. Fine.

On twitter, the algo tunes the user. Unacceptable.

@randomwalker

The solution is getting back to personal web sites

Aggregation and curation would be done by hand, by people in telegram chats

@randomwalker not sure if you’ve seen it, but the renewed interest could also be because of this useful thread and discussion from @jon, an ex-Twitter designer

https://social.lot23.com/@jon/109372292696300424

Jon Bell (@[email protected])

4/ I remember when we moved from strict reverse-chron (which 97% struggle with) to "You might like" prompts (which 3% struggle with) and hearing from the VERY LOUD minority that we were destroying Twitter. But we saw as the 97% had a much better time. We saw that every step forward we took (I have a whole presentation on this) was helping people more and more. The data told us we were making a better product. And that reverse-chron kinda sucks. For most people.

Hometown
@randomwalker Ain't that starting to look more like an internal search engine?
Interesting.
Maybe an implementation of YaCy over Mastodon...
@randomwalker And a month later, it’s back! Personally, I’m very excited by all the discussions going on about how to move forward on several fronts in the reimagined social media world!
@randomwalker I wonder if using and following hashtags would help? My understanding is that Mastodon users tend to use hashtags a lot & I am trying to adopt that custom.

@randomwalker

Agree that a customizable and/or community-governed algorithm would be helpful

I found Twitter's algorithm to be "too fast", in that either a tweet got picked up right away or it would fall into obscurity.

I actually like the speed of the LinkedIn algorithm, which serves up content from people you follow for up to weeks after the initial post

@randomwalker Interesting. The algorithm was awful for me, especially when trying to find new research/ers to follow. Twitter was only useable when I switched to reverse chronological order. Every time I logged into a new device or my preferences got wiped, it was back to chaos and often content I didn't need to see (stuff that was posted to make people angry for example), even though I muted judiciously.

I think I'd much rather try following hashtags first, personally.

@randomwalker I prefer to use Lists to follow my interests on Twitter. I haven´t yet organized Mastondon lists because my network here is still small.
@randomwalker I suspect a strong correlation between people who like/dislike the algorithmic feed and people who did/didn’t feel the pressure to follow others for social rather than content reasons.

@randomwalker I don’t fundamentally disagree with the idea of algorithmic options for sorting feeds. However, I think there is opportunity to embrace a different culture, rather than falling back on our conditioned understanding of how social media should function.

Re 1: Maybe that social pressure isn’t healthy, and the current feeds illustrate why and discourage it.

Re 2: Maybe a soft explainer on how to thread with unlisted posts will help that person post more consciously.

@randomwalker As a start, simple offline algorithms could be implemented in the Mastodon clients themselves. Client can look at stats of each toot in my feed + my past interactions with toots of a user and decide the ordering.
@randomwalker I am truly happy to have my feed determined by actuality and not by algorithms. If someone in the list of my followings posts 15 posts and I happen to be not interested in one of them, I just scroll down. But most folks I follow are capable of writing posts I want to see, which is why I am following them.
@randomwalker This is an interesting feature here - if I boost a dozen things when I wake up every morning, some poor soul who is up 15 minutes after me gets this firehose of me-boosted posts every morning and thinks I'm some always-online freak that they've seen enough of :D They have to shovel through mine to get to anyone else. And I'm on the east coast - I will never see posts from folks waking up on the west coast without an algorithm. Instead I wake up to Europeans :) Jumbling wd be nice.
@@randomwalker i unfollowed patton oswalt in twitter’s early feed days because my entire chronological feed would get filled by him live-tweeting events like “eating a sandwich”
@randomwalker I think it matters what kind of content one follows. If research, the order of "tweets" is probably less important, since speed (measured in hours) is not essential. However, if one is tracking people identifying- discussing current events, it is really useful to see the chronological order -> helps me identify who is able to not only be accurate + perceptive, but also early. In the long run, this helps me create a list of trusted followers, from whom I want to see all "tweets".1/2
@randomwalker If I don't see all "tweets", it is more difficult to track the quality of their assessments - also who is willing to acknowledge mistakes, e.g. So, I've created my own "algorithm" of how to get diverse input, allowing me to rely less (!) on any external algorithm.
@randomwalker Point 2 seems really practical, also, there's already a natural solution implemented in those cases: people unfollow accounts that "abuse verbalizing" in that way...

@randomwalker I’d like to have clients make “toots” (only) the default and “replies too” an option. That would manage the chronological timeline for now.

One day we may need more but again easier to do just client side.

@randomwalker you're not wrong about any of this

@randomwalker
is there not a parallel here to epidemics and infection control - the individual risk framing of Covid misses the population level impact; likewise, the focus on “individual choice” of algorithms misses the discourse level impacts this might have?

it’s a complex system, changing the individual agent rules stands every chance of changing the global system dynamics as well

that would make it more than ‘just’ a matter of individual choice, no?

@randomwalker the fun thing here is: if you want it - make it.

Chronological feeds might not scale - question is: do they need to? If my radio is getting at my nerves I turn it off...

@randomwalker I'm glad that we can reopen the conversation about algorithm. I agree that the chronological order that sort our timeline today is still technically "an algorithm". And that it would be nice to offer user with various ways to sort their timeline.

Just like I can sort my emails by date, by sender, by subject, etc. I'd like to be able to do the same here.

@randomwalker Me personally, I would like a way to bring to the top my friends who post very rarely. So, basically to sort my timeline by how long since their last post.

Yes, we can use lists or the bell button, but that's not exactly it...

Would be nice to have a way to build our own sorting rules! 😄

@randomwalker "People who are arriving now have as much right to be here and bring their own culture as the ones who came before them."

That sounds reasonable and sensible. But it's an idea that will encounter bitter resistance.

It seems like every idea to improve Mastodon's appalling lack of functionality encounters bitter resistance.

I can certainly see the potential for some bitter conflict here.