✨ A new release candidate for Mastodon 4.0 is now available for testing! We are planning to release the stable on Monday, along with some important security fixes. Stay tuned!

https://github.com/mastodon/mastodon/releases/tag/v4.0.0rc3

Release v4.0.0rc3 · mastodon/mastodon

Note: This is a release candidate. It is intended to be stable, but not guaranteed. Upgrade overview This release contains upgrade notes that deviate from the norm: ℹ️ Requires two-step database m...

GitHub
@Mastodon how is #scaleability handled on #mastodon? I'm concerned about traffic. Do the messages get aggregated before being sent to various sites? Or is it sitting individual messages to every user that is subscribed?
@denebeim @Mastodon uses a message queuing system called sidekiq that handles passing messages around

@anna @Mastodon ok, I noticed. I've been watching logs on my new instance. That's what made me think of it. There's a ton of traffic just on my little box.

Anyway are there docs on precisely what's going on? Or is the communicating micreservice 3rd party?

@denebeim @Mastodon sidekiq is a commonly used message queuing system so you could look up the docs on it, yeah. you can find a link to your sidekiq under administration in the settings page to see the web frontend for it that shows you stats on how many messages it's processing
@anna @Mastodon well looking at it it seems to be like a sidecar, a process that runs doing long time things. I'm not sure that tells me what I was trying to ask though. I guess I should probably look at the source when I have some time.
@denebeim it processes all the messages, as well as doing long running tasks. if you stop it, pretty much everything stops working. not giving sidekiq enough workers is the most common reason you would experience federation delays or other severe issues
@anna and that's what I was thinking of as the bottleneck. If you're sending the same message to multiple people it seems like it would make sense to do it once instead of many times. Maybe I'm just showing my age most of my federation practice was on Usenet. And transfer rates were much lower then.
@denebeim there might be some optimization or digests involved but at the end of the day it's gotta go to everyone that wants it, whether it's pushed or pulled
@anna I hear you, but the scale of things has just gotten a lot higher you know?