Eugen RochkoApr 5, 2017

Good morning! Background processing queues on this instance cleared up a little, but still haven't caught up with real-time. Going to continue working on increasing the performance of background tasks to increase the number of toots per minute that can be processed without delay.

Sorry for the silliness. The activity is simply more than 4x of previous peaks.

In other news, yesterday I finally fixed the mastodon bridge tool.

Show thread[EUnomia Trust Factor: 21/100]Apr 5, 2017
@Gargron what are you using for a queue
Show threadEugen RochkoApr 5, 2017
@MoonMan Redis/sidekiq
Show thread[EUnomia Trust Factor: 21/100]Apr 5, 2017
@Gargron I'm currently using RabbitMQ, very reliable, clusters and works good when you've got a lot of consumers & can still do transactions if needed. not sure if what it offers gives you much over what you have though, but I thought I'd mention it.
Show threadEugen Rochko
@MoonMan The bottleneck is in the amount of jobs that can be processed concurrently. Currently it's 75. Can't simply add more workers because Postgres connections are maxed out. So I need to 1) make jobs run faster 2) read/write replicas. Sidekiq or redis itself are not the problem atm
Apr 5, 2017 at 9:36amWeb