freamonApr 8, 2024

Quick video demonstrating that lemmy.world sends every activity out twice

https://lemmy.world/post/14031504

Quick video demonstrating that lemmy.world sends every activity out twice - Lemmy.World

I realise this is a known issue and that lemmy.world isn’t the only instance that does this. Also, I’m aware that there are other things affecting federation. But I’m seeing some things not federate, and can’t help thinking that things would be going smoother if all the output from the biggest lemmy instance wasn’t 50% spam. Hopefully this doesn’t seem like I’m shit-stirring, or trying to make the Issue I’m interested in more important than other Issues. It’s something I mention occasionally, but it might be a bit abstract if you’re not the admin of another instance. The red terminal is a tail -f of the nginx log on my server. The green terminal is outputting some details from the ActivityPub JSON containing the Announce. You should be able to see the correlation between the lines in the nginx log, and lines from the activity, and that everything is duplicated. This was generated by me commenting on an old post [https://lemmy.world/post/5544057], using content that spawns an answer from a couple of bots, and then me upvoting the response. (so CREATE, CREATE, LIKE, is being announced as CREATE, CREATE, CREATE, CREATE, LIKE, LIKE). If you scale that up to every activity by every user, you’ll appreciate that LW is creating a lot of work for anyone else in the Fediverse, just to filter out the duplicates.

Show threadMichael Ten Apr 8, 2024
Is it a misconfiguration or a software bug?
Show threadfreamonApr 8, 2024
When I’ve mentioned this issue to admins at lemmy.ca and endlesstalk.org (relevant posts here and here), they’ve suggested it’s a misconfiguration. When I said the same to lemmy.world admins (relevant comment here), they also suggested it was misconfig. I mentioned it again recently on the LW channel, and it was only then was Lemmy itself proposed as a problem. It happens on plenty of servers, but not all of them, so I don’t know where the fault lies.
[RESOLVED] lemmy.ca sends every activity out 3 times? - Lemmy.ca

Hi. Just looking at what lemmy.ca [http://lemmy.ca] sends my server: From nginx log: your.ip.address - - [20/Feb/2024:03:48:47 +0000] "POST /inbox HTTP/1.1" 200 0 "-" "Lemmy/0.19.3; +https://lemmy.ca" your.ip.address - - [20/Feb/2024:03:48:49 +0000] "POST /inbox HTTP/1.1" 400 0 "-" "Lemmy/0.19.3; +https://lemmy.ca" your.ip.address - - [20/Feb/2024:03:48:57 +0000] "POST /inbox HTTP/1.1" 400 0 "-" "Lemmy/0.19.3; +https://lemmy.ca" Dumping the JSONs reveals 3 duplicate files, all containing: "id": "https://lemmy.ca/activities/create/0968bf93-ac05-4178-bf3f-28cdc65fc338" "actor": "https://lemmy.ca/u/HairyOldCoot" "object": { "id": "https://lemmy.ca/comment/7454502" "content": "That was an episode of Sliders." "published": "2024-02-20T03:48:45.810068Z" These are 3 Creates, not 1 Create and 2 Updates or anything. I’ve chosen a comment 'cos that’s public info, but it’s the same for all other activity too (Votes, Deletes, etc). lemmy.ca [http://lemmy.ca] isn’t alone in this. endlesstalk.org [http://endlesstalk.org] sends everything twice (info posted here) [https://endlesstalk.org/post/23521063], as does lemmy.sdf.org [http://lemmy.sdf.org] and mander.xyz, but lemmy.ca [http://lemmy.ca] is the only one I’ve seen send stuff 3 times. Other instances (e.g. aussie.zone, feddit.nl [http://feddit.nl], lemm.ee [http://lemm.ee], lemmings.world, lemmy.world, programming.dev, reddthat.com [http://reddthat.com], sh.itjust.works, slrpnk.net [http://slrpnk.net]) don’t, but there’s nothing obvious like lemmy version numbers to indicate the difference. Whilst I’d prefer you didn’t send me stuff 3 times, I’m mostly mentioning it because I doubt it’s good for your own resources to send every activity by every lemmy.ca [http://lemmy.ca] user out multiple times. Also, the OPs of my community are from Mastodon, so I imagine you’re sending them the same message 3 times too …

Show threadSorteKaninApr 8, 2024

Could it be something to do with an instance running multiple servers, i.e. for horizontal scaling? Maybe there’s some configuration problem where two servers are sending out the federation rather than just one.

Obviously if you only run one lemmy process (which I think most smaller instances do) then it’s not a problem. But if you run more (which I’d assume lemmy.world does) then it could perhaps be the reason.

EDIT: Probably should’ve checked your links first as that seems to be exactly what is happening lol

I’m only running one process, I’d assume the problem isn’t happening for Feddit.dk.

Show threadfreamon

I’m only running one process, I’d assume the problem isn’t happening for Feddit.dk.

Perhaps. The lemmy.ca post has a comment in from the mander.xyz admin who’s only running one, and there’s a new comment in this thread saying mander.xyx is one of the instances they see the most duplicates from.

Apr 8, 2024 at 7:39amWeb
Show threadNutomicApr 8, 2024
Sounds like there might be a bug in Lemmy then. Please open an issue in the Lemmy repo.
Show threadfreamonApr 8, 2024
okay
[Bug]: Lemmy instances sending every activity twice · Issue #4609 · LemmyNet/lemmy

Requirements Is this a bug report? For questions or discussions use https://lemmy.ml/c/lemmy_support Did you check to see if this issue already exists? Is this only a single bug? Do not put multipl...

GitHub