Feature suggestion: duplicate posts handling

https://programming.dev/post/1229241

Feature suggestion: duplicate posts handling - programming.dev

Hello LJDawson, let me start with saying how happy I am to have Sync back :) The one issue I have with Lemmy is duplicated posts between different communities (see screenshot). Posts usually have same title, author and link, yet differ in community/server they are posted to. It would be great to be able to make the appear as one item on the feed with some note below that links to both instances’ posts, or something like that basically to make them not appear twice or thrice one under another.

Playing devil’s advocate for a bit… So these are just cross-posts. Which existed even on Reddit. …I assume they weren’t handled in any way in Sync or Reddit?

But let’s say this is fixed… What to do about the multiple comments threads? How would you reconcile them with each other? Especially since the user can choose different ways to sort the comments as well. Would all of this logic normally handled by the Lemmy back-end now need to run on your phone?

Btw, I’m not trying to dismiss the idea. Just want to call out some of the technical problems that might come up trying to implement such a feature. As well as ask questions to try and determine exactly how such a feature is expected to work.

Since this issue is most prevalent while browsing new, you could temporarily store (a hash of) the titles and contents of each post during a given browsing session, and if a post matches another post on the same page (e.g. one set of posts from Everything/new), hide it and allow the user to see comments from each instance of the post when they view the canonical (earliest, or most active, or returned first) post.

If another duplicate post is later loaded (through scrolling) the post could be hidden and replaced with a smaller indicator telling the user a duplicate post has been detected, and they can click it to view the comments.