Works on a lot of news sites. I think they let web crawlers get the full text in order to improve their search ranking, however it also lets in crawlers with other purposes like archiving.

Depaywaled

Does that include kbin.social users?

"Don't do that" - Zooms in to make sure everybody can see exactly what they aren't supposed to do.