#NoBot #NoIndex #NoBridge

This post is a test of a custom rule for Cloudflare I've been working on, and of my own conspiracy theory.

Forgive me my tinfoil hat: I have long suspected that the use of these tags (above), in fact, results in attracting more attention from crawlers/spiders/bots/whatever; that said automated systems exist which are specifically instructed to look for these tags, and to index any and all pages in which they find them.

If and only if my custom rule blocks a notably higher number of attempts to index this post alone, as compared to any of my other posts individually, I assume my theory is true until otherwise proven.

I will provide an update about this whenever I have one.

#CloudflareTunnel #Cloudflare #Fediverse #SelfHosting #SelfHosted

UPDATE: well, the path that more crawlers have tried than anywhere else on the site, so far, is robots.txt itself. 😂

@plutarch I see this post because I follow a part of the tags in your post. That results in showing it in my feed. While as far as I know I didn't see any tooth from you before.

To be honest I don't fully know how Mastodon handles the tags and following them.

@tvbeek

Yeah, this is a brand new instance, so you're probably right that you hadn't seen one of my posts before.  I don't really know how Mastodon handles tags either, tbh.  Also, I'm on GoToSocial and not Mastodon, but I really don't understand how it handles tags either.  ðŸ˜‚