mikoThe more I think about this, the more sense it makes.
We can rescind our invitation to Google.
Patrick Johanneson 🚀 🇨🇦@ademagic [strokes chin] I'm listening.
@pjohanneson discoverability of my website via the search engine is less important to me. Besides, I have linkedin and other socials for that.
I put more value in connections with people who find my site in the places i share it. So why have the bots crawl me at all?
@pjohanneson not even mentioning the other things the article talks about, like my data, traffic to my server, training LLMs etc etc.
Didn't really think about it in the past. Being crawled by google is just a thing to do. Never really considered the why until now.
@ademagic Yeah, the bulk of the traffic1 to my personal site comes from Facebook, as far as I can tell. The more business-focused sites I deal with might be a harder sell.
—
1 The traffic I get, anyway.
@pjohanneson yeah likely still necessary for business sites, i assume they usually rely on search for discovery.
I suppose my takeaway is to ask the question and consciously decide. It shouldn't be a "must do".
mav 
@ademagic
Yeah. Seems reasonable really.
Yeah. Seems reasonable really.
Corbin@ademagic It's still silly. The incentives are all good for Google; they don't mind spending fewer resources on you, and your data might still end up being scraped by them if you're popular enough to be quoted or archived.
If you want to harm Google, find a way to waste Googlebot resources.
Brett@ademagic I wonder if one could detect the user agent and do something like... hash anything more complex than a sentence for seachability?
Make them record junk but it would be unusable by LLMs. 🤔
Make them record junk but it would be unusable by LLMs. 🤔
Ivan Sagalaev 
@ademagic I just want this to be said aloud that the "nuclear" option really isn't: bots respect robots.txt out of good will, and there's absolutely nothing stopping Google from ignoring it. The solution to this isn't technical, it's legal. And I don't know how.