If text search is ever implemented, it should be limited to your home timeline/mentions only. Lack of full-text search on general content is intentional, due to negative social dynamics of it in other networks
I can't stop google from indexing public pages but there's a difference between "possible" and "convenient". There's already hashtags for when you *want* to be discovered via some keyword.
@Gargron what's wrong with robots.txt?
@animeirl @gargron You mean other than the fact that most web crawlers actively ignore it nowadays?
@animeirl @Gargron
Well.
https://blog.archive.org/2017/04/17/robots-txt-meant-for-search-engines-dont-work-well-for-web-archives/
TL;DR: Robots.txt may work for google but people are free to interpret their purpose as they see fit.