There has absolutely not been a better opportunity in this century to build a successful new search engine for the internet. The dominant players are running full speed to make their offerings worse, and that’s after *years* of complaints that Google’s results are decaying.
@anildash no, cloudflare and other anti-bot products make it largely impossible for new entrants. Google/bing crawlers are whitelisted
@stephenjudkins @anildash or it’s the other way around — SEO spam of both human and increasingly AI origin, makes crawling a rather pointless exercise.. which is what we’re seeing.

@anderseknert @stephenjudkins @anildash This. I am fairly sure search is kinda done for. We'll have to go to the library/curated places for information. Oh, and stores will have to become curated too, sell relatively few products that they actually know something about.

Good news on many levels.

@thelovebing @anderseknert @stephenjudkins @anildash that means crawlers are over. Good. Federation, publish and subscribe, syndication, webs of trust can enable better search than they ever could have.