Anil DashThere has absolutely not been a better opportunity in this century to build a successful new search engine for the internet. The dominant players are running full speed to make their offerings worse, and that’s after *years* of complaints that Google’s results are decaying.
stephen judkins@anildash no, cloudflare and other anti-bot products make it largely impossible for new entrants. Google/bing crawlers are whitelisted
Anders Eknert@stephenjudkins @anildash or it’s the other way around — SEO spam of both human and increasingly AI origin, makes crawling a rather pointless exercise.. which is what we’re seeing.
Världens bästa Kille™@anderseknert @stephenjudkins @anildash This. I am fairly sure search is kinda done for. We'll have to go to the library/curated places for information. Oh, and stores will have to become curated too, sell relatively few products that they actually know something about.
Good news on many levels.
Mojeek Search Engine@thelovebing @anderseknert @stephenjudkins @anildash I doubt that as explained here: https://blog.mojeek.com/2023/02/will-chatbots-kill-the-search-star.html
@Mojeek @thelovebing @stephenjudkins @anildash this isn’t about search engines incorporating AI but about AI creating SEO optimized crap content all over the web, rendering crawlers useless for finding anything of value.
@anderseknert @thelovebing @stephenjudkins @anildash Understood. It's about both. Both eroding the web. A few closed "brains" is the next assault on the web, building and following the few walled gardens assault
Paul Wilde 
:dontpanic_nobg:@Mojeek @anderseknert @thelovebing @stephenjudkins @anildash whoever stays a:
"Here's a list of places relevant to your search query where you may find the answer" - search engine and not a:
"This is a story all about how your query got twist-turned upside down and I'd like to show an answer just sit right there it might not be fully accurate but I don't care" Chatty AI system wins my loyalty to be honest
"Here's a list of places relevant to your search query where you may find the answer" - search engine and not a:
"This is a story all about how your query got twist-turned upside down and I'd like to show an answer just sit right there it might not be fully accurate but I don't care" Chatty AI system wins my loyalty to be honest
@paul @anderseknert @Mojeek @stephenjudkins @anildash Yeah, but with the Internet filled to the brim with (AI generated) SEO shite it really doesn't matter, that's my point. Chances of finding something useful in a pile of dung are slim regardless of what shovel you use.
@thelovebing @anderseknert @stephenjudkins
@Mojeek @anildash You're very right, but as soon as I sense AI generated content (normally after a couple of sentences) I go back and mentally block that base url
I'm happy to put in that extra load for my own wellbeing.
Hmmm... those sites should have a "bot" icon in search results perhaps 🤣
@Mojeek @anildash You're very right, but as soon as I sense AI generated content (normally after a couple of sentences) I go back and mentally block that base url
I'm happy to put in that extra load for my own wellbeing.
Hmmm... those sites should have a "bot" icon in search results perhaps 🤣
Viveka@thelovebing @anderseknert @stephenjudkins @anildash that means crawlers are over. Good. Federation, publish and subscribe, syndication, webs of trust can enable better search than they ever could have.