@mstadmin
#Yacy allows searching any #Mastodon post from any server.... IF it has crawled it. I have my server set up to crawl certain feeds on a schedule, so the search results will be up-to-date. And Yacy is not for Mastodon only, but for any web page that has been crawled.
Regarding #Elasticsearch, is that a search option available on your Mastodon instance but requires you to be logged in to use it? You can search only your posts, and not those from other accounts, right?
@mstadmin
Posting online is like an open diary, or a log of your life, if you want it to be. And yes, it is helpful to have it documented so you can come back later to refresh your memory.
#Elasticsearch is not something I know about, but that is good if it works for you.
I use #Yacy when I need to search my own posts. Example: Yacy finds the last time I mentioned #Mary in a #Mastodon post....
New blog post: https://blog.mei-home.net/posts/yacy-part-2-crawling-backburner/
The second post in the YaCy series, talking about crawling the web to fill the search inxed, and where I see issues.
Also putting the project on the backburner for now, because...well, it's really gotten to the size of a main project, and I already have one of those at the moment.
This seems like a moment to mention #search engines, and federated alternatives.
I am (again) experimenting with #YaCy - https://yacy.net. It is not a silver bullet. But my very amateur testing of a self-hosted instance is working on very old hardware. And the search results are decent, without the vast majority of crap we put up with from G, or MS. And, of course, no advertising or surveillance.
If you think a federated internet without big tech is good, take a look!
Hmmm, really confused about YaCy's crawling code at the moment. It looks to me like there's no handling for 429 HTTP codes. The URL which returned that code is just dropped, same as actual errors like 404. I would say the right approach would be to reduce the crawl frequency for the site and try again later on?
Or am I overlooking some Netiquette here?
Earl
gary
klokanek
Markus
Michael
vinny kocima
Amgine
Frank