mhoyeMay 11, 2024
I'm on here looking for text indexers and everything is 'lightning fast exoscale terafloops that scales to enterprise quantawarbles with polytopplic performanations' and it would be great if this industry could breathe into a bag until it remembers that one person with one computer is a constituency that matters.
Show thread4censord May 11, 2024

@mhoye Do you want recommendations for your text-indexers question?

In the full text search department:
Take a look at melisearch (https://github.com/meilisearch/meilisearch)
or Apache solr (https://solr.apache.org/guide/solr/latest/index.html), which is like elastic search but without all the licensing kerfuffle

GitHub - meilisearch/meilisearch: A lightning-fast search engine API bringing AI-powered hybrid search to your sites and applications.

A lightning-fast search engine API bringing AI-powered hybrid search to your sites and applications. - meilisearch/meilisearch

GitHub
Show threadmhoye
@4censord I do, thank you. My goals here are minimalism of implementation and wholly-local computation.
May 11, 2024 at 2:24pmWeb
Show thread4censord May 11, 2024

@mhoye ah, both of these are not what i would consider minimalist. Melisearch is smaller than solr, but especially solr has all the enterprise features of an enterprise java project from the 2000-ends.

Also, both run as a separate service that your application connects to, instead of being build into your application.

If you rather have something that is build into your application, maybe the full text search sqlite module is better suited. (https://www.sqlite.org/fts5.html)

SQLite FTS5 Extension

Show threadTanguy ⧓ HerrmannMay 12, 2024
@mhoye @4censord and do you need an app that does it for you with some configuration? Or more of a library you can call any which way you want?
Show threadmhoyeMay 12, 2024
@dolanor @4censord Ideally the outcome of this is a self-hosted webpage that gives me a reasonably good search experience for the extensive documentation already on my computer. I'd prefer not to run a web server locally - that's seems unnecessary - and even a periodic manual refresh rather than anything automatic is probably fine.
Show thread4censord May 12, 2024
@mhoye @dolanor hmm, that does sound like the usecase for something like the SQLite full text search module. (https://www.sqlite.org/fts5.html)
Or, if you are ok with having to use java, check if Apache Lucene is an option, thats the search engine behind apache solr (https://lucene.apache.org/core/)
SQLite FTS5 Extension

Show threadmhoyeMay 12, 2024
@4censord @dolanor yeah, I think my initial approach will be something like pandoc -> SQLite plus a front end.
Show threadTanguy ⧓ HerrmannMay 12, 2024

@mhoye @4censord by self hosted webpage without a web server, do you mean without some traditional webserver like Apache/nginx? Or no web server at all?

And if so, does the generated webpage should hold all the data in it that would be searched via JavaScript in the page content itself?