Dominik WeckmรผllerMar 5, 2024
#SemanticFinder meets
@ollama !
You can now add superpowers to your favorite in-browser semantic search tool๐Ÿฅณ
Chat with your document or an entire book and fuel #LLAMA with your relevant paragraphs!
App: https://do-me.github.io/SemanticFinder/
Announcement: https://reddit.com/r/ollama/comments/1b79c23/inbrowser_rag_feeding_ollama/
SemanticFinder - Frontend-only Semantic Search with transformers.js

Frontend-only Semantic Search with transformers.js.

Dominik WeckmรผllerFeb 12, 2024
#SemanticFinder now offers built-in dimensionality reduction with wasm-powered BH-tSNE. Try it now: https://do-me.github.io/SemanticFinder/
SemanticFinder - Frontend-only Semantic Search with transformers.js

Frontend-only Semantic Search with transformers.js.

Dominik WeckmรผllerJan 16, 2024

Private semantic & hybrid search for large documents like books in 2 seconds in your browser with #SemanticFinder!๐Ÿš€Examples:
- The Bible (en) https://do-me.github.io/SemanticFinder/?hf=King_James_Bible_24f6dc4c
- Les Misรฉrables (fr) https://do-me.github.io/SemanticFinder/?hf=Les_Mis%C3%A9rables_2239df51
- Das Kapital (de) https://do-me.github.io/SemanticFinder/?hf=Das_Kapital_c1a84fba
Full catalogue: https://huggingface.co/datasets/do-me/semanticfinder

You can save your own index and keep it private or share it publicly. Proposals for books or docs of public interest always welcome - just share a source URL and I'll add it to the collection :)

SemanticFinder - Frontend-only Semantic Search with transformers.js

Frontend-only Semantic Search with transformers.js.

Dominik WeckmรผllerDec 21, 2023
Just added the current #MTEB leader #WhereIsAI/UAE-Large-V1 to #SemanticFinder and it's performing great! Would love a base or small version to have it slightly faster for in-browser semantic search.
Test here: https://do-me.github.io/SemanticFinder/
SemanticFinder - Frontend-only Semantic Search with transformers.js

Frontend-only Semantic Search with transformers.js.

Dominik WeckmรผllerNov 5, 2023

โœจ Open source RAG (Retrieval Augmented Generation) right in your browser! โœจ

#SemanticFinder now offers an ๐š๐๐ฏ๐š๐ง๐œ๐ž๐ ๐œ๐ก๐š๐ญ & ๐ฌ๐ฎ๐ฆ๐ฆ๐š๐ซ๐ฒ ๐Ÿ๐ž๐š๐ญ๐ฎ๐ซ๐ž for your search results - all in your browser.

๐Ÿ’กThere are very few capable small LLMs that offer high-quality results. Quantized LaMini-Flan-T5-783M offers good performance with 3-4s load time and >6 tokens/s after model download on an old i7.

https://do-me.github.io/SemanticFinder/

#transformers #RAG #AI #LLM #embeddings #semanticsearch #text2text #Flan #T5

SemanticFinder - Frontend-only Semantic Search with transformers.js

Frontend-only Semantic Search with transformers.js.

Dominik WeckmรผllerOct 27, 2023
Just indexed the whole bible in my browser with Jina AI's new 8k embeddings and #SemanticFinder (https://do-me.github.io/SemanticFinder/). 742 pages, 80.500 lines or 4.641.000 chars and my browser doesn't even crash. 30-40 mins indexing time but less than 60s for any consecutive search! ๐Ÿš€
SemanticFinder - Frontend-only Semantic Search with transformers.js

Frontend-only Semantic Search with transformers.js.

Dominik WeckmรผllerOct 26, 2023

๐‰๐ข๐ง๐š ๐€๐ˆ ๐Ÿ–๐ค ๐ญ๐ž๐ฑ๐ญ ๐ž๐ฆ๐›๐ž๐๐๐ข๐ง๐ ๐ฌ ๐Ÿ“„
I just quantized both available versions for ๐Ÿ’๐ฑ ๐ซ๐ž๐๐ฎ๐œ๐ž๐ ๐Ÿ๐ข๐ฅ๐ž ๐ฌ๐ข๐ณ๐ž and usage in #transformers.js and #SemanticFinder (https://do-me.github.io/SemanticFinder/) when dealing with a large corpus:

- ๐Ÿ๐Ÿ–.๐Ÿ“ ๐Œ๐ jina-embeddings-v2-small-en (https://huggingface.co/do-me/jina-embeddings-v2-small-en)
- ๐Ÿ๐ŸŽ๐Ÿ— ๐Œ๐ jina-embeddings-v2-base-en (https://huggingface.co/do-me/jina-embeddings-v2-base-en)

โš ๏ธ I noted however, that the base version seems to perform a little poor on smaller text chunks. Test in SemanticFinder.

Jina AI announcement: https://jina.ai/news/jina-ai-launches-worlds-first-open-source-8k-text-embedding-rivaling-openai/

SemanticFinder - Frontend-only Semantic Search with transformers.js

Frontend-only Semantic Search with transformers.js.

Dominik WeckmรผllerSep 27, 2023
๐Ÿ” ๐—ฆ๐—ฒ๐—บ๐—ฎ๐—ป๐˜๐—ถ๐—ฐ๐—™๐—ถ๐—ป๐—ฑ๐—ฒ๐—ฟ ๐—•๐—ฟ๐—ผ๐˜„๐˜€๐—ฒ๐—ฟ ๐—˜๐˜…๐˜๐—ฒ๐—ป๐˜€๐—ถ๐—ผ๐—ป ๐Ÿ”
Varun and me are super excited to present you the open source Chrome extension for #SemanticFinder - in-browser, privacy-preserving #SemanticSearch! ๐Ÿฅณ
GitHub: http://github.com/do-me/SemanticFinder
Web: https://do-me.github.io/SemanticFinder
Contributors wanted!
GitHub - do-me/SemanticFinder: SemanticFinder - frontend-only live semantic search with transformers.js

SemanticFinder - frontend-only live semantic search with transformers.js - GitHub - do-me/SemanticFinder: SemanticFinder - frontend-only live semantic search with transformers.js

GitHub
Dominik WeckmรผllerJun 26, 2023

#SemanticFinder just received a major feature contribution from @IamVarunSri! Interactively explore all the results for your semantic search query right in your browser for any text up to hundreds of pages: github.com/do-me/SemanticFinder

Made with github.com/xenova/transformers.js

Dominik WeckmรผllerApr 17, 2023
You can now pre-index documents with #SemanticFinder and allow for blazingly fast semantic search for very large documents of e.g. 100 pages right in your browser!
See the example:
๐—œ๐—ฃ๐—–๐—– ๐—ฅ๐—ฒ๐—ฝ๐—ผ๐—ฟ๐˜: https://geo.rocks/semanticfinder/ipcc
๐—š๐—ถ๐˜๐—›๐˜‚๐—ฏ: https://github.com/do-me/SemanticFinder
SemanticFinder - Frontend-only Semantic Search with transformers.js