How many times do you need to shuffle a card deck to make it truly random?

How much uranium does one need for a nuclear bomb?

How does autocomplete work?

The answer are #MarkovChains

How a feud in Russia led to modern prediction algorithms.

https://www.youtube.com/watch?v=KZeIEiBrT_w

https://piped.video/watch?v=KZeIEiBrT_w

https://inv.nadeko.net/watch?v=KZeIEiBrT_w

#Mathematics #science #computerScience #LLMs #AI #artificialIntelligence #vectorDatabase #RAG #WordEmbeddings #MachineLearning #DeepLearning #ManhattanProject #Veritasium #Yahoo

The Strange Math That Predicts (Almost) Anything

YouTube

What if your RAG system is 60% slower because you're feeding it too much context?

Here's the context window optimization trick that's revolutionizing retrieval-augmented generation performance.

If you're wrestling with RAG performance, drop a comment or send a connection request.

#RAG #AI #VectorDatabase #PostgreSQL #pgVector #dougortiz

Title: P2: Choosing vector database [2024-07-29 Mon]
vectors
- Parallelization and Distributed Processing

Mantra for: My body wants joy to be fried. My mind wants
to succeed. My soul don't need anything.
๐Ÿ˜ถ #dailyreport #rag #embeddings #encoder #vectordatabase

Title: P2: P1: Choosing vector database [2024-07-29 Mon]
partition the vector space and facilitate efficient
nearest neighbor search.
- Compression and Quantization - Reducing the
dimensionality and precision of vector embeddings, sparce #dailyreport #rag #embeddings #encoder #vectordatabase
Title: P1: P1: Choosing vector database [2024-07-29 Mon]
- Approximate Nearest Neighbor (ANN) indexing
- locality-sensitive hashing (LSH), product quantization
(PQ), or hierarchical navigable small world graphs (HNSW)
- Tree-based Indexing - k-d trees or ball trees to #dailyreport #rag #embeddings #encoder #vectordatabase

Title: P0: Choosing vector database [2024-07-29 Mon]
Today I have been choosing vector database for my little
project of RAG for cheepest PC.

The best open-source solutions that I consider:
SQLite-VEC, Redis, Clickhouse, ElasticSearch. (โ€ขฬแด—โ€ขฬ€โœฟ)

I am thinking now how to organize wide and massive amount
of information about PC configuration and files.
ยฏ_(ใƒ„)_/ยฏ

Main approaches to implement vector database: #dailyreport #rag #embeddings #encoder #vectordatabase

Zilliz - Provides a managed vector database service.

Cossmology Profile: https://dub.sh/HxFCcoG

Key People: Charles Xie, James Luan

#VectorDatabase #OpenSource #OSS #COSS

Text embeddings for RAG and search - Python, Ollama, OpenAI-compatible APIs:
https://www.glukhov.org/rag/embeddings/
#Embeddings #RAG #Python #Ollama #LLM #SelfHosting #VectorDatabase
Text embeddings for RAG and search - Python, Ollama, OpenAI-compatible APIs

Learn what text embeddings are, how they power RAG and semantic search, and how to call embedding APIs from Python using Ollama or an OpenAI-compatible server (for example llama.cpp). Includes persistence, retrieval, and links to chunking, vector stores, and reranking on this site.

Rost Glukhov | Personal site and technical blog

Databases for #AI: Should you use a vector #database? ๐Ÿค”

This article compares #opensource projects competing to handle modern #AI workloads, including #machinelearning and #LLMs. Discover which databases best meet todayโ€™s AI challenges: https://lpi.org/636x

(Disclaimer: This post contains an AI-generated image.)

#AndyOram #AI #vectordatabase #machinelearning #LLMs #SQL #opensource #hybridsearch #generativeAI #MariaDB #MongoDB #Milvus #Qdrant #Weaviate #Vespa #ChromaDB #LanceDB

Chat with Your Documents: A Practical Guide to RAG Using the New Laravel AI SDK

Have you ever wished you could just ask your documents a question and get an answer? That's exactly what RAG (Retrieval-Augmented Generation) lets you do. It's the technique behind those AI chatbots...

Tighten