🔍 We already know how storage handles data ingestion from #vminsert, turning them into “raw-row shards” in memory. However, they’re not searchable yet.
⚡ vmstorage flushes the raw-row shards data into what’s called “LSM parts”, starting with in-memory parts.
📖 Check Phuong's latest blog post to learn How #vmstorage Processes #Data: Retention, Merging, Deduplication..

https://victoriametrics.com/blog/vmstorage-retention-merging-deduplication/

#VictoriaMetrics #opensource

How vmstorage Processes Data: Retention, Merging, Deduplication,...

vmstorage takes data from vminsert through a concurrency limiter, creates TSIDs for each row, and puts them in memory buffers. Every few seconds, it moves data to storage parts on disk. The system merges parts, removes duplicates, and cleans old data. This turns raw metrics into data users can search.

VictoriaMetrics