New thing from the Zstd (and LZ4/xxhash) crowd: OpenZL. A dozen or so building blocks (shufflers, transposers, filters, compressors) that can be chained together. Can automatically build "best" config based on sample data; same decompressor can decompress any config. Nice! https://openzl.org/ (and whitepaper: https://arxiv.org/abs/2510.03203) #compression #openzl
OpenZL

Introducing OpenZL: An Open Source Format-Aware Compression Framework

OpenZL is a new open source data compression framework that offers lossless compression for structured data. OpenZL is designed to offer the performance of a format-specific compressor with the eas…

Engineering at Meta