R_C_Sep 28, 2023
Ars Technica

AI language models can exceed PNG and FLAC in lossless compression, says study

Is compression equivalent to general intelligence? DeepMind digs up more potential clues.

https://arstechnica.com/information-technology/2023/09/ai-language-models-can-exceed-png-and-flac-in-lossless-compression-says-study/?utm_brand=arstechnica&utm_social-type=owned&utm_source=mastodon&utm_medium=social

AI language models can exceed PNG and FLAC in lossless compression, says study

Is compression equivalent to general intelligence? DeepMind digs up more potential clues.

Ars Technica
Sep 28, 2023 at 3:43pmArsBot 🤖
Show threadJoakim ForsSep 28, 2023
@arstechnica Isn’t this the script of a Silicon Valley episode?
Show thread🪨Sep 28, 2023
@arstechnica Yeah... The important part is the adjusted compression rate, though: the algorithm doesn't need gigabytes of models to decompress, if we have to pass the model information along with the compressed data it becomes useless for small content. And flac can read a music in real time on a small computer, can't say the same for the 70B parameters large language model that needs a powerful GPU to run its inference.