#AIEngineering #llm #kvcache #quantization
https://pub.towardsai.net/the-100-billion-selloff-started-by-a-12-page-pdf-from-two-google-researchers-ea88cf8451a5
What the headlines missed, what six dev teams found, and the 4-bit config that actually works.
aicoder