Hacker NewsAug 15, 2024
Gemlite: Towards Building Custom Low-Bit Fused CUDA Kernels
https://mobiusml.github.io/gemlite_blogpost/
#ycombinator #Model_Quantization #CUDA #Machine_Learning #Model_Compression #Transformer_Models #Neural_Networks #AI_Optimization
Gemlite: Towards Building Custom Low-Bit Fused CUDA Kernels

A set of CUDA kernels for building custom low-bit gemv.