NumKong: 2'000 Mixed Precision Kernels for All
https://ashvardanian.com/posts/numkong/
#HackerNews #NumKong #Mixed #Precision #Kernels #AI #Performance #Optimization
NumKong: 2'000 Mixed Precision Kernels for All
https://ashvardanian.com/posts/numkong/
#HackerNews #NumKong #Mixed #Precision #Kernels #AI #Performance #Optimization
@epistatacadam @ChrisMayLA6
On the first clause, yes (but it measures what it measures).
On the second, it is a basic principle of #measurement that #accuracy and #precision should each be known and reckoned with, but that large departures from perfection in either or both do not prevent useful measurements being made.
(When the fiction is reduced the instrument needs recalibrating.)
True 4-Bit Quantized Convolutional Neural Network Training on CPU: Achieving Full-Precision Parity

Low-precision neural network training has emerged as a promising direction for reducing computational costs and democratizing access to deep learning research. However, existing 4-bit quantization โฆ
A quotation from Hyman Rickover
Nature is not as forgiving as Christ.Hyman Rickover (1900-1986) Polish-American naval engineer, admiral [b. Chaim Gdala Rykower]
(Attributed)
More about this quote: wist.info/rickover-hyman/6585/
#quote #quotes #quotation #qotd #hymanrickover #engineering #forgiveness #JesusChrist #nature #precision #tolerance #marginoferror
Diagnosing FP4 inference: a layer-wise and block-wise sensitivity analysis of NVFP4 and MXFP4

Quantization addresses the high resource demand for large language models (LLMs) by alleviating memory pressure and bandwidth congestion and providing significantly scaled compute power with a toleโฆ
Lego's 0.002 mm Specification and Its Implications for Manufacturing
#HackerNews #Lego #Manufacturing #3DPrinting #Precision #Engineering #Innovation