Andreas HertenThere a nonsensical performance metrics in computing – and then there’s “Gigawatts of Compute”. #HPC
Glenn K. Lockwood@andih It does capture the constrained resource though. FLOPS are so cooked these days too (eg, sparse NVFP4 is a nonsense metric)
@glennklockwood It slightly incentivizes on the wrong thing, though. In terms of power-per-compute ratio, you can get these sweet Watts most efficiently by making a rack of hairdryers. 28 x 2 kW = 56 kW needed for an adder! Instant Gigascale!
But at least Watts are easily understandable by basically anyone… FLOP/s is not only inflated but also nothing from everyone’s day-to-day business.
But at least Watts are easily understandable by basically anyone… FLOP/s is not only inflated but also nothing from everyone’s day-to-day business.