Mastodawn

Kimi K2 1T model runs on 2 512GB M3 Ultras

https://twitter.com/awnihannun/status/1943723599971443134

#HackerNews #Kimi #K2 #M3 #Ultras #TechNews #Innovation #Hardware #512GB

Awni Hannun (@awnihannun) on X

The new Kimi K2 1T model (4-bit quant) runs on 2 512GB M3 Ultras with mlx-lm and mx.distributed. 1 trillion params, at a speed that's actually quite usable:

X (formerly Twitter)