Run a 1T parameter model on a 32gb Mac by streaming tensors from NVMe
#HackerNews #Run #a #1T #parameter #model #on #a #32gb #Mac #by #streaming #tensors #from #NVMe #https://github.com/t8/hypura #MachineLearning #Tensors #NVMe #Mac #Optimization
Run a 1T parameter model on a 32gb Mac by streaming tensors from NVMe
#HackerNews #Run #a #1T #parameter #model #on #a #32gb #Mac #by #streaming #tensors #from #NVMe #https://github.com/t8/hypura #MachineLearning #Tensors #NVMe #Mac #Optimization
And worst of it: They still just put #Amazon #Affiliate links to the search...
Not that Amazon has any listings for the #32GB #OrangePi5 anywhere, but worse-than @Raspberry_Pi #Pi4B8GB - scalped 4GB models...
I find it severely disingenous by #LinusTech to showcase products that AFAICT haven't been released.
Like The #OrangePi5 #32GB version:
https://youtu.be/uJvCVw1yONQ?t=499
https://www.geeky-gadgets.com/orange-pi-5-mini-pc-18-07-2022/