Run a 1T parameter model on a 32gb Mac by streaming tensors from NVMe
#HackerNews #Run #a #1T #parameter #model #on #a #32gb #Mac #by #streaming #tensors #from #NVMe #https://github.com/t8/hypura #MachineLearning #Tensors #NVMe #Mac #Optimization
Run a 1T parameter model on a 32gb Mac by streaming tensors from NVMe
#HackerNews #Run #a #1T #parameter #model #on #a #32gb #Mac #by #streaming #tensors #from #NVMe #https://github.com/t8/hypura #MachineLearning #Tensors #NVMe #Mac #Optimization
Writing an Optimizing Tensor Compiler from Scratch
1st Open-Sourced Neural Network Tensor Activation Visualization for GGUF Models??
https://github.com/3rdEyeVisuals/Spectra-Vis
Heavily stripped down version of my private flow. Open to questions, comments, and suggestions. This repo will be maintained and occasionally enhanced.
All in on MatMul? Don’t Put All Your Tensors in One Basket!
https://www.sigarch.org/dont-put-all-your-tensors-in-one-basket-hardware-lottery/
#HackerNews #MatMul #Tensors #HardwareLottery #AIResearch #DataScience
Have a quick explanation of tensors, complete with visual aids.