Run a 1T parameter model on a 32gb Mac by streaming tensors from NVMe

https://github.com/t8/hypura

#HackerNews #Run #a #1T #parameter #model #on #a #32gb #Mac #by #streaming #tensors #from #NVMe #https://github.com/t8/hypura #MachineLearning #Tensors #NVMe #Mac #Optimization

GitHub - t8/hypura: Run models too big for your Mac's memory

Run models too big for your Mac's memory. Contribute to t8/hypura development by creating an account on GitHub.

GitHub

Arrays store data; matrices are 2D; tensors generalize across dimensions.

#math #ai #tensors

Writing An Optimizing Tensor Compiler From Scratch

Not everyone will write their own optimizing compiler from scratch, but those who do sometimes roll into it during the course of ever-growing project scope creep. People like [Michael Moroz], who w…

Hackaday

1st Open-Sourced Neural Network Tensor Activation Visualization for GGUF Models??

https://github.com/3rdEyeVisuals/Spectra-Vis

Heavily stripped down version of my private flow. Open to questions, comments, and suggestions. This repo will be maintained and occasionally enhanced.

#MachineLearning #LLMs #Tensors #InterpretabilityTools

GitHub - 3rdEyeVisuals/Spectra-Vis

Contribute to 3rdEyeVisuals/Spectra-Vis development by creating an account on GitHub.

GitHub
All in on MatMul? Don’t Put All Your Tensors in One Basket!

Matrix multiplication dominates AI hardware and research. Betting everything on MatMul risks an innovation monoculture — it’s time to diversify our compute bets.

SIGARCH

I'm finishing a book on geometrical tensor calculus, and in the last chapter there're sophisticated stuff like the exterior covariant derivative and similar. Some laws of physics that are typically taught without this formalism are shown in this formalism, but there's much material in few pages (you know, it's the last chapter).

Do you know of a book that presents classical physics in this language? I know that Thorne & Blandford's "Modern Classical Physics" uses tensors, but I'm not sure if it uses sophisticated stuff like an exterior covariant derivative (I don't have a copy). #physics #differentialgeometry #tensors

Final Draft Available: Tensor Decompositions for Data Science | MathSci.ai

Mathematical Consultant

The Geometric Tool That Solved Einstein’s Relativity Problem | Quanta Magazine

Tensors are used all over math and science to reveal hidden geometric truths. What are they?

Quanta Magazine

Have a quick explanation of tensors, complete with visual aids.

https://www.youtube.com/watch?v=f5liqUk0ZTw

#tensors #vectors

What's a Tensor?

YouTube