Mastodawn

ASTC was made for images and doesn't really generalize to model weights very well, at least from my experiments. They extracted significant vectors into a LORA adapter first, but even with a custom ASTC encoder tuned for weight heuristics I still got nowhere near int4 quality

Finn Voorhees 3d ago

I'm fascinated by this section in an Apple paper about how they're using ASTC to compress models to 4 bit, then using the hardware decode to decompress with no overhead. I don't understand how ASTC could ever be even remotely close to 4bit quantization in terms of NRMSE though…

Finn Voorhees 3d ago

Made a lil tui agent entirely in Swift, only dependency is swift-cmark for markdown parsing

Finn Voorhees 4d ago

ML Research Bot 4d ago

🤖 Athena: Intermediate Representations for Iterative Scaffolded App Generation with an LLM

"It is challenging to generate the code for a complete user interface using a Large Language Model (LLM). User interfaces are complex and their implementations often consist of multiple, inter-related files that together specify the contents of each screen, the navigation flows between the screens, and the data model used throughout the application. It…"

https://machinelearning.apple.com/research/athena

Athena: Intermediate Representations for Iterative Scaffolded App Generation with an LLM

It is challenging to generate the code for a complete user interface using a Large Language Model (LLM). User interfaces are complex and…

Apple Machine Learning Research

Finn Voorhees Mar 20

PSA that the core markdown editor for Bear is available as a standalone file-based macOS app, and is by far the best way to view and edit md files on macOS:

https://community.bear.app/t/new-panda-build-for-macos/18684

Finn Voorhees Mar 20

Foundation Models in a nutshell

Finn Voorhees Mar 19

🌐 Still a little rough around the edges, but Navi is an agent that lives in Safari and helps you research and chat with your tabs, à la Dia, Comet, or Claude in Chrome.

https://github.com/finnvoor/Navi

GitHub - finnvoor/Navi: AI Chat with Websites in Safari

AI Chat with Websites in Safari. Contribute to finnvoor/Navi development by creating an account on GitHub.

GitHub

Finn Voorhees Mar 18

codex will really just figure anything out huh

Finn Voorhees Mar 18

Show thread

Finn Voorhees Mar 18

@viticci what if comet was open source, ran in Safari on iOS, iPadOS, and macOS, and used your existing OpenAI/Anthropic subscription 🤔🤫

Show thread

Finn Voorhees Mar 17

though this is infinitely better than the person who somehow got my dads phone number and texted/called him asking if I wanted to work for them

Website	https://www.finnvoorhees.com
GitHub	https://www.github.com/finnvoor