jeffwEverything Apple iOS 18 Will Do, Android Already Does
The Dark Lord ☑️Yes. Android already does all these things. But I think the things I’m excited most about are not on this list at all.
A private local LLM. With the on-device context of my notes, messages, calendar, etc, I’m rather excited to have a more personal LLM than ChatGPT.
Personal messaging via satellite. I love that I can stay in touch with people outside of a cell network.
Ace! _SL/SA private local LLM
Running on a phone? No way, not without being absolutely horrible, slow or making your phone churn through your battery anyway.
Good LLMs are olready slow on a GTX 1080, which is already miles faster than any phone out there
It’s not a LLM, it’s a much smaller model (~3B) which is closer to what Microsoft labels as a SLM (Small Language Models, e.g. MS Phi-3 Mini).
Microsoft’s penchant for making up names for thing that already have names is neither here nore there. It is an LLM, in fact its already twice as large as chatGTP2 (1.5B params).
I do think it’s a useful distinction considering open models can be more than 100B+ nowdays and GPT4 is rumored to be 1.7T params. Plus this class of models are far more likely to be on-device.