Run your language models directly on your phone, courtesy of the ApacheTVM machine learning compiler:

https://mlc.ai/mlc-llm/

My phone got warm, but it feels as if you were doing gpt4 on the cloud, except it is all local!

MLC LLM | Home

I knew upgrading my iPhone on launch day would paid off.

Sorry “Apple doesn’t innovate so I only upgrade my phone every six years” peeps.

@Migueldeicaza super cool. Mine got stuck in what seemed like an infinite loop of made up nutritional information.