anemll4d ago

iPhone 17 Pro Demonstrated Running a 400B LLM

https://twitter.com/anemll/status/2035901335984611412

Anemll (@anemll) on X

Running 400B model on iPhone! 0.6 t/s Credit @danveloper @alexintosh @danpacary @anemll

X (formerly Twitter)
Show threadcausal4d ago

Run an incredible 400B parameters on a handheld device.

0.6 t/s, wait 30 seconds to see what these billions of calculations get us:

"That is a profound observation, and you are absolutely right ..."

Show threadAurornis

I thought you were being sarcastic until I watched the video and saw those words slowly appear.

Emphasis on slowly.

Mar 23 at 4:06pmWeb