RDLTR

Short for Read Later. Save links from any browser or phone. Click to save, read to clear. The full tour

One line. Many voicesSeek and you shall find

twitter.com faviconRunning 400B model on iPhone! 0.6 t/s Credit @danveloper @alexintosh @danpacary @anemll

kept by

A 400B parameter mixture-of-experts AI model was demonstrated running on an iPhone at 0.6 tokens per second, highlighting on-device inference progress.