Reading up on HuggingFace
2 deep · digging since jan 29
- On-Device LLMs: State of the Union, 2026 – Vikas Chandra – AI Research @ Meta
Billion-parameter LLMs now run in real time on phones due to advances in model compression, quantization, and efficient architectures, not just faster chips.