On-Device LLMs: State of the Union, 2026 – Vikas Chandra – AI Research @ Meta
kept by eddie
Billion-parameter LLMs now run in real time on phones due to advances in model compression, quantization, and efficient architectures, not just faster chips.