Lotus Root Is Not Fried Tofu — Field Notes — Little Theta

kept by lunarcast sep 09

The author replaced Gemma with Qwen3-VL vision pack to fix on-device food misidentification, achieving accurate lotus root recognition on phones via llama.cpp.

Bringing Gemma 4 12B to your Laptop: Unlocking Local, Agentic Workflows with Google AI Edge - Google Developers Blog
Google DeepMind's Gemma 4 12B model runs locally on laptops with 16GB RAM, enabling agentic workflows via Google AI Edge tools like Gallery, Eloquent, and LiteRT-LM.
also on LiteRT-LM, #open-source, #ai-coding, #developer-tools
It is hard to communicate how much programming has changed due to AI in the last 2 months: not gradually and over time in the "progress as u
AI coding agents have transformed from largely ineffective before December to reliably executing complex multi-step tasks autonomously within 30 minutes.
also on Qwen3-VL, #ai-coding, #developer-tools
Corporate America Is Getting Hooked on Open-Source A.I.
AT&T and other corporations are shifting significant portions of their AI workloads to free, open‑source models to cut costs and reduce vendor dependence.
also on Gemma, #open-source, #developer-tools
Apple Silicon costs more than OpenRouter
Running local LLMs on Apple Silicon costs about 3x more per million tokens than using OpenRouter, and also runs slower.
also on Gemma, #developer-tools
On-Device LLMs: State of the Union, 2026 – Vikas Chandra – AI Research @ Meta
Billion-parameter LLMs now run in real time on phones due to advances in model compression, quantization, and efficient architectures, not just faster chips.
also on Llama.cpp, #mobile, #developer-tools