Reading up on local-llm

A developer details setting up a local coding agent on macOS using llama.cpp, Gemma 4, and Pi for real-time terminal-based AI assistance.

A guide for running Gemma 4 models locally on a Mac Mini via Ollama, with commenters reporting that the 26B variant is too slow and memory-intensive for daily use, while smaller quantizations suffice for light tool-calling tasks.