How to setup a local coding agent on macOS

kept by eddie jun 19

A developer details setting up a local coding agent on macOS using llama.cpp, Gemma 4, and Pi for real-time terminal-based AI assistance.

April 2026 TLDR Setup for Ollama and Gemma 4 26B on a Mac mini
A guide for running Gemma 4 models locally on a Mac Mini via Ollama, with commenters reporting that the 26B variant is too slow and memory-intensive for daily use, while smaller quantizations suffice for light tool-calling tasks.
also on #local-llm, Gemma 4, LM Studio, Llama.cpp, Ollama, #developer-tools
Running local models is good now
Local agentic coding models have reached surprising quality and usability over the past six months, now offering ~75% of frontier-model accuracy for many development tasks on a 64GB M2 Mac.
also on LM Studio, Llama.cpp, Ollama, pi, #open-source, #ai-coding, #developer-tools
Google's new Gemma 4 12B model is designed to run on any laptop with 16GB of RAM - Ars Technica
Google's Gemma 4 12B model uses Multi-Token Prediction and a streamlined multimodal encoder to run efficiently on laptops with 16GB RAM, matching larger models.
also on Gemma 4, LM Studio, #open-source, #developer-tools
Multi-token-prediction in Gemma 4
Google released Multi-Token Prediction drafters for Gemma 4 that use speculative decoding to achieve up to 3x faster inference without output quality loss.
also on Gemma 4, #open-source, #ai-coding, #developer-tools
This website has been temporarily rate limited | www.warman.life
Open-weight models from China are commoditizing AI capability, breaking the monopoly moat of US closed labs, prompting protectionist moves that will harm long-term US competitiveness.
also on Llama.cpp, Ollama, #open-source