Reading up on MLX
6 deep · digging since dec 15, 25
- The PR you would have opened yourself
Hugging Face built a Claude Code Skill and test harness that helps contributors port language models from transformers to mlx-lm while preserving code quality and reviewer trust.
- April 2026 TLDR Setup for Ollama and Gemma 4 26B on a Mac mini
A guide for running Gemma 4 models locally on a Mac Mini via Ollama, with commenters reporting that the 26B variant is too slow and memory-intensive for daily use, while smaller quantizations suffice for light tool-calling tasks.
- Right-sizes LLM models to your system's RAM, CPU, and GPU
LLMFit is a terminal tool that scans system hardware and scores LLM models on fit, speed, and quality to recommend which can run locally.
- My iPhone 16 Pro Max produces garbage output when running MLX LLMs
An iPhone 16 Pro Max produces garbage output when running MLX LLMs due to a hardware defect in the Neural Engine, while an iPhone 15 Pro runs the same code correctly.
- LM Studio 0.4 | Hacker News
LM Studio 0.4 introduces a headless server daemon (llmster), parallel requests with continuous batching, a refreshed UI, and a new stateful REST API.
- macOS 26.2 enables fast AI clusters with RDMA over Thunderbolt
macOS 26.2 enables RDMA over Thunderbolt for clustering multiple Macs into fast AI inference nodes, prioritizing capacity over throughput.