Reading up on Apple Silicon
6 deep · digging since jan 30
- Haiku OS runs on M1 Macs now
Haiku OS now boots on Apple M1 Macs via UTM and bare metal, but performance and hardware support remain experimental.
- Apple Silicon costs more than OpenRouter
Running local LLMs on Apple Silicon is not cheaper than using cloud APIs like OpenRouter when factoring hardware, electricity, and speed costs.
- Apple Silicon costs more than OpenRouter
Running local LLMs on Apple Silicon costs about 3x more per million tokens than using OpenRouter, and also runs slower.
- GitHub - RunanywhereAI/RCLI: Talk to your Mac, query your docs, no cloud required. On-device voice AI + RAG
RCLI is an open-source, on-device voice AI for macOS that runs STT, LLM, TTS, and VLM entirely locally on Apple Silicon, with sub-200ms latency and no cloud dependency.
- M5 Pro and M5 Max are surprisingly big departures from older Apple Silicon - Ars Technica
Apple's M5 Pro and M5 Max chips introduce a chiplet-based Fusion Architecture and a third CPU core type, splitting CPU/GPU across two dies for the first time in non-Ultra chips.
- Apple's AI Game is Misunderstood - by Dave Friedman
Apple's AI strategy bets on-device inference using its 2.2 billion devices as pre-deployed infrastructure, avoiding cloud compute costs.