GitHub - RunanywhereAI/RCLI: Talk to your Mac, query your docs, no cloud required. On-device voice AI + RAG

kept by eddie mar 12

RCLI is an open-source, on-device voice AI for macOS that runs STT, LLM, TTS, and VLM entirely locally on Apple Silicon, with sub-200ms latency and no cloud dependency.

Gemini 3.1 Flash Live: Google’s latest AI audio model
Google released Gemini 3.1 Flash Live, its highest-quality audio model, for real-time dialogue across developer, enterprise, and consumer products.
also on #voice-ai, #ai, #developer-tools
Real-time Voice AI. Built to Scale.
Smallest AI argues that specialized small models operating on compressed representations, rather than monolithic large models, are the future of real-time voice AI.
also on #voice-ai, #ai
Apple's AI Game is Misunderstood - by Dave Friedman
Apple's AI strategy bets on-device inference using its 2.2 billion devices as pre-deployed infrastructure, avoiding cloud compute costs.
also on Apple Silicon, #ai, #developer-tools
Apple Silicon costs more than OpenRouter
Running local LLMs on Apple Silicon costs about 3x more per million tokens than using OpenRouter, and also runs slower.
also on Apple Silicon, #developer-tools
How to setup a local coding agent on macOS
A developer details setting up a local coding agent on macOS using llama.cpp, Gemma 4, and Pi for real-time terminal-based AI assistance.
also on Llama.cpp, #macos, #open-source, #developer-tools