Real-time Voice AI. Built to Scale.

kept by eddie jun 09

Smallest AI argues that specialized small models operating on compressed representations, rather than monolithic large models, are the future of real-time voice AI.

Show HN: I built a sub-500ms latency voice agent from scratch
A developer built a sub-500ms latency voice agent by co-locating and aggressively pipelining STT, LLM, and TTS stages. Commenters debate trade-offs vs. end-to-end models, endpoint detection alternatives, and the difficulty of human-like turn-taking.
also on Smallest.ai, #ai
Gemini 3.1 Flash Live: Google’s latest AI audio model
Google released Gemini 3.1 Flash Live, its highest-quality audio model, for real-time dialogue across developer, enterprise, and consumer products.
also on #voice-ai, #ai
GitHub - RunanywhereAI/RCLI: Talk to your Mac, query your docs, no cloud required. On-device voice AI + RAG
RCLI is an open-source, on-device voice AI for macOS that runs STT, LLM, TTS, and VLM entirely locally on Apple Silicon, with sub-200ms latency and no cloud dependency.
also on #voice-ai, #ai
Introducing the Codex app
OpenAI released a macOS app for its Codex coding agent, adding a UI, skills, and automations, and reporting over a million developers have used it.
also on Electron, #ai-agents
Claude is an Electron App because we’ve lost native @ tonsky.me
Claude is an Electron app because native development no longer offers advantages in APIs, consistency, integration, or performance.
also on Electron, #ai