Reading up on voice-agents

A developer built a sub-500ms latency voice agent by co-locating and aggressively pipelining STT, LLM, and TTS stages. Commenters debate trade-offs vs. end-to-end models, endpoint detection alternatives, and the difficulty of human-like turn-taking.

By piping Deepgram Flux, Groq's LLM, and ElevenLabs TTS with geographic optimization, the author achieved ~400ms end-to-end voice agent latency, beating Vapi by 2x.