RDLTR

Short for Read Later. Save links from any browser or phone. Click to save, read to clear. The full tour

One line. Many voicesSeek and you shall find

ngrok.com faviconPrompt caching: 10x cheaper LLM tokens, but how?

kept by

Prompt caching cuts LLM token costs by 10x and latency by up to 85% by caching attention key-value projections for repeated prompt prefixes.