Reading up on Pi Durable
2 deep · digging since oct 03
- Cutting our inference bill by 68% by being obsessive about optimization
Cloudflare cut its AI code reviewer costs by 68% (to $0.77 per review) and halved latency through aggressive prompt caching, fewer LLM calls per session, and cheaper model routing.