Saving 100 terabytes of memory by optimizing 1.1.1.1's DNS cache

kept by eddie aug 28

Cloudflare cut over 100 terabytes of RAM used by its 1.1.1.1 DNS cache by redesigning cache layout and eviction policies without hurting query latency.

How we saved 100 terabytes of memory by optimizing 1.1.1.1’s DNS cache
Cloudflare reduced its Big Pineapple DNS cache entry size by 56% through five Rust optimizations, freeing ~100 TB of memory while boosting insert throughput 43% and cutting lookup latency 19%.
also on 1.1.1.1, Cloudflare, #cloud-computing
What came first: the CNAME or the A record?
Cloudflare's reordering of CNAME records in DNS responses broke glibc and other clients due to widespread reliance on undocumented ordering.
also on 1.1.1.1, Cloudflare
How OpenAI Delivers Low-Latency Voice AI for 900M Users
OpenAI splits WebRTC into a stateless relay and a stateful transceiver, using the ICE ufrag for routing to serve 900M voice AI users with low latency.
also on #performance, Cloudflare