Reading up on LLMTraceFX
1 deep · digging since sep 14
- A cache hit is not proof that you skipped the work
A deterministic KV‑cache auditor shows that a reported cache hit does not guarantee skipped work, as reuse can be attested while the prompt path still recomputes tokens.