Reading up on LiteLLM
3 deep · digging since jan 13
- Introduction | Headroom
Headroom claims 87% token reduction with 100% accuracy by compressing tool outputs, logs, and other LLM context before model inference.
- Show HN: A MitM proxy to see what your LLM tools are sending
Tokentap is a MitM proxy that monitors what LLM CLI tools are sending to their API endpoints.
- A Software Library with No Code
A spec-only software library (whenwords) that AI agents implement on demand suggests simple utilities may no longer need traditional code libraries, but complex ones still require code for performance, testing, support, updates, and community.