Reading up on context-window
1 deep · digging since nov 26, 25
- LLMs can invent their own compression - Rajan Agarwal
Co-training a summarizer and generator via RL lets an LLM learn its own text compression scheme, achieving ~9.5% context size with minimal prediction loss.