Reading up on Recursive Language Models

Recursive Language Models (RLMs) mitigate context rot in LLMs by wrapping long contexts in a REPL environment, turning the problem into a coding and reasoning task.