Reading up on XKCD
2 deep · digging since apr 17
- i was just pressing continue
In a week-long experiment, the author scaled an AI‑agent fleet to 144 agents that completed 106 work units, but found shutting half down improved clarity and quality.
- What I learned this week - Pretraining parallelisms, Can distillation be stopped, Mythos and the cybersecurity equilibrium, Pipeline RL, On why pretraining runs fails
A set of rough notes exploring challenges in AI model distillation, cybersecurity offense/defense dynamics, and pipeline RL for training.