What I learned this week - Pretraining parallelisms, Can distillation be stopped, Mythos and the cybersecurity equilibrium, Pipeline RL, On why pretraining runs fails
kept by eddie
A set of rough notes exploring challenges in AI model distillation, cybersecurity offense/defense dynamics, and pipeline RL for training.