On-Policy Distillation
A careful introduction to on-policy distillation as on-policy student rollouts with dense teacher supervision.
Archive
Long-form notes on model behavior after pretraining, from evaluation and alignment to product systems.
A careful introduction to on-policy distillation as on-policy student rollouts with dense teacher supervision.
Why this site exists and what kinds of AI systems writing will live here.