Distillation in 2026: Why the Best Teachers Are No Longer Bigger Models
Distillation isn't compression anymore — it's synthesis. Frontier labs now merge specialized RL checkpoints of the same base model via on-policy distillation, creating students that exceed their teachers without ever seeing a larger model.
