Distillation in Practice: Turning a Frontier Model Into a Cheap Specialist
A walkthrough of taking a narrow task off an expensive frontier model and onto a small fine-tuned model that costs a fraction as much to run, using the frontier model as the teacher.
7/18/202612 min read