episode pub. Jul 27, 2026
Explains model distillation as both a legitimate technique for building smaller, cheaper models and a contested way to clone a rival lab's model via its API, plus why proving distillation happened is forensically hard. Covers the 2015 Hinton/Vinyals/Dean paper's soft-target vs. hard-label distinction.