Knowledge Distillation Draft notes on Knowledge Distillation. draft certainty: unlikely importance: 5 Overview Background Key Ideas Further Reading Draft — not yet written. Overview Background Key Ideas Further Reading