Knowledge Distillation: Compressing Large Models

2025-04-13

Knowledge distillation trains smaller student models to mimic larger teacher models.

Related Chronicles: The Compression Catastrophe (2035)