UniSD: Towards a Unified Self-Distillation Framework for Large Language Models
UniSD unifies the fragmented landscape of self-distillation for large language models, providing a principled framework that supports systematic comparison and new combinations across data, representation, and decoding levels.
May 30, 2026