作者位次 #4/8ACL 2026Findings· Findings of ACL
Distilling the Essence: Efficient Reasoning Distillation via Sequence Truncation
Wei-Rui Chen · Vignesh Kothapalli · Ata Fatahibaarzi · Hejian Sang · shao tang · Qingquan Song · Zhipeng Wang · Muhammad Abdul-Mageed
摘要
Distilling the capabilities from a large reasoning model (LRM) to a smaller student model often involves training on substantial amounts of reasoning data. However, knowledge distillation (KD) over lengthy sequences with prompt (P), chain-of-thought (CoT), and answer (A) sections makes the proces...