作者位次 #3/9ACL 2026Findings· Findings of ACL
Why Can Distillation Work with Limited Resources? A Systematic Study
Xiao Hu · Xingyu Lu · Liyuan Mao · YiFan Zhang · Tianke Zhang · Bin Wen · Fan Yang · Tingting Gao · Guorui Zhou
摘要
Recently, large language models have made remarkable progress in reasoning, largely driven by scaling data and model size. In parallel, several studies argue that for smaller models, high-quality distillation can yield strong reasoning performance with minimal resources. However, a framework for...