Long-Chain Reasoning Distillation via Adaptive Prefix Alignment
Zhenghao Liu · Zhuoyang Wu · Xinze Li · Yukun Yan · Shuo Wang · Zulong Chen · Yu Gu · Ge Yu · Maosong Sun
摘要
Large Language Models (LLMs) have demonstrated remarkable reasoning capabilities, particularly in solving complex mathematical problems. Recent studies show that distilling long reasoning trajectories can effectively enhance the reasoning performance of small-scale student models. However, teache...