Too Long, Do Re-weighting for Efficient LLM Reasoning Compression
Zhong-Zhi Li · Xiao Liang · Zihao Tang · Lei Ji · Peijie Wang · Haotian Xu · Xing W · Haizhen Huang · Weiwei Deng · Yeyun Gong · Zhijiang Guo · Xiao Liu · Fei Yin · Cheng-lin Liu
摘要
Large Language Models (LLMs) have recently achieved remarkable progress on complex reasoning tasks by leveraging extended Chain-of-Thought (CoT) techniques. These reasoning processes can be roughly categorized into System-1 (fast and intuitive) and System-2 (slow and deliberate) paradigms. Howeve...