Exploring Knowledge Purification in Multi-Teacher Knowledge Distillation for LLMs
Ruihan Jin · Pengpeng Shao · Zhengqi Wen · Jinyang Wu · Mingkuan Feng · Shuo Yang · Chu Yuan Zhang · Jianhua Tao
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Ruihan Jin · Pengpeng Shao · Zhengqi Wen · Jinyang Wu · Mingkuan Feng · Shuo Yang · Chu Yuan Zhang · Jianhua Tao
Zheng Lian · Licai Sun · Lan Chen · Haoyu Chen · Zebang Cheng · Fan Zhang · Ziyu Jia · Ziyang Ma · Fei Ma · Xiaojiang Peng · Jianhua Tao
Jinyang Wu · Mingkuan Feng · Shuai Zhang · Feihu Che · Zhengqi Wen · Chonghua Liao · Ling Yang · Haoran Luo · Zheng Lian · Jianhua Tao
In-context learning (ICL) leverages demonstrations to enhance the performance of large language models (LLMs). However, traditional ICL struggles with complex reasoning mainly due to superficial, example-level implicit imitation. To address these limitations, we introduce ThoughtICR , an automate...
Mingkuan Feng · Jinyang Wu · Siyuan Liu · Shuai Zhang · Hongjian Fang · Ruihan Jin · Feihu Che · Pengpeng Shao · Zhengqi Wen · Jianhua Tao
The deployment of large language models (LLMs) is largely hindered by their large number of parameters. Structural pruning has emerged as a promising solution. Prior structured pruning methods directly remove unimportant parameters based on certain metrics, which often causes knowledge loss and n...
Cunhang Fan · Jun Zhang · Xue Zhang · Shuai Zhang · Zhao Lv · Jianhua Tao · Zhengqi Wen
Large Language Models (LLMs) often generate factually incorrect content, known as “hallucinations”, which undermine the reliability and safety of their outputs. Existing hallucination detection methods either depend on external knowledge sources, incurring high computational costs and limiting re...
Jinyang Wu · Shuo Yang · Yuhao Shen · Shuai Zhang · Zhengqi Wen · Jianhua Tao
Reinforcement learning has empowered large language models to act as intelligent agents, yet training them for long-horizon tasks remains challenging due to the scarcity of high-quality trajectories, especially under limited resources. Existing methods typically scale up rollout sizes and indiscr...
Jinyang Wu · Chonghua Liao · Mingkuan Feng · Shuai Zhang · Zhengqi Wen · Haoran Luo · Ling Yang · Huazhe Xu · Jianhua Tao
Reinforcement learning (RL) has emerged as an effective paradigm for enhancing model reasoning. However, existing RL methods like GRPO often rely on unstructured self-sampling to fit scalar rewards, often producing inefficient rollouts that fail to capture transferable problem-solving strategies....
Jinyang Wu · Guocheng Zhai · Ruihan Jin · Jiahao Yuan · Yuhao Shen · Shuai Zhang · Zhengqi Wen · Jianhua Tao
The integration of large language models (LLMs) with external tools has significantly expanded the capabilities of AI agents. However, as the diversity of both LLMs and tools increases, selecting the optimal model-tool combination becomes a high-dimensional optimization challenge. Existing approa...
Fengyu Zhang · Bin Liu · Jianhua Tao · Zhuofan Wen · Shun Chen · Hailiang Yao · Zhengqi Wen
Multimodal emotion reasoning requires both accurate identification and logical rationales to explain emotional triggers. However, current methods often suffer from causal degeneracy, where models produce linguistically fluent but superficial explanations that lack authentic logical derivation. To...
Heng Xie · Kang Zhu · Zhengqi Wen · Jianhua Tao · Xuefei Liu · Ruibo Fu · Changsheng Li
Jinyang Wu · Mingkuan Feng · Guocheng Zhai · Shuai Zhang · Zheng Lian · Fangrui Lv · Pengpeng Shao · Ruihan Jin · Zhengqi Wen · Jianhua Tao