Exploring Knowledge Purification in Multi-Teacher Knowledge Distillation for LLMs
Ruihan Jin · Pengpeng Shao · Zhengqi Wen · Jinyang Wu · Mingkuan Feng · Shuo Yang · Chu Yuan Zhang · Jianhua Tao
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Ruihan Jin · Pengpeng Shao · Zhengqi Wen · Jinyang Wu · Mingkuan Feng · Shuo Yang · Chu Yuan Zhang · Jianhua Tao
Mingkuan Feng · Jinyang Wu · Siyuan Liu · Shuai Zhang · Hongjian Fang · Ruihan Jin · Feihu Che · Pengpeng Shao · Zhengqi Wen · Jianhua Tao
The deployment of large language models (LLMs) is largely hindered by their large number of parameters. Structural pruning has emerged as a promising solution. Prior structured pruning methods directly remove unimportant parameters based on certain metrics, which often causes knowledge loss and n...
Jinyang Wu · Guocheng Zhai · Ruihan Jin · Jiahao Yuan · Yuhao Shen · Shuai Zhang · Zhengqi Wen · Jianhua Tao
The integration of large language models (LLMs) with external tools has significantly expanded the capabilities of AI agents. However, as the diversity of both LLMs and tools increases, selecting the optimal model-tool combination becomes a high-dimensional optimization challenge. Existing approa...
Jinyang Wu · Mingkuan Feng · Guocheng Zhai · Shuai Zhang · Zheng Lian · Fangrui Lv · Pengpeng Shao · Ruihan Jin · Zhengqi Wen · Jianhua Tao