Knowledge Fusion of Large Language Models via Modular SkillPacks
Guodong DU · Zhuo Li · Xuanning Zhou · Junlin Li · Zesheng Shi · Wanyu LIN · Ho-Kin Tang · Xiucheng Li · Fangming Liu · Wenya Wang · Min Zhang · Jing Li
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Guodong DU · Zhuo Li · Xuanning Zhou · Junlin Li · Zesheng Shi · Wanyu LIN · Ho-Kin Tang · Xiucheng Li · Fangming Liu · Wenya Wang · Min Zhang · Jing Li
Wu Li · Yigeng Zhou · Zesheng Shi · Yequan Wang · Min Zhang · Jing Li
While recent self-training approaches have reduced reliance on human-labeled data for aligning LLMs, they still face critical limitations: (i) sensitivity to synthetic data quality, leading to instability and bias amplification in iterative training; (ii) ineffective optimization due to a diminis...
Weiyang Guo · Zesheng Shi · Zeen Zhu · Yuan Zhou · Min Zhang · Jing Li
Reinforcement Learning with Verifiable Rewards (RLVR) is an emerging paradigm that significantly boosts a Large Language Model’s (LLM’s) reasoning abilities on complex logical tasks, such as mathematics and programming. However, we identify, for the first time, a latent vulnerability to backdoor...
Xiang Li · Yucheng Zhou · Xiangzhi Wei · Zesheng Shi · Haiyuan Wan · Gong Yifan · Fangming Liu · Jing Li
Existing methods for enhancing the inductive reasoning of large language models (LLMs) at test-time typically depend on iterative self-refinement of hypotheses, which lacks explicit optimization guidance and effective error correction. This often results in superficial rewording and the accumulat...
Weiyang Guo · Zesheng Shi · Liye Zhao · Jiayuan Ma · Zeen Zhu · Junxian He · Min Zhang · Jing Li
While Large Language Models (LLMs) have demonstrated significant potential in Tool-Integrated Reasoning (TIR), existing training paradigms face significant limitations: Zero-RL suffers from inefficient exploration and mode degradation due to a lack of prior guidance, while SFT-then-RL is limited...
Zhuo Li · Guodong DU · Zesheng Shi · Weiyang Guo · Weijun Yao · Yuan Zhou · Jiabo Zhang · Jing Li
In this work, we introduce SkillWeave, a modular improvement framework that enables large language models to specialize under fixed memory budgets. SkillWeave partitions full capabilities of a general-purpose model into domain-specific skillpacks—lightweight, domain-specific delta modules—that re...