Multi-objective Large Language Model Alignment with Hierarchical Experts
Zhuo Li · Guodong DU · Weiyang Guo · Yigeng Zhou · Xiucheng Li · Wenya Wang · Fangming Liu · Yequan Wang · Deheng Ye · Min Zhang · Jing Li
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Zhuo Li · Guodong DU · Weiyang Guo · Yigeng Zhou · Xiucheng Li · Wenya Wang · Fangming Liu · Yequan Wang · Deheng Ye · Min Zhang · Jing Li
Guodong DU · Zhuo Li · Xuanning Zhou · Junlin Li · Zesheng Shi · Wanyu LIN · Ho-Kin Tang · Xiucheng Li · Fangming Liu · Wenya Wang · Min Zhang · Jing Li
Zhuoyuan Hao · Zhuo Li · Wu Li · Fangming Liu · Min Zhang · Jing Li
Wu Li · Yigeng Zhou · Zesheng Shi · Yequan Wang · Min Zhang · Jing Li
While recent self-training approaches have reduced reliance on human-labeled data for aligning LLMs, they still face critical limitations: (i) sensitivity to synthetic data quality, leading to instability and bias amplification in iterative training; (ii) ineffective optimization due to a diminis...
Xilai Ma · Liye Zhao · Weijun Yao · Haibing Di · Wenya Wang · Jing Li
Large Language Model (LLM) personalization aims to align model behaviors with individual user preferences.Existing methods often focus on isolated user histories, neglecting the essential role of inter-user differences.We propose C-BPO, a framework that personalizes LLMs via preference-calibrated...
Weiyang Guo · Zesheng Shi · Zeen Zhu · Yuan Zhou · Min Zhang · Jing Li
Reinforcement Learning with Verifiable Rewards (RLVR) is an emerging paradigm that significantly boosts a Large Language Model’s (LLM’s) reasoning abilities on complex logical tasks, such as mathematics and programming. However, we identify, for the first time, a latent vulnerability to backdoor...
Yangneng Chen · Junlin Li · Weijun Yao · Xilai Ma · Guodong DU · Wenya Wang · Jing Li
Large Vision-Language Models (LVLMs) have achieved remarkable progress in multimodal tasks, yet their reliability is persistently undermined by hallucinations—generating text that contradicts visual input. Recent studies often attribute these errors to inadequate visual attention. In this work, w...
Junlin Li · Shuangyong Song · Guodong DU · Ngai Wong · Xuebo Liu · Yongxiang Li · Min Zhang · Jing Li · Xuelong Li
Supervised Fine-Tuning (SFT) accelerates task-specific large language models (LLMs) development, but the resulting proliferation of fine-tuned models incurs substantial memory overhead. Delta compression addresses this by retaining a single pre-trained LLM with multiple compressed delta weights....
Xiang Li · Yucheng Zhou · Xiangzhi Wei · Zesheng Shi · Haiyuan Wan · Gong Yifan · Fangming Liu · Jing Li
Existing methods for enhancing the inductive reasoning of large language models (LLMs) at test-time typically depend on iterative self-refinement of hypotheses, which lacks explicit optimization guidance and effective error correction. This often results in superficial rewording and the accumulat...
Weiyang Guo · Zesheng Shi · Liye Zhao · Jiayuan Ma · Zeen Zhu · Junxian He · Min Zhang · Jing Li
While Large Language Models (LLMs) have demonstrated significant potential in Tool-Integrated Reasoning (TIR), existing training paradigms face significant limitations: Zero-RL suffers from inefficient exploration and mode degradation due to a lack of prior guidance, while SFT-then-RL is limited...
Zhuo Li · Guodong DU · Zesheng Shi · Weiyang Guo · Weijun Yao · Yuan Zhou · Jiabo Zhang · Jing Li
In this work, we introduce SkillWeave, a modular improvement framework that enables large language models to specialize under fixed memory budgets. SkillWeave partitions full capabilities of a general-purpose model into domain-specific skillpacks—lightweight, domain-specific delta modules—that re...
Yin Wu · Quanyu Long · Jing Li · Jianfei Yu · Wenya Wang
Retrieval-augmented generation (RAG) augments large language models (LLMs) with external knowledge to tackle knowledge-intensive question answering.While several benchmarks evaluate multimodal LLMs (MLLMs) under multimodal RAG settings, they predominantly retrieve from textual corpora and do not...