2026 顶会论文
20作者位次 #13/18OSDI 2026Oral· Operating Systems & Distributed Systems
RollArt: Disaggregated Multi-Task Agentic RL Training at Scale
Wei Gao · Yuheng Zhao · Tianyuan Wu · Shaopan Xiong · Weixun Wang · Dakai An · Lunxi Cao · Dilxat Muhtar · Zichen Liu · Haizhou Zhao · Ju Huang · Siran Yang · Yongbin Li · Wenbo Su · Jiamang Wang · Lin Qu · Zerui Huang (Taobao & · Wei Wang
摘要
Agentic Reinforcement Learning (RL) trains LLMs through multi-turn interactions with environments, producing workloads that mix compute-bound prefill, bandwidth-bound decoding, CPU-heavy environment execution, and bursty reward evaluation. Existing systems either colocate all stages on a single G...
作者位次 #9/10ICLR 2026Oral· Social Aspects / Everything Else
P-GenRM: Personalized Generative Reward Model with Test-time User-based Scaling
Pinyi Zhang · Ting-En Lin · Yuchuan Wu · Jingyang Chen · Zongqi Wang · Hua Yang · Bing Zhao · Fei Huang · Yongbin Li · Kai Zhang
作者位次 #5/7ICLR 2026Poster· Reinforcement Learning / Everything Else
Agentic Reinforcement Learning with Implicit Step Rewards
Xiaoqian Liu · Ke Wang · Yuchuan Wu · Fei Huang · Yongbin Li · Jianbin Jiao · Junge Zhang
作者位次 #2/9ICLR 2026Poster
Adaptive Social Learning via Mode Policy Optimization for Language Agents
Minzheng Wang · Yongbin Li · Haobo Wang · Xinghua Zhang · Nan Xu · Bingli Wu · Fei Huang · Haiyang Yu · Wenji Mao
作者位次 #8/9ICLR 2026Poster· Reinforcement Learning / Deep RL
A Simple "Motivation" Can Enhance Reinforcement Finetuning of Large Reasoning Models
Junjie Zhang · Guozheng Ma · Shunyu Liu · Haoyu Wang · Jiaxing Huang · Ting-En Lin · Fei Huang · Yongbin Li · Dacheng Tao
作者位次 #4/4ACL 2026Poster· Natural Language Processing
Controlling Multimodal Conversational Agents with Coverage-Enhanced Latent Actions
Yongqi Li · Hao Lang · Tieyun Qian · Yongbin Li
摘要
Vision-language models are increasingly employed as multimodal conversational agents (MCAs) for diverse conversational tasks. Recently, reinforcement learning (RL) has been widely explored for adapting MCAs to various human-AI interaction scenarios. Despite showing great enhancement in generaliza...
作者位次 #6/6ACL 2026Poster· Natural Language Processing
MOA : Multi-Objective Alignment for Role-Playing Agents
Chonghua Liao · Ke Wang · Yuchuan Wu · Ruoran Li · Fei Huang · Yongbin Li
摘要
Role-playing agents (RPAs) require balancing multiple objectives, such as instruction following, persona consistency, and stylistic fidelity, which are not always perfectly aligned across different dimensions. While prior work has primarily relied on supervised fine-tuning or reinforcement learni...
作者位次 #13/13ACL 2026Poster· Natural Language Processing
Act-Adaptive Margin: Dynamically Calibrating Reward Models for Subjective Ambiguity
Feiteng Fang · Dingwei Chen · Xiang Huang · Ting-En Lin · Yuchuan Wu · Xiong Liu · Jing Ye · Ziqiang Liu · Haonan Zhang · Liang Zhu · Hamid Alinejad-Rokny · Min Yang · Yongbin Li
摘要
Currently, most reinforcement learning tasks focus on domains like mathematics and programming, where verification is relatively straightforward. However, in subjective tasks such as role-playing, alignment techniques struggle to make progress, primarily because subjective reward modeling using t...
作者位次 #6/7ACL 2026Poster· Natural Language Processing
E vo R oute: Experience-Driven Self-Routing LLM Agent Systems
Guibin Zhang · Haiyang Yu · Kaiming Yang · Bingli Wu · Fei Huang · Yongbin Li · Shuicheng YAN
摘要
Complex agentic AI systems, powered by a coordinated ensemble of Large Language Models (LLMs), tool and memory modules, have demonstrated remarkable capabilities on intricate, multi-turn tasks. However, this success is shadowed by prohibitive economic costs and severe latency, exposing a critical...
作者位次 #13/14ACL 2026Poster· Natural Language Processing
RL - PLUS : Countering Capability Boundary Collapse of LLM s in Reinforcement Learning with Hybrid-policy Optimization
Yihong Dong · Xue Jiang · Yongding Tao · Huanyu Liu · Kechi Zhang · Lili Mou · Rongyu Cao · YINGWEI MA · Jue Chen · Binhua Li · Zhi Jin · Fei Huang · Yongbin Li · Ge Li
摘要
Reinforcement Learning with Verifiable Reward (RLVR) has significantly advanced the complex reasoning abilities of Large Language Models (LLMs). However, it struggles to break through the inherent capability boundaries of the base LLM, due to its essentially on-policy strategy coupled with LLM’s...
作者位次 #5/5ACL 2026Findings· Findings of ACL
Understanding Generalization in Role-Playing Models via Information Theory
Yongqi Li · Hao Lang · Fei Huang · Tieyun Qian · Yongbin Li
摘要
Role-playing models (RPMs) are widely used in real-world applications but underperform when deployed in the wild. This degradation can be attributed to distribution shifts, including user, character, and dialogue compositional shifts. Existing methods like LLM-as-a-judge fall short in providing a...
作者位次 #19/19ACL 2026Findings· Findings of ACL
Beyond Quantity: Trajectory Diversity Scaling for Code Agents
Guhong Chen · Chenghao Sun · Cheng Fu · Qiyao Wang · Zhihong Huang · ChaoPeng Wei · Guangxu Chen · Feiteng Fang · Ahmadreza Argha · Bing Zhao · Xander Xu · Qi Han · Hamid Alinejad-Rokny · Qiang Qu · Binhua Li · Shiwen Ni · Min Yang · HU WEI · Yongbin Li
摘要
As code large language models (LLMs) evolve into tool-interactive agents via the Model Context Protocol (MCP), their generalization is increasingly limited by low-quality synthetic data and the diminishing returns of quantity scaling; moreover, quantity-centric scaling exhibits an early bottlenec...
作者位次 #10/10ACL 2026Findings· Findings of ACL
Format-Adapter: Improving Reasoning Capability of LLM s by Adapting Suitable Format
Dingzirui Wang · Xuanliang Zhang · Rongyu Cao · Longxu Dou · Xianzhen Luo · YINGWEI MA · Qingfu Zhu · Binhua Li · Fei Huang · Yongbin Li
摘要
Generating and voting multiple answers is an effective method to mitigate reasoning inconsistencies of large language models (LLMs). Prior works have shown that multiple reasoning formats outperform a single format when generating multiple answers. However, previous works using multiple formats r...
作者位次 #9/10ACL 2026Findings· Findings of ACL
M em PO : Self-Memory Policy Optimization for Long-Horizon Agents
Ruoran Li · Xinghua Zhang · Haiyang Yu · Shitong Duan · Xiang Li · Wenxin Xiang · Chonghua Liao · Xudong Guo · Yongbin Li · Jinli Suo
摘要
Long-horizon agents face the challenge of growing context size during interaction with environment, which degrades the performance and stability. Existing methods typically introduce the external memory module and look up the relevant information from the stored memory, which prevents the model i...
作者位次 #5/6ACL 2026Findings· Findings of ACL
Reasoning-Guided Exploration for Online DPO
Zetian Hu · Shunyu Liu · Ting-En Lin · Fei Huang · Yongbin Li · Dacheng Tao
摘要
Recent work has aimed to enhance the reasoning capabilities of language models, but these methods are often limited to domains with objectively verifiable answers. To overcome this limitation, we introduce Reasoning-Guided Exploration for Online DPO (RGE-DPO), a novel self-play framework designed...
作者位次 #8/8ACL 2026Findings· Findings of ACL
E xp S eek: Self-Triggered Experience Seeking for Web Agents
Wenyuan Zhang · Xinghua Zhang · Haiyang Yu · Shuaiyi Nie · Bingli Wu · Juwei Yue · Tingwen Liu · Yongbin Li
摘要
Experience intervention in web agents emerges as a promising technical paradigm, enhancing agent interaction capabilities by providing valuable insights from accumulated experiences. However, existing methods predominantly inject experience passively as global context before task execution, strug...
作者位次 #6/7ACL 2026Findings· Findings of ACL
To Diff or Not to Diff? Structure-Aware and Adaptive Output Formats for Efficient LLM -based Code Editing
Wei Cheng · Yongchang Cao · Chen Shen · Binhua Li · Jue Chen · Yongbin Li · Wei Hu
摘要
Large Language Models (LLMs) are increasingly used for code editing, yet the prevalent full-code generation paradigm suffers from severe efficiency bottlenecks, posing challenges for interactive coding assistants that demand low latency and cost. Despite the predominant focus on scaling model cap...
作者位次 #9/9ACL 2026Findings· Findings of ACL
T o M -Synth: Scaling Robust Theory of Mind in LLM s via 6,912 Structured Social Units
Guiyang Hou · Xiang Huang · Shangke Lyu · Yuchuan Wu · Weiyao Luo · Xinyu Mei · Yongliang Shen · Weiming Lu · Yongbin Li
摘要
Theory of Mind (ToM), the ability to infer others’ mental states from behavior, is pivotal for developing machines with human-level social intelligence. Existing methods endowing LLMs with ToM fall into two paradigms: training-free methods and those repurposing ToM evaluation benchmarks as traini...
作者位次 #11/12AAAI 2026Poster· Artificial Intelligence
Large Language Model Unlearning for Source Code
Xue JIANG · Yihong Dong · Huangzhao Zhang · Tangxinyu Wang · Zheng Fang · YINGWEI MA · Rongyu Cao · Binhua Li · Zhi Jin · Wenpin Jiao · Yongbin Li · Ge Li
作者位次 #3/3AAAI 2026Poster· Artificial Intelligence
Selective Weak-to-Strong Generalization
Hao Lang · Fei Huang · Yongbin Li