2026 顶会论文
18作者位次 #14/18OSDI 2026Oral· Operating Systems & Distributed Systems
RollArt: Disaggregated Multi-Task Agentic RL Training at Scale
Wei Gao · Yuheng Zhao · Tianyuan Wu · Shaopan Xiong · Weixun Wang · Dakai An · Lunxi Cao · Dilxat Muhtar · Zichen Liu · Haizhou Zhao · Ju Huang · Siran Yang · Yongbin Li · Wenbo Su · Jiamang Wang · Lin Qu · Zerui Huang (Taobao & · Wei Wang
摘要
Agentic Reinforcement Learning (RL) trains LLMs through multi-turn interactions with environments, producing workloads that mix compute-bound prefill, bandwidth-bound decoding, CPU-heavy environment execution, and bursty reward evaluation. Existing systems either colocate all stages on a single G...
作者位次 #11/12ICLR 2026Poster· Deep Learning / Generative Models and Autoencoders
Expert Divergence Learning for MoE-based Language Models
Jiaang Li · Haibin Chen · langming liu · Yujin Yuan · Yadao Wang · Yizhen Zhang · Chengting Yu · Xin Tong · Weidong Zhang · Shilei Liu · Wenbo Su · Zerui Huang (Taobao &
作者位次 #11/12ICLR 2026Poster· Applications / Language, Speech and Dialog
Reconstructing KV Caches with Cross-Layer Fusion for Enhanced Transformers
Hongzhan Lin · Zhiqi Bai · Xinmiao Zhang · Siran Yang · Jiamang Wang · Yunlong Xu · JIAHENG LIU · Yongchi Zhao · Xiang Li · Yuchi Xu · Wenbo Su · Zerui Huang (Taobao &
作者位次 #6/10ICLR 2026Poster
Asymmetric Proximal Policy Optimization: mini-critics boost LLM reasoning
Jiashun Liu · Johan S Obando Ceron · Han Lu · Yancheng He · Weixun Wang · Wenbo Su · Zerui Huang (Taobao & · Pablo Samuel Castro · Aaron Courville · Ling Pan
作者位次 #6/7ICLR 2026Poster· Applications / Language, Speech and Dialog
COMI: Coarse-to-fine Context Compression via Marginal Information Gain
Jiwei Tang · Shilei Liu · ZHICHENG ZHANG · Yujin Yuan · Libin Zheng · Wenbo Su · Zerui Huang (Taobao &
作者位次 #10/11ICLR 2026Poster
MeSH: Memory-as-State-Highways for Recursive Transformers
Chengting Yu · Xiaobo Shu · Yadao Wang · Yizhen Zhang · Haoyi Wu · Jiaang Li · Rujiao Long · Ziheng Chen · Yuchi Xu · Wenbo Su · Zerui Huang (Taobao &
作者位次 #10/11ICLR 2026Poster· Applications / Language, Speech and Dialog
DESIGNER: Design-Logic-Guided Multidisciplinary Data Synthesis for LLM Reasoning
Weize Liu · Yongchi Zhao · Yijia Luo · Mingyu Xu · JIAHENG LIU · Yanan Li · Xiguo Hu · Zhiqi Bai · Yuchi Xu · Wenbo Su · Zerui Huang (Taobao &
作者位次 #14/15ICLR 2026Poster· Reinforcement Learning / Deep RL
Tricks or Traps? A Deep Dive into RL for LLM Reasoning
Zihe Liu · Jiashun Liu · Yancheng He · Weixun Wang · JIAHENG LIU · Ling Pan · Xinyu Hu · Shaopan Xiong · Ju Huang · Jian Hu · Shengyi Huang · Siran Yang · Jiamang Wang · Wenbo Su · Zerui Huang (Taobao &
作者位次 #8/10CVPR 2026Poster· Computer Vision & Pattern Recognition
Reasoning Palette: Modulating Reasoning via Latent Contextualization for Controllable Exploration for (V)LMs
Rujiao Long · Yang Li · Xingyao Zhang · Weixun Wang · Tianqianjin Lin · Xi Zhao · Yuchi Xu · Wenbo Su · Junchi Yan · Zerui Huang (Taobao &
作者位次 #12/15ACL 2026Poster· Natural Language Processing
USB : A COMPREHENSIVE AND UNIFIED SAFETY EVALUATION BENCHMARK FOR MULTIMODAL LARGE LANGUAGE MODELS
Baolin Zheng · Guanlin Chen · Qingyang Teng · Hongqiong Zhong · Yingshui Tan · Zhendong Liu · Weixun Wang · JIAHENG LIU · Jian Yang · Huiyun Jing · Jincheng Wei · Wenbo Su · Xiaoyong Zhu · Zerui Huang (Taobao & · Kaifu Zhang
摘要
Despite their rapid advancement, Multimodal Large Language Models (MLLMs) remain vulnerable to diverse safety risks. Current benchmarks fail to provide reliable assessments due to limited risk coverage, insufficient scale, and the oversight of complex modality combinations (e.g., cross-modal risk...
作者位次 #11/12ACL 2026Poster· Natural Language Processing
Read As Human: Compressing Context via Parallelizable Close Reading and Skimming
Jiwei Tang · Shilei Liu · ZHICHENG ZHANG · Qingsong Lv · Runsong Zhao · Tingwei Lu · langming liu · Haibin Chen · Yujin Yuan · Hai-Tao Zheng · Wenbo Su · Zerui Huang (Taobao &
摘要
Large Language Models (LLMs) demonstrate exceptional capability across diverse tasks. However, their deployment in long-context scenarios is hindered by two challenges: computational inefficiency and redundant information. We propose RAM (Read As HuMan), a context compression framework that adopt...
作者位次 #15/16ACL 2026Poster· Natural Language Processing
S hop S imulator: Evaluating and Exploring RL -Driven LLM Agent for Shopping Assistants
Pei Wang · Yanan Wu · Xiaoshuai Song · Weixun Wang · Gengru Chen · Zhongwen Li · Kezhong Yan · Qi Liu · Ken Deng · Shuaibing Zhao · Shaopan Xiong · Xuepeng Liu · Xuefeng Chen · Wanxi Deng · Wenbo Su · Zerui Huang (Taobao &
摘要
Large language model (LLM)-based agents are increasingly deployed in e-commerce shopping. To perform thorough, user-tailored product searches, agents should interpret personal preferences, engage in multi-turn dialogues, and ultimately retrieve and discriminate among highly similar products. Howe...
作者位次 #10/11ACL 2026Poster· Natural Language Processing
C o M e T : Collaborative Memory Transformer for Efficient Long Context Modeling
Runsong Zhao · Shilei Liu · Jiwei Tang · langming liu · Haibin Chen · Weidong Zhang · Yujin Yuan · Tong Xiao · JingBo Zhu · Wenbo Su · Zerui Huang (Taobao &
摘要
The quadratic complexity and indefinitely growing key-value (KV) cache of standard Transformers pose a major barrier to long-context processing. To overcome this, we introduce the Co llaborative Me mory T ransformer (CoMeT), a novel architecture that enables LLMs to handle arbitrarily long sequen...
作者位次 #9/10ACL 2026Poster· Natural Language Processing
SELEC ting over Tokens: Curating Pre-training Data at Scale via Token Classification
Xin Tong · Weidong Zhang · Jiaang Li · Haibin Chen · Shilei Liu · langming liu · Kangtao Lv · Yujin Yuan · Wenbo Su · Zerui Huang (Taobao &
摘要
The quality of pre-training data critically impacts the capabilities of large language models. Existing pipelines rely on expert-crafted heuristic rules, which primarily operate at the sample level and are based on coarse statistical indicators, thus lacking content-aware, fine-grained noise dete...
作者位次 #10/11ACL 2026Findings· Findings of ACL
P retrain RL : Alleviating Factuality Hallucination of Large Language Models at the Beginning
langming liu · Kangtao Lv · Haibin Chen · Weidong Zhang · an Jiaotong University) · Shilei Liu · Xin Tong · Yujin Yuan · Yongwei Wang · Wenbo Su · Zerui Huang (Taobao &
摘要
Large language models (LLMs), despite their powerful capabilities, suffer from factual hallucinations where they generate verifiable falsehoods. We identify a root of this issue: the imbalanced data distribution in the pretraining corpus, which leads to a state of “low-probability truth” and “hig...
作者位次 #7/8ACL 2026Findings· Findings of ACL
RAVR : Reference-Answer-guided Variational Reasoning for Large Language Models
Tianqianjin Lin · Xi Zhao · Xingyao Zhang · Rujiao Long · Yi Xu · Zhuoren Jiang · Wenbo Su · Zerui Huang (Taobao &
摘要
Reinforcement learning (RL) can refine the reasoning abilities of large language models (LLMs), but critically depends on a key prerequisite: the LLM can already generate high-utility reasoning paths with non-negligible probability. For tasks beyond the LLM’s current competence, such reasoning pa...
作者位次 #7/9ACL 2026Findings· Findings of ACL
CE - RM : A Pointwise Generative Reward Model Optimized via Two-Stage Rollout and Unified Criteria
Xinyu Hu · Yancheng He · Weixun Wang · Tao Feng · Li Lin · Jiashun Liu · Wenbo Su · Zerui Huang (Taobao & · Xiaojun Wan
摘要
Automatic evaluation is crucial yet challenging for open-ended natural language generation, especially when rule-based metrics are infeasible. Compared with traditional methods, the recent LLM-as-a-Judge paradigms enable better and more flexible evaluation, and show promise as generative reward m...
作者位次 #8/8AAAI 2026Poster· Artificial Intelligence
Think-J: Learning to Think for Generative LLM-as-a-Judge
Hui Huang · Yancheng He · Hongli Zhou · Rui Zhang · Wei Liu · Weixun Wang · JIAHENG LIU · Wenbo Su