WSM: Decay-Free Learning Rate Schedule via Checkpoint Merging for LLM Pre-training
Changxin Tian · Jiapeng Wang · Qian Zhao · Kunlong Chen · Jia Liu · Ziqi Liu · Jiaxin Mao · Wayne Xin Zhao · Zhiqiang Zhang · JUN ZHOU
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Changxin Tian · Jiapeng Wang · Qian Zhao · Kunlong Chen · Jia Liu · Ziqi Liu · Jiaxin Mao · Wayne Xin Zhao · Zhiqiang Zhang · JUN ZHOU
Guoxin Chen · Wu Jing · Xinjie Chen · Wayne Xin Zhao · Ruihua Song · Chengxi Li · Kai Fan · Dayiheng Liu · Minpeng Liao
Yifan Li · Zhenghao Chen · Ziheng Wu · Kun Zhou · Ruipu Luo · Can Zhang · Zhentao he · Yufei Zhan · Wayne Xin Zhao · Minghui Qiu
Guoxin Chen · Zile Qiao · Xuanzhong Chen · Donglei Yu · Haotian Xu · Wayne Xin Zhao · Ruihua Song · Wenbiao Yin · Huifeng Yin · Liwen Zhang · Kuan Li · Minpeng Liao · Yong Jiang · Pengjun Xie · Fei Huang · Jingren Zhou
Xinyu Tang · Zhenduo Zhang · Yurou Liu · Wayne Xin Zhao · zujie wen · Zhiqiang Zhang · JUN ZHOU
Yingqian Min · Kun Zhou · Yifan Li · Yuhuan Wu · Han Peng · Yifan Du · Wayne Xin Zhao · Min Yang · Ji-Rong Wen
Yifan Du · Kun Zhou · Yingqian Min · Yue Ling · Wayne Xin Zhao · Youbin Wu · Ji-Rong Wen
Xinyu Tang · Yuliang Zhan · Zhixun Li · Wayne Xin Zhao · Zhenduo Zhang · zujie wen · Zhiqiang Zhang · JUN ZHOU
Large reasoning models (LRMs) are typically trained using reinforcement learning with verifiable reward (RLVR) to enhance their reasoning abilities. In this paradigm, policies are updated using both positive and negative self-generated rollouts, which correspond to distinct sample polarities . In...
Yuhao Wang · Ruiyang Ren · Yucheng Wang · Wayne Xin Zhao · Jing Liu · hua wu · Haifeng Wang
Long-form question answering (LFQA) requires open-ended long-form responses that synthesize coherent, factually grounded content from multi-source evidence. This makes reinforcement learning (RL) reward design critical. The reward must be verifiable for faithful grounding and stable optimization....
Haoxiang Sun · Yingqian Min · Zhipeng Chen · Wayne Xin Zhao · Ji-Rong Wen
The rapid advancement of large reasoning models has saturated existing math benchmarks, underscoring the urgent need for more challenging evaluation frameworks. To address this, we introduce OlymMATH, a rigorously curated, Olympiad-level math benchmark comprising 350 problems, each with parallel...
Yifan Li · YuKai Gu · Yingqian Min · Zikang Liu · Yifan Du · Kun Zhou · Min Yang · Wayne Xin Zhao · Minghui Qiu
Recent breakthroughs in video generation have demonstrated an emerging capability termed Chain-of-Frames (CoF) reasoning, where models resolve complex tasks through the generation of continuous frames. While these models show promise for Generative Video Reasoning (GVR), existing evaluation frame...
Jia Deng · Junyi Li · Wayne Xin Zhao · Jinpeng Wang · Hongyu Lu · Ji-Rong Wen
Diffusion large language models (dLLMs) offer an efficient alternative to autoregressive models through parallel decoding, yet existing post-training methods largely rely on random masking strategies that overlook intrinsic token dependencies. In this work, we present an empirical analysis of att...
Yihong Liu · Junyi Li · Hongyu Lu · Wayne Xin Zhao · Ji-Rong Wen
Combinatorial optimization has long been dominated by manually engineered heuristics, a paradigm requiring substantial expert intuition and implementation overhead. The advent of Large Language Models has disrupted this landscape, enabling the autonomous synthesis and optimization of algorithms....
Jian Yang · Shuyue Guo · Linzheng Chai · Wei Zhang · Aishan Liu · Chuan Hao · Zhoujun Li · Wayne Xin Zhao · Xianglong Liu · Weifeng Lv · Bryan Dai
Large language models (LLMs) are powerful but costly to train, with scaling laws predicting performance from model size, data, and compute. However, different programming languages (PLs) have varying impacts during pre-training that significantly affect base model performance, leading to inaccura...
Bowen Zheng · Hongyu Lu · Yu Chen · Wayne Xin Zhao · Ji-Rong Wen
Recently, generative recommendation has emerged as a promising paradigm, attracting significant research attention. The basic framework involves an item tokenizer, which represents each item as a sequence of codes serving as its identifier, and a generative recommender that predicts the next item...
Hongzhi Yin · Wei Yuan · Yi Zhang · Joel Mackenzie · Quoc Viet Hung Nguyen · Wayne Xin Zhao · Yong Li · Lina Yao
Enze Liu · Zhen Tian · Wayne Xin Zhao
Yifan Li · Kun Zhou · Wayne Xin Zhao · Lei Fang · Ji-Rong Wen
Rui Zou · Mengqi Wei · Yutao Zhu · Ji-Rong Wen · Wayne Xin Zhao · Jing Chen
Fei Bai · Yingqian Min · Beichen Zhang · Zhipeng Chen · Wayne Xin Zhao · Lei Fang · Zheng Liu · Zhongyuan Wang · Hongteng Xu
Daixuan Cheng · Shaohan Huang · Xuekai Zhu · Bo Dai · Wayne Xin Zhao · Zhenliang Zhang · Furu Wei
Yuhao Wang · Ruiyang Ren · Yucheng Wang · Jing Liu · Wayne Xin Zhao · hua wu · Haifeng Wang