Crimson: Collaborative Parameter Updates for Efficient Pipeline Training of Large Language Models
Yapeng Jiang · Wuhui Chen · Ganhong Huang · Yuzhou Huang · Zicong Hong · Song Guo · Yue Yu
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Yapeng Jiang · Wuhui Chen · Ganhong Huang · Yuzhou Huang · Zicong Hong · Song Guo · Yue Yu
Zicong Hong · Yuyan Chen · Haoyue Zhang · Peng Li · Wuhui Chen · Song Guo · Xiaowei Shen
Fangqi Zhu · Zhengyang Yan · Zicong Hong · Quanxin Shou · Xiao Ma · Song Guo
Jian Liu · Chunshi Wang · Song Guo · Haohan Weng · Zhen Zhou · Zhiqi Li · Jiaao Yu · Yiling Zhu · Jing Xu · Biwen Lei · Zhuo Chen · Chunchao Guo
Shuang Chen · Hangyu Guo · Yimeng Ye · Shijue Huang · Wenbo Hu · Jiayu Chen · Manyuan Zhang · Haoxi Li · Song Guo · Nanyun (Violet) Peng
Zhen Zhou · Jian Liu · Biwen Lei · Jing Xu · Haohan Weng · Yiling Zhu · Zhuo Chen · Junfeng Fan · Yunkai Ma · Dazhao Du · Song Guo · Fengshui Jing · Chunchao Guo
Chenggang Rong · Tao Han · Zhiyuan Zhao · Yaowu Fan · Jia Wan · Song Guo · Yuan Yuan · Junyu Gao
Haoyue Zhang · HUALEI Zhang · Xiaosong Ma · Jie ZHANG · Song Guo
Large Language Models (LLMs) exhibit enhanced capabilities by Chain-of-Thought reasoning. However, the extended reasoning sequences introduce significant GPU memory overhead due to increased key-value (KV) cache. Existing KV cache compression methods mitigate memory bottlenecks but struggle in lo...
Yongjiang Liu · Haoxi Li · Xiaosong Ma · Jie ZHANG · Song Guo
Recent Large Reasoning Models (LRMs) excel at complex reasoning tasks but often suffer from overthinking, generating overly long and redundant reasoning trajectories. To explore its essence, our empirical analysis reveals that LRMs are primarily limited to recognizing task properties (i.e., diffi...
Sikai Bai · Haoxi Li · Jie ZHANG · Yongjiang Liu · Song Guo
Despite significant advances in Large Reasoning Models (LRMs) driven by reinforcement learning with verifiable rewards (RLVR), this paradigm is fundamentally limited in specialized or novel domains where such supervision is prohibitively expensive or unavailable, posing a key challenge for test-t...
Qianli Liu · Kaibin Guo · Zicong Hong · Peng Li · Fahao Chen · Haodong WANG · Jian Lin · Song Guo
Zile Wang · Qianli Liu · Kaibin Guo · Haodong WANG · Jian Lin · Zicong Hong · Song Guo
Dazhao Du · Tao Han · Song Guo