Autoencoding-Free Context Compression for LLMs via Contextual Semantic Anchors
Xin Liu · Runsong Zhao · Pengcheng Huang · Xinyu Liu · Junyi Xiao · chunyang xiao · Tong Xiao · Shengxiang Gao · Zhengtao Yu · JingBo Zhu
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Xin Liu · Runsong Zhao · Pengcheng Huang · Xinyu Liu · Junyi Xiao · chunyang xiao · Tong Xiao · Shengxiang Gao · Zhengtao Yu · JingBo Zhu
Chenglong Wang · Yifu Huo · Yang Gan · Qiaozhi He · Qi Meng · Bei Li · Yan Wang · Junfu Liu · Tianhua Zhou · JingBo Zhu · Tong Xiao
Pengcheng Huang · Tianming Liu · Zhenghao Liu · Yukun Yan · Shuo Wang · Tong Xiao · Zulong Chen · Maosong Sun
Masked Diffusion Models (MDMs) have recently emerged as a promising non-autoregressive paradigm for sequence generation. However, their performance is highly sensitive to the choice of decoding strategy. In this work, we reveal that prevalent uncertainty-based decoding strategies induce two decod...
Yuan Ge · Haishu Zhao · AoKai Hao · Junxiang Zhang · Bei Li · Xiaoqian Liu · Chenglong Wang · Jianjin Wang · Bingsen Zhou · Bingyu Liu · JingBo Zhu · Zhengtao Yu · Tong Xiao
Emotion is a core paralinguistic feature in voice interaction. It is widely believed that emotion understanding models learn fundamental representations that transfer to synthesized speech, making emotion understanding results a plausible reward or evaluation metric for assessing emotional expres...
Yingfeng Luo · Ziqiang Xu · Yuxuan Ouyang · MuRun Yang · DingYang Lin · Kaiyan Chang · Tong Zheng · Bei Li · Peinan Feng · Quan Du · Tong Xiao · JingBo Zhu
Large language models have significantly advanced Multilingual Machine Translation (MMT), yet scaling to many languages while keeping quality robust across directions remains challenging.In this paper, we identify a failure mode of multilingual supervised fine-tuning (SFT) on multi-way parallel d...
Junhao Ruan · Abudukeyumu Abudula · Bei Li · Yongjing Yin · Xinyu Liu · Kechen Jiao · Xin Chen · Jingang Wang · Xunliang Cai · Tong Xiao · JingBo Zhu
Accurate evaluation of conversational retrieval is pivotal for advancing Retrieval-Augmented Generation (RAG) systems. However, existing conversational retrieval benchmarks suffer from costly, sparse human annotation or rigid, unnatural automated heuristics. To address these challenges, we introd...
Runsong Zhao · Shilei Liu · Jiwei Tang · langming liu · Haibin Chen · Weidong Zhang · Yujin Yuan · Tong Xiao · JingBo Zhu · Wenbo Su · Zerui Huang (Taobao &
The quadratic complexity and indefinitely growing key-value (KV) cache of standard Transformers pose a major barrier to long-context processing. To overcome this, we introduce the Co llaborative Me mory T ransformer (CoMeT), a novel architecture that enables LLMs to handle arbitrarily long sequen...
Yuchun Fan · Bei Li · Peiguang Li · Yilin Wang · Yongyu Mu · Jian Yang · Xin Chen · Rongxiang Weng · Jingang Wang · Xunliang Cai · JingBo Zhu · Tong Xiao
Reinforcement learning has proven effective for enhancing multi-step reasoning in Large Language Models (LLMs), yet its benefits have not fully translated to multilingual contexts. Existing methods struggle with a fundamental trade-off: prioritizing input-language consistency severely hampers rea...
Yingfeng Luo · Hongyu Liu · DingYang Lin · Kaiyan Chang · Chenglong Wang · Bei Li · Quan Du · Tong Xiao · JingBo Zhu
Large Language Models (LLMs) have achieved remarkable performance in Machine Translation (MT), but deploying them at scale remains prohibitively expensive. A widely adopted remedy is the hybrid system paradigm, which balances cost and quality by serving most requests with a small model and select...
Xiaoqian Liu · Zhengkun Ge · Jianjin Wang · Haoran Zhang · Yuan Ge · Kaiyan Chang · Chen Xu · Tong Xiao · Zhengtao Yu · Linfeng Zhang · JingBo Zhu
Recent advancements in audio diffusion models have significantly improved text-to-audio editing via inversion techniques. However, these models typically rely on dense, fixed-step sampling trajectories to maintain structural integrity during inversion and generation, leading to prohibitive comput...
Chenglong Wang · Canjia Li · Xingzhao Zhu · Yifu Huo · Huiyu Wang · Weixiong Lin · Yun Yang · Qiaozhi He · Tian Hua Zhou · Changxiaojia · JingBo Zhu · Tong Xiao
Due to the dynamically evolving nature of real-world query streams, relevance models struggle to generalize to practical search scenarios. A sophisticated solution is self-evolution techniques. However, in large-scale industrial settings with massive query streams, this technique faces two challe...
Yuxuan Ouyang · Yingfeng Luo · JingBo Zhu · Tong Xiao
Large Language Models (LLMs) are increasingly used to generate narrative content, including children’s stories, which play an important role in social and cultural learning. Despite growing interest in AI safety and alignment, most existing evaluations focus primarily on English, leaving the cros...
Yifu Huo · Chenglong Wang · Ziming Zhu · Shunjie Xing · Peinan Feng · Tongran Liu · Qiaozhi He · Tian Hua Zhou · Changxiaojia · JingBo Zhu · Zhengtao Yu · Tong Xiao
Reinforcement learning (RL) has emerged as a promising paradigm for training reasoning-oriented models by leveraging rule-based reward signals. However, RL training typically tends to improve single-sample success rates (i.e., Pass@1) while offering limited exploration of diverse reasoning trajec...
Yuan Ge · Junxiang Zhang · Xiaoqian Liu · Bei Li · Xiangnan Ma · Chenglong Wang · Kaiyang Ye · Yangfan Du · Linfeng Zhang · Yuxin Huang · Tong Xiao · Zhengtao Yu · JingBo Zhu
Xiaoqian Liu · Xiyan Gui · Zhengkun Ge · Yuan Ge · Chang Zou · Jiacheng Liu · Zhikang Niu · Qixi Zheng · Chen Xu · Xie Chen · Tong Xiao · JingBo Zhu · Linfeng Zhang
Chenglong Wang · Yongyu Mu · Hang Zhou · Yifu Huo · Ziming Zhu · Jiali Zeng · MuRun Yang · Bei Li · Xiaoyang Hao · Chunliang Zhang · Fandong Meng · JingBo Zhu · Tong Xiao
Chenglong Wang · Yifu Huo · Yang Gan · Yongyu Mu · Qiaozhi He · MuRun Yang · Bei Li · Chunliang Zhang · Tongran Liu · Anxiang Ma · Zhengtao Yu · JingBo Zhu · Tong Xiao