KV Cache Compression via Attention Output Distortion Minimization
Yi Wang · Yixuan Cao · Qiang Ding · Zelin Gao · Ping Luo
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Yi Wang · Yixuan Cao · Qiang Ding · Zelin Gao · Ping Luo
Bo Lv · Jingbo Sun · Jianwei Lv · Chen Tang · Shaojie Zhang · Nayu Liu · Guoxin Yu · Zihao Li · Qichao Zhang · Dongbin Zhao · Ping Luo · Yue Yu
Optimizing the trade-off among predictive performance and computational cost is a central focus in the deployment of Large Language Models (LLMs). Current routing methods primarily rely on direct mapping from queries to models based on surface-level features, making them susceptible to the memori...
Zhanli Li · Yixuan Cao · Lvzhou Luo · Ping Luo
This paper introduces the task of analytical question answering over large, semi-structured document collections. We present MuDABench, a benchmark for multi-document analytical QA, where questions require extracting and synthesizing information across numerous documents to perform quantitative a...
Yixuan Cao · Chunhao Yang · Yifan Wang · Tmall Group of Alibaba) · Kun Wan · Gang Xiao · Ping Luo