HybridSpec: Exploiting Hybrid-Bonding Memory to Accelerate LLM Serving Through Heterogeneous Architecture and Speculative Decoding
Zongle Huang · Wenbin Jia · Yaolei Li · Xinyuan Lin · Shupei Fan · Chen Tang · Shuwen Deng · Yongpan Liu
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Zongle Huang · Wenbin Jia · Yaolei Li · Xinyuan Lin · Shupei Fan · Chen Tang · Shuwen Deng · Yongpan Liu
Wenxun Wang · Xiuhong Li · Yida Wang · Chen Tang · Zongle Huang · Ke Hong · Yu Wang · Yongpan Liu
Bo Lv · Jingbo Sun · Jianwei Lv · Chen Tang · Shaojie Zhang · Nayu Liu · Guoxin Yu · Zihao Li · Qichao Zhang · Dongbin Zhao · Ping Luo · Yue Yu
Optimizing the trade-off among predictive performance and computational cost is a central focus in the deployment of Large Language Models (LLMs). Current routing methods primarily rely on direct mapping from queries to models based on surface-level features, making them susceptible to the memori...
Yangfan Wang · Tianyang Sun · Chen Tang · Jie Liu · Wei Cai · Jingchi Jiang
Lifelong model editing (LME) aims to sequentially rectify outdated or inaccurate knowledge in deployed LLMs while minimizing side effects on unrelated inputs. However, existing approaches typically apply parameter perturbations to a static and dense set of LLM layers for all editing instances. Th...
Lian Yan · Haotian Wang · Chen Tang · Haifeng Liu · Tianyang Sun · Liangliang Liu · Yi Guan · Jingchi Jiang