HARD-KV: Head-Adaptive Regularization for Decoding-time KV Compression
Yuxuan Yang · Feiyang Ren · Bowen Zeng · Dalin Zhang · Jinpeng Chen · Gang Chen · Huan Li
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Yuxuan Yang · Feiyang Ren · Bowen Zeng · Dalin Zhang · Jinpeng Chen · Gang Chen · Huan Li
Bowen Zeng · Feiyang Ren · Jun Zhang · Xiaoling Gu · Ke Chen · Lidan Shou · Huan Li
Multimodal Large Language Models (MLLMs) have advanced unified reasoning over text, images, and videos, but their inference is hindered by the rapid growth of key–value (KV) caches. Each visual input expands into thousands of tokens, causing caches to scale linearly with context length and remain...
Jun Zhang · Yicheng Ji · Feiyang Ren · Yihang Li · Bowen Zeng · Zonghao Chen · Ke Chen · Lidan Shou · Gang Chen · Huan Li
Large Vision-Language Models (LVLMs) enable sophisticated reasoning over images and videos, yet their inference is hindered by a systemic efficiency barrier known as visual token dominance. This overhead is driven by a multi-regime interplay between high-resolution feature extraction, quadratic a...