ParallelVLM: Lossless Video-LLM Acceleration with Visual Alignment Aware Parallel Speculative Decoding
Quan Kong · Yuhao Shen · Yicheng Ji · Huan Li · Cong Wang
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Quan Kong · Yuhao Shen · Yicheng Ji · Huan Li · Cong Wang
Yicheng Ji · Jun Zhang · Jinpeng Chen · Cong Wang · Lidan Shou · Gang Chen · Huan Li
Video Large Language Models (Video-LLMs) excel in video understanding but suffer from high inference latency due to autoregressive generation. Speculative Decoding (SD) mitigates this by applying a draft-and-verify paradigm, yet existing methods are constrained by rigid exact-match rules, severel...
Jun Zhang · Yicheng Ji · Feiyang Ren · Yihang Li · Bowen Zeng · Zonghao Chen · Ke Chen · Lidan Shou · Gang Chen · Huan Li
Large Vision-Language Models (LVLMs) enable sophisticated reasoning over images and videos, yet their inference is hindered by a systemic efficiency barrier known as visual token dominance. This overhead is driven by a multi-regime interplay between high-resolution feature extraction, quadratic a...