作者位次 #4/10ACL 2026Findings· Findings of ACL
Efficient Inference for Large Vision-Language Models: Bottlenecks, Techniques, and Prospects
Jun Zhang · Yicheng Ji · Feiyang Ren · Yihang Li · Bowen Zeng · Zonghao Chen · Ke Chen · Lidan Shou · Gang Chen · Huan Li
摘要
Large Vision-Language Models (LVLMs) enable sophisticated reasoning over images and videos, yet their inference is hindered by a systemic efficiency barrier known as visual token dominance. This overhead is driven by a multi-regime interplay between high-resolution feature extraction, quadratic a...