RATION : Entropy-Driven Task-Adaptive Visual Attention Allocation Framework for Multimodal Reasoning
Xingle Xu · Fanheng Kong · Dexian Cai · Shi Feng · Xiaocui Yang · Daling Wang · Yifei Zhang
摘要
Multimodal Large Language Models (MLLMs) integrate visual encoders with Large Language Models (LLMs) and enable multimodal reasoning. However, for tasks that heavily rely on visual information, the model’s utilization of visual information remains unstable, which leads to reasoning failures. Prio...