一作ACL 2026Poster· Natural Language Processing
When Vision-Language Models Judge Without Seeing: Exposing Informativeness Bias
Xiaohan Zou · Roshan Sridhar · Mohammadtaher Safarzadeh · Dan Roth
摘要
The reliability of VLM-as-a-Judge is critical for the automatic evaluation of vision-language models (VLMs). Despite recent progress, our analysis reveals that VLM-as-a-Judge often pays limited attention to the image when making decisions. Instead, they often blindly favor the more informative an...