作者位次 #6/12ACL 2026Findings· Findings of ACL
Do Image–Text Metrics Respect Semantic Invariances?
Amit Agarwal · Hitesh Laxmichand Patel · Meizhu Liu · Jyotika Singh · Karan Dua · Hansa Meghwani · Matthew Rowe · M. Avendi · Yassi Abbasi · Tao Sheng · Sujith Ravi · Dan Roth
摘要
Reference-free image–to–text evaluators are now standard for scoring image–caption alignment, yet it is unclear whether they respect semantic invariances. We present an invariance probe on five popular evaluators (CLIPScore, PAC-S, UMIC, FLEUR, and a deterministic LLM judge) under semantics-prese...