MMAC : A Multilingual, Multimodal Alignment Framework for Cultural Grounding Evaluation
Weihua Zheng · Zhengyuan Liu · Tanmoy Chakraborty · Weiwen Xu · Xiaoxue Gao · Bryan Chen Zhengyu Tan · Bowei Zou · Chang Liu · Yujia Hu · Xing Xie · Xiaoyuan Yi · Jing Yao · Chaojun Wang · Long Li · Rui Liu · Huiyao Liu · Koji Inoue · Ryuichi Sumida · Tatsuya Kawahara · Fan Xu · Lingyu Ye · Wei Tian · Dongjun Kim · Jimin Jung · Jaehyung Seo · Nadya Yuki Wangsajaya · Pham Minh Duc · Ojasva Saxena · Palash Nandi · Xiyan Tao · Wiwik Karlina · Tuan Luong · Keertana Arun Vasan · Roy Ka-Wei Lee · Nancy F. Chen
摘要
The global deployment of Large Language Models (LLMs) underscores the urgent need to evaluate their cultural alignment. However, assessing genuine “cultural awareness” across modalities (text, vision, speech) and languages remains a significant challenge. To comprehensively investigate this domai...