作者位次 #7/14ACL 2026Poster· Natural Language Processing
Decentralized Arena: Towards Democratic and Scalable Automatic Evaluation of Language Models
Yanbin Yin · Kun Zhou · Zhen Wang · Xiangdong Zhang · Yifei Shao · Shibo Hao · Yi Gu · Jieyuan Liu · Somanshu Singla · Tianyang Liu · Eric P. Xing · Zhengzhong Liu · Haojian Jin · Zhiting Hu
摘要
The recent explosion of large language models (LLMs), each with its own general or specialized strengths, makes scalable, reliable benchmarking more urgent than ever. Standard practices nowadays face fundamental trade-offs: closed-ended question-based benchmarks (MMLU) struggle with saturation as...