一作ACL 2026Poster· Natural Language Processing
Mediocrity is the key for LLM as a Judge Anchor Selection
Shachar Don-Yehiya · Asaf Yehudai · Leshem Choshen · Omri Abend
摘要
The “LLM-as-a-judge” paradigm has become a standard method for evaluating open-ended generation. To address the quadratic scalability costs of pairwise comparisons, popular benchmarks like Arena-Hard and AlpacaEval compare all models against a single anchor. However, despite its widespread use, t...