作者位次 #8/8ACL 2026Poster· Natural Language Processing
Illusions of the Gold Standard: A Large-scale Analysis of Human Evaluation Protocols for Long-form Text Generation
Katelyn X. Mei · Yi-Li Hsu · Minjoon Choi · Zongwan Cao · Chenjun Xu · Bingbing Wen · Su Lin Blodgett · Lucy Lu Wang
摘要
Human evaluation plays a critical role in assessing the quality of generated text. However, the reliability and reproducibility of these evaluations depend on transparent and well-documented protocols—details that are frequently missing in current practice. In this work, we conduct a large-scale...