一作ACL 2026Poster· Natural Language Processing
MTR -Suite: A Framework for Evaluating and Synthesizing Conversational Retrieval Benchmarks
Junhao Ruan · Abudukeyumu Abudula · Bei Li · Yongjing Yin · Xinyu Liu · Kechen Jiao · Xin Chen · Jingang Wang · Xunliang Cai · Tong Xiao · JingBo Zhu
摘要
Accurate evaluation of conversational retrieval is pivotal for advancing Retrieval-Augmented Generation (RAG) systems. However, existing conversational retrieval benchmarks suffer from costly, sparse human annotation or rigid, unnatural automated heuristics. To address these challenges, we introd...