作者位次 #6/7SIGIR 2026Oral· Information Retrieval (Full)
Formalized Information Needs Improve Large-Language-Model Relevance Judgments
Jüri Keller · Maik Fröbe · Björn Engelmann · Fabian Haak · Timo Breuer · Birger Larsen · Philipp Schaer
摘要
Cranfield-style retrieval evaluations with too few or too many relevant documents or with low inter-assessor agreement on relevance can reduce the reliability of observations. In evaluations with human assessors, information needs are often formalized as retrieval topics to avoid an excessive num...