一作SIGIR 2026OralBest Student Paper· Information Retrieval (Full)
Topic-Specific Classifiers are Better Relevance Judges than Prompted LLMs
Lukas Gienapp · Martin Potthast · Andrew Yates · Harrisen Scells · Eugene Yang
摘要
The unjudged document problem, where systems that did not contribute to the original judgement pool may retrieve documents without a relevance judgement, is a key obstacle to the reuseability of test collections in information retrieval. This is commonly dealt with by treating unjudged documents...