一作SIGIR 2026Poster· Information Retrieval (Industry)
As It Was: Aligning LLM Search Evaluation with Historical User Preferences
Ali Vardasbi · Gustavo Penha · Enrico Palumbo · Claudia Hauff · Hugues Bouchard · Mounia Lalmas
摘要
Large-scale search systems evolve faster than human quality assurance scales, especially for long-tail intents and multilingual queries. LLM-as-a-judge approaches are a scalable alternative for evaluating the relevance of search engine result pages (SERPs), but judgments based solely on semantic...