Do Simulated Users Need to Remember? Analyzing the Impact of Memory Models in Conversational Search Evaluation
Nailia Mirzakhmedova · Marcel Gohsen · Johannes Kiesel · Matthias Hagen · Benno Stein
摘要
Conversational search systems are typically evaluated using a fixed reference collection of conversations or through user studies with a live system. However, fixed-reference conversations can cover only a few plausible conversations, and user studies are costly, time-consuming, and often hard to...