Language Models Don’t Know What You Want: Evaluating Personalization in Deep Research Needs Real Users
Nishant Balepur · Malachi Hamada · Varsha Kishore · Sergey Feldman · Amanpreet Singh · Pao Siangliulue · Joseph Chee Chang · Eunsol Choi · Jordan Lee Boyd-Graber · Aakanksha Naik
摘要
Deep Research (DR) tools (e.g. OpenAI DR) help researchers cope with ballooning publishing counts. Such tools can synthesize scientific papers to answer researchers’ queries, but lack understanding of their users. We change that in MyScholarQA (MySQA), a personalized DR tool that: 1) infers a pro...