一作ACL 2026Findings· Findings of ACL
Who’s Asking? Simulating Role-Based Questions for Conversational AI Evaluation
Navreet Kaur · Hoda Ayad · Hayoung Jung · Shravika Mittal · Munmun De Choudhury · Tanu Mitra
摘要
Language model users often embed personal and social context in their questions. Theasker’s role—implicit in how the question is framed—creates specific needs for an appropriate response. However, most evaluations, while capturing the model’s capability to respond, often ignore who is asking. Thi...