一作ACL 2026Poster· Natural Language Processing
Impatient Users Confuse AI Agents: High-fidelity Simulations of Human Traits for Testing Agents
Muyu He · Anand Kumar · Soumyadeep Bakshi · James Zou · Nazneen Rajani
摘要
Despite rapid progress in building conversational AI agents, robustness is still largely untested. Small shifts in user behavior, such as being more impatient, incoherent, or skeptical, can cause sharp drops in agent performance, revealing how brittle current AI agents are. Today’s benchmarks fai...