作者位次 #2/4ACL 2026Findings· Findings of ACL
Take Out Your Calculators: Estimating the Real Difficulty of Question Items with LLM Student Simulations
Christabel Acquaye · Yi Ting Huang · Marine Carpuat · Rachel Rudinger
摘要
Standardized math assessments require expensive human pilot studies to establish the difficulty of test items. We investigate the predictive value of open-source large language models (LLMs) for evaluating the difficulty of multiple-choice math questions for real-world students. We show that, whi...