一作ACL 2026Workshop· Natural Language Processing
How Hard is Math? Using Quantitative Metrics to Measure LLM Alignment to Human Intuitions of Difficulty
Micah Helzerman · Steven R Wilson · Cam McLeman
摘要
Modern LLMs have demonstrated advanced reasoning skills, including the ability to solve Olympiad-level mathematics problems. While solving more and more difficult problems is a hallmark of LLM progress, less attention has been placed on how “difficulty” is operationalized in the context of LLM pr...