作者位次 #5/5ACL 2026Findings· Findings of ACL
O pen E xempt: A Diagnostic Benchmark for Legal Reasoning and a Framework for Creating Custom Benchmarks on Demand
Sergio Servantez · Sarah B. Lawsky · Rajiv Jain · Daniel W. Linna Jr. · Kristian J Hammond
摘要
Reasoning benchmarks have played a crucial role in the progress of language models. Yet rigorous evaluation remains a significant challenge as static question-answer pairs provide only a snapshot of performance, compressing complex behavior into a single accuracy metric. This limitation is especi...