作者位次 #2/5ACL 2026Findings· Findings of ACL
C ontract E val: A Benchmark for Evaluating Contract-Satisfying Assertions in Code Generation
Soohan Lim · Joonghyuk Hahn · Hyunwoo Park · Sang-Ki Ko · Yo-Sub Han
摘要
Current code generation evaluation measures functional correctness on well-formed inputs that satisfy all input preconditions. This paradigm has a critical limitation: task descriptions often leave these preconditions implicit, while evaluation filters out inputs that violate them. As a result, g...