一作ACL 2026Findings· Findings of ACL
Multi-Docker-Eval: A ‘Shovel of the Gold Rush’ Benchmark on Automatic Environment Building for Software Engineering
Kelin Fu · Tianyu Liu · Zeyu Shang · YINGWEI MA · JIAHENG LIU · Jian Yang · Kaigui Bian
摘要
Automated environment configuration is a critical bottleneck in scaling software engineering (SWE) automation. To provide a reliable evaluation standard for this task, we present Multi-Docker-Eval benchmark. It includes 40 real-world repositories spanning 9 programming languages and measures both...