作者位次 #10/18ACL 2026Findings· Findings of ACL
L ong CLI -Bench: A Preliminary Benchmark and Study for Long-horizon Agentic Programming in Command-Line Interfaces
Yukang Feng · Jianwen Sun · Zelai Yang · Jiaxin Ai · Chuanhao Li · Zizhen Li · Fanrui Zhang · Kang He · Rui Ma · Jifan Lin · Jie Sun · Yang Xiao · Sizhuo Zhou · Wenxiao Wu · Yiming Liu · Pengfei Liu · Shenglin Zhang · Kaipeng Zhang
摘要
Recent advances in AI-assisted programming have empowered agents to execute complex workflows via command-line interfaces, however, existing benchmarks are limited by short task horizons, data contamination from GitHub scraping, and a lack of fine-grained evaluation metrics, fail to rigorously ev...