作者位次 #3/4ACL 2026Findings· Findings of ACL
Large Language Models for IT Automation Tasks: Are We There Yet?
Md Mahadi Hassan Sibat · John Salvador · Akond Rahman · Santu Karmaker
摘要
LLMs show promise in code generation, yet their effectiveness for IT automation tasks, particularly for tools like Ansible, remains understudied. Existing benchmarks rely primarily on synthetic tasks that fail to capture the needs of practitioners who use IT automation tools. We present ExITBench...