paper.dinq.meAI 与前沿科学顶会 · 学术新星雷达
登录 DINQ
返回新星榜
MM

Mark Niklas Mueller

COLM 2026代码评测与基准社会与人本
新星分贡献者
22
一作贡献0
核心/参与5
方向广度6
合作网络3
0 一作 · 1 篇 · COLM 2026

获取完整研究档案

首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。

联系方式

实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。

2026 顶会论文

1
作者位次 #3/5COLM 2026Poster· Poster Session 3· Imperial Ballroom· #57

Coding Agents Don’t Know When to Act

Thibaud Gloaguen · Niels Mündler · Mark Niklas Mueller · Veselin Raychev · Martin Vechev

We show that coding agents always propose a patch to fix issues, even if no issue is present in the codebase

摘要

Coding agents are increasingly deployed to autonomously maintain software, including to resolve user-reported issues: a bug report comes in and the agent creates a patch to address it. However, in any real-world deployment, they will encounter stale bug reports about issues that have already been resolved. Agents should recognize this and abstain from modifying the code to avoid accumulating technical debt. To systematically evaluate whether current agents do so, we introduce FixedBench a code benchmark with 200 human-verified coding tasks in which no code changes are required, testing five recent models across four agent harnesses. We find that even state-of-the-art models fail, proposing undesirable changes (exluding tests and documentation) in $35$ to $65$% of cases. Explicit instructions to reproduce the issue before patching partially address this issue but introduce a new failure mode: when an issue is partially fixed, they abstain even though a patch would still be needed. More broadly, our results indicate that LLMs fall prey to an action bias: they choose to act even if inaction would be appropriate. To break this pattern, inaction needs to be expliclitly framed as a path to success, which highlights an overreliance on human guidance implicit in current training objectives.

代码评测与基准社会与人本coding agentsLLMbenchmarksSWEOpenReview

常见合作者