paper.dinq.meAI 与前沿科学顶会 · 学术新星雷达
登录 DINQ
返回新星榜
HS

Hamidreza Saghir

COLM 2026代码推理智能体与工具
新星分贡献者
32
一作贡献0
核心/参与12
方向广度6
合作网络3
0 一作 · 1 篇 · COLM 2026

获取完整研究档案

首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。

联系方式

实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。

2026 顶会论文

1
作者位次 #2/8COLM 2026Poster· Poster Session 4· Grand Ballroom· #112

The Devil Is in the Interface: Evaluating How Tool Architecture Shapes Coding Agent Behavior

Xiangzhe Xu · Hamidreza Saghir · Qianhui Wu · Marc-Alexandre Côté · Tong Wang · Kiran Lakkaraju · Kexin Pei · Xiangyu Zhang

Tool architecture, not just tool capability, shapes how coding agents explore, behave, and perform.

摘要

As large language models continue to improve, agentic systems are becoming increasingly important, and tools are a key design dimension because they determine how agents access information and take action in their environments. Prior work on agent tooling has primarily focused on expanding what agents can do, but has paid less systematic attention to how those capabilities are organized and exposed to the model. We refer to this latter design dimension as *tool architecture*. We study tool architecture in coding agents through controlled experiments on repository-level issue fixing, comparing six tool architectures that hold the underlying information and actions similar while varying how they are organized and exposed to the model, across three actors and a total of 11,700 trajectories. Our experiments show that, even when tools provide similar capabilities, tool architecture changes agent behavior: Compared to a basic architecture where the agent has only the bash tool, more structured low-level interfaces improve consistency across repeated attempts by up to 4.7$\times$; natural-language search broadens repository exploration and increases access to relevant files by more than 11\%; and Python CodeAct-style interfaces achieve similar task performance with 41.6\% fewer steps and 56.3\% lower token usage. By contrast, lightweight text-based cognitive-scaffolding tools, such as tools that let the agent record intermediate reasoning, have limited effect on actor behavior.

代码推理智能体与工具coding agentharness engineeringtool designempirical studyOpenReview 项目页

常见合作者