paper.dinq.meAI 与前沿科学顶会 · 学术新星雷达
登录 DINQ
返回新星榜
YK

Ye Rin Kim

COLM 2026NeurIPS 2026推理评测与基准智能体与工具多模态
新星分贡献者
35
一作贡献0
核心/参与10
方向广度11
合作网络3
0 一作 · 2 篇 · COLM 2026 / NeurIPS 2026

获取完整研究档案

首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。

联系方式

实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。

2026 顶会论文

2
作者位次 #3/9COLM 2026Poster· Poster Session 6· Imperial Ballroom· #42

MolDesignBench: Evaluating LLM-based Agent for Scenario- grounded Molecular Design

Yongjun Jeong · Hanbum Ko · Ye Rin Kim · Chanhui Lee · Rodrigo Hormazabal · Jaewan Lee · Sehui Han · Sungbin Lim · Sungwoong Kim

Proposing MolDesignBench and evaluating the reasoning of tool-augmented LLM agents through scenario-grounded, multi-constrained molecular design benchmark.

摘要

Real-world molecular design remains challenging for large language model (LLM)-based agents. It requires them to interpret design contexts, satisfy multiple constraints, identify infeasible specifications, and reason over multi-step tool outputs. Existing benchmarks do not capture this complexity, focusing instead on explicit and narrow constraints, only feasible problems, and single-path solutions. To address this gap, we propose MolDesignBench, a scenario-grounded benchmark that more closely reflects real-world molecular design for evaluating tool-augmented LLM agents. MolDesignBench comprises 2K generation and optimization instances that combine implicit requirements embedded in design narratives with explicit property and functional-group constraints, including infeasible cases, and require the effective use of 17 specialized chemistry tools. Experiments across diverse frontier LLMs reveal low success rates—with the best achieving only $\sim43$\%—and frequent failures in implicit-constraint reasoning, infeasibility detection, and tool reasoning. The corresponding fine-grained failure-mode analysis identifies implicit constraint interpretation and infeasibility detection as the primary bottlenecks, establishing MolDesignBench as a rigorous testbed to guide future research on chemical agents. The benchmark, tool interface, and evaluation code will be open-sourced.

评测与基准推理智能体与工具Multi-Constraint Molecular DesignTool-Augmented LLM AgentsScenario-Based BenchmarkAI for Scientific DiscoveryOpenReview

常见合作者