paper.dinq.meAI 与前沿科学顶会 · 学术新星雷达
登录 DINQ
返回新星榜
MN

Mahdi Namazifar

COLM 2026推理智能体与工具评测与基准
新星分贡献者
22
一作贡献0
核心/参与5
方向广度6
合作网络3
0 一作 · 1 篇 · COLM 2026

获取完整研究档案

首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。

联系方式

实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。

2026 顶会论文

1
作者位次 #13/15COLM 2026Poster· Poster Session 1· Imperial Ballroom· #32

CreativityBench: Evaluating Creative Reasoning via Affordance-Based Tool Repurposing

Cheng Qian · Hyeonjeong Ha · Jiayu Liu · Bingxiang He · Jeonghwan Kim · Jiateng Liu · Bingxuan Li · Aditi Tiwari · Dwip Dalal · Zhenhailong Wang · Xiusi Chen · Aleksey Panasyuk · Mahdi Namazifar · Yunzhu Li · Heng Ji

We introduce CreativityBench, a benchmark for evaluating agents' affordance-based creativity in tool repurposing.

摘要

Recent advances in large language models (LLMs) have enabled strong performance in reasoning and environment-interaction, yet their ability for creative problem solving remains underexplored. One core form of such creativity is *tool use*: repurposing objects by reasoning about their affordances and attributes rather than relying on canonical usage. To study this capability, we introduce **CreativityBench**, a benchmark for affordance-based creative tool use. It is built on a large-scale affordance knowledge base containing 4K entities and 150K+ annotations linking objects, parts, attributes, and uses, from which we generate 14K grounded tasks requiring non-obvious but physically plausible solutions under constraints. Evaluation across 10 closed and open-source LLMs reveal a consistent gap: while models often select plausible objects, they fail to identify the correct parts, affordances, and underlying physical mechanism. Moreover, general reasoning ability does not reliably transfer to creative affordance discovery, gains from scaling quickly saturate, and Chain-of-Thought yields limited benefit. These findings highlight creative tool use as a missing dimension in current LLMs capabilities, and position CreativityBench as a systematic testbed for advancing creative intelligence in future LLMs and embodied agents.

推理智能体与工具评测与基准creative intelligencecreative reasoningevaluationLLM agentOpenReview

常见合作者