paper.dinq.meAI 与前沿科学顶会 · 学术新星雷达
登录 DINQ
返回新星榜
JH

Junzhe Huang

COLM 2026ICLR 2026推理多模态评测与基准智能体与工具
新星分新星
65
一作贡献30
核心/参与5
方向广度11
合作网络12
1 一作 · 2 篇 · COLM 2026 / ICLR 2026

获取完整研究档案

首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。

联系方式

实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。

2026 顶会论文

2
一作COLM 2026Poster· Poster Session 3· Imperial Ballroom· #60

WildTableBench: Benchmarking Multimodal Foundation Models on Table Understanding In the Wild

Junzhe Huang · Xiaoxiao Sun · Yan Yang · Yuxuan Hou · Ruotian Zhang · Sirui Li · Hehe Fan · Serena Yeung-Levy · Xin Yu

This paper presents WildTableBench, a question-answering benchmark dedicated to naturally occurring, real-world table images, and shows that current multimodal foundation models still struggle substantially with practical table image understanding.

摘要

Using multimodal foundation models to analyze table images is a high-value yet challenging application in consumer and enterprise scenarios. Despite its importance, current evaluations rely largely on structured-text tables or clean rendered images, leaving the visual complexity of \emph{in-the-wild} table images underexplored. Such images feature varied layouts and diverse domains that demand sophisticated structural perception and numerical reasoning. To bridge this gap, we introduce WildTableBench, a question-answering benchmark dedicated to naturally occurring table images from real-world settings. WildTableBench comprises 402 high-information-density table images collected from online forums and websites across diverse domains, together with 928 manually annotated and verified questions spanning 17 subtypes across five categories. We evaluate 21 frontier proprietary and open-source multimodal foundation models on this benchmark. Only one model exceeds 50\% accuracy, while all remaining models range from 4.0\% to 49.8\%. We further conduct diagnostic analyses to characterize model failures and reveal persistent weaknesses in structural perception and reasoning. These results and analyses provide useful insights into current model capabilities and establish WildTableBench as a valuable diagnostic benchmark for table image understanding.

多模态评测与基准推理Table Image UnderstandingMultimodal Foundation ModelsReal-World Table VQAOpenReview

常见合作者