paper.dinq.meAI 与前沿科学顶会 · 学术新星雷达
登录 DINQ
返回新星榜
XP

XIANGYU PENG

ICLR 2026×2ACL 2026COLM 2026检索与知识智能体与工具多模态强化学习与后训练数据与预训练
新星分新星
77
一作贡献30
核心/参与22
方向广度16
合作网络12
1 一作 · 4 篇 · ICLR 2026 / ACL 2026 / COLM 2026

获取完整研究档案

首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。

联系方式

实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。

2026 顶会论文

4
一作COLM 2026Poster· Poster Session 4· Imperial Ballroom· #25

MTA-Agent: An Open Recipe for Multimodal Deep Search Agents

XIANGYU PENG · Can Qin · An Yan · Xinyi Yang · Ran Xu · Zeyuan Chen · Chien-Sheng Wu

We release a fully open recipe—data, trajectories, and training—for multimodal deep search agents, enabling open models to surpass closed systems.

摘要

Multimodal large language models (MLLMs) have demonstrated strong capabilities in visual understanding, yet they remain limited in complex, multi-step reasoning that requires deep searching and integrating visual evidence with external knowledge. In this work, we address this challenge by constructing high-quality, verified multi-hop vision-language training data for multimodal deep-search agents. We propose a **Multi-hop Tool-Augmented Agent for Evidence-based QA Synthesis (MTA-Agent)**, which automatically selects tools and their parameters to retrieve and validate evidence from both visual and textual sources and generates structured multi-hop question–answer trajectories. Starting from diverse VQA seed datasets, our pipeline produces a large-scale training dataset, **MTA-Vision-DeepSearch**, containing 21K high-quality multi-hop examples. The data is filtered through a multi-stage verification process to ensure factual consistency and answer uniqueness. Using MTA-Vision-DeepSearch, a 32B open-source multimodal search agent achieves state-of-the-art performance, reaching an average of **54.63%** across six challenging benchmarks, outperforming GPT-5 (51.86%), Gemini-2.5-Pro (50.98%), and Gemini-3-Pro (54.46%) under the same tool settings. We further show that training on our data improves both reasoning depth and tool-use behavior, increasing the average number of steps from 2.27 to 4.28, and leading to more systematic and persistent search strategies. Additionally, we demonstrate that training can be performed without real-time tool calls by replaying cached interactions, significantly reducing training cost. Importantly, we present MTA-Agent as a fully open recipe for multimodal deep search: we release the entire dataset, training trajectories, and implementation details to enable reproducibility and future research on open multimodal search agents.

检索与知识智能体与工具多模态Multimodal Deep SearchMLLMsMulti-hop ReasoningTool-Augmented AgentsOpenReview
作者位次 #7/8ACL 2026Poster· ACL Industry Track

Don’t Stop Early: Scalable Enterprise Deep Research with Controlled Information Flow and Evidence-Aware Termination

Prafulla Kumar Choubey · Kung-Hsiang Huang · Pranav Narayanan Venkit · Jiaxin Zhang · Vaibhav Vats · Yu Li · XIANGYU PENG · Chien-Sheng Wu

摘要

Enterprise deep research often fails to produce decision-ready reports due to uneven information coverage, context explosion, and premature stopping. We propose a scalable Enterprise Deep Research (EDR) architecture to address these failures. Our system (i) decomposes requests into coverage-drive...

评测与基准智能体与工具检索与知识OpenReview 项目页

常见合作者