MRMR: A Realistic and Expert-Level Multidisciplinary Benchmark for Reasoning-Intensive Multimodal Retrieval
Siyue Zhang · Yuan Gao · Xiao Zhou · Yilun Zhao · Tingyu Song · Arman Cohan · Anh Tuan Luu · Chen Zhao
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Siyue Zhang · Yuan Gao · Xiao Zhou · Yilun Zhao · Tingyu Song · Arman Cohan · Anh Tuan Luu · Chen Zhao
Yilun Zhao · Jinbiao Wei · Tingyu Song · Siyue Zhang · Chen Zhao · Arman Cohan
Reasoning-intensive retrieval aims to surface evidence that maximizes downstream reasoning utility rather than only topical similarity. This capability is increasingly vital for agentic retriever-in-the-loop systems such as Deep-Research. However, existing retriever evaluation benchmarks, exempli...
Yiyang Wei · Tingyu Song · Siyue Zhang · Yilun Zhao
Reasoning-Intensive Retrieval (RIR) targets retrieval settings where relevance is mediated by latent inferential links between a query and supporting evidence, rather than semantic similarity. Motivated by the emergent reasoning abilities of Large Language Models (LLMs), recent work integrates th...
Tingyu Song · yanzhao zhang · Mingxin Li · Zhuoning Guo · Dingkun Long · Pengjun Xie · Siyue Zhang · Yilun Zhao · shu wu
Composed Image Retrieval (CIR) is a pivotal and complex task in multimodal understanding. Current CIR benchmarks typically feature limited query categories and fail to capture the diverse requirements of real-world scenarios. To bridge this evaluation gap, we leverage image editing to achieve pre...