VideoKR: Towards Knowledge- and Reasoning-Intensive Video Understanding
Lin Fu · Zheyuan Yang · Yang Wang · Tingyu Song · Arman Cohan · Yilun Zhao
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Lin Fu · Zheyuan Yang · Yang Wang · Tingyu Song · Arman Cohan · Yilun Zhao
Xueqing Peng · Lingfei Qian · Yan Wang · Ruoyu Xiang · Yueru He · Yang Ren · Mingyang Jiang · Vincent Jim Zhang · Yuqing Guo · Jeff Zhao · Huan He · Yi Han · Yun Feng · Yuechen Jiang · Yupeng Cao · Haohang Li · Yangyang Yu · Xiaoyu Wang · Penglei Gao · Shengyuan Lin · Keyi Wang · Shanshan Yang · Yilun Zhao · Zhiwei Liu · Peng Lu · Jerry Huang · Suyuchen Wang · Triantafillos Papadopoulos · Polydoros Giannouris · Efstathia Soufleri · Nuo Chen · Zhiyang Deng · Heming Fu · Yijia Zhao · MINGQUAN LIN · Meikang Qiu · Kaleb E Smith · Arman Cohan · Xiao-Yang Liu · Jimin Huang · GUOJUN XIONG · Alejandro Lopez-Lira · Xi Chen · Junichi Tsujii · Jian-Yun Nie · Sophia Ananiadou · Qianqian Xie
Real-world financial analysis involves information across multiple languages and modalities, from reports and news to scanned filings and meeting recordings. Yet most existing evaluations of LLMs in finance remain text-only, monolingual, and largely saturated by current models. To bridge these ga...
Jinbiao Wei · Yilun Zhao · Kangqi Ni · Arman Cohan
End-to-end GUI agents for real desktop environments require large amounts of high-quality interaction data, yet collecting human demonstrations is expensive and existing synthetic pipelines often suffer from limited task diversity or noisy, goal-drifting trajectories. We present a trajectory expa...
Justice Ou · Tinglin Huang · Yilun Zhao · Ziyang Yu · Peiqing Lu · Yifei Shen · Rex Ying
To improve the reliability of Large Language Models (LLMs) in clinical applications, retrieval-augmented generation (RAG) is extensively applied to provide factual medical knowledge. However, beyond general medical knowledge from open-ended datasets, clinical case-based knowledge is also critical...
Sihong Wu · Owen Jiang · Yilun Zhao · Tiansheng Hu · Yiling Ma · Kaiyan Zhang · Manasi Patwardhan · Arman Cohan
Peer review is a multi-stage process involving reviews, rebuttals, meta-reviews, final decisions, and subsequent manuscript revisions. Recent advances in large language models (LLMs) have motivated methods that assist or automate different stages of this pipeline. In this survey, we synthesize te...
Xue Xia · Zheyuan Yang · Arman Cohan · Yilun Zhao
We introduce MMSciCode, a comprehensive expert-level, multilingual multi-discipline benchmark for evaluating foundation models in scientific code generation. It includes 624 expert-annotated research coding problems spanning six core scientific disciplines. Compared to prior benchmarks, MMSciCode...
Chengye Wang · Lin Fu · Zexi Kuang · Yilun Zhao
Existing document OCR largely targets plain text or Markdown, discarding the structural and executable properties that make LaTeX essential for scientific publishing. We study page-level reconstruction of scientific PDFs into compilable LaTeX and introduce TexOCR-Bench, a benchmark, and TexOCR-Tr...
Yilun Zhao · Jinbiao Wei · Tingyu Song · Siyue Zhang · Chen Zhao · Arman Cohan
Reasoning-intensive retrieval aims to surface evidence that maximizes downstream reasoning utility rather than only topical similarity. This capability is increasingly vital for agentic retriever-in-the-loop systems such as Deep-Research. However, existing retriever evaluation benchmarks, exempli...
Yiyang Wei · Tingyu Song · Siyue Zhang · Yilun Zhao
Reasoning-Intensive Retrieval (RIR) targets retrieval settings where relevance is mediated by latent inferential links between a query and supporting evidence, rather than semantic similarity. Motivated by the emergent reasoning abilities of Large Language Models (LLMs), recent work integrates th...
Tianyu Yang · Sihong Wu · Yilun Zhao · Zhenwen Liang · Lisen Dai · Chen Zhao · Minhao Cheng · Arman Cohan · Xiangliang Zhang
Multimodal Mathematical Reasoning (MMR) has recently attracted increasing attention for its capability to solve mathematical problems involving both textual and visual modalities. However, current models still face significant challenges in real-world visual math tasks, often misinterpreting diag...
Ziyu Chen · Yilun Zhao · Chengye Wang · Rilyn R. Han · Manasi Patwardhan · Arman Cohan
Constructing scientific multimodal document reasoning datasets for foundation model training involves an inherent trade-off among scale, faithfulness, and realism. To address this challenge, we introduce the synthesize-and-reground framework, a two-stage pipeline comprising: (1) Claim-Centric QA...
Tingyu Song · yanzhao zhang · Mingxin Li · Zhuoning Guo · Dingkun Long · Pengjun Xie · Siyue Zhang · Yilun Zhao · shu wu
Composed Image Retrieval (CIR) is a pivotal and complex task in multimodal understanding. Current CIR benchmarks typically feature limited query categories and fail to capture the diverse requirements of real-world scenarios. To bridge this evaluation gap, we leverage image editing to achieve pre...
Asaf Yehudai · Lilach Eden · Alan Li · Guy Uziel · Yilun Zhao · Roy Bar-Haim · Arman Cohan · Michal Shmueli-Scheuer
LLM-based agents represent a paradigm shift in AI, enabling autonomous systems to plan, reason, and use tools while interacting with dynamic environments. This paper provides the first comprehensive survey of evaluation methods for these increasingly capable agents. We analyze the field of agent...
Sihong Wu · Yiling Ma · Yilun Zhao · Tiansheng Hu · Owen Jiang · Manasi Patwardhan · Arman Cohan
Large language models (LLMs) are increasingly used across the scientific workflow, including to draft peer-review reports. However, many AI-generated reviews are superficial and insufficiently actionable, leaving authors without concrete, implementable guidance and motivating the gap this work ad...
Zheyuan Yang · Liqiang Shang · Junjie Chen · Xun Yang · Chenglong Xu · Bo Yuan · Chenyuan Jiao · Yaoru Sun · Yilun Zhao
We introduce TableVista, a comprehensive benchmark for evaluating foundation models in multimodal table reasoning under visual and structural complexity. TableVista consists of 3,000 high-quality table reasoning problems, where each instance is expanded into 10 distinct visual variants through ou...
Zhiyuan Hu · Yucheng Wang · Yufei He · Jiaying Wu · Yilun Zhao · See-Kiong Ng · Cynthia Breazeal · Anh Tuan Luu · Hae Won Park · Bryan Hooi
Reinforcement learning (RL) has become a central paradigm for post-training large language models (LLMs), particularly for complex reasoning tasks, yet it often suffers from exploration collapse: policies prematurely concentrate on a small set of dominant reasoning patterns, improving pass@1 whil...