paper.dinq.meAI 与前沿科学顶会 · 学术新星雷达
登录 DINQ
返回新星榜
SY

Shoubin Yu

COLM 2026CVPR 2026ICML 2026多模态评测与基准推理智能体与工具
新星分新星
70
一作贡献30
核心/参与10
方向广度14
合作网络12
1 一作 · 3 篇 · COLM 2026 / CVPR 2026 / ICML 2026

获取完整研究档案

首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。

联系方式

实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。

2026 顶会论文

3
作者位次 #3/9COLM 2026Poster· Poster Session 2· Imperial Ballroom· #71

EgoMemReason: A Memory-Driven Reasoning Benchmark for Long-Horizon Egocentric Video Understanding

Ziyang Wang · Yue Zhang · Shoubin Yu · Ce Zhang · Zengqi Zhao · Jaehong Yoon · Hyunji Lee · Gedas Bertasius · Mohit Bansal

EgoMemReason evaluates memory-driven reasoning over week-long egocentric videos across entity, event, and behavior memory.

摘要

Next-generation visual assistants, such as smart glasses, embodied agents, and always-on life-logging systems, must reason over an entire day or more of continuous visual experience. In ultra-long videos, relevant information is sparsely distributed across hours or days, making memory a fundamental challenge: models must accumulate information over time, recall prior states, track temporal order, and abstract recurring patterns. However, existing week-long video benchmarks are primarily designed for perception and recognition, such as moment localization or global summarization, rather than reasoning that requires integrating evidence across multiple days. To address this gap, we introduce **EgoMemReason**, a comprehensive benchmark for week-long egocentric video understanding through memory-driven reasoning. EgoMemReason evaluates three complementary memory types: **entity memory**, tracking how object states evolve and change across days; **event memory**, recalling and ordering activities separated by hours or days; and **behavior memory**, abstracting recurring patterns from sparse, repeated observations over the whole week period. EgoMemReason comprises 500 questions across three memory types and six core challenges, with an average of 5.1 video segments of evidence per question and 25.9 hours of memory backtracking. We evaluate EgoMemReason on 17 methods across MLLMs and agentic frameworks, revealing that even the best model achieves only 39.6% overall accuracy. Further analysis shows that the three memory types fail for distinct reasons and that performance degrades as evidence spans longer temporal horizons, revealing that long-horizon memory remains far from solved. We believe EgoMemReason establishes a strong foundation for evaluating and advancing long-context, memory-aware multimodal systems.

多模态评测与基准推理Long Video UnderstandingVideo-Language UnderstandingMultimodal MemoryOpenReview 项目页

常见合作者