一作ACL 2026Findings· Findings of ACL
Decoding the Multimodal Mind: Generalizable Brain-to-Text Translation via Multimodal Alignment and Adaptive Routing
Chunyu Ye · Yunhao Zhang · Jingyuan Sun · Chong Li · Yang Zhao · Shaonan Wang
摘要
Decoding language from the human brain remains a grand challenge for Brain-Computer Interfaces (BCIs). Current approaches typically rely on unimodal brain representations, neglecting the brain’s inherently multimodal processing. Inspired by the brain’s associative mechanisms, where viewing an ima...