作者位次 #2/7ACL 2026Poster· Natural Language Processing
M o C a: Modality-aware Continual Pre-training Makes Better Bidirectional Multimodal Embeddings
Haonan Chen · Hong Liu · Yuping Luo · Liang Wang · Nan Yang · Furu Wei · Zhicheng Dou
摘要
Multimodal embedding models, built upon causal Vision Language Models (VLMs), have shown promise in various tasks. However, current approaches face three limitations: causal attention in VLM backbones is suboptimal for embedding tasks; scalability issues due to reliance on high-quality labeled pa...