paper.dinq.meAI 与前沿科学顶会 · 学术新星雷达
登录 DINQ
返回新星榜
AV

Andre G. Viveiros

COLM 2026多模态多语言与语言学评测与基准
新星分新星
53
一作贡献30
核心/参与0
方向广度6
合作网络6
1 一作 · 1 篇 · COLM 2026

获取完整研究档案

首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。

联系方式

实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。

2026 顶会论文

1
一作COLM 2026Poster· Poster Session 5· Imperial Ballroom· #25

TowerVision: Understanding and Improving Multilinguality in Vision-Language Models

Andre G. Viveiros · Patrick Fernandes · Saul Santos · Sonal Sannigrahi · Emmanouil Zaranis · Nuno M Guerreiro · Amin Farajian · Graham Neubig · Andre Martins

We introduce a VLM that supports image and video called TowerVision, with improved multilingual capabilities explored via several ablations on data, base model, and vision encoders

摘要

Despite rapid progress in vision-language models (VLMs), most existing approaches remain English-centric, often relying on undisclosed training data or recipes, which limits their effectiveness and reproducibility in multilingual settings. In this work, we present a systematic empirical study of how to best incorporate multilinguality across training data, encoder choices, and language models. Our results show that high-quality multilingual vision-language data substantially improve cross-lingual generalization, enabling effective transfer both from high-resource to under-represented languages and in the opposite direction. We further find that language models with strong multilingual priors are often more effective than initializing from general-purpose language models. Guided by these findings, we design TowerVision, a family of open-source multilingual VLMs, built on the multilingual text-only model Tower+. TowerVision-9B achieves competitive performance across a range of multimodal multilingual benchmarks, with particular strength in culturally grounded tasks and multi- modal translation. Notably, our models outperform existing approaches trained on substantially larger datasets, as demonstrated on ALM-Bench and Multi30K. Alongside the models, we release VISIONBLOCKS, a high-quality, curated vision-language dataset.

多模态多语言与语言学评测与基准mutltilingualitylarge language modelvision language modelsmultimodal modelsOpenReview 项目页

常见合作者