作者位次 #3/7ACL 2026Poster· Natural Language Processing
How Can Synthetic Data Improve Multilingual Language Model Pretraining? A Data Quality Perspective
Tongyao Zhu · Qian Liu · Chang Ma · Jinghan Zhang · Longxu Dou · Junxian He · Shiqi Chen
摘要
Low-resource languages challenge multilingual LLMs due to limited high-quality training data, leading to weaker performance on complex reasoning and knowledge tasks. To address this, we propose improving training data quality through data synthesis, moving beyond simple resource scaling. First, w...