一作ACL 2026Poster· Natural Language Processing
S ci P edia: Unlocking the Value of Scientific Data for Pre-training
Yiwei Qin · Zhen Huang · Tiantian Mi · Weiye Si · Qipeng Guo · Siyuan Feng · Pengfei Liu
摘要
High-quality scientific data is critical for advancing LLMs, yet academic literature remains largely underutilized. This work addresses the fundamental question: How can we systematically unlock scientific data’s value for pre-training? First, we construct a large-scale raw scientific corpus but...