T ^\star : Progressive Block Scaling for Masked Diffusion Language Models Through Trajectory Aware Reinforcement Learning
Hanchen Xia · Baoyou Chen · Yutang Ge · Guojiang Zhao · Siyu Zhu
摘要
We present T ^\star , a simple TraceRL-based curriculum for progressive block-size scaling in masked diffusion language models (MDMs).Starting from an AR-initialized small-block MDM, T ^\star gradually increases the block size while re-optimizing the denoising policy at each stage, enabling highe...