Reinforcement Learning for Diffusion LLM s via Energy-Based G ibbs Alignment
Yijia Fan · Jing Yang · Mingyu Liu · Kaitong Cai · Jian Wang · Keze Wang · jusheng zhang
摘要
Diffusion Large Language Models (dLLMs) have emerged as a promising non-autoregressive paradigm for text generation, offering parallel decoding and bidirectional context modeling. However, aligning dLLMs with reinforcement learning (RL) remains a significant challenge, as the marginal likelihood...