Rethinking Entropy Interventions in RLVR : An Entropy Change Perspective
Zhezheng Hao · Hong Wang · Haoyang Liu · Jian Luo · Jiarui Yu · Hande Dong · Qiang Lin · Can Wang · Jiawei Chen
摘要
Reinforcement Learning with Verifiable Rewards (RLVR) serves as a cornerstone technique for enhancing the reasoning capabilities of Large Language Models (LLMs). However, its training is often plagued by entropy collapse , a rapid decline in policy entropy that limits exploration and undermines t...