Prune as You Generate: Online Rollout Pruning for Faster and Better RLVR
Haobo Xu · Sirui Chen · Ruizhong Qiu · Yuchen Yan · Chen Luo · Monica Xiao Cheng · Jingrui He · Hanghang Tong
摘要
Reinforcement Learning with Verifiable Rewards (RLVR) has significantly advanced the reasoning capabilities of Large Language Models (LLMs). However, methods such as GRPO and DAPO suffer from substantial computational cost, since they rely on sampling many rollouts for each prompt. Moreover, in R...