Taming Extreme Tokens: Covariance-Aware GRPO with G aussian-Kernel Advantage Reweighting
Cheng Wang · Qin Liu · Wenxuan Zhou · Muhao Chen
摘要
Group Relative Policy Optimization (GRPO) has emerged as a promising approach for improving the reasoning capabilities of large language models. However, it struggles to effectively balance the trade-off between exploration and exploitation during training, often resulting in suboptimal performan...