MAESTRO : Meta-learning Adaptive Estimation of Scalarization Trade-offs for Reward Optimization
yang zhao · Hepeng Wang · Xiao Ding · Yangou Ouyang · Bibo Cai · Kai Xiong · Jinglong Gao · Zhouhao Sun · Li Du · Bing Qin · Ting Liu
摘要
Group-Relative Policy Optimization (GRPO) has emerged as an efficient paradigm for aligning Large Language Models (LLMs), yet its efficacy is primarily confined to domains with verifiable ground truths. Extending GRPO to open-domain settings remains a critical challenge, as unconstrained generati...