一作ACL 2026Findings· Findings of ACL
Exploiting Tree Structure for Credit Assignment in Reinforcement Learning with Large Language Models
Hieu Tran · Zonghai Yao · Hong Yu
摘要
Reinforcement learning has shown strong promise for strengthening the reasoning ability of large language models (LLMs), but sparse, delayed rewards over long chains make token-level credit assignment a central challenge. Actor–critic methods like PPO provide token-level credit but require traini...