R e P robe: Efficient Test-Time Scaling of Multi-Step Reasoning by Probing Internal States of Large Language Models
Jingwei Ni · Ekaterina Fadeeva · Tianyi Wu · Mubashara Akhtar · Jiaheng Zhang · Elliott Ash · Markus Leippold · Timothy Baldwin · See-Kiong Ng · Artem Shelmanov · Mrinmaya Sachan
摘要
LLMs can solve complex tasks by generating long, multi-step reasoning chains. Test-time scaling (TTS) can further improve LLM performance by sampling multiple variants of intermediate reasoning steps, verifying their correctness, and strategically choosing the best steps for continuation. However...