Learning Diverse Responses with Prefix-Conditioned Supervised Fine-Tuning
Zhiyuan Fan · Guanqiao Chen · Yanyi Huang · Mingkuan Zhao · Dadi Guo · Yi R. Fung
摘要
Large language models (LLMs) have shown strong performance on hard reasoning and general instruction-following tasks. However, when sampling multiple outputs for the same prompt, they often produce highly homogeneous, repetitive responses, resulting in inefficient exploration. This limits the gai...