SOP -Maze: Evaluating Large Language Models on Complicated Business Standard Operating Procedures
Jiaming Wang · Zhe Tang · Zehao Jin · Hefei Chen · Yilin Jin · Peng Ding · Xiaoyu Li · Xuezhi Cao
摘要
As large language models (LLMs) are widely deployed as domain-specific agents, many benchmarks have been proposed to evaluate their ability to follow instructions and make decisions in real-world scenarios. However, business scenarios often involve complex standard operating procedures (SOPs), an...