Prefix Executability: Evaluating Tool-Using Agents Beyond Final Success
Amir H. Rezaeian · Weiyi Sun · Yassine Benajiba · Dan Roth
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Amir H. Rezaeian · Weiyi Sun · Yassine Benajiba · Dan Roth
Jyotika Singh · Fang Tu · Miguel Ballesteros · Weiyi Sun · Sandip Ghoshal · Michelle Yuan · Yassine Benajiba · Sujith Ravi · Dan Roth
Large language models (LLMs) suffer significant performance degradation when user instructions and context are distributed over multiple conversational turns, yet multi-turn (MT) interactions dominate chat interfaces. The routine approach of appending full chat history to prompts rapidly exhausts...
Sandip Ghoshal · Anshul Mittal · Jyotika Singh · Miguel Ballesteros · Weiyi Sun · Fang Tu · Shailender Singh · Yassine Benajiba · Syed Fahad Allam Shah · Sujeeth Bharadwaj · Sujith Ravi · Dan Roth
Large language model (LLM) agents augmented with external tools often struggle as number of tools grow large and become domain-specific. In such settings, ambiguous tool descriptions and under-specified agent instructions frequently lead to tool mis-selection and incorrect slot/value instantiatio...
Sadat Shahriar · Zheng Qi · Nikolaos Pappas · Srikanth Doss · Kishaloy Halder · Monica Sunkara · Manuel Mager · Yassine Benajiba
Aligning Large Language Models (LLM) to address subjectivity and nuanced preference levels requires adequate flexibility and control, which can be a resource-intensive and time-consuming procedure. Existing training-time alignment methods require full re-training when a change is needed and infer...