一作NeurIPS 2026Poster
AgentLens: Revealing The Lucky Pass Problem in SWE-Agent Evaluation
Priyam Sahoo · Gaurav Mittal · Xiaomin Li · Shengjie Ma · Benjamin Steenhoek · Pingping Lin · Yu Hu
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Priyam Sahoo · Gaurav Mittal · Xiaomin Li · Shengjie Ma · Benjamin Steenhoek · Pingping Lin · Yu Hu
Parisa Rabbani · Priyam Sahoo · Ruben Mathew · Aishee Mondal · Harshita Ketharaman · Nimet Beyza Bozdag · Dilek Hakkani-Tür
LLMs are increasingly used as third-party judges, yet their reliability when evaluating speakers in dialogue remains poorly understood. We show that LLMs judge identical claims differently depending on framing: the same content receives different verdicts when presented as a statement to verify (...