GameDevBench: Evaluating Agentic Capabilities Through Game Development
Wayne Chi · Yixiong Fang · Arnav Yayavaram · Siddharth Yayavaram · Seth Karten · Qiuhong Anna Wei · Runkun Chen · Alexander Wang · Valerie Chen · Ameet Talwalkar · Chris Donahue
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Wayne Chi · Yixiong Fang · Arnav Yayavaram · Siddharth Yayavaram · Seth Karten · Qiuhong Anna Wei · Runkun Chen · Alexander Wang · Valerie Chen · Ameet Talwalkar · Chris Donahue
Valerie Chen · Rohit Malhotra · Xingyao Wang · Juan Michelini · Xuhui Zhou · Aditya Bharat Soni · Hoang Tran · Calvin Smith · Ameet Talwalkar · Graham Neubig
Xuhui Zhou · Valerie Chen · Zhiruo Wang · Graham Neubig · Maarten Sap · Xingyao Wang
Shannon Zejiang Shen · Valerie Chen · Ken Gu · Alexis Ross · Zixian Ma · Jillian Ross · Alex Gu · Chenglei Si · Wayne Chi · Andi Peng · Jocelyn J. Shen · Ameet Talwalkar · Tongshuang Wu · David Sontag
Current evaluations of agents remain centered around one-shot task completion, failing to account for the inherently iterative and collaborative nature of many real-world problems, where human goals are often underspecified and evolve. We argue for a shift from building and assessing task complet...
Valerie Chen · Ameet Talwalkar · Robert Brennan · Graham Neubig