JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors
Jiho Jin · Junho Myung · Juhyun Oh · Junyeong Park · Rifki A Putri · Sunipa Dev · Vinodkumar Prabhakaran · Alice Oh
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Jiho Jin · Junho Myung · Juhyun Oh · Junyeong Park · Rifki A Putri · Sunipa Dev · Vinodkumar Prabhakaran · Alice Oh
Eunsu Kim · Junyeong Park · Juhyun Oh · Kiwoong Park · Seyoung Song · A. Seza Doğruöz · Alice Oh · Najoung Kim
As LLMs are increasingly deployed in real-world interactions, their social reasoning in interpersonal communication becomes critical. To explore their capabilities, we introduce SCRIPTS, a 1.1k-dialogue dataset in English and Korean, sourced from movie scripts and propose a social reasoning task...
Juhyun Oh · Haneul Yoo · Faiz Ghifari Haznitrama · Alice Oh
Code-switching, alternating between languages within a conversation, is natural for multilingual users, yet poses fundamental challenges for large language models (LLMs). When a user code-switches in their prompt to an LLM, they typically do not specify the expected language of the LLM response,...
Jisu Shin · Hoyun Song · Juhyun Oh · Changgeon Ko · Eunsu Kim · Chani Jung · Alice Oh
People often encounter role conflicts—social dilemmas where the expectations of multiple roles clash and cannot be simultaneously fulfilled. As large language models (LLMs) increasingly navigate these social dynamics, a critical research question emerges. When faced with such dilemmas, do LLMs pr...