paper.dinq.meAI 与前沿科学顶会 · 学术新星雷达
登录 DINQ
返回新星榜
HN

HyunJi Nam

COLM 2026×2ACL 2026ICLR 2026社会与人本推理对齐与偏好评测与基准智能体与工具
新星分新星
87
一作贡献70
核心/参与17
方向广度16
合作网络9
2 一作 · 4 篇 · COLM 2026 / ACL 2026 / ICLR 2026

获取完整研究档案

首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。

联系方式

实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。

2026 顶会论文

4
作者位次 #2/3COLM 2026Poster· Poster Session 2· Imperial Ballroom· #48

Can Large Language Models Match Human Diversity in Educational Content Generation?

Mei Tan · HyunJi Nam · Dorottya Demszky

LLMs generate more homogeneous math problems and essay feedback than humans, amplifying the most common instructional routines while underrepresenting ambitious teaching.

摘要

Large language models (LLMs) are known to lack diversity in open-ended text generation, a limitation that is especially consequential in education, where homogeneity can narrow the kinds of thinking and disciplinary work students are invited to do. We study diversity in two educational generation tasks: math items and essay feedback. We compare frontier and open-weight models with human-authored reference distributions using lexical, semantic, and domain-grounded measures. For math, we examine the mathematical activities students are asked to perform; for feedback, we examine the revision work requested and the rhetorical strategies used to communicate it. We evaluate direct prompting, two diversity prompting methods, and post-training. Across both tasks, directly prompted model outputs are markedly less diverse than human-authored content---78% higher on lexical (Self-BLEU) and 51% higher on semantic (embedding) similarity---and represent a narrower range of instructional forms. Diversity prompting and post-training increase variation largely through surface features without broadening the instructional repertoire. Models inherit and amplify the most normative routines of human instruction. Overcoming mode collapse in education will require richer instructional data and investment in teachers’ creative capacity and professional judgment.

社会与人本评测与基准推理educational llmssocial applicationsmode collapsediversity evaluationOpenReview
一作COLM 2026Poster· Poster Session 6· Franciscan C· #97

Mitigating LLM biases toward spurious social contexts using direct preference optimization

HyunJi Nam · Dorottya Demszky

We propose a method to improve LLM robustness to spurious social contexts in prompt-based prediction tasks, grounded in a case study of instructional assessment using a largest publicly available classroom transcript dataset.

摘要

LLMs are increasingly used for high-stakes decision-making, yet their sensitivity to spurious contextual information can introduce harmful biases. This is a critical concern when models are deployed for tasks like evaluating teachers' instructional quality, where biased assessment can affect teachers' professional development and career trajectories. We investigate model robustness to spurious social contexts using the largest publicly available dataset of U.S. classroom transcripts (NCTE) paired with expert rubric scores. Evaluating seven frontier and open-weight models across seven categories of spurious contexts -- including teacher experience, education level, demographic identity, and sycophancy-inducing framings -- we find that irrelevant contextual information can shift model predictions by up to 1.48 points on a 7-point scale, with larger models sometimes exhibiting greater sensitivity despite higher predictive accuracy. Mitigations using prompts and standard direct preference optimization (DPO) prove largely insufficient. We propose **Debiasing-DPO**, a self-supervised training method that pairs neutral reasoning generated from the query alone, with the model's biased reasoning generated with both the query and additional spurious context. We further combine this objective with supervised fine-tuning on ground-truth labels to prevent losses in predictive accuracy. Applied to Llama 3B \& 8B and Qwen 3B \& 7B Instruct models, Debiasing-DPO reduces bias by 84\% and improves predictive accuracy by 52\% on average. Our findings from the educational case study highlight that robustness to spurious context is not a natural byproduct of model scaling and that our proposed method can yield substantial gains in both accuracy and robustness for prompt-based prediction tasks.

对齐与偏好社会与人本推理LLM for social applicationsLLMs for educationrobustness against spurious social contextsprompt-based prediction tasksOpenReview
作者位次 #5/10ACL 2026Workshop· ACL System Demonstrations

E du C oder: An Open-Source Annotation System for Education Transcript Data

Saad Ashraf · Jim Malamut · Vishal Kumar · Guanzhong Pan · HyunJi Nam · Mei Tan · Lucía Langlois · Liliana Carolina Santos-Deonizio · Helen Spencer Higgins · Dorottya Demszky

摘要

We present EduCoder, an open-source web platform designed for annotating classroom conversation transcripts. Existing annotation tools do not support the team-based workflows or access to instructional context that education discourse research requires. EduCoder addresses these gaps by combining...

社会与人本多模态检索与知识OpenReview 项目页

常见合作者