paper.dinq.meAI 与前沿科学顶会 · 学术新星雷达
登录 DINQ
返回新星榜
CS

Chantal Shaib

COLM 2026评测与基准对齐与偏好可解释性
新星分新星
56
一作贡献30
核心/参与0
方向广度6
合作网络9
1 一作 · 1 篇 · COLM 2026

获取完整研究档案

首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。

联系方式

实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。

2026 顶会论文

1
一作COLM 2026Poster· Poster Session 1· Grand Ballroom· #117

Measuring AI "Slop" in Text

Chantal Shaib · Tuhin Chakrabarty · Diego Garcia-Olano · Byron C Wallace

We present a taxonomy/annotations and evaluate automatic methods for detecting "slop" in AI-generated text.

摘要

AI "slop" is an increasingly popular term used to describe low-quality AI-generated text, but there is currently no agreed upon definition of this term nor a means to measure its occurrence. In this work, we develop a taxonomy of "slop" through interviews with experts in NLP, writing, and philosophy, and propose a set of interpretable dimensions for its assessment in text. Through span-level annotation, we find that binary ``slop'' judgments are (somewhat) subjective, but such determinations nonetheless correlate with latent dimensions such as coherence and relevance. Our framework can be used to examine AI-generated text in both detection and binary preference tasks, potentially offering new insights into the linguistic and stylistic factors that contribute to quality judgments. We highlight that fully automated and scalable methods remain an open challenge.

评测与基准对齐与偏好可解释性evaluationautomatic measuresOpenReview

常见合作者