一作ACL 2026Workshop· Natural Language Processing
Task Assignment meets Annotator Modeling: Human- LLM Collaborative Annotation with Constraints
Kei Moriyama · Kouta Nakayama · Yukino Baba
摘要
Crowdsourced annotators and Large Language Models (LLMs) offer complementary, cost-effective ways to obtain labeled data, yet ensuring high label quality remains challenging.We observe that task features influence the accuracy of humans and LLMs, while real-world constraints, such as per-annotato...