一作ACL 2026Poster· Natural Language Processing
How Tokenization Limits Phonological Knowledge Representation in Language Models and How to Improve Them
Disen Liao · Freda Shi
摘要
Tokenization is the first step in every language model (LM), yet it never takes the sounds of words into account. We investigate how tokenization influences text-only LMs’ ability to represent phonological knowledge. Through a series of probing experiments, we show that subword-based tokenization...