Ted-Tok: Maintaining an Evolving Vocabulary for Lifelong Learning
Jiameng Huang · Zhi Zhang · Zhenyu He · Jiacheng Sun · Di He
摘要
Lifelong learning investigates how models adapt when exposed to a potentially infinite stream of data. Most conventional approaches focus on updating model parameters (i.e., the neural network weights) as the underlying data distribution evolves over time. However, in natural language processing,...