Content-Style Identification via Differential Independence
Subash Timilsina · Hoang-Son Nguyen · Sagar Shrestha · Xiao Fu
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Subash Timilsina · Hoang-Son Nguyen · Sagar Shrestha · Xiao Fu
Sagar Shrestha · Subash Timilsina · Hoang-Son Nguyen · Xiao Fu
Quoc Phong Dao · Hoang-Son Nguyen · Pham Khanh Chi · Linh Ngo Van · Nguyen Thi Ngoc Diep · Thien Huu Nguyen · Trung Le
Knowledge Distillation (KD) has established itself as a pivotal technique for compressing large pre-trained language models. However, existing methods that force a student to strictly mimic the teacher’s sentence embeddings or internal features often incur prohibitive computational costs and yiel...
Quoc Phong Dao · Hoang-Son Nguyen · Pham Khanh Chi · Tung Nguyen · Linh Ngo Van · Nguyen Thi Ngoc Diep · Trung Le
Cross-Tokenizer Knowledge Distillation (CTKD) enables knowledge transfer between a large language model and a smaller student, even when they employ different tokenizers. While existing approaches mainly focus on token-level alignment strategies, which are often brittle and sensitive to discrepan...