一作ACL 2026Workshop· ACL System Demonstrations
M ixture K it: A General Framework for Composing, Training, and Visualizing Mixture-of-Experts Models
Ahmad Chamma · Omar El Herraoui · Guokan Shang
摘要
We introduce MixtureKit, a modular open-source framework for constructing, training, and analyzing Mixture-of-Experts (MoE) models from arbitrary pre-trained or fine-tuned checkpoints. MixtureKit supports three complementary strategies: (i) Traditional MoE, using a single router per transformer b...