Will it Merge? On The Causes of Model Mergeability
Adir Rahamim · Asaf Yehudai · Boaz Carmeli · Leshem Choshen · Yosi Mass · Yonatan Belinkov
摘要
Model merging has emerged as a promising technique for combining multiple fine-tuned models into a single multitask model without retraining. However, the factors that determine whether merging will succeed or fail remain poorly understood. In this work, we investigate why specific models are mer...