When Data is the Algorithm: A Systematic Study and Curation of Preference Optimization Datasets
Aladin Djuhera · Farhan Ahmed · Swanand Kadhe · Syed Zawad · Heiko Ludwig · Holger Boche
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Aladin Djuhera · Farhan Ahmed · Swanand Kadhe · Syed Zawad · Heiko Ludwig · Holger Boche
Hajar Emami Gohari · Swanand Kadhe · Yousaf Shah · Constantin Adam · Abdulhamid Adebayo · Praneet Adusumilli · Farhan Ahmed · Nathalie Baracaldo · Santosh Borse · Yuan-Chi Chang · Xuan-Hong Dang · Nirmit Desai · Revital Eres · Ran Iwamoto · Alexei Karve · Yan Koyfman · Wei-Han Lee · Changchang Liu · Boris Lublinsky · Takuya Ohko · Pablo Pesce · Maroun Touma · Shiqiang Wang · Shalisha Witherspooon · Herbert Woisetschläger · David Wood · Kun-Lung Wu · Issei Yoshida · Syed Zawad · Petros Zerfos · Yi Zhou · Bishwaranjan Bhattacharjee
Aladin Djuhera · Swanand Ravindra Kadhe · Farhan Ahmed · Syed Zawad · Holger Boche
Fine-tuning large language models (LLMs) is a common practice to adapt generalist models to specialized domains. However, recent studies show that fine-tuning can erode safety alignment, causing LLMs to respond to harmful or unethical prompts. Many methods to realign safety have been proposed, bu...