Entropy-Aware On-Policy Distillation of Language Models
Woogyeol Jin · Taywon Min · Yongjin Yang · Dennis Wei · Yi Zhou · Swanand Kadhe · Nathalie Baracaldo · Kimin Lee
首次获取该候选人的完整档案及 StartLux 评估共 20 积分;每位用户单独解锁,之后查看免费。主动刷新 20 积分。
实时查找电子邮箱,费用不超过20积分;未找到邮箱不扣费。
Woogyeol Jin · Taywon Min · Yongjin Yang · Dennis Wei · Yi Zhou · Swanand Kadhe · Nathalie Baracaldo · Kimin Lee
Amit Dhurandhar · Vijil Chenthamarakshan · Dennis Wei · Tejaswini Pedapati · Karthikeyan Natesan Ramamurthy · Rahul Nair
Zirui Yan · Dennis Wei · Dmitriy A Katz · Prasanna Sattigeri · Ali Tajer
Causal tracing systematically intervenes on a large language model’s (LLM’s) internal representations to uncover and quantify the causal pathways linking specific inputs or computations to specific metrics of interest, quantifying the LLM’s behavior. Building on previous single-component or singl...
Erik Miehling · Karthikeyan Natesan Ramamurthy · Praveen Venkateswaran · Ching-Yun Ko · Pierre Dognin · Moninder Singh · Tejaswini Pedapati · Avinash Balakrishnan · Matthew Riemer · Dennis Wei · Inge Vejsbjerg · Elizabeth M. Daly · Kush R. Varshney
The AI Steerability 360 toolkit is an extensible, open-source Python library for steering LLMs. Steering abstractions are designed around four model control surfaces: input (modification of the prompt), structural (modification of the model’s weights or architecture), state (modification of the m...