Multi-component Causal Tracing in Large Language Models
Zirui Yan · Dennis Wei · Dmitriy A Katz · Prasanna Sattigeri · Ali Tajer
摘要
Causal tracing systematically intervenes on a large language model’s (LLM’s) internal representations to uncover and quantify the causal pathways linking specific inputs or computations to specific metrics of interest, quantifying the LLM’s behavior. Building on previous single-component or singl...