Nicholas Popovič

We study how large language models recall relational knowledge during text generation, with a focus on identifying latent representations suitable for relation classification via linear probes.Prior work shows how attention heads and MLPs interact to resolve subject, predicate, and object, but it...