Todd et al.

LLM function-vector heads split into 'writers' and 'cancellers'

Researchers have identified two distinct populations within function-vector (FV) heads in large language models, challenging the assumption that these heads are a homogeneous group. By employing a sign-preserving criter…