Function vectors
PulseAugur coverage of Function vectors — every cluster mentioning Function vectors across labs, papers, and developer communities, ranked by signal.
-
Study finds function vectors in LLMs are largely language-agnostic for translation
Researchers have investigated whether function vectors (FVs), which represent tasks extracted from model activations during in-context learning, are language-agnostic. Using machine translation as a case study across th…
-
New Theory Explains Deep Transformer Inference Mechanisms
Researchers have developed a new theory explaining the internal workings of deep transformers, viewing them as mean-field interacting systems that perform distributed inference. This theory introduces 'function vectors'…
-
New method improves LLM steering with function vectors
Researchers have developed a new method for creating function vectors (FVs) to steer Large Language Models (LLMs) during in-context learning. The study explores variations in FV definitions, focusing on attention head s…