Function vectors
PulseAugur coverage of Function vectors — every cluster mentioning Function vectors across labs, papers, and developer communities, ranked by signal.
1 day(s) with sentiment data
-
Linguistic structure impacts LLM in-context learning effectiveness
A new research paper explores how linguistic structure influences the effectiveness of in-context learning (ICL) in large language models. The study found that certain linguistic operations, like forward inflection, can…
-
New research explores emotion detection in LLMs across layers and languages
Researchers are exploring new methods to enhance emotion detection in large language models (LLMs) by investigating how emotions are represented across different layers and languages. One study examines emotion expressi…
-
Study finds function vectors in LLMs are largely language-agnostic for translation
Researchers have investigated whether function vectors (FVs), which represent tasks extracted from model activations during in-context learning, are language-agnostic. Using machine translation as a case study across th…
-
New Theory Explains Deep Transformer Inference Mechanisms
Researchers have developed a new theory explaining the internal workings of deep transformers, viewing them as mean-field interacting systems that perform distributed inference. This theory introduces 'function vectors'…
-
New method improves LLM steering with function vectors
Researchers have developed a new method for creating function vectors (FVs) to steer Large Language Models (LLMs) during in-context learning. The study explores variations in FV definitions, focusing on attention head s…