Yeongwoo Song

LLMs Spontaneously Develop Physics Representations in Contextual Learning

Researchers have uncovered that large language models (LLMs) spontaneously develop internal representations of physical concepts like energy during in-context learning. By analyzing model activations while forecasting p…