MechLens

LLMs Crystallize Factual Knowledge Late in Layers, Study Finds

Researchers have identified a phenomenon called "Late Crystallization" in large language models, where factual knowledge primarily emerges in the final layers rather than gradually across all layers. This finding, obser…