Alexander Berdnikov

Large language models show surprising night sky map representations

Researchers have discovered that large language models, specifically those around 100 billion parameters, can encode a representation of the night sky map. This representation is decodable from the model's residual stre…