Alex Ning

LLM latent space geometry visualized using PCA and UMAP

Researchers have developed new methods to visualize the internal geometric structures of large language models (LLMs) by employing dimensionality reduction techniques like PCA and UMAP. Their analysis of GPT-2 and LLaMa…