A follow-up project visualizes the vocabulary of the GPT-2 model as a hyperbolic tree, containing 32,070 tokens within a navigable Poincaré disk. This interactive visualization, runnable on mobile devices, uses token embeddings from GPT-2-small and naturally maps the tree-like structure of word similarities in hyperbolic space. Users can explore the data by rotating, zooming, and tapping tokens to recenter the view, revealing relationships such as the days of the week or specific connections like 'Trump' and 'Ivanka'. The entire visualization is contained within a single, client-side HTML file. AI
IMPACT Provides a novel way to explore and understand the internal structure of language models.
RANK_REASON The item describes a visualization of an existing model's internal structure, which falls under research or other non-core AI release categories. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →
