GPT2
PulseAugur coverage of GPT2 — every cluster mentioning GPT2 across labs, papers, and developer communities, ranked by signal.
3 day(s) with sentiment data
-
New research quantifies agreement between data-influence and data-similarity in LLMs
Researchers have quantified the agreement between data-similarity and data-influence measures used to trace LLM outputs back to their training data. Their findings indicate a significant overlap between the two measures…
-
AI Model Time Horizon Projections Show Continued Improvement Trend
A user on Reddit's r/singularity subreddit has used Claude to project forward the time horizon data for AI models, based on historical trends from METR. The current leading model, Mythos, has a task completion time hori…
-
New AI Models Emerge: DiffusionGemma, Qwopus, Hive, and More
Several AI models have been released or highlighted across various platforms. DiffusionGemma 26B-A4B is noted for its parallel text processing capabilities, while Qwopus 3.6 27b-Coder is now available. Additionally, Hiv…
-
PolySAE enhances AI interpretability by modeling feature interactions
Researchers have developed PolySAE, a novel method to enhance sparse autoencoders (SAEs) by modeling feature interactions. Unlike traditional SAEs that assume additive feature combinations, PolySAE incorporates higher-o…
-
New frameworks boost Transformer inference efficiency across devices
Researchers have developed new methods to improve the efficiency of Transformer model inference across multiple devices. One approach, ASTRA, integrates sequence parallelism with mixed-precision attention to reduce inte…
-
Eugene Yan curates essential language modeling papers for study groups
Eugene Yan has compiled a reading list of fundamental language modeling papers, intended to facilitate group study sessions. The list includes seminal works like "Attention Is All You Need," "BERT," and "GPT-3," each ac…