Diffusion language models
PulseAugur coverage of Diffusion language models — every cluster mentioning Diffusion language models across labs, papers, and developer communities, ranked by signal.
4 day(s) with sentiment data
-
New 7B Uniform Diffusion Language Model 'Sumi' Released, Alongside Diffusion Model Advancements
Researchers have introduced Sumi, a 7-billion parameter uniform diffusion language model (UDLM) pretrained from scratch on 1.5 trillion tokens. This open-source model demonstrates competitive performance against autoreg…
-
TimpaTeks enables in-place text modification with diffusion language models
Researchers have developed TimpaTeks, a new method for modifying text in-place using diffusion language models (DLMs). This technique allows for concept steering within existing text sequences without requiring instruct…
-
New methods boost diffusion language model decoding speed and quality
Researchers are developing new methods to improve the decoding process for diffusion language models (DLMs), which enable parallel text generation but currently lag behind auto-regressive models in quality. Several pape…
-
New watermarking techniques enhance AI content provenance
Researchers have developed new methods for watermarking diffusion language models to ensure content provenance. One approach, "Global Sketch-Based Watermarking," uses a global sketch representation of text, decoupling d…
-
NVIDIA unveils Nemotron-Labs Diffusion language models for faster text generation
NVIDIA has introduced a new family of diffusion language models (DLMs) called Nemotron-Labs Diffusion, designed to overcome the limitations of traditional autoregressive models. These DLMs generate text by creating mult…
-
New research tackles diffusion language model limitations
Researchers are exploring new methods to improve diffusion language models (DLMs), which offer faster inference than autoregressive models. Several recent papers introduce techniques to enhance DLM performance, includin…
-
Apple researchers identify local scores for diffusion model generalization
Apple's research paper explores the mechanisms behind compositional generalization in conditional diffusion models, particularly focusing on how these models handle generating images with more objects than trained on. T…