LM1B
PulseAugur coverage of LM1B — every cluster mentioning LM1B across labs, papers, and developer communities, ranked by signal.
3 day(s) with sentiment data
-
Next-Concept Modeling offers faster, parallel text generation
Researchers have introduced Next-Concept Modeling (NCM), a novel two-stage framework for text generation that significantly speeds up the process compared to existing autoregressive and diffusion models. NCM utilizes a …
-
Seq-Drifting enables one-step text generation in language models
Researchers have introduced Seq-Drifting, a novel framework for language models that enables one-step text generation. This method applies a "drifting" mechanism to sequences of continuous token representations, learnin…
-
New research enhances Mixture-of-Experts LLMs with improved routing and diffusion models · 2 sources tracked
Two new research papers explore enhancements to Mixture-of-Experts (MoE) large language models. The first paper introduces token-error supervision to guide MoE routing, improving accuracy on benchmarks like Granite and …
-
New research explores efficient few-step generation for text and images
Two new research papers introduce novel approaches to generative modeling, focusing on improving the efficiency and quality of few-step generation for text and images. The first paper, "Latent-Kernel Discrete Flow Maps …
-
New research tackles evaluation and architecture for masked diffusion language models
Two new research papers introduce novel evaluation protocols and architectures for masked diffusion language models (MDLMs). The first paper, "CaRE," proposes a compute-aware framework to standardize evaluations, reveal…
-
Gumbel Distillation enhances parallel text generation quality
Researchers have developed Gumbel Distillation, a new technique to improve the generation quality of parallel text models. This method uses the Gumbel-Max trick to create a deterministic link between a latent noise spac…
-
New 7B Uniform Diffusion Language Model 'Sumi' Released, Alongside Diffusion Model Advancements
Researchers have introduced Sumi, a 7-billion parameter uniform diffusion language model (UDLM) pretrained from scratch on 1.5 trillion tokens. This open-source model demonstrates competitive performance against autoreg…
-
K-Forcing accelerates LLM inference by decoding multiple tokens at once
Researchers have introduced K-Forcing, a new paradigm for accelerating language model inference by decoding multiple tokens simultaneously. This push-forward approach distills an existing autoregressive model into a map…
-
AI text evaluation methods criticized in new research papers
Two new research papers highlight significant issues with current methods for evaluating AI-generated text. One paper reveals widespread under-reporting of human evaluation protocols in NLP conferences, hindering reprod…
-
New LLM training methods boost efficiency and error recovery
Researchers have developed new techniques for improving the efficiency of training large language models (LLMs). One method, Step Rejection Fine-Tuning (SRFT), leverages unsuccessful training trajectories by assessing t…