Researchers have introduced DELA, a novel framework designed to enhance controllable editing capabilities for diffusion language models (DLMs). DELA operates as a plug-in, allowing for explicit draft refinement through actions like insertion, deletion, and remasking, while keeping the core DLM frozen. This approach separates high-level edit control from token-level generation, addressing computational inefficiencies by employing a two-phase decoding process that optimizes KV-cache reuse during drafting and allows for targeted non-monotonic edits in a subsequent refinement phase. Experiments demonstrate that DELA can improve performance on tasks such as mathematical reasoning and code generation by up to 5.5 percentage points. AI
IMPACT Enhances control over text generation in diffusion models, potentially improving performance in tasks like code generation and mathematical reasoning.
RANK_REASON The cluster contains a research paper detailing a new framework for diffusion language models. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →