Calibrating Generative Models to Feature Distributions with MMD Finetuning
Researchers have introduced kernel Calibrating Generative Models (kCGM), a novel method designed to align generative models with specific feature distributions. This technique uses a maximum mean discrepancy (MMD) to adjust models, ensuring generated samples match target features without overfitting. kCGM has demonstrated success in adapting various model types, including autoregressive, diffusion, and discrete diffusion models, across tasks like drug discovery, protein generation, and DNA synthesis, using only feature-level supervision. AI
IMPACT Enables more precise control over generative model outputs for specialized applications like drug discovery and protein engineering.