Brief

Researchers have developed a new method to improve human portrait generation in text-to-image diffusion models, addressing the common trade-offs between text-image alignment, realism, and aesthetics. Their approach uses a feature supervision paradigm for Multimodal Diffusion Transformers (MM-DiT) that integrates vision-aligned text guidance from SigLIP 2 without impacting the model's original capabilities. This technique also leverages aesthetic signals from pre-trained vision models to enhance perceived beauty, pushing the Pareto frontier for improved results across all three metrics. AI

Hugging Face is releasing several new vision language models and tools to advance the field. This includes updates like SigLIP 2 for multilingual encoding and SmolVLM for efficient performance. The platform also introduces new models such as Google's PaliGemma 2 and Microsoft's Florence-2, alongside Idefics2, an 8B parameter model. These releases are complemented by new alignment techniques like TRL and DPO, aiming to improve model capabilities and usability. AI