Brief

Single-image diffusion model inference is slowed by kernel launch overhead and attention memory traffic, rather than raw computational power. Optimizing with `torch.compile` in `reduce-overhead` mode, employing a fused attention backend, and batching classifier-free guidance can significantly reduce latency. Only after these optimizations should one consider distillation methods for further speed improvements, while carefully evaluating potential quality degradation. AI

Retrieval-Augmented Generation (RAG) pipelines often fail with PDF documents due to naive text splitting methods that ignore the document's layout. This leads to corrupted chunks containing concatenated columns, misplaced footers, and detached captions, resulting in inaccurate information retrieval. The solution involves a four-layer approach: detecting the correct reading order of text blocks, classifying blocks by semantic role (e.g., text, table, figure), removing repetitive headers and footers, and chunking content by document structure (sections) rather than arbitrary token counts. This layout-aware chunking significantly improves retrieval accuracy compared to standard methods, even with the same embedding models. AI

Researchers have developed a new diagnostic dataset and protocol called TRACE-Edit to evaluate how well semantic information is preserved when Vision-Language Models (VLMs) are used for video editing. Their findings indicate that the alignment process between VLMs and Diffusion Transformer models (DiTs) can significantly degrade fine-grained structural details, challenging the assumption of lossless semantic transfer. This research identifies the VLM-to-DiT alignment as a critical bottleneck and provides a foundation for developing improved multi-modal alignment architectures. AI

Researchers have developed a new framework called REPA-P to improve the accuracy and robustness of physics-informed diffusion models. This method aligns intermediate model representations with physical states during training by using lightweight projection heads that are removed during inference, thus adding no computational overhead. Experiments across four different physics tasks demonstrated that REPA-P can accelerate convergence, reduce physics residuals, and enhance out-of-distribution performance. AI