MagicFuse: Single Image Fusion for Visual and Semantic Reinforcement
Researchers have developed MagicFuse, a novel single-image fusion framework that can generate a comprehensive cross-spectral scene representation from a single, low-quality visible image. This method extends traditional data-level fusion to the knowledge level by using diffusion models to reinforce intra-spectral knowledge and generate cross-spectral knowledge. The framework integrates probabilistic noise from diffusion streams and applies visual and semantic constraints to ensure the output is suitable for both human observation and downstream semantic decision-making. Experiments indicate MagicFuse performs comparably to or better than state-of-the-art multi-modal fusion methods, despite using only one input image. AI
IMPACT This novel single-image fusion technique could enhance machine vision systems in environments with limited sensor data.