SpectralEarth-FM: Bringing Hyperspectral Imagery into Multimodal Earth Observation Pretraining
Researchers have developed SpectralEarth-FM, a new foundation model designed to process and fuse hyperspectral imagery with other Earth observation data like multispectral, radar, and temperature readings. This model utilizes a hierarchical transformer architecture that can handle varying spectral dimensions and integrates a cross-sensor fusion module. To train SpectralEarth-FM, a large dataset called SpectralEarth-MM was curated, containing over 40TB of co-located data from multiple satellite sensors, enabling state-of-the-art results on downstream tasks. AI
IMPACT Advances hyperspectral data processing and fusion, enabling more comprehensive Earth observation analysis.