EMMA: Extracting Multiple physical parameters from Multimodal Data
Researchers have developed EMMA, a novel physics-informed framework capable of extracting multiple physical parameters from multimodal data, including video, audio, and chart-based time-series observations. This approach overcomes limitations of prior video-only methods by jointly inferring explicit parameters, latent dynamics, and calibration invariants within a continuous-time model. EMMA utilizes a Liquid Time-Constant network and a physics-constrained loss to ensure consistency with governing differential equations, demonstrating robust multi-parameter recovery across diverse scenarios and outperforming existing baselines. AI
IMPACT Introduces a new method for physics-consistent model extraction from multimodal data, potentially improving scientific modeling and simulation.