Periodic-MAE learns pulse signals from facial videos

Researchers have developed Periodic-MAE, a novel self-supervised learning framework for estimating remote photoplethysmography (rPPG) from facial videos. This method utilizes a masked autoencoder to learn general spatio-temporal representations without direct rPPG supervision. By incorporating periodicity-aware frame masking and physiological bandlimit constraints, Periodic-MAE effectively captures quasi-periodic patterns relevant to pulse signal estimation. The framework demonstrates improved performance across multiple benchmark datasets and challenging real-world conditions. AI

IMPACT This self-supervised approach could enable more accessible and robust physiological monitoring from everyday video sources.

RANK_REASON The cluster contains a research paper detailing a new methodology for signal estimation. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.CV →

• Jiho Choi
• Periodic-MAE

• paper
• other

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →