Researchers have developed EgoHRV, a novel method that enables egocentric vision systems to estimate heart rate variability (HRV) and heart rate (HR) using only gaze cameras. This technique overcomes previous limitations caused by motion and noise in egocentric video, which obscured the fine-grained timing required for HRV analysis. By employing a 3D backbone and a low-high decomposition module, EgoHRV extracts blood volume pulse signals and aligns frequency-domain representations from contact-based and camera-derived data. The system demonstrates state-of-the-art accuracy in HR and HRV estimation, and its integration into the EgoExo4D proficiency estimator improved accuracy by 17.8%. This advancement allows egocentric systems to assess not only skills but also physiological states like stress and arousal. AI
IMPACT Enables egocentric systems to monitor user stress and arousal, potentially improving training and human-computer interaction.
RANK_REASON The cluster describes a new method presented in a research paper for estimating physiological data from egocentric systems.
Read on Hugging Face Daily Papers →
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →
