36Kr Exclusive | Tsinghua University Team Develops World's First Foundational Model for Real-time Understanding of Physiology and Emotion, Further Expanding into Hardware
A Tsinghua University-affiliated team has developed a foundational model called FacePhys that can analyze physiological and emotional states in real-time through facial analysis. This model utilizes remote photoplethysmography (rPPG) technology to extract over 120 metrics, including heart rate, respiratory rate, and emotional dimensions, achieving medical-grade accuracy. The technology is designed for edge computing, enabling real-time processing on devices like smartphones and cameras, thereby enhancing human-computer interaction and privacy. AI
IMPACT Enables more empathetic and proactive AI interactions by providing real-time physiological and emotional data, potentially transforming human-computer interfaces.