Researchers have developed a multimodal framework to predict student engagement in online learning environments, addressing the challenges of multidimensional engagement states and high inter-person variability. The system integrates spatiotemporal features from video, audio, and image encoders with behavioral data such as head pose, gaze, and facial action units. It utilizes a Perceiver IO bottleneck and models student and instructor personalities to improve pooling across participants, employing evidential regression and Gaussian process classification for uncertainty-aware predictions. AI
IMPACT This research could lead to more effective and calibrated AI tools for personalized online education.
RANK_REASON The cluster contains an academic paper detailing a new multimodal framework for engagement prediction in online learning.
Read on Hugging Face Daily Papers →
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →