ST-DiffEye: Diffusion-based Continuous Gaze Generation via Joint Scanpath-Trajectory Modeling
Researchers have developed ST-DiffEye, a novel diffusion framework for generating human gaze patterns. This model uniquely integrates both continuous eye-tracking trajectories and discrete scanpaths, treating gaze variability as a core feature rather than noise. The framework utilizes a joint modeling approach by concatenating these modalities as an input channel, requiring minimal architectural changes. An accompanying evaluation framework based on the Continuous Ranked Probability Score (CRPS) is also introduced to assess both accuracy and diversity of generated gaze. AI
IMPACT This research advances generative models for human behavior analysis, potentially impacting fields like HCI and user experience research.