Researchers have developed FigmaTrace, a novel dataset containing over 200 hours of human design workflows captured in Figma. This dataset, comprising 3,469 design trajectories, aims to address the limitations of current Vision Language Models in subjective creative tasks. By training models on FigmaTrace, the researchers demonstrated performance improvements comparable to advanced models like Claude-Opus-5 and GPT-5.6-Sol on specific agentic GUI environments. The study highlights the effectiveness of a design phase-based video-to-trajectory conversion method and includes an open-sourced dataset and best-performing model. AI
IMPACT This dataset could significantly improve AI's ability to understand and replicate subjective creative processes in design.
RANK_REASON The cluster describes a new research paper introducing a dataset and trained models. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →