Researchers have developed CodeInsight, a new dataset comprising over 3 million submissions from 3,286 students in introductory C++ courses. This dataset is designed to model iterative problem-solving by tracking student attempts, feedback, and code revisions. A benchmark was created using this data, evaluating various models including a Recurrent State Space Model (RSSM) and a Large Language Model (LLM). The adapted RSSM demonstrated superior predictive accuracy, while the LLM, though less accurate, provided explicit solutions for analysis. AI
IMPACT Provides a new resource for developing and evaluating AI models that can understand and predict iterative learning processes.
RANK_REASON The cluster is about a new academic paper introducing a dataset and benchmark for modeling iterative problem-solving. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →