PulseAugur
EN
LIVE 10:59:43

SemaDiff uses LLMs to identify semantic-changing code commits

Researchers have developed SemaDiff, a novel approach to distinguish between semantic-preserving and semantic-changing commits in software development. This method utilizes behavior-based analysis by comparing test executions on pre- and post-commit versions of code. To ensure consistent testing, SemaDiff generates additional calling methods and tests for the modified code using a large language model, classifying commits as semantic-preserving only if all generated tests yield identical outcomes across versions. In evaluations on open-source Java projects, SemaDiff accurately identified semantic-preserving versus changing commits 76% of the time, achieving 100% precision in detecting semantic-changing commits. AI

IMPACT Enhances code repository analysis and debugging by improving the accuracy of identifying code changes.

RANK_REASON The cluster contains a research paper detailing a new method for software engineering. [lever_c_demoted from research: ic=1 ai=0.7]

Read on arXiv cs.AI →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

SemaDiff uses LLMs to identify semantic-changing code commits

COVERAGE [1]

  1. arXiv cs.AI TIER_1 English(EN) · Maha Ayub, Michael Konstantinou, Ahmed Khanfir, Nikolaos Tsantalis, Mike Papadakis ·

    SemaDiff: Identifying Semantic-Changing Commits with Generated Code and Tests

    arXiv:2607.13111v1 Announce Type: cross Abstract: Distinguishing semantic-preserving commits from changing ones remains an open challenge in software repository mining. While existing approaches detect refactoring commits accurately, they cannot ensure that a commit is purely sem…