A new paper explores how software engineering principles can be applied to enhance the development and capabilities of large language models (LLMs) designed for coding tasks. Researchers developed a pipeline called RefactorForge, which uses refactoring knowledge and established SE tools to create training data. Fine-tuning a 92B-parameter coding LLM with this data led to significant improvements on benchmarks like RefactorBench and SWE-Bench ProMax, as well as in real-world issue resolution. AI
IMPACT Applying software engineering principles to LLM development could lead to more capable and reliable coding assistants for developers.
RANK_REASON The cluster contains an academic paper detailing research into improving LLMs for software engineering tasks. [lever_c_demoted from research: ic=1 ai=1.0]
- arXiv
- Hugging Face
- Python
- RefactorBench
- RefactorForge
- Software Engineering LLMs
- SWE-Bench
- SWE-Bench ProMax
- SWE-Bench Verified
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →