PulseAugur
EN
LIVE 08:52:32

ISO-grounded NFRs improve LLM code quality but not always correctness

A new research paper explores how to improve Large Language Model (LLM) code generation by grounding Non-Functional Requirements (NFRs) in the ISO/IEC 25010 Quality Model. The study found that using either rich natural language or structured JSON for NFR specifications enhances static quality metrics and reduces sensitivity to prompt variations, though it does not consistently improve functional correctness. The research indicates that the semantic content of the NFRs is more critical than their format, suggesting practitioners should focus on standard-grounded NFR content. AI

IMPACT Suggests improved methods for specifying requirements to LLMs for better code quality, though functional correctness remains a challenge.

RANK_REASON Academic paper on LLM code generation techniques. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.AI →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

ISO-grounded NFRs improve LLM code quality but not always correctness

COVERAGE [1]

  1. arXiv cs.AI TIER_1 English(EN) · Jo\`ao Pedro Monteiro Pereira, Vinicius Cardoso Garcia ·

    Does ISO-Grounded NFR Specification Improve LLM Code Generation? A Comparison of Rich and Structured Interventions against a Natural-Language Baseline

    arXiv:2608.13742v1 Announce Type: cross Abstract: In LLM-based code generation, Non-Functional Requirements (NFRs) are often specified as terse one-line phrases. We ask whether grounding those specifications in ISO/IEC 25010 Quality Model, either as rich natural-language prose (N…