PulseAugur
EN
LIVE 10:48:03

New CAPRI system ensures LLMs don't alter Isabelle proofs

Researchers have developed CAPRI, a novel workflow designed to enhance the reliability of large language models (LLMs) in generating proofs for the Isabelle theorem prover. CAPRI introduces a contract-aware repair mechanism where Isabelle verifies the proof's correctness, while an independent checker enforces a machine-readable edit contract to ensure LLMs only modify authorized sections. Evaluations on failed proofs demonstrated that CAPRI significantly reduces the risk of unauthorized modifications, particularly when focused on proof bodies rather than entire theories. The system was tested across various configurations, including comparisons with OpenRouter and OpenAI, showing promising results in generating valid repairs while maintaining integrity. AI

IMPACT Enhances trust in LLM-assisted formal verification by ensuring model edits adhere to specified contracts.

RANK_REASON Academic paper detailing a new method for LLM proof generation in theorem proving. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.AI →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

New CAPRI system ensures LLMs don't alter Isabelle proofs

COVERAGE [1]

  1. arXiv cs.AI TIER_1 English(EN) · Jim Woodcock, Gabriel Leite, Augusto Sampaio, Ran Wei ·

    CAPRI: Contract-Aware Proof Repair for Isabelle

    arXiv:2608.13459v1 Announce Type: cross Abstract: We address the use of large language models (LLMs) to help discover Isabelle proofs. An Isabelle build establishes that the submitted theory is accepted, but not that an LLM changed only what the developer authorised. We present C…