Train, Retrieve, or Both? A Four-Arm Head-to-Head for Correct Statutory Citation on the Ontario Residential Tenancies Act
A new research paper explores the effectiveness of different AI approaches for accurately citing legal statutes, specifically focusing on the Ontario Residential Tenancies Act. The study compared a base model, a fine-tuned model, a retrieval-augmented generation (RAG) model, and a hybrid SFT+RAG model using the Qwen2.5-7B-Instruct model. Results indicate that retrieval methods are crucial for eliminating hallucinations and achieving accurate citations, with the SFT+RAG hybrid model achieving the highest exact-match score of 0.481. AI
IMPACT Highlights the necessity of retrieval-augmented generation for accurate legal citation by AI models.