Researchers have developed a retrieval-augmented generation (RAG) approach to improve the reliability of large language models (LLMs) for public health question answering. By grounding responses in official guidance, RAG mitigates issues like hallucinations and outdated information. The study systematically evaluated various retrieval configurations, finding that hybrid retrieval methods and careful context selection significantly enhance accuracy, enabling smaller models to perform comparably to larger ones without retrieval. A new LLM-as-a-judge rubric was introduced to assess free-form answers, highlighting the importance of faithfulness and completeness while noting challenges in consistently evaluating factual consistency and clarity. AI
IMPACT Enhances reliability of LLMs for critical public health information dissemination.
RANK_REASON The cluster contains an academic paper detailing a new method for improving LLM performance on a specific task.
- alphaXiv
- CatalyzeX
- DagsHub
- Gotit.pub
- Government of the United Kingdom
- Hugging Face
- PubHealthBench
- retrieval-augmented generation
- ScienceCast
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →