OCC-RAG: Optimal Cognitive Core for Faithful Question Answering
Researchers have developed OCC-RAG, a family of small language models (SLMs) designed for faithful question answering. These models are trained on a novel dataset of over three million examples, focusing on multi-hop reasoning and context adherence. OCC-RAG models, including 0.6B and 1.7B parameter versions, demonstrate the ability to match or surpass larger general-purpose models in specific QA benchmarks. AI
IMPACT Task-specific SLMs like OCC-RAG could offer more efficient and accurate solutions for specialized QA applications, potentially reducing reliance on larger, general-purpose models.