Researchers have developed CourseChat, an on-premises RAG tutor designed for undergraduate business education, integrated with Moodle. The system utilizes local LLMs served by Ollama and FastAPI, with a focus on hardware-software trade-offs for campus deployment. Initial evaluations showed that while some larger models struggled with speed requirements, a 12B model and a 7B alternative were viable, leading to the selection of an 8B production model for its balance of performance and accuracy. AI
IMPACT This research highlights practical considerations for deploying RAG-based AI tutors in educational settings, focusing on model selection and infrastructure.
RANK_REASON The item is a research paper detailing the development and evaluation of a specific AI application (CourseChat) and its underlying technical trade-offs. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →