Researchers have developed an agentic LLM assistant designed to improve user support for high-performance computing (HPC) environments. This assistant leverages retrieval-augmented generation (RAG) on live documentation and a Llama 3-8B model fine-tuned with QLoRA on historical support tickets. The system aims to answer user queries by drawing from existing documentation and resolved tickets, addressing the difficulty users face in navigating these resources. Evaluations on held-out tickets from Purdue University's Rosen Center for Advanced Computing showed that fine-tuning on rewritten ticket resolutions significantly improved agreement with the center's resolutions, outperforming the base model. AI
IMPACT This research demonstrates a practical application of LLMs in specialized technical support, potentially improving efficiency and user experience in HPC environments.
RANK_REASON The cluster contains an academic paper detailing a novel LLM application for a specific domain. [lever_c_demoted from research: ic=1 ai=1.0]
- BERTScore
- Elham J. Barezi Ms
- high-performance computing
- Llama 3-8B
- Purdue University
- QLoRA
- Rosen Center for Advanced Computing
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →