The RMIT-ADM+S team participated in the TREC 2026 Retrieval-Augmented Generation (RAG) track, submitting seven research-agent runs that utilized both proprietary OpenAI models and open-weight alternatives. Their research focused on exploring various retrieval strategies, writer models, and agent workflows, with pre-submission tests indicating that writer selection and adjacent-chunk expansion significantly impacted answer quality. In the official NIST evaluation, six of their seven runs surpassed the track median, and their top-performing run achieved the highest all-item coverage among their submissions, tying the track maximum for vital coverage in one batch. AI
IMPACT Highlights the potential of open-weight models for research-agent systems and differences between automated metrics and human preferences.
RANK_REASON Academic paper detailing participation in a research competition and model performance. [lever_c_demoted from research: ic=1 ai=1.0]
Read on arXiv cs.IR (Information Retrieval) →
- ClimbMix corpus
- NIST
- OpenAI
- owa-glm5
- RMIT-ADM+S
- sol-research-first
- TREC 2026 Retrieval-Augmented Generation (RAG) track
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →