Apple Machine Learning Research has published a paper detailing a new rubric-based reward framework for open-domain question answering. This framework aims to improve answer quality by decomposing it into multiple dimensions, such as composition, grounding, and instruction-following, rather than relying on a single scalar objective. The approach uses query-specific rubrics grounded in retrieved evidence, showing significant improvements over existing methods on various evaluation datasets, particularly in factual support and coherence. AI
IMPACT This research could lead to more accurate and reliable AI models for question answering, particularly in complex, knowledge-intensive domains.
RANK_REASON Research paper published by Apple's ML Research division. [lever_c_demoted from research: ic=1 ai=1.0]
Read on Apple Machine Learning Research →
- Aman Saini
- Anshu Jha
- Apple Machine Learning Research
- Eric W. Peng
- Harsh Girase
- Kai Yuan
- MKQA: A Linguistically Diverse Benchmark for Multilingual Open Domain Question Answering
- Multilingual Knowledge Questions and Answers
- OKVQA
- Outside Knowledge Visual Question Answering
- Wanming Chen
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →