Perplexity Research and turbopuffer have released pplx-embed-v2-context-9b-preview, a new contextual embedding model designed for retrieval-augmented generation (RAG) pipelines. This model differs from traditional approaches by training to retrieve not just the answer, but also the supporting evidence needed for verification, moving away from the single 'gold passage' method. The model is available as a self-hosted preview with weights on Hugging Face under the MIT license, and it utilizes a novel training process involving a query-aware context compression model as a teacher. AI
IMPACT This new model could improve the accuracy and explainability of RAG systems by providing supporting evidence alongside answers.
RANK_REASON The release of a new embedding model with a novel training approach for RAG pipelines. [lever_c_demoted from research: ic=1 ai=1.0]
- Colbert
- Hugging Face
- MIT License
- Perplexity API
- Perplexity Research
- pplx-embed-v2-context-9b-preview
- retrieval-augmented generation
- Stirling
- turbopuffer
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →