PulseAugur
实时 11:00:08

New CoREB benchmark and model advance code search capabilities

Researchers have introduced CoREB, a new benchmark and model designed to improve code search beyond simple retrieval. CoREB addresses limitations in existing benchmarks, such as data contamination and noisy labels, by focusing on a full code search pipeline that includes reranking and developer-style queries. Experiments with various embedding models and rerankers showed that while code-specialized embeddings excel in code-to-code retrieval, no single model performed best across all tasks, and short keyword queries significantly degraded performance. The proposed CoREB-Reranker demonstrated consistent gains across all evaluated tasks, and the benchmark data and model have been released. AI

影响 Enhances code search capabilities by providing a more comprehensive benchmark and a specialized reranking model.

排序理由 The cluster describes a new academic paper introducing a benchmark and model for code search. [lever_c_demoted from research: ic=1 ai=1.0]

在 Hugging Face Daily Papers 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。 我们如何撰写摘要 →

New CoREB benchmark and model advance code search capabilities

报道来源 [1]

  1. Hugging Face Daily Papers TIER_1 English(EN) ·

    Beyond Retrieval: A Multitask Benchmark and Model for Code Search

    Code search has usually been evaluated as first-stage retrieval, even though production systems rely on broader pipelines with reranking and developer-style queries. Existing benchmarks also suffer from data contamination, label noise, and degenerate binary relevance. In this pap…