PulseAugur
实时 16:13:41
English(EN) The Clustering Strikes Back: Building Cost-Effective and High-Performance ANNS at Scale with Helmsman

RedNote的HELMSMAN将ANNS硬件成本降低90%

RedNote(小红书)的研究人员开发了HELMSMAN,一个新颖的基于聚类的近似最近邻搜索(ANNS)系统,旨在显著降低大规模ANNS部署的硬件成本。通过集成用户空间存储栈、学习型剪枝模块和GPU加速构建流水线,HELMSMAN实现了可观的节省,将硬件成本降低了90%以上。该系统能够在数小时内处理数十亿规模的索引重建,并且目前支持在40台机器上运行ANNS工作负载,而此前这需要大约35,000个核心和0.35 PB的DRAM。 AI

影响 降低了大规模ANNS的硬件成本,可能促进AI驱动的搜索和推荐系统的更广泛采用。

排序理由 详细介绍ANNS新系统的学术论文。[lever_c_demoted from research: ic=1 ai=0.7]

在 arXiv cs.IR (Information Retrieval) 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。 我们如何撰写摘要 →

报道来源 [1]

  1. arXiv cs.IR (Information Retrieval) TIER_1 English(EN) · Chuliang Weng ·

    The Clustering Strikes Back: Building Cost-Effective and High-Performance ANNS at Scale with Helmsman

    RedNote (a.k.a., Xiaohongshu, a global-scale social network platform) widely adopts approximate nearest neighbor search (ANNS) to power its search, recommendation, and advertising services. Due to the demanding Service Level Agreements (SLAs), we have to rely on in-memory graph-b…