研究人员开发了一种名为EmbedFilter的线性变换技术，用于改进大型语言模型生成的文本嵌入。该方法解决了嵌入过度受到频繁、无信息标记影响的问题，从而阻碍了语义捕捉。通过过滤掉unembedding矩阵编码的子空间，EmbedFilter优化了这些嵌入，提高了语义质量，并实现了显著的降维，从而提高了存储和检索效率。 AI
影响 增强了LLM嵌入的质量和效率，可能提高下游任务的性能并降低存储成本。
排序理由 该集群包含一篇详细介绍改进LLM嵌入新技术的学术论文。
在 Hugging Face Daily Papers 阅读 →
AI 生成摘要 · Google Gemini · 来自 3 个来源。 我们如何撰写摘要 →
arXiv:2606.07502v1 Announce Type: new Abstract: Large language models exhibit impressive zero-shot capabilities across a wide range of downstream tasks. However, they struggle to function as off-the-shelf embedding models, leading to suboptimal performance on massive text embeddi…
Large language models exhibit impressive zero-shot capabilities across a wide range of downstream tasks. However, they struggle to function as off-the-shelf embedding models, leading to suboptimal performance on massive text embedding benchmarks. In this paper, we identify a pote…
Text embeddings from large language models are enhanced by EmbedFilter, a linear transformation that reduces the influence of high-frequency tokens and improves semantic representations while enabling dimensionality reduction.