研究人员开发了一个用于理解对比表示学习中缩放定律的理论框架。该论文在配对高斯潜在变量设置下分析了一个草图线性模型，推导出了一个风险分解，包括不可约风险、近似误差以及梯度下降的偏差和方差。研究结果提供了关于草图维度、样本量和优化视界的明确缩放定律，为对比学习在模型大小、数据和计算资源之间的平衡提供了指导。 AI
影响 通过平衡计算资源和数据，为优化对比学习模型提供理论指导。
排序理由 该集群包含一篇详细介绍机器学习理论研究的学术论文。
AI 生成摘要 · Google Gemini · 来自 2 个来源。 我们如何撰写摘要 →
arXiv:2606.26617v1 Announce Type: new Abstract: Scaling laws describe how learning performance varies with model size, data size, and compute. While recent theoretical work has established scaling laws for sketched linear regression, much less is understood for contrastive repres…
Scaling laws describe how learning performance varies with model size, data size, and compute. While recent theoretical work has established scaling laws for sketched linear regression, much less is understood for contrastive representation learning. In this paper, we study a ske…