研究人员推出了一种新颖的低秩正交参数高效微调（PEFT）框架LOFT。该方法明确地将适应子空间与其中应用的变换分离开来，提供了一种包含现有正交PEFT技术的统一方法。LOFT的关键创新在于其由下游训练信号驱动的任务感知支持选择策略，从而提高了效率-性能权衡。 AI
影响 引入了一种改进大型模型微调效率和性能的新方法，有可能降低适应的计算成本。
排序理由 该集群包含一篇详细介绍微调机器学习模型新方法的学术论文。
AI 生成摘要 · Google Gemini · 来自 2 个来源。 我们如何撰写摘要 →
arXiv:2605.11872v1 Announce Type: cross Abstract: Orthogonal parameter-efficient fine-tuning (PEFT) adapts pretrained weights through structure-preserving multiplicative transformations, but existing methods often conflate two distinct design choices: the subspace in which adapta…
Orthogonal parameter-efficient fine-tuning (PEFT) adapts pretrained weights through structure-preserving multiplicative transformations, but existing methods often conflate two distinct design choices: the subspace in which adaptation occurs and the transformation applied within …