PulseAugur
中
实时 06:56:40
English(EN) Astraios: Parameter-Efficient Instruction Tuning Code Large Language Models

新的基准和微调方法提升了大型语言模型代码生成能力 · 跟踪3个来源

研究人员推出了Astraios,这是一套包含28个指令微调的OctoCoder模型,旨在评估大型语言模型(LLM)的参数高效微调(PEFT)方法。研究发现,全参数微调通常能带来最佳性能,而LoRA则提供了有利的成本效益权衡。此外,还开发了一个名为BigCodeBench的新基准,用于评估LLM使用多样化函数调用和复杂指令进行代码生成的能力,结果显示当前模型在这些任务上的表现与人类相比仍有差距。另一个平台BigCodeArena的创建,通过集成执行环境,为代码生成评估提供了更可靠的人类偏好数据,并指出GPT-5和Claude Opus 4等专有模型在代码生成能力方面处于领先地位。 AI

影响 参数高效微调和代码特定基准的这些进展对于提升LLM在软件开发和复杂任务自动化方面的能力至关重要。

排序理由 该集群包含多篇研究论文,介绍了用于LLM代码生成的新模型、基准和评估平台。

在 arXiv cs.AI 阅读 →

AI 生成摘要 · Google Gemini · 来自 3 个来源。 我们如何撰写摘要 →

新的基准和微调方法提升了大型语言模型代码生成能力 · 跟踪3个来源

本文如何被排名

Signal score
59 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Research
该集群包含多篇研究论文,介绍了用于LLM代码生成的新模型、基准和评估平台。
Source corroboration
3 independent sources
Multiple independent publishers reporting the same story raises confidence that it's real and newsworthy.
Topics
paper, product
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
Breaking (< 6h)
Fresh story with cross-source coverage still developing. Ranking may shift as more sources report.

完整方法见我们的编辑标准。

报道来源 [3]

  1. arXiv cs.AI TIER_1 English(EN) · Terry Yue Zhuo, Armel Zebaze, Nitchakarn Suppattarachai, Leandro von Werra, Harm de Vries, Qian Liu, Niklas Muennighoff ·

    Astraios:参数高效指令微调代码大语言模型

    arXiv:2401.00788v2 Announce Type: replace-cross Abstract: The high cost of full-parameter fine-tuning (FFT) of Large Language Models (LLMs) has led to a series of parameter-efficient fine-tuning (PEFT) methods. However, it remains unclear which methods provide the best cost-perfo…

  2. arXiv cs.AI TIER_1 English(EN) · Terry Yue Zhuo, Minh Chien Vu, Jenny Chim, Han Hu, Wenhao Yu, Ratnadira Widyasari, Imam Nur Bani Yusuf, Haolan Zhan, Junda He, Indraneil Paul, Simon Brunner, Chen Gong, Thong Hoang, Armel Randy Zebaze, Xiaoheng Hong, Wen-Ding Li, Jean Kaddour, Ming Xu, Z… ·

    BigCodeBench:通过多样化的函数调用和复杂指令对代码生成进行基准测试

    arXiv:2406.15877v5 Announce Type: replace-cross Abstract: Task automation has been greatly empowered by the recent advances in Large Language Models (LLMs) via Python code, where the tasks ranging from software engineering development to general-purpose reasoning. While current b…

  3. arXiv cs.AI TIER_1 English(EN) · Terry Yue Zhuo, Xiaolong Jin, Hange Liu, Juyong Jiang, Tianyang Liu, Chen Gong, Bhupesh Bishnoi, Vaisakhi Mishra, Marek Suppa, Noah Ziems, Saiteja Utpala, Ming Xu, Guangyu Song, Kaixin Li, Yuhan Cao, Bo Liu, Zheng Liu, Sabina Abdurakhmanova, Wenhao Yu, M… ·

    BigCodeArena:通过执行揭示代码生成中更可靠的人类偏好

    arXiv:2510.08697v3 Announce Type: replace-cross Abstract: Crowdsourced model evaluation platforms, such as Chatbot Arena, enable real-time evaluation from human perspectives to assess the quality of model responses. In the coding domain, manually examining the quality of LLM-gene…