Neuroevolution framework boosts LLM output diversity via prompt embedding evolution

Researchers have developed QD-LLM, a novel framework that uses parameter-efficient neuroevolution to enhance the diversity of outputs from large language models. This method evolves compact prompt embeddings, which act as interfaces to steer large, frozen LLMs without requiring full model fine-tuning. The system employs a Quality-Diversity optimization approach with hybrid behavior characterization and co-evolutionary operators, demonstrating significant improvements in output coverage and quality scores across various benchmarks. AI

影响 Enhances LLM output diversity and quality, potentially improving downstream applications like test generation and fine-tuning.

排序理由 The cluster contains an academic paper detailing a new method for improving LLM output diversity. [lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.CL 阅读 →

• HumanEval
• Large Language Models
• Llama-3-70B
• MBPP
• Mistral-Large
• QD-LLM

• 论文
• 模型发布

AI 生成摘要 · Google Gemini · 来自 1 个来源。 我们如何撰写摘要 →