Open-source LLM efficient frontier charted by parameter efficiency

A Reddit user has compiled a chart illustrating the efficient frontier of open-source large language models, defining efficiency as the model's score relative to its active parameters. The chart focuses on models that represent the best trade-off between performance and size, excluding those that are less efficient. The user acknowledges that the aggregation benchmark used may not be perfect but considers it a reliable indicator of overall performance. AI

IMPACT Provides a visual guide for users seeking efficient open-source LLMs.

RANK_REASON User-generated chart and discussion of existing models.

Read on r/LocalLLaMA →

• Falcon
• Gemma
• I Ching
• Llama 3
• mistral.ai
• Mixtral 8x22B
• Nous Hermes 2
• OpenHermes
• Phi 3
• Qwen1.5
• Starling
• Zephyr

• model release

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →