Aya Expanse 8B

Smaller LLMs now outperform larger models, challenging scaling trend

The trend of increasing LLM size for better performance is reaching its limits, according to an essay by Sara Hooker. While larger models have historically outperformed smaller ones, recent evidence shows that smaller, …