Clover 2, a new language model from Clover 2030 Engineering, utilizes a unique architecture with a 27.8B base model and seven specialized LoRA adapters. Unlike traditional merged models, Clover 2 employs a router that selects the most appropriate adapter(s) for each token during inference, falling back to the base model when no specific expertise is needed. This approach has demonstrated performance improvements on benchmarks like GSM8K, MATH-500, and LongBench-v2, while also reducing generic AI-writing artifacts in creative text. The model's components, including the base model, adapters, and router, are publicly available on Hugging Face, with support for vLLM inference and a free trial offered on their platform. AI
IMPACT Introduces a novel routing mechanism for LoRA adapters, potentially improving efficiency and specialization in local LLM deployments.
RANK_REASON Release of a new, publicly available language model with a novel architecture. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →