A new language model called QLLM has been released, featuring a novel architecture that does not rely on Transformers or Mamba. This model boasts O(1) inference complexity, meaning its processing time does not increase with input length, and it operates without a KV cache. While currently at a GPT-2 level of performance and not state-of-the-art, QLLM is open-sourced with its code and a model available on Hugging Face, with potential applications in voice modeling. AI
IMPACT This novel architecture could offer significant efficiency gains for long-context processing in LLMs.
RANK_REASON Release of a new, non-Transformer/Mamba language model with O(1) inference complexity. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →
