Qwen2
PulseAugur coverage of Qwen2 — every cluster mentioning Qwen2 across labs, papers, and developer communities, ranked by signal.
- 2026-07-24 product_launch Alibaba Cloud launched the Qwen2 series of open-source language models. source
-
New RODE optimizer decouples neural network training dynamics
Researchers have introduced RODE, a novel optimization engine for neural networks that decouples the radial and directional components of matrix updates. This separation allows for distinct update rules and step sizes, …
-
Ornith-1.0: Novel open coding model faces integration hurdles
Ornith-1.0 is a new open-weight coding model that distinguishes itself by learning to build its own problem-solving harness during training, rather than relying on a pre-existing one. Despite its 9B parameter size, it d…
-
Qwen models use ChatML format, with community refining templates
Qwen models, including the Qwen2.5 series, utilize a ChatML format for structuring conversational prompts, similar to OpenAI's early models. This format relies on specific tokens like <|im_start|> and <|im_end|> and req…
-
AI models hampered by outdated data, real-time search is the solution
Large language models (LLMs) are hindered by knowledge cutoffs, meaning their training data is outdated by the time they are released. This limitation, even for advanced models like Anthropic's Claude 4.7 Opus trained o…
-
Qwen VLMs show strong performance on complex persuasion tasks
Researchers have evaluated Vision Language Models (VLMs) on complex tasks related to Aristotelian persuasion, using the ImageArg dataset which focuses on Logos, Ethos, and Pathos detection. The study found that models f…
-
Alibaba Cloud releases Qwen2 model series with long-context and multilingual capabilities
Alibaba Cloud has released the Qwen2 series of open-source language models, offering a range of sizes from 0.5 billion to 72 billion parameters, including a mixture-of-experts model. These models boast enhanced capabili…
-
Keyless Attention mechanism halves KV cache and boosts transformer efficiency
Researchers have introduced Keyless Attention, a novel attention mechanism for transformers that eliminates the key projection entirely, operating solely on queries and values. This approach results in a Value-Only Cach…