A user tested the Qwen3.8-27B model on an Nvidia RTX 5070 Ti, achieving a 91.1% success rate on their tasks with a context window of 131K. The test was conducted using a local setup and Russian cloud infrastructure, with the model demonstrating a speed of 68.3 tokens/s in a single thread. Despite common opinions that a 131K context is insufficient and the IQ3 variant is less capable, the user found it effective for their specific use cases. AI
IMPACT Demonstrates the capabilities of the Qwen3.8-27B model with a large context window on consumer-grade hardware.
RANK_REASON User benchmark of an existing model on specific hardware and context length. [lever_c_demoted from research: ic=1 ai=1.0]
Read on Mastodon — mastodon.social →
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →