Qwen3.6-35B model achieves 100k context on single P40 GPU

A user on Reddit's r/LocalLLaMA subreddit shared impressive performance metrics for the Qwen3.6-35B model running on a single NVIDIA P40 GPU. By utilizing TheTom's TurboQuant fork of llama.cpp and disabling the vision component, the user achieved a 100k context window and a speed of 80 tokens/second. This setup was optimized to maximize performance on older hardware while maintaining agent usability. AI

IMPACT Demonstrates optimized performance for large context windows on older hardware, potentially enabling wider use of advanced models.

RANK_REASON User-shared performance metrics for a specific model on consumer hardware.

Read on r/LocalLLaMA →

• llama.cpp
• NVIDIA P40
• Q4_K_M
• Qwen3.6
• Unsloth

• infra
• model release

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →