A Surface Laptop Ultra equipped with an Nvidia RTX Spark N1X GPU achieved impressive speeds of 90.9 tokens per second when running the Qwen3 coder 30B model locally using Ollama for short coding tasks. This performance is notably faster than a Lenovo Yoga 9n on the same hardware for similar tasks. However, when processing a very long prompt of over 100,000 tokens, the Surface Laptop Ultra's performance significantly degraded to 19.7 tokens per second, while the Lenovo setup with a more optimized vLLM configuration maintained a much higher speed of 44.3 tokens per second. AI
IMPACT Demonstrates practical performance differences for local LLM deployment on consumer hardware, highlighting trade-offs between ease of use and long-context efficiency.
RANK_REASON The article details the performance of a specific hardware and software setup for running a local LLM, focusing on practical usage rather than a novel release or research breakthrough.
- Lenovo Yoga 9n
- Microsoft
- Nvidia
- Ollama
- Qwen3.8-27B
- Qwen3 coder 30b
- RTX Spark N1X
- Surface Laptop Ultra
- vLLM
- Windows Subsystem for Linux
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →