A user on Mastodon shared their experience running the Qwen3.8-Flash-Next-oQ4e-mtp model locally on their Apple M3 Max chip. Despite slow performance due to only being able to offload 50% of the model's experts, the user was impressed that it successfully completed a benchmark for computer use with a custom GUI and harness, scoring 23 out of 25. This model is noted as the first local model the user could run that was capable of tackling this specific benchmark. AI
IMPACT Demonstrates the increasing capability of local LLMs on consumer hardware, potentially enabling more widespread use cases.
RANK_REASON User experience report on running a specific model locally on consumer hardware.
Read on Mastodon — mastodon.social →
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →