PulseAugur
EN
LIVE 08:14:10

0.6B LLM achieves 14.8 tokens/sec on budget Android phone

Team Neykosa has benchmarked a 0.6B parameter model, Qwen3 0.6B, running on a 4GB Galaxy A05s phone. The model achieved a speed of 14.8 tokens per second using llama.cpp, with specific settings including 6-bit Q6_K quantization and 4 threads. However, the team emphasizes that this speed metric does not reflect the user experience, which is more dependent on overall response time. Separate tests for their Nesayo offline edition showed response times ranging from 4.25 seconds for a stock answer to 18.8 seconds for the first launch, with model memory usage around 673 MB. AI

IMPACT Demonstrates the feasibility of running smaller LLMs on low-resource mobile devices, potentially enabling offline AI applications.

RANK_REASON Benchmark results for a small LLM running on a mobile device. [lever_c_demoted from research: ic=1 ai=1.0]

Read on dev.to — LLM tag →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

0.6B LLM achieves 14.8 tokens/sec on budget Android phone

How we ranked this

Signal score
65 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
Benchmark results for a small LLM running on a mobile device. [lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration
Single-source cluster
Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics
infra, product
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
Breaking (< 6h)
Fresh story with cross-source coverage still developing. Ranking may shift as more sources report.

Full methodology in our editorial standards.

COVERAGE [1]

  1. dev.to — LLM tag TIER_1 English(EN) · Neykosa ·

    Neykosa phone benchmark: 14.8 tok/s from a 0.6B model on a 4 GB Galaxy A05s, and what that number leaves out

    <p>Team Neykosa measured a 0.6B model writing 14.8 tokens a second on a 4 GB Galaxy A05s. But a user never waits for tokens a second. They wait for an answer, so we report the two separately.</p> <h2> The speed bench </h2> <p>The model is Qwen3 0.6B, a small open model taught onl…