An individual has successfully tested a private Qwen 35B MoE LLM runtime on a Samsung S26 Ultra, finding that the model's active footprint fits within the device's memory. Initial optimizations yielded approximately 90 input processing tokens per second and 8 output tokens per second on the mobile device. The individual, who is self-taught in AI/ML and lacks formal institutional affiliation, is seeking collaborators for further testing and has had papers held up on arXiv due to their independent status. AI
IMPACT Demonstrates the potential for running sophisticated LLMs on mobile hardware, suggesting future advancements in on-device AI capabilities.
RANK_REASON The item describes a technical test and performance evaluation of a specific LLM on a consumer device, fitting the research category. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →
