Jailbroken PlayStation 5 consoles can now run large language models (LLMs) locally at impressive speeds, exceeding 100 tokens per second for smaller models. A fork of the PS5LM project, which ports llama.cpp to the PS5, has been optimized to run natively, leveraging the console's GPU and accessing more RAM. This allows for the execution of models like Qwen3.8-27B at 20 tokens per second, and smaller models such as Gemma 4 E4B and Llama 3.2:3b at significantly higher rates. The enhanced version also includes a dashboard for monitoring performance metrics and can be accessed remotely from other devices. AI
IMPACT Enables local AI model execution on consumer gaming hardware, potentially increasing accessibility for AI experimentation.
RANK_REASON The cluster describes a modification of existing hardware (PS5) to run AI models, rather than a new AI model release or core AI research.
Read on Mastodon — mastodon.social →
- Mastodon
- PlayStation 5
- AMD
- Çobanov Elmin İsmixan oğlu
- Gemma 4 E4B
- Llama 3.2:3b
- llama.cpp
- PS5LM
- PS5_Vulkan
- Qwen3.8-27B
- u/AdIllustrious7246
AI-generated summary · Google Gemini · from 4 sources. How we write summaries →
