FreeToken, an open-source engine developed by the University of California, Berkeley, allows large Mixture-of-Experts (MoE) models, such as the 753 billion parameter GLM-5.2, to run on consumer hardware. It achieves this by treating a personal computer as a unified elastic inference platform, dynamically mapping computation across the GPU, CPU, and memory. This innovation opens new possibilities for deploying frontier-scale AI models at the edge. AI
IMPACT Enables deployment of large AI models on consumer hardware, potentially democratizing access to frontier AI capabilities.
RANK_REASON Open-source release of a new engine for running large AI models on consumer hardware.
Read on Mastodon — fosstodon.org →
- 753 billion parameter model
- elastic inference platform
- FreeToken
- personal machine
- workstation GPU
- 753B parameter models
- GLM-5.2
- graphics processing unit
- marktechpost
- University of California, Berkeley
AI-generated summary · Google Gemini · from 4 sources. How we write summaries →