Xiaomi has released its MiMo-V2.5-DFlash model, making the official DFlash weights available on Hugging Face. This model, reportedly with over 300 billion parameters, is noted for its performance, running at approximately 8-10 tokens/second on specific hardware configurations. The release is particularly significant as it includes separate MTP (Mixture of Tangent Experts) weights, which are expected to resolve compatibility issues with Llama.cpp and potentially double the model's inference speed. AI
IMPACT This release could improve inference speeds and compatibility for large models, potentially benefiting researchers and developers working with similar architectures.
RANK_REASON Release of model weights by a company, not a frontier lab. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →