PulseAugur
EN
LIVE 18:45:59

PLaMo 3 Translate 0.8B model shrinks to 423MB with mixed quantization

A new mixed-quantization version of the PLaMo 3 Translate 0.8B model has been released, reducing its weight size to approximately 423MB. This version, converted using mlx-lm 0.32.2, allocates 4-bit quantization to specific layers while using 3-bit for the rest, resulting in an average of 3.804 bits per weight. While the model's translation quality metric shows a slight decrease compared to the uniform 4-bit version, it maintains a decode speed of around 352 tokens/s and peak memory usage of about 565MB on a Mac mini M2 Pro. AI

IMPACT Enables running more capable translation models on resource-constrained devices.

RANK_REASON Release of a smaller, quantized version of an existing LLM with performance metrics. [lever_c_demoted from research: ic=1 ai=1.0]

Read on dev.to — LLM tag →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

PLaMo 3 Translate 0.8B model shrinks to 423MB with mixed quantization

How we ranked this

Signal score
26 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
Release of a smaller, quantized version of an existing LLM with performance metrics. [lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration
Single-source cluster
Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics
model release, infra
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
Breaking (< 6h)
Fresh story with cross-source coverage still developing. Ranking may shift as more sources report.

Full methodology in our editorial standards.

COVERAGE [1]

  1. dev.to — LLM tag TIER_1 English(EN) · Noptium ·

    PLaMo 3 Translate 0.8B Gets Down to About 423MB of Weights

    <p>An MLX version of PLaMo 3 Translate 0.8B, the smallest model in PFN's translation-focused LLM family, now has weights of only about 423MB. It is a mixed-quantization model called "mixed_3_4", published on Hugging Face by an individual converter.</p> <p>Unless noted otherwise, …