PulseAugur
EN
LIVE 13:45:34

LLM RAM needs dwarf typical workloads; 70B models require ~45GB

Running large language models (LLMs) locally on a virtual private server (VPS) requires significantly more RAM than typical applications, with a 70B parameter model needing around 40-45 GB. A general formula for estimating LLM RAM needs is parameters multiplied by bits per weight, divided by eight, plus overhead for the context window and runtime. For non-LLM workloads, 1-4 GB of RAM is usually sufficient, with 2 GB being a common default for services using databases or Docker. Monitoring available RAM and checking for Out-Of-Memory (OOM) killer events is crucial for proper VPS sizing, rather than over-provisioning based on guesswork. AI

IMPACT Provides practical guidance for deploying LLMs on VPS, helping users avoid overspending on RAM and ensuring stable performance.

RANK_REASON The item provides practical advice on sizing VPS resources for specific workloads, particularly LLMs, rather than announcing a new model or research.

Read on dev.to — LLM tag →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

LLM RAM needs dwarf typical workloads; 70B models require ~45GB

How we ranked this

Signal score
39 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
The item provides practical advice on sizing VPS resources for specific workloads, particularly LLMs, rather than announcing a new model or research.
Source corroboration
Single-source cluster
Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics
infra, model release
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
Breaking (< 6h)
Fresh story with cross-source coverage still developing. Ranking may shift as more sources report.

Full methodology in our editorial standards.

COVERAGE [1]

  1. dev.to — LLM tag TIER_1 English(EN) · EQVPS ·

    How much RAM does a VPS need? Real numbers by workload

    <p>Most people guess their RAM. They either buy far too much "just in case" or discover the OOM killer at 3 a.m. Memory is actually one of the easiest things to size, because workloads are predictable once you know the rough numbers. Here they are, from a 1 GB bot box up to the 6…