PulseAugur
EN
LIVE 17:29:24

NVIDIA Run:ai GPU Fractioning enables shared GPU use on Amazon EKS

NVIDIA Run:ai GPU Fractioning is now available for Amazon Elastic Kubernetes Service (EKS), enabling multiple teams to share a single GPU. This open-source software builds upon NVIDIA's Multi-Process Service (MPS) to offer Kubernetes-integrated scheduling, per-Pod memory contracts, and enforcement. The solution is particularly useful for workloads like notebooks, model evaluations, and small inference services that might otherwise leave GPUs underutilized due to memory constraints. The walkthrough demonstrates configuring this on an Amazon EC2 g5.xlarge instance with an NVIDIA A10G GPU, showing how to set memory limits and verify allocations. AI

IMPACT Enhances GPU utilization for AI workloads on Kubernetes, potentially reducing costs and improving resource availability for development and inference tasks.

RANK_REASON This is a software integration and configuration guide for existing infrastructure, not a new model release or core research.

Read on Mastodon — fosstodon.org →

AI-generated summary · Google Gemini · from 2 sources. How we write summaries →

NVIDIA Run:ai GPU Fractioning enables shared GPU use on Amazon EKS

How we ranked this

Signal score
21 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
This is a software integration and configuration guide for existing infrastructure, not a new model release or core research.
Source corroboration
2 independent sources
Multiple independent publishers reporting the same story raises confidence that it's real and newsworthy.
Topics
infra, product
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
Breaking (< 6h)
Fresh story with cross-source coverage still developing. Ranking may shift as more sources report.

Full methodology in our editorial standards.

COVERAGE [2]

  1. AWS Machine Learning Blog TIER_1 English(EN) · Muru Bhaskaran ·

    Using NVIDIA Run:ai GPU Fractioning on Amazon EKS

    Learn how to run two memory-bounded Kubernetes Pods on a single NVIDIA A10G GPU using open-source NVIDIA Run:ai GPU Fractioning on Amazon EKS. This walkthrough builds a custom Amazon Linux 2023 image, installs KAI Scheduler and the GPU Fractioning Operator, and validates per-Pod …

  2. Mastodon — fosstodon.org TIER_1 English(EN) · [email protected] ·

    🤖 Using NVIDIA Run:ai GPU Fractioning on Amazon EKS Learn how to run two memory-bounded Kubernetes Pods on a single NVIDIA A10G GPU using open-source NVIDIA Run

    🤖 Using NVIDIA Run:ai GPU Fractioning on Amazon EKS Learn how to run two memory-bounded Kubernetes Pods on a single NVIDIA A10G GPU using open-source NVIDIA Run:ai GPU Fractioning on Amazon EKS. This walkthrough builds a custom Amazon Linux 2023 ima... 📰 Source: Artificial Intell…