PulseAugur
EN
LIVE 03:22:17

NVIDIA open-sources cuDNN kernels after 12 years, including MoE and sparse attention

By PulseAugur Editorial · [3 sources] ·

NVIDIA has open-sourced parts of its cuDNN library, a significant move after 12 years of it being closed-source. This release includes over 20 Mixture-of-Experts (MoE) kernels and NSA sparse attention kernels. The codebase for these kernels is largely written in Python CuTe-DSL, with public documentation now available. AI

IMPACT Open-sourcing of cuDNN kernels could accelerate research and development in AI infrastructure and model optimization.

RANK_REASON Open-sourcing of a significant software library component by a major tech company.

Read on X — SemiAnalysis →

AI-generated summary · Google Gemini · from 3 sources. How we write summaries →

NVIDIA open-sources cuDNN kernels after 12 years, including MoE and sparse attention

How we ranked this

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Research
Open-sourcing of a significant software library component by a major tech company.
Source corroboration
3 independent sources
Multiple independent publishers reporting the same story raises confidence that it's real and newsworthy.
Topics
model release, infra
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
146 days old
Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.

Full methodology in our editorial standards.

COVERAGE [3]

  1. X — SemiAnalysis TIER_1 English(EN) · SemiAnalysis_ ·

    @manicely6005 The public documentation can be found here too (3/3)

    @manicely6005 The public documentation can be found here too (3/3) https://t.co/jUnoOJ7kj7 https://t.co/M74p6UyTKc

  2. X — SemiAnalysis TIER_1 English(EN) · SemiAnalysis_ ·

    @manicely6005 The codebase for these kernels, a lot of these OSS cuDNN kernels are written in Python CuTe-DSL (2/3)

    @manicely6005 The codebase for these kernels, a lot of these OSS cuDNN kernels are written in Python CuTe-DSL (2/3) https://t.co/7awOYa0dbd https://t.co/euu5qaKveW

  3. X — SemiAnalysis TIER_1 English(EN) · SemiAnalysis_ ·

    For the past 12 years, cuDNN has been completely closed sourced (besides the .h files), until this week! OVER 20 MoE kernels &amp; NSA sparse attention kernels

    For the past 12 years, cuDNN has been completely closed sourced (besides the .h files), until this week! OVER 20 MoE kernels &amp; NSA sparse attention kernels from cuDNN has been open sourced! Great work to @manicely6005 &amp; the rest of the team on seeing that parts of NVIDIA …

RELATED ENTITIES

RELATED TOPICS