PulseAugur
EN
LIVE 01:06:59

NVIDIA open-sources cuDNN kernels after 12 years, including MoE and sparse attention

By PulseAugur Editorial · [3 sources] ·

NVIDIA has open-sourced parts of its cuDNN library, a significant move after 12 years of it being closed-source. This release includes over 20 Mixture-of-Experts (MoE) kernels and NSA sparse attention kernels. The codebase for these kernels is largely written in Python CuTe-DSL, with public documentation now available. AI

IMPACT Open-sourcing of cuDNN kernels could accelerate research and development in AI infrastructure and model optimization.

RANK_REASON Open-sourcing of a significant software library component by a major tech company.

Read on X — SemiAnalysis →

AI-generated summary · Google Gemini · from 3 sources. How we write summaries →

NVIDIA open-sources cuDNN kernels after 12 years, including MoE and sparse attention

COVERAGE [3]

  1. X — SemiAnalysis TIER_1 English(EN) · SemiAnalysis_ ·

    @manicely6005 The public documentation can be found here too (3/3)

    @manicely6005 The public documentation can be found here too (3/3) https://t.co/jUnoOJ7kj7 https://t.co/M74p6UyTKc

  2. X — SemiAnalysis TIER_1 English(EN) · SemiAnalysis_ ·

    @manicely6005 The codebase for these kernels, a lot of these OSS cuDNN kernels are written in Python CuTe-DSL (2/3)

    @manicely6005 The codebase for these kernels, a lot of these OSS cuDNN kernels are written in Python CuTe-DSL (2/3) https://t.co/7awOYa0dbd https://t.co/euu5qaKveW

  3. X — SemiAnalysis TIER_1 English(EN) · SemiAnalysis_ ·

    For the past 12 years, cuDNN has been completely closed sourced (besides the .h files), until this week! OVER 20 MoE kernels & NSA sparse attention kernels

    For the past 12 years, cuDNN has been completely closed sourced (besides the .h files), until this week! OVER 20 MoE kernels & NSA sparse attention kernels from cuDNN has been open sourced! Great work to @manicely6005 & the rest of the team on seeing that parts of NVIDIA …

RELATED ENTITIES

RELATED TOPICS