PulseAugur
EN
LIVE 18:45:16

NVIDIA unveils Nemotron LLMs for efficient inference and audio tasks · 2 sources tracked

NVIDIA has released two new large language models: Nemotron-Labs-3-Puzzle-75B-A9B, an optimized version of Nemotron-3-Super-120B-A12B, designed for improved inference efficiency and long-context workloads. This model uses a hybrid MoE architecture and reduces parameter count while maintaining accuracy across various benchmarks. Additionally, NVIDIA introduced Nemotron-Labs-Audex-30B-A3B, an audio-text LLM built on Nemotron-Cascade-2-30B-A3B. Audex-30B-A3B extends its capabilities to audio tasks such as speech recognition, translation, and generation, while retaining strong reasoning and knowledge abilities from its text-only backbone and supporting a 1M-token context length. AI

IMPACT These releases enhance efficiency for interactive and long-context workloads, and expand LLM capabilities into audio processing, potentially accelerating adoption in specialized AI applications.

RANK_REASON Cluster contains announcements of new LLM models from NVIDIA, a frontier lab. [lever_c_demoted from frontier_release: ic=2 ai=1.0]

Read on r/LocalLLaMA →

AI-generated summary · Google Gemini · from 2 sources. How we write summaries →

NVIDIA unveils Nemotron LLMs for efficient inference and audio tasks · 2 sources tracked

COVERAGE [2]

  1. r/LocalLLaMA TIER_1 English(EN) · /u/jacek2023 ·

    nvidia/NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-BF16 · Hugging Face

    <table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1upsdmi/nvidianvidianemotronlabs3puzzle75ba9bbf16_hugging/"> <img alt="nvidia/NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-BF16 · Hugging Face" src="https://external-preview.redd.it/9KNaWiT3A0U4xGNY8hRs0D9rkm6EHuN3da…

  2. r/LocalLLaMA TIER_1 English(EN) · /u/pmttyji ·

    nvidia/Nemotron-Labs-Audex-30B-A3B · Hugging Face

    <table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1upnm8x/nvidianemotronlabsaudex30ba3b_hugging_face/"> <img alt="nvidia/Nemotron-Labs-Audex-30B-A3B · Hugging Face" src="https://external-preview.redd.it/I6RTEmv-UD7si5r-ldUn2OnbIIuovU5Lzh5-mTaD-04.png?width=64…