PulseAugur
EN
LIVE 05:57:04

Unsloth adds AMD GPU support for faster local LLM training

Unsloth has released an update that significantly enhances support for AMD GPUs, enabling local LLM training and inference across Windows, WSL, and Linux. This new version offers up to 2x faster performance and requires 70% less VRAM compared to previous configurations, with no loss in accuracy. The update also improves compatibility with AMD's MI300X and MI325X GPUs, supports GGUF and Safetensors formats, and introduces features for running larger models by utilizing system memory and splitting models across multiple GPUs. AI

IMPACT Accelerates local LLM deployment on AMD hardware, potentially lowering barriers for users without NVIDIA GPUs.

RANK_REASON This is a software update for a tool that enhances LLM performance on specific hardware, not a core AI model release or research paper.

Read on Unsloth — Releases →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Unsloth adds AMD GPU support for faster local LLM training

COVERAGE [1]

  1. Unsloth — Releases TIER_1 English(EN) · Etherll ·

    Introducing AMD support

    <p>Hey everyone! This release brings local LLM training and inference to AMD GPUs across Windows, WSL and Linux. <a href="https://unsloth.ai/docs/basics/amd" rel="nofollow">Read our AMD Blog + Guide</a></p> <p>Starting today, our AMD collaboration, custom Triton kernels, and math…