PulseAugur
EN
LIVE 05:11:02

Unsloth adds AMD hardware support for local AI model inference

Unsloth, an open-source platform for local AI model inference and fine-tuning, has officially added support for AMD hardware. This expansion allows users to leverage AMD GPUs, including Radeon RX 9000/7000 series and Instinct MI350/MI300, for various AI tasks. The update promises significant VRAM reduction, with up to 70% less needed for training and 80% less for reinforcement learning, and includes optimized builds for ROCm, Triton, and PyTorch. AI

IMPACT Expands accessibility of local AI model training and inference to users with AMD hardware, potentially increasing adoption of open-source AI tools.

RANK_REASON This is a software update for an existing tool that adds hardware compatibility, not a new frontier model release or significant industry-wide event.

Read on r/LocalLLaMA →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Unsloth adds AMD hardware support for local AI model inference

COVERAGE [1]

  1. r/LocalLLaMA TIER_1 English(EN) · /u/danielhanchen ·

    Unsloth now supports AMD!

    <table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1v1nor4/unsloth_now_supports_amd/"> <img alt="Unsloth now supports AMD!" src="https://preview.redd.it/y35zj1u8deeh1.png?width=640&amp;crop=smart&amp;auto=webp&amp;s=ec449916b43eb79bbabbbc4c063c3b3e0eea967a" ti…