PulseAugur
EN
LIVE 00:35:43

Graphics card prices surge, impacting local LLM setups

The price of graphics cards suitable for running local large language models has significantly increased, prompting a user to seek advice on purchasing a second card. The user notes that their existing AMD RX 7900 XTX, purchased for €900, now costs €1200 new or €900 used, with even older models like the RX 7900 XT being expensive. Nvidia cards are also prohibitively priced. The user is considering a dual AMD RDNA 3 setup for compatibility with llama.cpp but is concerned about the cost and performance implications. AI

IMPACT Rising graphics card costs may hinder accessibility for individuals running local LLMs.

RANK_REASON User query about hardware pricing for AI model deployment.

Read on r/LocalLLaMA →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Graphics card prices surge, impacting local LLM setups

COVERAGE [1]

  1. r/LocalLLaMA TIER_1 English(EN) · /u/zenbeni ·

    Prices of graphic cards are going crazy, should I buy a second card though?

    <!-- SC_OFF --><div class="md"><p>A few months ago, I bought a RX 7900 XTX 24g to start toying with local LLM, at 900€ new. Little I knew that now I want to add a second card to my rig, but prices have gone insane! Adding a new 7900 XTX would cost me 1200€ as new now, used price …