The price of graphics cards suitable for running local large language models has significantly increased, prompting a user to seek advice on purchasing a second card. The user notes that their existing AMD RX 7900 XTX, purchased for €900, now costs €1200 new or €900 used, with even older models like the RX 7900 XT being expensive. Nvidia cards are also prohibitively priced. The user is considering a dual AMD RDNA 3 setup for compatibility with llama.cpp but is concerned about the cost and performance implications. AI
IMPACT Rising graphics card costs may hinder accessibility for individuals running local LLMs.
RANK_REASON User query about hardware pricing for AI model deployment.
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →