PulseAugur
EN
LIVE 12:09:35

User seeks advice on multi-GPU setup for local AI models

A user on the r/LocalLLaMA subreddit is seeking advice on how to best utilize a collection of older consumer GPUs for local AI model deployment. They have a mix of NVIDIA and AMD cards with varying VRAM capacities, including a 9070 XT, 5700 XT, GTX 1080 Ti, GTX 970, and an R290. The user also has access to several PCIe slots and M.2 to Oculink eGPU connections on their AM5 platform with 64GB of DDR5 RAM. AI

RANK_REASON User-generated content on a niche subreddit seeking personal technical advice, not reporting on industry news.

Read on r/LocalLLaMA →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

COVERAGE [1]

  1. r/LocalLLaMA TIER_1 English(EN) · /u/Vaguswarrior ·

    I am not a smart man, please help me figure out my weird poor man's multigpu frankensetup

    <!-- SC_OFF --><div class="md"><p>I have the following old consumer GPUs in my house:</p> <p>9070 XT 16gb </p> <p>5700 XT 8gb </p> <p>GTX 1080 TI 12gb </p> <p>GTX 970 3.5gb </p> <p>R290 4GB (It's an older <del>code</del> GPU ​but it still checks out)</p> <p>I have access to the f…