PulseAugur
EN
LIVE 02:38:42

Local LLM users seek networked multi-GPU solutions

A user on the r/LocalLLaMA subreddit is seeking methods to combine the processing power of two separate PCs, one equipped with an RTX 5090 and another with an RTX 4080, for running large language models. They are looking for a user-friendly client application, similar to existing tools like LMStudio or JanAI, that facilitates this networked GPU usage. The user also inquires about the reasons behind the apparent lack of readily available solutions for this specific use case. AI

IMPACT Highlights a potential gap in tooling for users wanting to scale local LLM inference across multiple machines.

RANK_REASON User-generated question about a technical challenge in running LLMs locally.

Read on r/LocalLLaMA →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

COVERAGE [1]

  1. r/LocalLLaMA TIER_1 English(EN) · /u/F0UR_TWENTY ·

    I have 2x PC's. One with a 5090 and one with a 4080. Is there an easy way to use both together networked?

    <!-- SC_OFF --><div class="md"><p>I have a 5090 PC with 64 gb DDR5 and a 4080 build with 192gb DDR5. </p> <p>I have heard methods of networking multiple PC's together, but is there a simple client that does this easily? </p> <p>If not, then can someone explain why there isn't one…