PulseAugur
EN
LIVE 21:28:35

User asks about running Qwen 122B on 64GB RAM, 24GB VRAM

A user on the r/LocalLLaMA subreddit is inquiring about the feasibility of running the Qwen 122B large language model with a specific hardware configuration. They are asking for guidance on the necessary settings to achieve this, given their available 64GB of RAM and 24GB of VRAM. AI

RANK_REASON This is a user question on a forum about running a specific model with given hardware, not a news event.

Read on r/LocalLLaMA →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

User asks about running Qwen 122B on 64GB RAM, 24GB VRAM

COVERAGE [1]

  1. r/LocalLLaMA TIER_1 English(EN) · /u/soyalemujica ·

    Is it possible to run Qwen 122B in 64GB ram + 24gb vram ? If so, how ?

    <!-- SC_OFF --><div class="md"><p>Which settings would suffice to work with it ?</p> </div><!-- SC_ON --> &#32; submitted by &#32; <a href="https://www.reddit.com/user/soyalemujica"> /u/soyalemujica </a> <br /> <span><a href="https://www.reddit.com/r/LocalLLaMA/comments/1uts3ly/i…