Dual GPUs - 3060 & 3090 on a P520
A user on the r/LocalLLaMA subreddit is seeking advice on configuring a dual-GPU setup for running large language models locally. They plan to combine a new NVIDIA RTX 3090 with their existing RTX 3060 in a ThinkStation P520 workstation. The primary goal is to achieve 36GB of VRAM for enhanced model performance, with considerations for power supply limitations and software compatibility using Manjaro Linux and llama.cpp. AI