Should I exchange my rtx 30 for P40?
A user on the r/LocalLLaMA subreddit is seeking advice on whether to trade their RTX 3080 and RTX 3070 GPUs for two NVIDIA P40 cards. The primary concern is optimizing performance for running local large language models, particularly for models exceeding 10GB VRAM, where the P40's 24GB capacity might offer an advantage despite potential speed differences with smaller models. The user also notes potential issues with mixing GPU architectures and is looking for guidance on the best hardware configuration for their specific use case, which includes running a Hermes agent and testing new large models. AI