3090
PulseAugur coverage of 3090 — every cluster mentioning 3090 across labs, papers, and developer communities, ranked by signal.
8 day(s) with sentiment data
-
NInfer fork enables 2x performance boost for Qwen3.6-35B on CMP170HX hardware
A user has successfully forked the NInfer project to enable it to run on CMP170HX hardware, achieving a twofold performance increase for the Qwen3.6-35B model. This modification involved adjusting CUDA kernels and compi…
-
User seeks help optimizing llama.cpp for multi-GPU LLM inference
A user on Reddit's r/LocalLLaMA subreddit is seeking assistance with configuring llama.cpp to effectively utilize multiple GPUs for running large language models. They are experiencing issues with performance when attem…
-
Local LLM execution doesn't guarantee local data path
Running a large language model locally does not guarantee that all associated data remains within a controlled environment. Sensitive data can still be exposed through components like retrieval-augmented generation (RAG…
-
Dual 3090 GPUs achieve 1600+ tps with Qwen 3.6 27B by switching split modes
A user on Reddit's r/LocalLLaMA community shared their experience optimizing performance for the Qwen 3.6 27B model on a dual 3090 GPU setup. Initially, using `--split-mode tensor` resulted in prompt processing occurrin…
-
GPU thermal paste replacement offers significant cooling improvements
A user on the r/LocalLLaMA subreddit shared a public service announcement regarding the maintenance of older GPUs, specifically mentioning the 3090 model. They detailed how replacing the thermal paste on their GPU signi…
-
DSv4 Flash 0731 model runs on single NVIDIA 3090 GPU
A user has successfully run the DSv4 Flash 0731 model on a single, unoptimized NVIDIA 3090 graphics card. The setup includes an E5 2690v4 CPU and 3x32 DDR4 ECC RAM, with the 3090 operating at 250W. The model achieved a …
-
RTX 3090 owners share VRAM temps under AI load
Users on the r/LocalLLaMA subreddit are discussing the VRAM temperatures experienced by NVIDIA RTX 3090 graphics cards when running large language models. The original poster is seeking to determine if their GPU's tempe…
-
RTX Pro 4500: Evaluating Use Cases Against Higher-Power GPUs
The NVIDIA RTX Pro 4500 graphics card is being discussed for its potential use cases, particularly in comparison to other configurations like the RTX 5090 or multiple RTX 3090s. Users are questioning its value propositi…
-
User seeks AI model recommendation for 4x 3090 GPU setup
A user with a server equipped with four NVIDIA 3090 GPUs and 96GB of VRAM is seeking recommendations for which AI model to run. They plan to use the server as a personal AI playground for idea manifestation and prototyp…
-
User upgrades to dual 3080 20GB GPUs for local LLM tasks
A Reddit user on the r/LocalLLaMA subreddit shared their recent acquisition of two 3080 20GB graphics cards. They purchased these cards for less than the cost of a single 3090, aiming to upgrade from their current 3090 …
-
Qwen3.6 27B model achieves 219 tokens/sec decoding speed
A user has achieved a new personal best in decoding speed with the Qwen3.6 27B model, reaching 219 tokens per second on a single 3090 GPU. This surpasses their previous record of 206 tokens per second. The user also not…
-
AI Enthusiast Seeks GPU Upgrade Advice for Large Models
A user on the r/LocalLLaMA subreddit is seeking advice on upgrading their GPU setup to accommodate larger AI models, specifically mentioning DeepSeek V4. They are considering adding either two modified 4090s with 48GB o…
-
NVIDIA Puzzle-75B-A9B model achieves high performance on consumer GPUs
A user on r/LocalLLaMA has detailed their experience running the Nemotron-3-Puzzle-75B-A9B model with NVFP4 quantization across three NVIDIA 3090 GPUs. The setup achieved 132 tokens/second with a 256K context window and…
-
User praises Qwen 27B model with 200K context on 3090 GPU
A Reddit user shared an appreciation post on the r/LocalLLaMA subreddit, expressing satisfaction with their setup. They are running the Qwen 27B model with a 200K context window on a new 3090 GPU. The user specifically …
-
Krea2 training speeds discussed on Reddit for 3090 GPUs
Users on Reddit are discussing training speeds for Krea2, a tool likely related to AI image generation, on NVIDIA's 3090 graphics card. One user reported 6-7 second iterations at 512px resolution while optimizing VRAM, …
-
Local LLM user seeks advice on maximizing context window for coding tasks
A user on the r/LocalLLaMA subreddit is seeking advice on maximizing context window size for local LLM usage, specifically for coding tasks. They are currently using a Qwen 3.6 27B model on a single 3090 GPU with 24GB V…
-
NVIDIA 3090 GPU Stuck at High Idle Power Consumption
A user on the r/LocalLLaMA subreddit is experiencing an issue where their NVIDIA 3090 graphics card is not returning to its idle power state. Despite previous driver updates improving idle consumption, one of the user's…
-
Krea2 Turbo FP8 model tested for character recognition and performance
Users are testing the Krea2 Turbo FP8 model, noting its performance and character recognition capabilities. One extensive test involved over 1000 prompts to evaluate how well the model identifies characters from various…
-
User asks if 11x 3090 GPUs are enough VRAM for Qwen LLM
A user on the r/LocalLLaMA subreddit is inquiring about the necessary VRAM to run the Qwen large language model. They list their available hardware, which includes eleven 3090 GPUs, one 5090 GPU, and one 5060 Ti GPU, an…
-
User laments 3090 GPU failure, loss of advanced model capabilities
A user on the r/LocalLLaMA subreddit shared that their 3090 GPU has failed. They expressed disappointment, particularly noting the loss of capability for running larger models with BF16 precision and KV cache, and lamen…