PCI Express
PulseAugur coverage of PCI Express — every cluster mentioning PCI Express across labs, papers, and developer communities, ranked by signal.
7 day(s) with sentiment data
-
PCIe P2P Boosts LLM Performance on Consumer NVIDIA GPUs
A Reddit user shared a method to significantly improve the performance of large language models on multi-GPU consumer hardware by enabling PCI Express Peer-to-Peer (P2P) communication. By enabling P2P with patched NVIDI…
-
ASUS Pro WS WRX90E-SAGE SE Workstation Motherboard Detailed
The ASUS Pro WS WRX90E-SAGE SE motherboard is designed for AMD Threadripper PRO CPUs, offering extensive PCIe expansion and ECC memory support. This workstation-grade board is not intended for typical gaming setups but …
-
PCIe SSDs: Capacity Over Speed Amidst RAM Shortage
During a global memory supply shortage, the choice between PCIe SSDs for PC builds should prioritize capacity over raw speed for most users. While high read/write speeds are beneficial for tasks like game loading, the a…
-
AI presents major opportunity and threat to data storage sector
The storage industry faces a dual challenge and opportunity with the rise of AI. While AI drives demand for faster access and more secure data recovery, it also introduces significant threats through potential mishaps a…
-
Multi-LoRA Serving Latency Solved with Dependency-Aware Caching
Startups fine-tuning large language models for specific customer needs often face escalating infrastructure costs. A common solution is to use Multi-LoRA serving, which allows multiple fine-tuned adapters to run on a si…
-
Supermicro becomes go-to OEM for custom server architectures
Supermicro has emerged as a key OEM for startups developing unique server architectures, moving beyond standard designs. The company offers flexible solutions that accommodate diverse PCIe topologies, including single a…
-
AMD unveils Instinct MI350P AI accelerator with HBM and PCIe
AMD has unveiled the Instinct MI350P, a new AI accelerator featuring High Bandwidth Memory (HBM) and a PCI Express interface. This accelerator is designed to enhance AI and high-performance computing tasks. The MI350P i…
-
Together AI boosts GPU cluster reliability with auto-repair and Slinky 1.0
Together AI has enhanced its GPU Clusters with new features focused on reliability and operational control for large-scale AI workloads. These updates include passive health checks to detect hardware and software degrad…
-
New ATSInfer system boosts local LLM inference on consumer devices
A new system called ATSInfer has been developed to improve the performance of large language models (LLMs) on consumer devices by efficiently utilizing both CPU and GPU resources. This system operates at a tensor granul…
-
AI model serving speedups decomposed: runtime gains dominate, quantization offers minor boost · 2 sources tracked
A new research paper details a method for decomposing speedups in AI model serving, separating gains from runtime, kernel optimizations, and quantization. The study, conducted on four NVIDIA RTX A5000 GPUs, found that r…
-
Dual GPU llama.cpp tests reveal PCIe transfer differences between tensor and pipeline parallel
A Reddit user conducted tests on a dual-GPU setup using llama.cpp to measure PCIe transfer speeds under different parallelization strategies. The tests compared tensor parallel and pipeline parallel configurations, reve…
-
MI50 GPU Performance: PCIe vs. PEX8749 Switch Card
A user on Reddit's r/LocalLLaMA subreddit shared performance benchmarks comparing two configurations of MI50 GPUs. The first setup utilized six MI50s directly connected via PCIe, while the second used a PEX8749 card to …
-
China's Loongson launches 16-core LoongArch server CPU for SMBs
China-based Loongson Technology has released its new 3C3000 server processor, featuring 16 cores based on the LoongArch architecture. This 40W chip supports DDR4 ECC memory and offers 32 PCIe lanes, positioning it for c…
-
Rosewill M.2 SSD Cloner and Eraser Hits Record Low Price of $47
Rosewill's M.2 SSD Cloner and Eraser is currently available at its lowest price of $47, offering a convenient solution for IT professionals and home users alike. This device supports cloning and erasing NVMe drives both…
-
Meta pauses employee-tracking AI program after internal data leak
Meta has temporarily halted an internal AI training program that tracked employee computer activity, including mouse movements and keystrokes, following a significant data leak. The program, known as the Model Compatibi…
-
AI Sector Poised for Growth: Computing Power, PCIe, and Drug Discovery Lead the Charge
Multiple reports from 36Kr highlight a bullish outlook on the AI sector, particularly focusing on the demand for computing power and related infrastructure. Analysts from CITIC Securities and CITIC Construction Investme…
-
Chinese firm creates compact V100 GPU for AI
A Chinese company called "GPU god" has developed a single-slot, half-height PCIe version of the NVIDIA V100 GPU. This custom-designed card retains the full performance of the V100 core and is intended for passive coolin…
-
User asks about dual-GPU performance for local LLMs
A user on Reddit's r/LocalLLaMA subreddit is seeking advice on optimizing hardware for running large language models locally. They are currently able to run a 16 billion parameter model with Q4 quantization on a single …
-
AMD B650 chipset cards add M.2 slots and USB ports to PCs
New expansion cards featuring AMD's Promontory 21 chipset are now available, offering users the ability to add significant I/O capabilities to their PCs. These cards can provide up to four M.2 slots, multiple USB ports,…
-
User doubles LLM inference speed by fixing PCIe slot bottleneck
A user building a multi-GPU setup for local LLM inference discovered a significant performance bottleneck caused by a misconfigured PCIe slot. One of the four RTX 3090 GPUs was incorrectly placed in a slot that only sup…