PCI Express
PulseAugur coverage of PCI Express — every cluster mentioning PCI Express across labs, papers, and developer communities, ranked by signal.
9 day(s) with sentiment data
-
Google's Elephant-Goldfish AI aids software design with memory features
Google has developed a new AI model called Elephant-Goldfish, designed to assist in software development by incorporating memory capabilities and enabling fresh review of code. This development comes as the broader tech…
-
LLMs vulnerable to GPU soft errors; integration challenges noted
A new study from arXiv investigates the vulnerability of large language models (LLMs) to soft errors in graphics processing units (GPUs), particularly in radiation-prone environments. The research, which involves instru…
-
CHARM+ mechanism boosts LLM distributed attention performance
Researchers have introduced CHARM+, a novel mechanism designed to enhance distributed attention in large language models, particularly for long sequences. This new approach reorganizes sequential communications into mul…
-
Together AI launches Together Compiler for continuous AI inference optimization · 8 sources tracked
Together AI has launched Together Compiler (TKCC), a novel system designed to continuously optimize AI inference. TKCC utilizes high-throughput agents to adapt inference engines to dynamic workloads, model architectures…
-
Optimized GLM-5.3-Flash for single GPU, boosting speed 1.5x
A technical blog post details optimizations for running the large GLM-5.3-Flash model on a single 96 GiB GPU, achieving up to 16.5 tokens per second. The author implemented a "hot-expert cache" that keeps frequently use…
-
User seeks budget GPU upgrade for 31B model on Reddit
A user on Reddit's r/LocalLLaMA subreddit is seeking advice on upgrading their AI server to run a 31B parameter model with a 16K context window at a speed of at least 15 tokens per second. Their current setup includes a…
-
Specter system accelerates MoE inference with quantization and speculative offloading
Researchers have developed Specter, a novel inference system designed to accelerate Mixture of Experts (MoE) models, which often exceed the memory capacity of a single accelerator. Specter combines quantization with spe…
-
Optical PCIe technology promises extended reach for AI data center designs
Companies like Lumentum, Astera Labs, and Corning are demonstrating optical PCIe technology as a potential solution to the limitations of traditional copper interconnects in AI data centers. This technology transmits da…
-
AI-Node-Sentinel project tests LLM integration for GPU fault triage
An open-source project called AI-Node-Sentinel has been developed to integrate LLMs into GPU fault triage systems. The project, currently in its early stages (scaffold v0.1), aims to automate the process of analyzing ha…
-
New system optimizes MoE LLM inference with CPU-GPU collaboration
A new system called \method has been developed to improve the efficiency of Mixture-of-Experts (MoE) Large Language Models (LLMs) during inference. This system addresses the challenge of large expert memory footprints e…
-
SanDisk offers 512GB Switch 2 microSD card for $98
SanDisk is offering a 512GB microSD Express card, designed for the Nintendo Switch 2, at a discounted price of $98. This card boasts significantly faster read and write speeds compared to traditional microSD cards, util…
-
SK Hynix designs custom cores to boost SSD controller efficiency
SK Hynix is developing custom, low-power CPU cores called Hynix Transaction Processing Units (H-TPUs) to offload repetitive tasks from traditional Arm CPUs in their SSD controllers. These H-TPUs are designed to handle r…
-
Nvidia GPU Terms Explained for AI Engineers
This article defines essential GPU terms for AI engineers, covering concepts from CUDA cores to NVLink. It explains how these NVIDIA GPU concepts influence model fitting, execution speed, and scalability. The piece aims…
-
New ThunderEP design boosts MoE inference on consumer GPUs
Researchers have developed ThunderEP, a new communication design for efficiently running large Mixture-of-Experts (MoE) models on consumer GPUs connected via PCIe. This system addresses the communication bottlenecks inh…
-
Intel's Nova Lake CPUs pass USB and PCIe compliance ahead of launch
Intel's upcoming Nova Lake processors and associated chipsets have successfully passed compliance testing with both the PCI-SIG and USB Implementers Forum. These certifications are crucial steps before the official laun…
-
AI interconnect demand surges, reshaping copper vs. optical debate
The demand for AI infrastructure is driving up the need for high-speed interconnects, pushing companies like Astera Labs to develop solutions that can handle increased data exchange between GPUs. This has led to a re-ev…
-
MSI Mode: A Windows Feature for GPU Communication Explained
MSI mode is a Windows feature that allows hardware devices like graphics cards to communicate with the CPU more efficiently. Introduced with PCIe 2.2 and Windows Vista, it uses memory-mapped interrupts instead of physic…
-
8-pin PCIe power connectors melt on Radeon RX 7900 XTX with adapter
An 8-pin PCIe power connector on a Thermal Grizzly WireView adapter reportedly melted while connected to a Radeon RX 7900 XTX graphics card. The user experienced system freezes and black screens before discovering the b…
-
M.2 to OCuLink adapter downgrades PCIe speed, impacting AI model performance
A user on Reddit's r/LocalLLaMA subreddit discovered that their M.2 to OCuLink adapter was unexpectedly downgrading the PCIe connection to Gen1 speeds. This issue was not immediately apparent and required manual checkin…
-
Technical deep dive into GPU memory write operations
This technical article delves into the intricacies of how GPUs manage memory writes, exploring the differences between various memory types like GDDR6 and HBM2. It examines the role of interfaces such as PCI Express and…