PyTorch
PulseAugur coverage of PyTorch — every cluster mentioning PyTorch across labs, papers, and developer communities, ranked by signal.
25 day(s) with sentiment data
-
Student seeks advice on PyTorch vs. Dlib for CNN image pattern recognition
A machine learning student is seeking advice on the best framework for training a convolutional neural network (CNN) to solve the "Where's Waldo?" challenge. The student is comparing PyTorch and Dlib, noting that their …
-
WAVE project creates unified GPU ISA for cross-vendor compatibility
A new portable GPU instruction set architecture (ISA) called WAVE has been developed, aiming to unify programming across different hardware vendors. WAVE abstracts common functionalities found in NVIDIA, AMD, and Intel …
-
TorchLean framework formalizes neural networks in Lean 4 theorem prover
Researchers have developed TorchLean, a framework that formalizes neural networks within the Lean 4 theorem prover. This system allows for the execution and verification of neural networks directly within the same envir…
-
TensorGalerkin framework accelerates PDE solving and learning
Researchers have developed a new algorithmic framework called TensorGalerkin for solving, optimizing, and learning partial differential equations (PDEs) with variational structures. This framework utilizes an efficient …
-
Julia library embeds ML models into optimization frameworks
A new open-source Julia library called MathOptAI.jl has been developed to integrate trained machine learning models into mathematical optimization frameworks. This library supports various model types, including neural …
-
New method integrates deep learning into database queries
Researchers have developed a new method to integrate deep learning directly into database queries, bypassing the need for external ML frameworks. This approach associates each database tuple with a learnable vector embe…
-
New Gini MDS framework offers robust, flexible data embedding
Researchers have developed a new framework called Gini Multidimensional Scaling (Gini MDS) that extends traditional Euclidean MDS by incorporating a Gini pseudo-distance. This novel approach allows for more flexible exp…
-
DCGAN runs on RISC-V microcontroller with 512KB SRAM
A project successfully implemented a 12.6 million parameter DCGAN model for generating 64x64 cat faces on a dual-core RISC-V microcontroller with only 512KB of SRAM. The inference engine, written entirely in C, achieved…
-
NyayAI launches AI legal assistant for Indian jurisprudence
NyayAI is an AI-powered legal intelligence platform designed to make Indian law accessible and affordable for its 1.4 billion citizens. The platform addresses the critical issue of over 50 million pending court cases in…
-
Orbax library simplifies JAX distributed checkpointing
A new JAX-native checkpointing library called Orbax has been introduced to address the lack of a standardized solution within the JAX framework for distributed machine learning systems. This library aims to simplify the…
-
Forge Neo compatibility issue with older NVIDIA GPUs reported
A user is encountering an error with Forge Neo, a Stable Diffusion interface, due to their NVIDIA GeForce GTX 1080 Ti graphics card not being compatible with the current PyTorch installation. The error message indicates…
-
Robotics imitation learning pipeline suffers from extreme training slowness
A user on r/MachineLearning is seeking advice regarding a significantly slow training pipeline for imitation learning in robotics. Despite using a Diffusion Transformer (DiT) model with approximately 50 million paramete…
-
Open-source AI meeting platform Hoovik faces real-time inference challenges
Anupam Kumar, the creator of the open-source AI meeting platform Hoovik, found that the most challenging aspect of development was not the core WebRTC technology but managing real-time multimodal AI inference. This invo…
-
Developer creates SM1, a memory-efficient Mamba variant for PyTorch
A developer has created SM1, a variant of the Mamba1 architecture, optimized for PyTorch and capable of running on NVIDIA Blackwell hardware. SM1 replaces the selective scan with two native PyTorch operations, achieving…
-
Fixing local LLM OOM errors by optimizing KV cache and quantization
Running large open-source language models locally can lead to out-of-memory errors, even if the model's weights seem to fit within the available VRAM. This is primarily due to the significant memory required for the KV …
-
Curated PyTorch resource list covers LLMs to medical imaging
The Incredible PyTorch is a curated list designed to serve as a comprehensive bookmark for the PyTorch ecosystem. It covers a wide range of applications, including LLMs, object detection, reinforcement learning, and med…
-
Stanford's ThunderKittens DSL optimizes AI kernel performance
A new article details ThunderKittens, a compact domain-specific language (DSL) developed at Stanford's Hazy Research Lab for creating high-performance AI kernels. The DSL aims to strike a balance between research produc…
-
Diffusion model speedup hinges on overhead reduction, not just fewer steps
Single-image diffusion model inference is slowed by kernel launch overhead and attention memory traffic, rather than raw computational power. Optimizing with `torch.compile` in `reduce-overhead` mode, employing a fused …
-
Quantization study enables smaller, more accurate Whisper-small ASR
A new study published on arXiv evaluates various post-training quantization (PTQ) techniques for the Whisper-small automatic speech recognition model. The research, which tested libraries like PyTorch, Optimum-Quanto, H…
-
LLMs and new frameworks boost GPU kernel optimization
Researchers are exploring novel ways to optimize GPU kernel performance for large language models. One approach uses language models as surrogates to predict kernel performance, significantly increasing the number of ca…