PyTorch
PulseAugur coverage of PyTorch — every cluster mentioning PyTorch across labs, papers, and developer communities, ranked by signal.
13 天有情绪数据
-
DCGAN runs on RISC-V microcontroller with 512KB SRAM
A project successfully implemented a 12.6 million parameter DCGAN model for generating 64x64 cat faces on a dual-core RISC-V microcontroller with only 512KB of SRAM. The inference engine, written entirely in C, achieved…
-
NyayAI launches AI legal assistant for Indian jurisprudence
NyayAI is an AI-powered legal intelligence platform designed to make Indian law accessible and affordable for its 1.4 billion citizens. The platform addresses the critical issue of over 50 million pending court cases in…
-
Orbax library simplifies JAX distributed checkpointing
A new JAX-native checkpointing library called Orbax has been introduced to address the lack of a standardized solution within the JAX framework for distributed machine learning systems. This library aims to simplify the…
-
Forge Neo compatibility issue with older NVIDIA GPUs reported
A user is encountering an error with Forge Neo, a Stable Diffusion interface, due to their NVIDIA GeForce GTX 1080 Ti graphics card not being compatible with the current PyTorch installation. The error message indicates…
-
Robotics imitation learning pipeline suffers from extreme training slowness
A user on r/MachineLearning is seeking advice regarding a significantly slow training pipeline for imitation learning in robotics. Despite using a Diffusion Transformer (DiT) model with approximately 50 million paramete…
-
Open-source AI meeting platform Hoovik faces real-time inference challenges
Anupam Kumar, the creator of the open-source AI meeting platform Hoovik, found that the most challenging aspect of development was not the core WebRTC technology but managing real-time multimodal AI inference. This invo…
-
Developer creates SM1, a memory-efficient Mamba variant for PyTorch
A developer has created SM1, a variant of the Mamba1 architecture, optimized for PyTorch and capable of running on NVIDIA Blackwell hardware. SM1 replaces the selective scan with two native PyTorch operations, achieving…
-
Fixing local LLM OOM errors by optimizing KV cache and quantization
Running large open-source language models locally can lead to out-of-memory errors, even if the model's weights seem to fit within the available VRAM. This is primarily due to the significant memory required for the KV …
-
Curated PyTorch resource list covers LLMs to medical imaging
The Incredible PyTorch is a curated list designed to serve as a comprehensive bookmark for the PyTorch ecosystem. It covers a wide range of applications, including LLMs, object detection, reinforcement learning, and med…
-
Stanford's ThunderKittens DSL optimizes AI kernel performance
A new article details ThunderKittens, a compact domain-specific language (DSL) developed at Stanford's Hazy Research Lab for creating high-performance AI kernels. The DSL aims to strike a balance between research produc…
-
Diffusion model speedup hinges on overhead reduction, not just fewer steps
Single-image diffusion model inference is slowed by kernel launch overhead and attention memory traffic, rather than raw computational power. Optimizing with `torch.compile` in `reduce-overhead` mode, employing a fused …
-
Quantization study enables smaller, more accurate Whisper-small ASR
A new study published on arXiv evaluates various post-training quantization (PTQ) techniques for the Whisper-small automatic speech recognition model. The research, which tested libraries like PyTorch, Optimum-Quanto, H…
-
Neural Compiler translates programs to differentiable PyTorch modules
Researchers have developed "The Neural Compiler," a system that translates symbolic programs into differentiable PyTorch modules for scientific machine learning. This approach allows for the exact encoding of known phys…
-
AI tutorial uses Grad-CAM to validate medical image models
This tutorial demonstrates how to build and evaluate an Alzheimer's MRI classification pipeline using PyTorch's ResNet18 model. It highlights the common pitfall of models achieving high accuracy by exploiting dataset-sp…
-
LLM analysis method reveals training data secrets and ethical risks
Researchers have developed a method using singular value decomposition (SVD) of a large language model's weight matrix to reveal interpretable semantic subspaces. This technique, requiring minimal code and no model infe…
-
PyTorch library torchtune streamlines LLM post-training
Researchers have introduced torchtune, a new PyTorch-native library designed to simplify the post-training phase for large language models. This library emphasizes modularity and direct access to PyTorch components, aim…
-
Sutra language compiles programs into PyTorch neural networks
Researchers have developed Sutra, a functional programming language that compiles into PyTorch neural networks. This system targets vector symbolic architectures by reducing programs to fused tensor-operation graphs. Su…
-
AI models explore music generation using piano and MIDI data
Researchers are exploring AI models for music generation, with one project focusing on creating generative instruments using large piano models trained on performance data. Another initiative details building an AI mode…
-
New FiLark framework streamlines distributed acoustic sensing data analysis
Researchers have developed FiLark, a new Python framework designed for distributed acoustic sensing (DAS) data. This framework adopts a streaming-first approach, enabling continuous exploration, annotation, and integrat…
-
New API uses LLMs for universal text-based optimization
Researchers have developed "optimize_anything," a universal API that uses LLMs to solve a wide range of optimization problems by treating them as text-based improvements. This system demonstrates state-of-the-art result…