CIFAR-10
PulseAugur coverage of CIFAR-10 — every cluster mentioning CIFAR-10 across labs, papers, and developer communities, ranked by signal.
- instance of CIFAR-100 70%
- instance of Tiny-ImageNet 70%
- used by federated learning 70%
- instance of residual neural network 70%
- instance of Fashion-MNIST 70%
- used by SGD 70%
- used by residual neural network 70%
- instance of ImageNet ILSVRC-2012 70%
- instance of ImageNet-100 70%
- competes with AdamW 70%
- used by Imagenette 70%
- instance of differential privacy 70%
20 day(s) with sentiment data
-
Spectral Surgery method rebalances deep network accuracy post-hoc
Researchers have developed a new post-hoc optimization method called Spectral Surgery to improve deep network classification performance. This technique directly perturbs model weights along specific "spike eigenvectors…
-
New STMD method speeds diffusion model inference without teacher
Researchers have developed Stochastic Transition-Map Distillation (STMD), a novel framework designed to accelerate the inference process for diffusion models without requiring a pre-trained teacher model. This method di…
-
New SWAP-Score metric evaluates neural networks without training
Researchers have introduced SWAP-Score, a novel zero-shot metric designed to evaluate neural networks without requiring training. This method measures a network's expressivity using sample-wise activation patterns and d…
-
GONO optimizer adapts Adam's momentum using directional consistency for better convergence
Researchers have introduced the GONO framework, an optimization signal designed to improve deep learning training by addressing the decoupling of directional alignment and loss convergence. Unlike existing optimizers th…
-
New research details efficient data reconstruction techniques for neural networks
Researchers have developed new techniques for data reconstruction attacks on neural networks, aiming to recover sensitive training data. Their unified optimization formulation, based on initial and trained parameter val…
-
New parameter E predicts Mixture-of-Experts model health, preventing dead experts.
Researchers have introduced a new dimensionless control parameter, E = T*H/(O+B), to predict the health of expert ecologies in Mixture-of-Experts (MoE) models. This parameter, derived from four hyperparameters, can prev…
-
Lookahead Drifting Model improves image generation with sequential drifting terms
Researchers have introduced a novel 'lookahead drifting model' for distribution mapping, building upon the existing 'drifting model' paradigm. This new approach computes a sequence of drifting terms at each training ite…
-
New MetaAdamW optimizer uses self-attention for adaptive learning rates
Researchers have developed MetaAdamW, a novel optimizer that enhances adaptive learning rates and weight decay by employing a self-attention mechanism. This Transformer-based approach dynamically adjusts hyperparameters…
-
LLMs accelerate neural architecture search with novel delta-based code generation
Researchers are exploring novel methods for Neural Architecture Search (NAS) using Large Language Models (LLMs). One approach, SPARK, aims to improve LLM knowledge integration by explicitly selecting functional factors …
-
Researchers accelerate discrete autoregressive models with Wasserstein flow and Jacobi decoding
Researchers have developed a new method to accelerate the inference of discrete autoregressive normalizing flows, a type of generative model. The proposed technique, Selective Jacobi Decoding, allows for parallel iterat…
-
AI research tackles layer free-riding and enhances data privacy for models
Researchers have identified a phenomenon in Forward-Forward networks called layer free-riding, where later layers can inherit tasks already partially handled by earlier layers, leading to a decay in gradient. Three loca…
-
GEM-FI: Gated Evidential Mixtures with Fisher Modulation
Researchers have introduced GEM-FI, a novel family of models designed to improve uncertainty estimation in deep learning. This approach addresses limitations of existing Evidential Deep Learning methods, which can be ov…
-
New AI framework learns classification losses without real data
Researchers have developed a new framework called Evolutionary Dynamic Loss (EDL) for pretraining classification losses without using real data. EDL learns a transferable loss function by generating synthetic prediction…
-
Researchers develop Evolutionary Dynamic Loss for distribution-free pretraining
Researchers have developed a new framework called Evolutionary Dynamic Loss (EDL) for pretraining classification losses. EDL learns a transferable loss function using synthetic data, avoiding the need for real samples d…
-
New AI unlearning methods balance data removal with model utility
Researchers have developed new methods for machine unlearning, a process that removes specific data from AI models without full retraining. One approach, SHRED, uses self-distillation and logit demotion to identify and …
-
New research explores ensemble models for improved AI performance and robustness
Two new research papers introduce novel methods for improving ensemble models in machine learning. The first, PACE, combines pruning and compression techniques to create more efficient and interpretable ensembles, outpe…
-
Checkerboard attack offers efficient, learning-free backdoor for deep learning models
Researchers have developed a new method called Checkerboard for launching clean-label backdoor attacks on deep learning models. This learning-free technique uses a closed-form checkerboard trigger derived from linear se…
-
Researchers develop DUNE, a dual-branch method to create robust unlearnable examples for AI models.
Researchers have developed DUNE, a novel dual-branch approach to create robust unlearnable examples for AI model training. This method optimizes perturbations in both spatial and color domains to degrade model generaliz…
-
New HyCAS defense bridges gap between certified and empirical adversarial robustness
Researchers have developed a new adversarial defense technique called Hybrid Convolutions with Attention Stochasticity (HyCAS). This method aims to bridge the gap between theoretical robustness guarantees and practical …
-
Kernel Hopfield networks show high storage capacity, stability limits analyzed
Researchers have analyzed the geometric properties and storage capacity limits of kernel Hopfield networks trained with Kernel Logistic Regression (KLR). Their experiments, using random sequences and CIFAR-10 image embe…