CIFAR-10
PulseAugur coverage of CIFAR-10 — every cluster mentioning CIFAR-10 across labs, papers, and developer communities, ranked by signal.
- used by federated learning 70%
- instance of Fashion-MNIST 70%
- instance of Imagenet 1k 70%
- instance of Tiny-ImageNet 70%
- used by residual neural network 70%
- used by Celeba 70%
- instance of CNNS 70%
- competes with AdamW 70%
- instance of Sulawesi 70%
- used by Imagenette 70%
- instance of CIFAR-100 60%
- instance of ImageNet ILSVRC-2012 60%
11 天有情绪数据
-
CurvSSL框架通过流形几何增强自监督学习
研究人员推出了一种新颖的自监督学习框架CurvSSL，该框架将局部流形几何纳入其训练过程。该方法通过添加基于曲率的正则化器来增强标准的SSL技术，该正则化器可以对不同数据增强之间的局部流形弯曲进行对齐和去相关。在MNIST和CIFAR-10数据集上的实验表明，与Barlow Twins和VICReg等现有方法相比，CurvSSL在线性评估中取得了具有竞争力或更优的性能，这表明显式建模局部几何是统计SSL的一个有价值的补充。
-
新StAD方法加速生成模型似然计算
研究人员开发了一种名为StAD的新方法，以提高扩散和流模型生成器中似然计算的速度和准确性。该技术绕过了计算概率流ODE的雅可比矩阵的需要，而是使用Langevin-Stein算子直接学习散度。StAD在各种密度估计任务上已证明其性能与Hutchinson和Hutch++等现有方法相比具有竞争力，显示出更高的方差和速度。
-
New watermarking embeds signals in generative model dynamics
Researchers have developed a novel watermarking technique for generative models that embeds signals directly into the learned continuous dynamics, specifically the velocity field of flow matching models. This method for…
-
New research advances federated learning with proactive client selection and privacy analysis
Researchers are exploring new methods to improve federated learning, a technique for training models across decentralized data sources while preserving privacy. One approach, "Choose Wisely and Privately," uses mutual i…
-
斑马鱼微环路启发节能鲁棒AI
研究人员开发了一种新方法，用于将特定计算功能归因于生物神经网络内的微环路，并以斑马鱼视顶盖微环路为模型。通过分析信号传播和模拟网络扰动，他们识别出负责节能处理和鲁棒性的不同子环路。然后，这些归因的功能被整合到人工神经网络中，在减少计算量和输入噪声的情况下展示了性能的提升。
-
New OUIDecay method adapts CNN regularization layer-by-layer
Researchers have introduced OUIDecay, a novel adaptive weight decay method for convolutional neural networks. This technique dynamically adjusts regularization strength for each layer based on online activation patterns…
-
Muon optimizer fails on convex Lipschitz functions, study finds
A new paper challenges the theoretical underpinnings of the Muon optimization algorithm, demonstrating that it does not converge on convex Lipschitz functions. The research suggests that Muon's practical success likely …
-
New framework corrects target shift in online learning systems
Researchers have developed a new framework to analyze and improve online learning systems that encounter distributional shifts. Their work, focusing on kernel regression, reveals that online learning effectively uses sh…
-
OrScale optimization method improves neural network training
Researchers have introduced OrScale, a novel optimization technique designed to enhance neural network training. OrScale builds upon the Muon method by incorporating layer-wise trust-ratio scaling, which measures the Fr…
-
光学网络通过预训练实现卓越的图像去噪
研究人员开发了一种新颖的基于衍射网络的全光学图像去噪预训练方法。该方法包括使用包含345万张图像的大型数据集进行初始训练，然后进行任务特定的微调。该方法显著提高了严重噪声图像的去噪质量，将PSNR从低于8 dB提升到18 dB以上，同时保留了精细细节。预训练网络通过针对数字、X射线和人脸等各种图像类型进行微调，展现了通用性，并在实际视觉应用中证明了其有效性，例如在噪声条件下的面部检测和无人机定位。
-
Spectral Surgery method rebalances deep network accuracy post-hoc
Researchers have developed a new post-hoc optimization method called Spectral Surgery to improve deep network classification performance. This technique directly perturbs model weights along specific "spike eigenvectors…
-
New STMD method speeds diffusion model inference without teacher
Researchers have developed Stochastic Transition-Map Distillation (STMD), a novel framework designed to accelerate the inference process for diffusion models without requiring a pre-trained teacher model. This method di…
-
New SWAP-Score metric evaluates neural networks without training
Researchers have introduced SWAP-Score, a novel zero-shot metric designed to evaluate neural networks without requiring training. This method measures a network's expressivity using sample-wise activation patterns and d…
-
GONO optimizer adapts Adam's momentum using directional consistency for better convergence
Researchers have introduced the GONO framework, an optimization signal designed to improve deep learning training by addressing the decoupling of directional alignment and loss convergence. Unlike existing optimizers th…
-
New research details efficient data reconstruction techniques for neural networks
Researchers have developed new techniques for data reconstruction attacks on neural networks, aiming to recover sensitive training data. Their unified optimization formulation, based on initial and trained parameter val…
-
New parameter E predicts Mixture-of-Experts model health, preventing dead experts.
Researchers have introduced a new dimensionless control parameter, E = T*H/(O+B), to predict the health of expert ecologies in Mixture-of-Experts (MoE) models. This parameter, derived from four hyperparameters, can prev…
-
Lookahead Drifting Model improves image generation with sequential drifting terms
Researchers have introduced a novel 'lookahead drifting model' for distribution mapping, building upon the existing 'drifting model' paradigm. This new approach computes a sequence of drifting terms at each training ite…
-
New MetaAdamW optimizer uses self-attention for adaptive learning rates
Researchers have developed MetaAdamW, a novel optimizer that enhances adaptive learning rates and weight decay by employing a self-attention mechanism. This Transformer-based approach dynamically adjusts hyperparameters…
-
LLM 通过新颖的基于 Delta 的代码生成加速神经架构搜索
研究人员正在探索使用大型语言模型 (LLM) 进行神经架构搜索 (NAS) 的新颖方法。一种名为 SPARK 的方法旨在通过显式选择功能因素进行修改来改进 LLM 知识集成，从而减少意外的副作用并提高效率。另一种技术，Delta-Code Generation，专注于微调 LLM 以生成紧凑的代码差异，以改进现有架构而不是从头开始生成它们，从而显著减少代码冗余和计算成本。一项调查还根据效率、鲁棒性和持续学习对 NAS 方法进行了分类，…
-
Researchers accelerate discrete autoregressive models with Wasserstein flow and Jacobi decoding
Researchers have developed a new method to accelerate the inference of discrete autoregressive normalizing flows, a type of generative model. The proposed technique, Selective Jacobi Decoding, allows for parallel iterat…