Tiny-ImageNet
PulseAugur coverage of Tiny-ImageNet — every cluster mentioning Tiny-ImageNet across labs, papers, and developer communities, ranked by signal.
1 天有情绪数据
-
CutMix training protocol induces spatial locality in Vision Transformers
Researchers have found that specific training techniques can encourage spatial locality in Vision Transformers. By using a 'Modern' protocol involving data augmentation like CutMix and ColorJitter, along with label smoo…
-
LSFormer通过新的注意力机制推动脉冲神经网络发展
研究人员开发了一种新颖的基于Transformer的脉冲神经网络，称为LSFormer，旨在克服现有模型的局限性。LSFormer引入了脉冲响应池化（SPooling）和局部结构感知脉冲自注意力（LS-SSA），以更好地保留区域特征并减少计算冗余。这种新架构利用局部扩张窗口机制来捕捉细粒度细节和更广泛的依赖关系，在Tiny-ImageNet和N-CALTECH101等数据集上取得了最先进的成果。
-
新的AS-LoRA方法提高了联邦学习的隐私性
研究人员开发了AS-LoRA，一种用于隐私保护联邦学习中LoRA组件自适应选择的新型框架。该方法通过允许每一层独立选择其活动组件并在通信轮次中调整这些选择来解决此类设置中常见的聚合错误。AS-LoRA在不增加隐私成本的情况下，理论上提高了收敛速度和准确性，并在GLUE和SQuAD等基准测试中取得了显著的进步。
-
New Covariance-Aware Goodness method boosts Forward-Forward learning performance
Researchers have developed a new method called Covariance-Aware Goodness (BiCovG) to improve the performance of the Forward-Forward (FF) learning algorithm, particularly in convolutional neural networks. This approach a…
-
AI research tackles layer free-riding and enhances data privacy for models
Researchers have identified a phenomenon in Forward-Forward networks called layer free-riding, where later layers can inherit tasks already partially handled by earlier layers, leading to a decay in gradient. Three loca…
-
New AI unlearning methods balance data removal with model utility
Researchers have developed new methods for machine unlearning, a process that removes specific data from AI models without full retraining. One approach, SHRED, uses self-distillation and logit demotion to identify and …
-
JEPAMatch paper introduces geometric shaping for semi-supervised learning
Researchers have introduced JEPAMatch, a novel approach to semi-supervised learning that aims to improve model performance when labeled data is scarce. This method moves beyond traditional confidence-based pseudo-labeli…
-
New research tackles Fast Adversarial Training with dynamic guidance and a fair benchmark
Researchers have developed a new strategy called Distribution-aware Dynamic Guidance (DDG) to improve the robustness of AI models trained using Fast Adversarial Training (FAT). DDG addresses issues like catastrophic ove…