PulseAugur
实时 14:13:22
English(EN) Criticality-Constrained Iterative Pruning for Energy-Efficient Spiking Neural Networks via Combined Importance Scoring

新的SNN训练和剪枝方法提升效率和性能

研究人员正在开发新的方法来提高脉冲神经网络(SNN)的效率和性能。一种方法,临界约束二次剪枝(CQP),结合了权重幅度和神经元临界性,以最小的精度损失实现高稀疏度,并在MNIST数据集上展示了显著降低的能耗。另一种方法通过将凸化技术扩展到循环网络并引入参数重构算法,该算法在替代梯度方法方面具有优势,专注于SNN的全局最优训练。此外,一种新架构,内在稳定SNN(IS-SNN),通过强制信号稳态消除了对计算成本高昂的批量归一化的需求,在ImageNet等基准测试中取得了有竞争力的性能,同时减少了硬件资源消耗。 AI

影响 SNN训练和剪枝方面的这些进步可能为专用AI任务带来更节能、性能更强的神经形态硬件。

排序理由 多篇在arXiv上发表的学术论文详细介绍了脉冲神经网络方面的新研究。

在 arXiv cs.NE (Neural & Evolutionary) 阅读 →

AI 生成摘要 · Google Gemini · 来自 4 个来源。 我们如何撰写摘要 →

新的SNN训练和剪枝方法提升效率和性能

报道来源 [4]

  1. arXiv cs.LG TIER_1 English(EN) · Muhammad Hamza ·

    面向高能效脉冲神经网络的临界约束迭代剪枝方法:结合重要性评分

    arXiv:2606.30676v1 Announce Type: cross Abstract: Deploying spiking neural networks (SNNs) on neuromorphic hardware demands aggressive synaptic pruning while preserving temporal computation integrity. Existing strategies either neglect neuronal criticality or rely on convex relax…

  2. arXiv cs.AI TIER_1 English(EN) · Himanshu Udupi, Xiaocong Yang, ChengXiang Zhai ·

    Globally Optimal Training of Spiking Neural Networks via Parameter Reconstruction

    arXiv:2605.08022v2 Announce Type: replace-cross Abstract: Spiking Neural Networks (SNNs) have been proposed as biologically plausible and energy-efficient alternatives to conventional Artificial Neural Networks (ANNs). However, the training of SNN usually relies on surrogate grad…

  3. arXiv cs.NE (Neural & Evolutionary) TIER_1 English(EN) · Muhammad Hamza ·

    面向高能效脉冲神经网络的临界约束迭代剪枝方法:结合重要性评分

    Deploying spiking neural networks (SNNs) on neuromorphic hardware demands aggressive synaptic pruning while preserving temporal computation integrity. Existing strategies either neglect neuronal criticality or rely on convex relaxations of the inherently combinatorial pruning pro…

  4. arXiv cs.CV TIER_1 English(EN) · Shaogang Hu ·

    内在稳定的脉冲神经网络:在无批归一化的情况下克服性能障碍

    The performance of deep spiking neural networks (SNNs) often relies on batch normalization (BN). However, the advanced dynamic BN variants used in state-of-the-art models introduce runtime multiplications, which weaken the hardware-efficiency motivation of SNNs. To address this t…