Forward-Only Convolutional Neural Networks with Learnable Channel-Class Assignment
Researchers have developed a new forward-only learning algorithm for convolutional neural networks (CNNs) that improves upon existing methods. This approach introduces a learnable mechanism for assigning channels to classes, allowing for more adaptive and data-driven specialization. Additionally, a loss-aware layer contribution strategy weights intermediate predictions based on their validation performance, enhancing inference. When integrated into residual CNNs, this method achieves state-of-the-art performance among forward-only models on several image datasets, significantly closing the gap with traditional backpropagation techniques. AI
IMPACT Introduces a more efficient learning paradigm for CNNs, potentially narrowing the performance gap with backpropagation.