ISTASTrack: Bridging ANN and SNN via ISTA Adapter for RGB-Event Tracking
Researchers have developed ISTASTrack, a novel hybrid tracking system that combines artificial neural networks (ANNs) with spiking neural networks (SNNs) for RGB-event visual object tracking. This system utilizes a transformer-based architecture with specialized ISTA adapters to facilitate bidirectional feature interaction between the RGB and event data streams. The approach aims to effectively fuse information from these heterogeneous sources, leading to state-of-the-art performance and high energy efficiency on benchmark datasets. AI
IMPACT Introduces a novel hybrid ANN-SNN architecture for improved visual tracking efficiency and performance.