Otters++: A Time-to-first-spike Based Energy Efficient Optical Spiking Transformer
Researchers have developed Otters++, a novel optical spiking transformer that leverages the natural signal decay in optoelectronic devices to achieve energy-efficient inference. This approach directly uses the decay of a custom In$_2$O$_3$ optoelectronic synapse for the time-to-first-spike computation, eliminating the need for explicit digital decay calculations. Otters++ demonstrates a hybrid training method, combining device-faithful SNN forward passes with QNN straight-through gradients and model distillation, to enable training and improve robustness against hardware noise. The system achieved an 84.17% average score on the GLUE dataset while showing significant energy savings compared to existing spiking transformer baselines. AI
IMPACT This research could lead to more energy-efficient AI hardware for inference, particularly for transformer models.