Fast and Efficient Deep Sparse Multi-Strength Spiking Neural Networks with Dynamic Pruning

Abstract

Deep convolutional neural networks (CNNs) have shown state-of-the-art accuracy for various computer vision and speech tasks. However, CNNs are computation-intensive and energy-inefficient which are difficult to be deployed in real-time systems. Event-driven Spiking Neural Networks (SNNs) are extremely power efficient, which provides an alternative for ultra-low power applications. But effective training methods for SNN are still lacking. Due to its spatio-temporal feature of SNN, conventional training method for CNN can not be employed in SNN. To address this problem, some researchers proposed to convert the corresponding weights of trained CNNs into the synapse weights of SNNs (CNNs-SNNs). Nevertheless, limited by the [0, 1] constraints on the SNN neuron outputs, the accuracy of the converted SNNs is impaired. Besides, as the SNN network becomes deeper, the convergence speed of SNN inference are unacceptably slow. In this work, we proposed an innovative deep multi-strength SNN (M-SNN) structure which relaxes the restriction of the neuron output spike strength while the event-driven feature for low-power implementations is maintained. Using this architecture, large scale SNN can be converted from CNN with comparable accuracy and fast inference speed. The evaluation results show 3.7 × convergence speedup. Moreover, with multi-strength spike, aggressive pruning strategies can be applied to reduce the computational operations by almost 85% while maintaining the same accuracy.