LSMCore: A 69k-Synapse/mm2 Single-Core Digital Neuromorphic Processor for Liquid State Machine

Abstract

Neuromorphic processors have gained momentum recently due to their high energy efficiency in artificial intelligence applications compared to DNN accelerators. Most neuromorphic processors are executing SNNs (Spiking Neural Networks). Liquid State Machine (LSM), as the spiking version of reservoir computing, shows advantages and great potential in image classification, speech recognition, language translation, etc.. Comparing with other SNN models, LSM has the characteristics of easy to train and low resource utilization, which is suitable for low-power and resource-constrained edge computing scenarios. In this paper, we propose a novel design of a neuromorphic processor, LSMCore, aiming at LSM acceleration. LSMCore supports both training and inference of LSM. It consists of 256 input neurons, 1024 liquid neurons, and 1.31M synapses. Besides, multiple optimization techniques, including weight quantization for reducing storage, zero-skipping for decreasing dynamic sparsity, and mini-batch training are adopted in this processor. The experimental results show that the frequency of LSMCore achieves 400 MHz, the power is 4.9W and the area is 18.49 mm² with a 40nm library. Comparing with the baseline, LSMCore achieves up to <inline-formula> <tex-math notation="LaTeX">$80.7\times $ </tex-math></inline-formula>(<inline-formula> <tex-math notation="LaTeX">$49.6\times $ </tex-math></inline-formula>), <inline-formula> <tex-math notation="LaTeX">$91.3\times $ </tex-math></inline-formula>(<inline-formula> <tex-math notation="LaTeX">$56.3\times $ </tex-math></inline-formula>), and <inline-formula> <tex-math notation="LaTeX">$83.1\times $ </tex-math></inline-formula>(<inline-formula> <tex-math notation="LaTeX">$56.8\times $ </tex-math></inline-formula>) speedup on MNIST, N-MNIST, and Free Spoken Digital Dataset (FSDD) respectively for training (inference), while the accuracy of LSMCore on these three datasets are 96.8&#x0025;, 97.6&#x0025;, and 90&#x0025; respectively.