HyperSpikeASIC: Accelerating Event-Based Workloads With HyperDimensional Computing and Spiking Neural Networks

Abstract

Today’s Machine Learning(ML) systems, running workloads such as Deep Neural Networks, which require billions of parameters and many hours to train a model, consume a significant amount of energy. Due to the complexity of computation and topology, even the quantized models are hard to deploy on edge devices under energy constraints. To combat this, researchers have been focusing on new emerging neuromorphic computing models. Two of those models are HDC and SNN, both with their own benefits. HDC has various desirable properties that other ML algorithms lack such as robustness to noise, simple operations, and high parallelism. SNN are able to process event-based signal data in an efficient manner. This work develops, which utilizes a single, randomly initialized, and untrained SNN layer as a feature extractor connected to a trained HDC classifier. HDC is used to enable more efficient classification as well as provide robustness to errors. We experimentally show that is on average 31.5× more robust to errors than traditional SNNs. On Intel’s Loihi Loihi, is 10× faster and 2.6× more energy efficient over traditional SNN networks. We further develop, a customized accelerator for . By decoupling the neuron and synapses, skips the inactive neurons and limits the neuron state updating to once per time step at most. is 601× faster and 3467× more energy efficient than running on Intel’s Loihi for SNN acceleration, and 12.2× faster and 211× more energy efficient than the state-of-the-art SNN ASIC implementation LSMCore.