A two-stage strategy for brain-inspired unsupervised learning in spiking neural networks

Abstract

Spiking Neural Networks (SNNs) are emerging as a promising model in the field of neuromorphic computing, offering possibilities for efficient bio-inspired computing. Unsupervised learning in SNNs plays a crucial role in exploring neural network dynamics and achieving efficient artificial intelligence systems. However, current unsupervised learning in SNNs mostly relies on single-stage learning strategies, which limits the possibility of combining diverse learning mechanisms and network structures, resulting in networks that lack flexibility and adaptability for low-power task processing. Inspired by the multi-stage and multi-strategy learning in the human brain, this paper proposes a two-stage learning strategy from coarse to fine to enhance the efficiency of unsupervised learning in SNNs. To quickly extract structural features from spike data in the first stage, we propose the Spiking-SOM algorithm, which effectively learns patterns in spike data and achieves clustering effects. Additionally, we integrate Rate encoding and Temporal encoding through a visual attention mechanism, where this hybrid encoding helps meet the need for rapid information processing in the first stage, while also aiding in detailed feature representation in the second stage. Compared to the traditional single-stage learning framework, this work maintains high accuracy in unsupervised classification while significantly reducing computational costs and speeding up training. This exploration offers a new direction for future learning frameworks in SNNs, helping to further improve the energy efficiency of the network.