Spiking Neurons Research Articles

Integrating Image Perception and Time‐to‐First‐Spike Coding in MoS2 Phototransistors for Spiking Neural Network

AbstractHuman vision system remains alert for dangers and adopts high‐speed and low‐power coding methods to convert the image information to spike signals. To meet the demand for danger alert in machine vision, it is important to design intelligent sensors to integrate the functions of image perception and high‐efficiency coding for high‐priority analysis. Inspired by the human visual system, a MoS2 phototransistor is introduced on SiNx substrate enabling simultaneous image perception and time‐to‐first‐spike (TTFS) coding. The device demonstrates exceptional performance in encoding 3‐bit grayscale images, achieving a low mean squared error of 0.008 and a high structural similarity index of 0.9784. Spiking neural networks (SNN) with TTFS coding achieve high recognition accuracy (98.86%) while reducing spike count by 75%. The device array also perceives motion direction and object states by converting data temporally. This work establishes a hardware foundation to promote the performance of SNNs in efficiently identifying crucial information.

Phase-amplitude coupling detection and analysis of human 2-dimensional neural cultures in multi-well microelectrode array in vitro

BackgroundHuman induced pluripotent stem cell (hiPSC)- derived neurons offer the possibility of studying human-specific neuronal behaviors in physiologic and pathologic states in vitro. It is unclear whether cultured neurons can achieve the fundamental network behaviors required to process information in the brain. Investigating neuronal oscillations and their interactions, as occurs in cross-frequency coupling (CFC), addresses this question. New methodsWe examined whether networks of two-dimensional (2D) cultured hiPSC-derived cortical neurons grown with hiPSC-derived astrocytes on microelectrode array plates recapitulate the CFC that is present in vivo. We employed the modulation index method for detecting phase-amplitude coupling (PAC) and used offline spike sorting to analyze the contribution of single neuron spiking to network behavior. ResultsWe found that PAC is present, the degree of PAC is specific to network structure, and it is modulated by external stimulation with bicuculline administration. Modulation of PAC is not driven by single neurons, but by network-level interactions. Comparison with existing methodsPAC has been demonstrated in multiple regions of the human cortex as well as in organoids. This is the first report of analysis demonstrating the presence of coupling in 2D cultures. ConclusionCFC in the form of PAC analysis explores communication and integration between groups of neurons and dynamical changes across networks. In vitro PAC analysis has the potential to elucidate the underlying mechanisms as well as capture the effects of chemical, electrical, or ultrasound stimulation; providing insight into modulation of neural networks to treat nervous system disorders in vivo.

Co-learning synaptic delays, weights and adaptation in spiking neural networks.

Spiking neural network (SNN) distinguish themselves from artificial neural network (ANN) because of their inherent temporal processing and spike-based computations, enabling a power-efficient implementation in neuromorphic hardware. In this study, we demonstrate that data processing with spiking neurons can be enhanced by co-learning the synaptic weights with two other biologically inspired neuronal features: (1) a set of parameters describing neuronal adaptation processes and (2) synaptic propagation delays. The former allows a spiking neuron to learn how to specifically react to incoming spikes based on its past. The trained adaptation parameters result in neuronal heterogeneity, which leads to a greater variety in available spike patterns and is also found in the brain. The latter enables to learn to explicitly correlate spike trains that are temporally distanced. Synaptic delays reflect the time an action potential requires to travel from one neuron to another. We show that each of the co-learned features separately leads to an improvement over the baseline SNN and that the combination of both leads to state-of-the-art SNN results on all speech recognition datasets investigated with a simple 2-hidden layer feed-forward network. Our SNN outperforms the benchmark ANN on the neuromorphic datasets (Spiking Heidelberg Digits and Spiking Speech Commands), even with fewer trainable parameters. On the 35-class Google Speech Commands dataset, our SNN also outperforms a GRU of similar size. Our study presents brain-inspired improvements in SNN that enable them to excel over an equivalent ANN of similar size on tasks with rich temporal dynamics.

Spike-Weighted Spiking Neural Network with Spiking Long Short-Term Memory: A Biomimetic Approach to Decoding Brain Signals

Background. Brain–machine interfaces (BMIs) offer users the ability to directly communicate with digital devices through neural signals decoded with machine learning (ML)-based algorithms. Spiking Neural Networks (SNNs) are a type of Artificial Neural Network (ANN) that operate on neural spikes instead of continuous scalar outputs. Compared to traditional ANNs, SNNs perform fewer computations, use less memory, and mimic biological neurons better. However, SNNs only retain information for short durations, limiting their ability to capture long-term dependencies in time-variant data. Here, we propose a novel spike-weighted SNN with spiking long short-term memory (swSNN-SLSTM) for a regression problem. Spike-weighting captures neuronal firing rate instead of membrane potential, and the SLSTM layer captures long-term dependencies. Methods. We compared the performance of various ML algorithms during decoding directional movements, using a dataset of microelectrode recordings from a macaque during a directional joystick task, and also an open-source dataset. We thus quantified how swSNN-SLSTM performed compared to existing ML models: an unscented Kalman filter, LSTM-based ANN, and membrane-based SNN techniques. Result. The proposed swSNN-SLSTM outperforms both the unscented Kalman filter, the LSTM-based ANN, and the membrane based SNN technique. This shows that incorporating SLSTM can better capture long-term dependencies within neural data. Also, our proposed swSNN-SLSTM algorithm shows promise in reducing power consumption and lowering heat dissipation in implanted BMIs.

Fast learning without synaptic plasticity in spiking neural networks

Spiking neural networks are of high current interest, both from the perspective of modelling neural networks of the brain and for porting their fast learning capability and energy efficiency into neuromorphic hardware. But so far we have not been able to reproduce fast learning capabilities of the brain in spiking neural networks. Biological data suggest that a synergy of synaptic plasticity on a slow time scale with network dynamics on a faster time scale is responsible for fast learning capabilities of the brain. We show here that a suitable orchestration of this synergy between synaptic plasticity and network dynamics does in fact reproduce fast learning capabilities of generic recurrent networks of spiking neurons. This points to the important role of recurrent connections in spiking networks, since these are necessary for enabling salient network dynamics. We show more specifically that the proposed synergy enables synaptic weights to encode more general information such as priors and task structures, since moment-to-moment processing of new information can be delegated to the network dynamics.

Brain-inspired spiking neural networks in Engineering Mechanics: a new physics-based self-learning framework for sustainable Finite Element analysis

AbstractThe present study aims to develop a sustainable framework employing brain-inspired neural networks for solving boundary value problems in Engineering Mechanics. Spiking neural networks, known as the third generation of artificial neural networks, are proposed for physics-based artificial intelligence. Accompanied by a new pseudo-explicit integration scheme based on spiking recurrent neural networks leading to a spike-based pseudo explicit integration scheme, the underlying differential equations are solved with a physics-informed strategy. We propose additionally a third-generation spike-based Legendre Memory Unit that handles large sequences. These third-generation networks can be implemented on the coming-of-age neuromorphic hardware resulting in less energy and memory consumption. The proposed framework, although implicit, is viewed as a pseudo-explicit scheme since it requires almost no or fewer online training steps to achieve a converged solution even for unseen loading sequences. The proposed framework is deployed in a Finite Element solver for plate structures undergoing cyclic loading and a Xylo-Av2 SynSense neuromorphic chip is used to assess its energy performance. An acceleration of more than 40% when compared to classical Finite Element Method simulations and the capability of online training is observed. We also see a reduction in energy consumption down to the thousandth order.

Predictive coding with spiking neurons and feedforward gist signaling.

Predictive coding (PC) is an influential theory in neuroscience, which suggests the existence of a cortical architecture that is constantly generating and updating predictive representations of sensory inputs. Owing to its hierarchical and generative nature, PC has inspired many computational models of perception in the literature. However, the biological plausibility of existing models has not been sufficiently explored due to their use of artificial neurons that approximate neural activity with firing rates in the continuous time domain and propagate signals synchronously. Therefore, we developed a spiking neural network for predictive coding (SNN-PC), in which neurons communicate using event-driven and asynchronous spikes. Adopting the hierarchical structure and Hebbian learning algorithms from previous PC neural network models, SNN-PC introduces two novel features: (1) a fast feedforward sweep from the input to higher areas, which generates a spatially reduced and abstract representation of input (i.e., a neural code for the gist of a scene) and provides a neurobiological alternative to an arbitrary choice of priors; and (2) a separation of positive and negative error-computing neurons, which counters the biological implausibility of a bi-directional error neuron with a very high baseline firing rate. After training with the MNIST handwritten digit dataset, SNN-PC developed hierarchical internal representations and was able to reconstruct samples it had not seen during training. SNN-PC suggests biologically plausible mechanisms by which the brain may perform perceptual inference and learning in an unsupervised manner. In addition, it may be used in neuromorphic applications that can utilize its energy-efficient, event-driven, local learning, and parallel information processing nature.

A neurocomputational model of decision and confidence in object recognition task

How does the brain process natural visual stimuli to make a decision? Imagine driving through fog. An object looms ahead. What do you do? This decision requires not only identifying the object but also choosing an action based on your decision confidence. In this circumstance, confidence is making a bridge between seeing and believing. Our study unveils how the brain processes visual information to make such decisions with an assessment of confidence, using a model inspired by the visual cortex. To computationally model the process, this study uses a spiking neural network inspired by the hierarchy of the visual cortex in mammals to investigate the dynamics of feedforward object recognition and decision-making in the brain. The model consists of two modules: a temporal dynamic object representation module and an attractor neural network-based decision-making module. Unlike traditional models, ours captures the evolution of evidence within the visual cortex, mimicking how confidence forms in the brain. This offers a more biologically plausible approach to decision-making when encountering real-world stimuli. We conducted experiments using natural stimuli and measured accuracy, reaction time, and confidence. The model's estimated confidence aligns remarkably well with human-reported confidence. Furthermore, the model can simulate the human change-of-mind phenomenon, reflecting the ongoing evaluation of evidence in the brain. Also, this finding offers decision-making and confidence encoding share the same neural circuit.

Highly biomimetic spiking neuron using SiGe heterojunction bipolar transistors for energy-efficient neuromorphic systems

We demonstrate a highly biomimetic spiking neuron capable of fast and energy-efficient neuronal oscillation dynamics. Our simple neuron circuit is constructed using silicon–germanium heterojunction based bipolar transistors (HBTs) with nanowire structure. The HBT has a hysteresis window with steep switching characteristics and high current margin in the low voltage range, which enables a high spiking frequency (~ 245 kHz) with low energy consumption (≤ 1.37 pJ/spike). Also, gated structure achieves a stable balance in the activity of the neural system by incorporating both excitatory and inhibitory signal. Furthermore, inhibition of multiple strengths can be realized by adjusting the integration time according to the amplitude of the inhibitory signal. In addition, the spiking frequency can be tuned by mutually controlling the hysteresis window in the HBTs. These results ensure the sparse activity and homeostasis of neural networks.

Ultralow Power Electronic Analog of a Biological Fitzhugh-Nagumo Neuron.

Here, we introduce an electronic circuit that mimics the functionality of a biological spiking neuron following the Fitzhugh-Nagumo (FN) model. The circuit consists of a tunnel diode that exhibits negative differential resistance (NDR) and an active inductive element implemented by a single MOSFET. The FN neuron converts a DC voltage excitation into voltage spikes analogous to biological action potentials. We predict an energy cost of 2 aJ/cycle through detailed simulation and modeling for these FN neurons. Such an FN neuron is CMOS compatible and enables ultralow power oscillatory and spiking neural network hardware. We demonstrate that FN neurons can be used for oscillator-based computing in a coupled oscillator network to form an oscillator Ising machine (OIM) that can solve computationally hard NP-complete max-cut problems while showing robustness toward process variations.

Leaky-integrate-fire neuron based on vertically extended drain Si[formula omitted]Ge[formula omitted] source TFET: Ultra-energy-efficient and high speed design

This article investigates the performance of a vertically extended drain double gate Si1−x Gex source tunnel field effect transistor (VD-DG-Si1−x Gex S-TFET) as a leaky integrate-and-fire (LIF) neuron. The proposed VD-DG-Si1−x Gex S-TFET structure has been designed and optimized by deploying the commercially available Silvaco TCAD. The LIF neuron using VD-DG-Si1−x Gex S-TFET requires a low spiking threshold voltage (i.e. 0.20 V) which is 5x, 3x, 5x, 1.3x, 1.55x, 7.5x, and 1.44x times less in comparison to MOSFET, Bulk FinFET, phase change device, SOI MOSFET, DG-JLFET, silicon nanowire, and DL-TFET silicon neuron. The proposed device based neuron demonstrates the least spiking energy (177 ZJ) reported to date which is 18192 times less as compared to BTBT based PDSOI MOSFET neuron. The threshold value of current is achieved at 0.20 V drain voltage which is 15x, 14x, 10x, and 1.5x less as compared to FinFET, PD-SOI MOSFET, LBIMOS, and DL-TFET, respectively. Moreover, the effects of gate metal work function, germanium mole fraction, and temperature on the spike current variations have also been investigated. Here, impact ionization is a key method for generating a neuron spike due to holes accumulated in the potential well of VD-DG-Si1−xGex S-TFET. In addition, a LIF neuron based on VD-DG-Si0.5Ge0.5 S-TFET device exhibits a 9 THz spiking frequency which is approximately 12 times higher than real nerves present in the human body. This work shows a remarkable reduction in the power consumption and the proposed device neuron is a potential start-up solution for a large scale spiking neural networks (SNN) implementation because of its better performance and compact circuitry.

A Novel Approach of DDOS Attack Classification with Genetic Algorithm-optimized Spiking Neural Network

Spiking Neural Network (SNN) use spiking neurons that transmit information through discrete spikes, similar to the way biological neurons communicate through action potentials. This unique property of SNNs makes them suitable for applications that require real-time processing and low power consumption. This paper proposes a new method for detecting DDoS attacks using a spiking neural network (SNN) with a distance-based rate coding mechanism and optimizing the SNN using a genetic algorithm (GA). The proposed GA-SNN approach achieved a remarkable accuracy rate of 99.98% in detecting DDoS attacks, outperforming existing state-of-the-art methods. The GA optimization approach helps to overcome the challenges of setting the initial weights and biases in the SNN, and the distance-based rate coding mechanism enhances the accuracy of the SNN in detecting DDoS attacks. Additionally, the proposed approach is designed to be computationally efficient, which is essential for practical implementation in real-time systems. Overall, the proposed GA-SNN approach is a promising solution for accurate and efficient detection of DDoS attacks in network security applications.

Overshoot‐Suppressed Memristor Crossbar Array with High Yield by AlOx Oxidation for Neuromorphic System

AbstractThere is a need to design a hardware synapse array appropriate for enhancing the efficiency of neuromorphic computing systems while minimizing energy consumption. This study introduces a memristor device with an AlOx overshoot suppression layer (A‐OSL) to achieve a self‐compliance effect. By optimizing each cell within the 16 × 16 crossbar array, synaptic devices are successfully fabricated with reliable characteristics and 3‐bit multilevel capabilities. In addition, the oxygen composition of TiOx and the annealing conditions are optimized to reduce the forming voltage and minimize the variation in the switching voltage. As a result, stable forming‐free characteristics are obtained through A‐OSL insertion, a reduction in forming voltage, and TiOx oxygen composition optimization. Also, target weights are accurately transferred to the A‐OSL memristor crossbar array and conducted the inference process by applying spike signals to the array following the designated time step. The spiking neural network (SNN) is demonstrated by measuring vector‐matrix multiplication (VMM) of the 16 × 16 crossbar array. The VMM results exhibit a classification accuracy of 90.80% for the MNIST dataset, which is close to the accuracy achieved by software‐based approaches, amounting to 91.85%.

Magnetic Flux Sensor Based on Spiking Neurons with Josephson Junctions.

Josephson junctions (JJs) are superconductor-based devices used to build highly sensitive magnetic flux sensors called superconducting quantum interference devices (SQUIDs). These sensors may vary in design, being the radio frequency (RF) SQUID, direct current (DC) SQUID, and hybrid, such as D-SQUID. In addition, recently many of JJ's applications were found in spiking models of neurons exhibiting nearly biological behavior. In this study, we propose and investigate a new circuit model of a sensory neuron based on DC SQUID as part of the circuit. The dependence of the dynamics of the designed model on the external magnetic flux is demonstrated. The design of the circuit and derivation of the corresponding differential equations that describe the dynamics of the system are given. Numerical simulation is used for experimental evaluation. The experimental results confirm the applicability and good performance of the proposed magnetic-flux-sensitive neuron concept: the considered device can encode the magnetic flux in the form of neuronal dynamics with the linear section. Furthermore, some complex behavior was discovered in the model, namely the intermittent chaotic spiking and plateau bursting. The proposed design can be efficiently applied to developing the interfaces between circuitry and spiking neural networks. However, it should be noted that the proposed neuron design shares the main limitation of all the superconductor-based technologies, i.e., the need for a cryogenic and shielding system.

All-optical neuromorphic XOR and XNOR operation utilizing a photonic spiking neuron based on a passive add-drop microring resonator.

We propose a concise hardware architecture supporting efficient exclusive OR (XOR) and exclusive NOR (XNOR) operations, by employing a single photonic spiking neuron based on a passive add-drop microring resonator (ADMRR). The threshold mechanism and inhibitory dynamics of the ADMRR-based spiking neuron are numerically discussed on the basis of the coupled mode theory. It is shown that a precise XOR operation in the ADMRR-based spiking neuron can be implemented by adjusting temporal differences within the inhibitory window. Additionally, within the same framework, the XNOR function can also be carried out by accumulating the input power over time to trigger an excitatory behavior. This work presents a novel, to the best of our knowledge, and pragmatic technique for optical neuromorphic computing and information processing utilizing passive devices.

Reconfigurable Resistive Switching in VO2/La0.7Sr0.3MnO3/Al2O3 (0001) Memristive Devices for Neuromorphic Computing.

The coexistence of nonvolatile and volatile switching modes in a single memristive device provides flexibility to emulate both neuronal and synaptic functions in the brain. Furthermore, such a device structure may eliminate the need for additional circuit elements such as transistor-based selectors, enabling low-power consumption and high-density device integration in fully memristive spiking neural networks. In this work, we report dual resistive switching (RS) modes in VO2/La0.7Sr0.3MnO3 (LSMO) bilayer memristive devices. Specifically, the nonvolatile RS is driven by the movement of oxygen vacancies (Vo) at the VO2/LSMO interface and requires a higher biasing voltage, whereas the volatile RS is controlled by the metal-insulator transition (MIT) of VO2 under a lower biasing voltage. The simple device structure is electrically driven between the two RS modes and thus can operate as a one selector-one resistor (1S1R) cell, which is a desirable feature in memristive crossbar arrays to avoid the sneak-path current issue. The RS modes are found to be stable and repeatable and can be reconfigured by exploiting the interfacial and phase transition properties, and thus, they hold great promise for applications in memristive neural networks and neuromorphic computing.

Deep multi-threshold spiking-UNet for image processing

U-Net, known for its simple yet efficient architecture, is widely utilized for image processing tasks and is particularly suitable for deployment on neuromorphic chips. This paper introduces the novel concept of Spiking-UNet for image processing, which combines the power of Spiking Neural Networks (SNNs) with the U-Net architecture. To achieve an efficient Spiking-UNet, we face two primary challenges: ensuring high-fidelity information propagation through the network via spikes and formulating an effective training strategy. To address the issue of information loss, we introduce multi-threshold spiking neurons, which improve the efficiency of information transmission within the Spiking-UNet. For the training strategy, we adopt a conversion and fine-tuning pipeline that leverage pre-trained U-Net models. During the conversion process, significant variability in data distribution across different parts is observed when utilizing skip connections. Therefore, we propose a connection-wise normalization method to prevent inaccurate firing rates. Furthermore, we adopt a flow-based training method to fine-tune the converted models, reducing time steps while preserving performance. Experimental results show that, on image segmentation and denoising, our Spiking-UNet achieves comparable performance to its non-spiking counterpart, surpassing existing SNN methods. Compared with the converted Spiking-UNet without fine-tuning, our Spiking-UNet reduces inference time by approximately 90%. This research broadens the application scope of SNNs in image processing and is expected to inspire further exploration in the field of neuromorphic engineering. The code for our Spiking-UNet implementation is available at https://github.com/SNNresearch/Spiking-UNet.

Harnessing nonlinear conductive characteristic of TiO2/HfO2 memristor crossbar for implementing parallel vector–matrix multiplication

Memristor crossbar arrays are expected to achieve highly energy-efficient neuromorphic computing via implementing parallel vector–matrix multiplication (VMM) in situ. The similarities between memristors and neural synapses offer opportunities for realizing hardware-based brain-inspired computing, such as spike neural networks. However, the nonlinear I–V characteristics of the memristors limit the implementation of parallel VMM on passive memristor crossbar arrays. In our work, we propose to utilize differential conductance as a synaptic weight to implement linear VMM operations on a passive memristor array in parallel. We fabricated a TiO2/HfO2 memristor crossbar array, in which differential-conductance-based synaptic weight exhibits plasticity, nonvolatility, multi-states, and tunable ON/OFF ratio. The noise-dependent accuracy performance of VMM operations based on the proposed approach was evaluated, offering an optimization guideline. Furthermore, we demonstrated a spike neural network circuit capable of processing small spiking signals through the differential-conductance-based synapses. The experimental results showcase effective space-coded and time-coded spike pattern recognition. Importantly, our work opens up new possibilities for the development of passive memristor arrays, leading to increased energy and area efficiency in brain-inspired chips.

Single Spike Neural Network Model for Superficial Environment Classification for Mobile Robot Navigation

In this work, a single Semi-Recurrent Spike Neural Network (SRSNN) supervised learning method based on time coding is proposed to classify visual terrain encountered by the mobile robot. To this end, the features are extracted using the Local Binary Pattern (LBP) method. Then, the SRSNN is trained to classify multi-class of terrains. This training is used to classify six classes of terrain: hydrop, gravel, asphalt, grass, mud, and sand. The proposed training algorithm is based on adaptive synaptic weights that reach the threshold value. The feature extracted method and SRSNN form the proposed Intelligent structure. This structure effectively evaluates the accuracy, precision, recall, and F1 score. The simulation results achieve good performance in minimizing the mean square error in the training phase and maximizing the overall accuracy to 87.22%, especially in dangerous terrain (i.e. hydrop). The effectiveness of the proposed model is proved by the efficiency of the training algorithm which can learn fast with accurate results.

Sampling complex topology structures for spiking neural networks.

Spiking Neural Networks (SNNs) have been considered a potential competitor to Artificial Neural Networks (ANNs) due to their high biological plausibility and energy efficiency. However, the architecture design of SNN has not been well studied. Previous studies either use ANN architectures or directly search for SNN architectures under a highly constrained search space. In this paper, we aim to introduce much more complex connection topologies to SNNs to further exploit the potential of SNN architectures. To this end, we propose the topology-aware search space, which is the first search space that enables a more diverse and flexible design for both the spatial and temporal topology of the SNN architecture. Then, to efficiently obtain architecture from our search space, we propose the spatio-temporal topology sampling (STTS) algorithm. By leveraging the benefits of random sampling, STTS can yield powerful architecture without the need for an exhaustive search process, making it significantly more efficient than alternative search strategies. Extensive experiments on CIFAR-10, CIFAR-100, and ImageNet demonstrate the effectiveness of our method. Notably, we obtain 70.79% top-1 accuracy on ImageNet with only 4 time steps, 1.79% higher than the second best model. Our code is available under https://github.com/stiger1000/Random-Sampling-SNN.