Spiking Neurons Research Articles

Gold saturable metasurface for building a wavelength-tunable optical spiking neuron

Plasmonic resonant metasurfaces have found many applications in nonlinear optics, such as harmonic generation, all-optical modulation, saturable absorption, etc. A saturable absorber, as a key device for pulsing emission, plays an important role in building passively Q-switched or mode-locked fiber lasers. Recently, excitable fiber lasers have attracted much attention in the area of neuromorphic photonics. In this work, a plasmonic metasurface consisting of periodic gold nanorods resonant near 1550 nm is designed and fabricated, which exhibits saturable absorption with a modulation depth of about 2.6%. The saturable metasurface is, for the first time, utilized in an excitable erbium-doped polarization-maintaining fiber laser, acting as a crucial nonlinear term for the dynamics of the optical spiking neuron. Compared to biological neurons, the artificial optical neuron possesses shorter a refractory period, faster pulse encoding capability, and changeable firing rate as a function of cavity length (up to 20 kHz in our experiment). In addition, the optical neuron is tunable in emission wavelength within the range from 1526.3 nm to 1568.2 nm, beneficial to wavelength-division multiplexing in photonic neural networks. The trial of the nonlinear plasmonic metasurface for an excitable laser could inspire new perspectives in constructing optical neurons and extend applications of metasurfaces from conventional nonlinear optics to neuromorphic computing.

Paired competing neurons improving STDP supervised local learning in Spiking Neural Networks.

Direct training of Spiking Neural Networks (SNNs) on neuromorphic hardware has the potential to significantly reduce the energy consumption of artificial neural network training. SNNs trained with Spike Timing-Dependent Plasticity (STDP) benefit from gradient-free and unsupervised local learning, which can be easily implemented on ultra-low-power neuromorphic hardware. However, classification tasks cannot be performed solely with unsupervised STDP. In this paper, we propose Stabilized Supervised STDP (S2-STDP), a supervised STDP learning rule to train the classification layer of an SNN equipped with unsupervised STDP for feature extraction. S2-STDP integrates error-modulated weight updates that align neuron spikes with desired timestamps derived from the average firing time within the layer. Then, we introduce a training architecture called Paired Competing Neurons (PCN) to further enhance the learning capabilities of our classification layer trained with S2-STDP. PCN associates each class with paired neurons and encourages neuron specialization toward target or non-target samples through intra-class competition. We evaluate our methods on image recognition datasets, including MNIST, Fashion-MNIST, and CIFAR-10. Results show that our methods outperform state-of-the-art supervised STDP learning rules, for comparable architectures and numbers of neurons. Further analysis demonstrates that the use of PCN enhances the performance of S2-STDP, regardless of the hyperparameter set and without introducing any additional hyperparameters.

Reproducibility Report for the Paper "Performance Evaluation of Spintronic-Based Spiking Neural Networks Using Parallel Discrete-Event Simulation"

The examined paper introduces Doryta , a simulator for Spiking Neural Networks (SNN) implemented as a ROSS model. The software artifact is available as part of the paper’s supplemental material and can be accessed via the journal’s website. It is well documented and enhances the overall quality of the paper by providing access to the source code of the Dorytra simulator and necessary scripts to reproduce the results shown in the figure. Using the script, we reproduced all major results presented in the paper. Thus, the paper qualifies for the Artifact Available , the Artifact Evaluated - Reusable , and the Artifact Validated - Results Reproduced badges.

Auto-Spikformer: Spikformer architecture search.

The integration of self-attention mechanisms into Spiking Neural Networks (SNNs) has garnered considerable interest in the realm of advanced deep learning, primarily due to their biological properties. Recent advancements in SNN architecture, such as Spikformer, have demonstrated promising outcomes. However, we observe that Spikformer may exhibit excessive energy consumption, potentially attributable to redundant channels and blocks. To mitigate this issue, we propose a one-shot Spiking Transformer Architecture Search method, namely Auto-Spikformer. Auto-Spikformer extends the search space to include both transformer architecture and SNN inner parameters. We train and search the supernet based on weight entanglement, evolutionary search, and the proposed Discrete Spiking Parameters Search (DSPS) methods. Benefiting from these methods, the performance of subnets with weights inherited from the supernet without even retraining is comparable to the original Spikformer. Moreover, we propose a new fitness function aiming to find a Pareto optimal combination balancing energy consumption and accuracy. Our experimental results demonstrate the effectiveness of Auto-Spikformer, which outperforms the original Spikformer and most CNN or ViT models with even fewer parameters and lower energy consumption.

A tunable multi-timescale Indium-Gallium-Zinc-Oxide thin-film transistor neuron towards hybrid solutions for spiking neuromorphic applications

Spiking neural network algorithms require fine-tuned neuromorphic hardware to increase their effectiveness. Such hardware, mainly digital, is typically built on mature silicon nodes. Future artificial intelligence applications will demand the execution of tasks with increasing complexity and over timescales spanning several decades. The multi-timescale requirements for certain tasks cannot be attained effectively enough through the existing silicon-based solutions. Indium-Gallium-Zinc-Oxide thin-film transistors can alleviate the timescale-related shortcomings of silicon platforms thanks to their bellow atto-ampere leakage currents. These small currents enable wide timescale ranges, far beyond what has been feasible through various emerging technologies. Here we have estimated and exploited these low leakage currents to create a multi-timescale neuron that integrates information spanning a range of 7 orders of magnitude and assessed its advantages in larger networks. The multi-timescale ability of this neuron can be utilized together with silicon to create hybrid spiking neural networks capable of effectively executing more complex tasks than their single-technology counterparts.

Tunable intermediate states for neuromorphic computing with spintronic devices

In the pursuit of advancing neuromorphic computing, our research presents a novel method for generating and precisely controlling intermediate states within heavy metal/ferromagnet systems. These states are engineered through the interplay of a strong in-plane magnetic field and an applied charge current. We provide a method for fine-tuning these states by introducing a small out-of-plane magnetic field, allowing for the modulation of the system’s probabilistic response to varying current levels. We also demonstrate the implementation of a spiking neural network (SNN) with a tri-state spike timing-dependent plasticity (STDP) learning rule using our devices. Our research furthers the development of spintronics and informs neural system design. These intermediate states can serve as synaptic weights or neuronal activations, paving the way for multi-level neuromorphic computing architectures.

Unlocking Neuromorphic Vision: Advancements in IGZO-Based Optoelectronic Memristors with Visible Range Sensitivity.

Optoelectronic memristors based on amorphous oxide semiconductors (AOSs) are promising devices for the development of spiking neural network (SNN) hardware in neuromorphic vision sensors. In such devices, the conductance state can be controlled by both optical and electrical stimuli, while the typical persistent photoconductivity (PPC) of AOS materials can be used to emulate synaptic functions. However, due to the large band gap of these materials, sensitivity to visible light (red/green/blue) is difficult to accomplish, which hinders applications requiring color discrimination. In this work, we report a 4 μm2 hydrogen-doped (H-doped) indium-gallium-zinc oxide (IGZO) optoelectronic memristor that emulates all of the important rules of SNNs such as short- to long-term memory transition (STM-LTM), paired-pulse facilitation (PPF), spike-time-dependent plasticity (STDP), and learning and forgetting capabilities. By the incorporation of hydrogen gas in the sputtering deposition of IGZO, visible sensitivity was achieved for green and blue wavelengths. Additionally, extremely high light/dark ratios of 179, 93, and 12 are demonstrated for wavelengths of 365, 405, and 505 nm, respectively, due to hydrogen-induced subgap states and device miniaturization. Therefore, the proposed device shows remarkable potential for integration with the pixel circuits of IGZO-based displays with extreme resolution for a true intelligent self-processing display.

Radar Emitter Recognition Based on Spiking Neural Networks

Efficient and effective radar emitter recognition is critical for electronic support measurement (ESM) systems. However, in complex electromagnetic environments, intercepted pulse trains generally contain substantial data noise, including spurious and missing pulses. Currently, radar emitter recognition methods utilizing traditional artificial neural networks (ANNs) like CNNs and RNNs are susceptible to data noise and require intensive computations, posing challenges to meeting the performance demands of modern ESM systems. Spiking neural networks (SNNs) exhibit stronger representational capabilities compared to traditional ANNs due to the temporal dynamics of spiking neurons and richer information encoded in precise spike timing. Furthermore, SNNs achieve higher computational efficiency by performing event-driven sparse addition calculations. In this paper, a lightweight spiking neural network is proposed by combining direct coding, leaky integrate-and-fire (LIF) neurons, and surrogate gradients to recognize radar emitters. Additionally, an improved SNN for radar emitter recognition is proposed, leveraging the local timing structure of pulses to enhance adaptability to data noise. Simulation results demonstrate the superior performance of the proposed method over existing methods.

Eye Tracking Based on Event Camera and Spiking Neural Network

An event camera generates an event stream based on changes in brightness, retaining only the characteristics of moving objects, and addresses the high power consumption associated with using high-frame-rate cameras for high-speed eye-tracking tasks. However, the asynchronous incremental nature of event camera output has not been fully utilized, and there are also issues related to missing event datasets. Combining the temporal information encoding and state-preserving properties of a spiking neural network (SNN) with an event camera, a near-range eye-tracking algorithm is proposed as well as a novel event-based dataset for validation and evaluation. According to experimental results, the proposed solution outperforms artificial neural network (ANN) algorithms, while computational time remains only 12.5% of that of traditional SNN algorithms. Furthermore, the proposed algorithm allows for self-adjustment of time resolution, with a maximum achievable resolution of 0.081 ms, enhancing tracking stability while maintaining accuracy.

Building an Analog Circuit Synapse for Deep Learning Neuromorphic Processing

In this article, we propose a circuit to imitate the behavior of a Reward-Modulated spike-timing-dependent plasticity synapse. When two neurons in adjacent layers produce spikes, each spike modifies the thickness in the shared synapse. As a result, the synapse’s ability to conduct impulses is controlled, leading to an unsupervised learning rule. By introducing a reward signal, reinforcement learning is enabled by redirecting the growth and shrinkage of synapses based on signal feedback from the environment. The proposed synapse manages the convolution of the emitted spike signals to promote either the strengthening or weakening of the synapse, represented as the resistance value of a memristor device. As memristors have a conductance range that may differ from the available current input range of typical CMOS neuron designs, the synapse circuit can be adjusted to regulate the spike’s amplitude current to comply with the neuron. The circuit described in this work allows for the implementation of fully interconnected layers of neuron analog circuits. This is achieved by having each synapse reconform the spike signal, thus removing the burden of providing enough power from the neurons to each memristor. The synapse circuit was tested using a CMOS analog neuron described in the literature. Additionally, the article provides insight into how to properly describe the hysteresis behavior of the memristor in Verilog-A code. The testing and learning capabilities of the synapse circuit are demonstrated in simulation using the Skywater-130 nm process. The article’s main goal is to provide the basic building blocks for deep neural networks relying on spiking neurons and memristors as the basic processing elements to handle spike generation, propagation, and synaptic plasticity.

Pulse Shape and Voltage-Dependent Synchronization in Spiking Neuron Networks.

Pulse-coupled spiking neural networks are a powerful tool to gain mechanistic insights into how neurons self-organize to produce coherent collective behavior. These networks use simple spiking neuron models, such as the θ-neuron or the quadratic integrate-and-fire (QIF) neuron, that replicate the essential features of real neural dynamics. Interactions between neurons are modeled with infinitely narrow pulses, or spikes, rather than the more complex dynamics of real synapses. To make these networks biologically more plausible, it has been proposed that they must also account for the finite width of the pulses, which can have a significant impact on the network dynamics. However, the derivation and interpretation of these pulses are contradictory, and the impact of the pulse shape on the network dynamics is largely unexplored. Here, I take a comprehensive approach to pulse coupling in networks of QIF and θ-neurons. I argue that narrow pulses activate voltage-dependent synaptic conductances and show how to implement them in QIF neurons such that their effect can last through the phase after the spike. Using an exact low-dimensional description for networks of globally coupled spiking neurons, I prove for instantaneous interactions that collective oscillations emerge due to an effective coupling through the mean voltage. I analyze the impact of the pulse shape by means of a family of smooth pulse functions with arbitrary finite width and symmetric or asymmetric shapes. For symmetric pulses, the resulting voltage coupling is not very effective in synchronizing neurons, but pulses that are slightly skewed to the phase after the spike readily generate collective oscillations. The results unveil a voltage-dependent spike synchronization mechanism at the heart of emergent collective behavior, which is facilitated by pulses of finite width and complementary to traditional synaptic transmission in spiking neuron networks.

Myelin dystrophy impairs signal transmission and working memory in a multiscale model of the aging prefrontal cortex.

Normal aging leads to myelin alterations in the rhesus monkey dorsolateral prefrontal cortex (dlPFC), which are positively correlated with degree of cognitive impairment. It is hypothesized that remyelination with shorter and thinner myelin sheaths partially compensates for myelin degradation, but computational modeling has not yet explored these two phenomena together systematically. Here, we used a two-pronged modeling approach to determine how age-related myelin changes affect a core cognitive function: spatial working memory. First, we built a multicompartment pyramidal neuron model fit to monkey dlPFC empirical data, with an axon including myelinated segments having paranodes, juxtaparanodes, internodes, and tight junctions. This model was used to quantify conduction velocity (CV) changes and action potential (AP) failures after demyelination and subsequent remyelination. Next, we incorporated the single neuron results into a spiking neural network model of working memory. While complete remyelination nearly recovered axonal transmission and network function to unperturbed levels, our models predict that biologically plausible levels of myelin dystrophy, if uncompensated by other factors, can account for substantial working memory impairment with aging. The present computational study unites empirical data from ultrastructure up to behavior during normal aging, and has broader implications for many demyelinating conditions, such as multiple sclerosis or schizophrenia.

Automatic detection of sleep apnea from a single-lead ECG signal based on spiking neural network model

BackgroundSleep apnea (SLA) is a commonly encountered sleep disorder characterized by repetitive cessation of respiration while sleeping. In the past few years, researchers have focused on developing less complex and more cost-effective diagnostic approaches for identifying SLA recipients, in contrast to the cumbersome, complicated, and expensive conventional methods. MethodThis study presents a biologically plausible learning approach of spiking neural networks (SNN) with temporal coding and a tempotron learning model for diagnosing SLA disorder using single-lead electrocardiogram (ECG) data information. The proposed framework utilizes temporal encoding and the leaky integrate and fire model to transform the ECG signal into spikes for capturing the signal's dynamic pattern nature and to simulate input response behaviors. The tempoton learning technique, a spike-based algorithm, trains the SNN model to identify SLA event patterns from encoded output spike trains. This study utilized ECG data to extract heart rate variability (HRV) and ECG-derived respiration (EDR) signals from 1-min segment data of ECG records for input to SNN model. Thirty-five recordings of both released and withheld data from the Apnea-ECG databases from Physionet have been applied to train the SNN model and validate the model's efficacy in identifying SLA occurrences. ResultsThe proposed method demonstrated substantial improvements compared to other SLA detection techniques, achieving a significant accuracy of 94.63 % for per-segment detection, along with specificity, sensitivity, F1-score and AUC values of 96.21 %, 92.04 %, 0.9285, and 0.9851 respectively. The accuracy for per-recording detection achieved 100 %, with a correlation coefficient value of 0.986. Additionally, the experiment used UCD data for validation methods, achieving an accuracy of 84.573 %. ConclusionsThese results suggest the effectiveness and accessibility of the presented approach for accurately identifying SLA cases. The suggested model enhances the performance of SLA detection when contrasted with various techniques based on feature engineering and feature learning.

Spiking neural networks in the Alexiewicz topology: A new perspective on analysis and error bounds

In order to ease the analysis of error propagation in neuromorphic computing and to get a better understanding of spiking neural networks (SNN), we address the problem of mathematical analysis of SNNs as endomorphisms that map spike trains to spike trains. A central question is the adequate structure for a space of spike trains and its implication for the design of error measurements of SNNs including time delay, threshold deviations, and the design of the reinitialization mode of the leaky-integrate-and-fire (LIF) neuron model. First, we identify the underlying topology by analyzing the closure of all sub-threshold signals of a LIF model. For zero leakage this approach yields the Alexiewicz topology, which we adopt to LIF neurons with arbitrary positive leakage. As a result, LIF can be understood as spike train quantization in the corresponding norm. This way we obtain various error bounds and inequalities such as a quasi-isometry relation between incoming and outgoing spike trains. Another result is a Lipschitz-style global upper bound for the error propagation and a related resonance-type phenomenon.

Touch and slippage detection in robotic hands with spiking neural networks

Significant research efforts have focused on advancing upper limb prostheses, addressing issues such as dexterity, embodiment, weight, and resistance. These key features require enhancements to mitigate prosthesis abandonment. Sensory feedback is a vital feature for improving the dexterity and embodiment of prostheses for patients. Current techniques utilize electronic signals for feedback to control systems and to partially restore tactile sensations to amputees. However, it has already been demonstrated that, in order to elicit responses from biological neurons signals must be converted into neuromorphic tactile information. Most of those demonstrations relied on algorithmic implementations of mechanoreceptor and neuron models running on classic processor cores. However, integrating real-time encoding and control strategies into such architectures is challenging due to computational complexity and high power usage. A prospective solution is to increasingly incorporate neuromorphic technologies for prosthesis sensing and control. In this work, we demonstrate the feasibility of using spiking neural networks for performing two key functions in controlling upper limb prosthesis: touch and slippage detection. We found that a simple two-layered architecture with a few tens of neurons is sufficient to identify slip and touch with nearly 100% accuracy. The first layer consists of a heterogeneous population of neurons with their parameters adjusted to model slowly and fast-adapting type 1 mechanoreceptors. An output layer classifies touch or slip events. Furthermore, simulations showed that implementing the network in ultra-low-power neuromorphic hardware, such as Loihi, has the potential to reduce power consumption by up to 162 times, with respect to a von Neumann processor.

An Enhanced Photonic Spiking Neural Network Based on the VCSEL-SA for Recognition and Classification

An Enhanced Photonic Spiking Neural Network Based on the VCSEL-SA for Recognition and Classification

A Novel Electronic Nose Using Biomimetic Spiking Neural Network for Mixed Gas Recognition

Odors existing in natural environment are typically mixtures of a large variety of chemical compounds in specific proportions. It is a challenging task for an electronic nose to recognize the gas mixtures. Most current research is based on the overall response of sensors and uses relatively simple datasets, which cannot be used for complex mixtures or rapid monitoring scenarios. In this study, a novel electronic nose (E-nose) using a spiking neural network (SNN) model was proposed for the detection and recognition of gas mixtures. The electronic nose integrates six commercial metal oxide sensors for automated gas acquisition. SNN with a simple three-layer structure was introduced to extract transient dynamic information and estimate concentration rapidly. Then, a dataset of mixed gases with different orders of magnitude was established by the E-nose to verify the model’s performance. Additionally, random forests and the decision tree regression model were used for comparison with the SNN-based model. Results show that the model utilizes the dynamic characteristics of the sensors, achieving smaller mean squared error (MSE < 0.01) and mean absolute error (MAE) with less data compared to random forest and decision tree algorithms. In conclusion, the electronic nose system combined with the bionic model shows a high performance in identifying gas mixtures, which has a great potential to be used for indoor air quality monitoring in practical applications.

Ascorbate insufficiency disrupts glutamatergic signaling and alters electroencephalogram phenotypes in a mouse model of Alzheimer's disease

Clinical studies have reported that increased epileptiform and subclinical epileptiform activity can be detected in many patients with an Alzheimer's disease (AD) diagnosis using electroencephalogram (EEG) and this may correlate with poorer cognition. Ascorbate may have a specific role as a neuromodulator in AD as it is released concomitantly with glutamate reuptake following excitatory neurotransmission. Insufficiency may therefore result in an exacerbated excitatory/inhibitory imbalance in neuronal signaling. Using a mouse model of AD that requires dietary ascorbate (Gulo−/-APPswe/PSEN1dE9), EEG was recorded at baseline and during 4 weeks of ascorbate depletion in young (5-month-old) and aged (20-month-old) animals. Data were scored for changes in quantity of spike trains, individual spikes, sleep-wake rhythms, sleep fragmentation, and brainwave power bands during light periods each week. We found an early increase in neuronal spike discharges with age and following ascorbate depletion in AD model mice and not controls, which did not correlate with brain amyloid load. Our data also show more sleep fragmentation with age and with ascorbate depletion. Additionally, changes in brain wave activity were observed within different vigilance states in both young and aged mice, where Gulo−/-APPswe/PSEN1dE9 mice had shifts towards higher frequency bands (alpha, beta, and gamma) and ascorbate depletion resulted in shifts towards lower frequency bands (delta and theta). Microarray data supported ascorbate insufficiency altering glutamatergic transmission through the decreased expression of glutamate related genes, however no changes in protein expression of glutamate reuptake transporters were observed. These data suggest that maintaining optimal brain ascorbate levels may support normal brain electrical activity and sleep patterns, particularly in AD patient populations where disruptions are observed.

Computational elements based on coupled VO2 oscillators via tunable thermal triggering

Computational technologies based on coupled oscillators are of great interest for energy efficient computing. A key to developing such technologies is the tunable control of the interaction among oscillators which today is accomplished by additional electronic components. Here we show that the synchronization of closely spaced vanadium dioxide (VO2) oscillators can be controlled via a simple thermal triggering element that itself is formed from VO2. The net energy consumed by the oscillators is lower during thermal coupling compared with the situation where they are oscillating independently. As the size of the oscillator shrinks from 6 μm to 200 nm both the energy efficiency and the oscillator frequency increases. Based on such oscillators with active tuning, we demonstrate AND, NAND, and NOR logic gates and various firing patterns that mimic the behavior of spiking neurons. Our findings demonstrate an innovative approach towards computational techniques based on networks of thermally coupled oscillators.

Learning improvement of spiking neural networks with dynamic adaptive hyperparameter neurons

Learning improvement of spiking neural networks with dynamic adaptive hyperparameter neurons