Neuronal Network Model Research Articles

Artificial Neural Network Modeling to Predict the Effect of Milling Time and TiC Content on the Crystallite Size and Lattice Strain of Al7075-TiC Composites Fabricated by Powder Metallurgy

In the study, Al7075-TiC composites were synthesized by using a novel dual step blending process followed by cold pressing and sintering. The effect of ball milling time on the microstructure of the synthesized composite powder was characterized using X-ray diffraction measurements (XRD), scanning electron microscopy (SEM), energy dispersive spectroscopy (EDS), and transmission electron microscopy (TEM). Subsequently, the integrated effects of the two-stage mechanical alloying process were investigated on the crystallite size and lattice strain. The crystallite size and lattice strain of blended samples were calculated using the Scherrer method. The prediction of the crystallite size and lattice strain of synthesized composite powders was conducted by an artificial neural network technique. The results of the mixed powder revealed that the particle size and crystallite size improved with increasing milling time. The particle size of the 3 h-milled composites was 463 nm, and it reduces to 225 nm after 7 h of milling time. The microhardness of the produced composites was significantly improved with milling time. Furthermore, an artificial neuron network (ANN) model was developed to predict the crystallite size and lattice strain of the synthesized composites. The ANN model provides an accurate model for the prediction of lattice parameters of the composites.

Mitigation of carbon footprint with 100% renewable energy system by 2050: The case of Galapagos islands

In this paper, a technical-economic study of the 100% renewable energy sources in the Galapagos islands is done. Historical consumption data for 2011–2020 have been considered to forecast the load curve. To achieve this goal, the load is forecasting by Nonlinear autoregressive exogenous neuronal network model for 2030 and 2050. The study focuses on supplying the energy demand of the islands with renewable sources, analyzing possible scenarios based on the current electricity system. The methodology studies the capacity of renewable sources to balance supply and demand through dispatch simulations using the EnergyPLAN software. The results show energy flows, costs and long-term energy balances (2050), with 100% renewable energy from several wind and photovoltaic combinations. Moreover, The precision of the demand forecast was 98.12% with a mean square error of 0.013%. The total annual cost decreases while the capacities of the renewable sources increase to a certain point of equilibrium. As salient features of the developed approach, various sensitivity analyzes are presented that allow understanding the uncertainties, scope and limitations of the proposed models.

Assessment of glomerular morphological patterns by deep learning algorithms

BackgroundCompilation of different morphological lesion signatures is characteristic of renal pathology. Previous studies have documented the potential value of artificial intelligence (AI) in recognizing relatively clear-cut glomerular structures and patterns, such as segmental or global sclerosis or mesangial hypercellularity. This study aimed to test the capacity of deep learning algorithms to recognize complex glomerular structural changes that reflect common diagnostic dilemmas in nephropathology.MethodsFor this purpose, we defined nine classes of glomerular morphological patterns and trained twelve convolutional neuronal network (CNN) models on these. The two-step training process was done on a first dataset defined by an expert nephropathologist (12,253 images) and a second consensus dataset (11,142 images) defined by three experts in the field.ResultsThe efficacy of CNN training was evaluated using another set with 180 consensus images, showing convincingly good classification results (kappa-values 0.838–0.938).Furthermore, we elucidated the image areas decisive for CNN-based decision making by class activation maps. Finally, we demonstrated that the algorithm could decipher glomerular disease patterns coinciding in a single glomerulus (e.g. necrosis along with mesangial and endocapillary hypercellularity).ConclusionsIn summary, our model, focusing on glomerular lesions detectable by conventional microscopy, is the first sui generis to deploy deep learning as a reliable and promising tool in recognition of even discrete and/or overlapping morphological changes. Our results provide a stimulus for ongoing projects that integrate further input levels next to morphology (such as immunohistochemistry, electron microscopy, and clinical information) to develop a novel tool applicable for routine diagnostic nephropathology.

Plasticity impairment exposes CA3 vulnerability in a hippocampal network model of mild traumatic brain injury.

Proper function of the hippocampus is critical for executing cognitive tasks such as learning and memory. Traumatic brain injury (TBI) and other neurological disorders are commonly associated with cognitive deficits and hippocampal dysfunction. Although there are many existing models of individual subregions of the hippocampus, few models attempt to integrate the primary areas into one system. In this work, we developed a computational model of the hippocampus, including the dentate gyrus, CA3, and CA1. The subregions are represented as an interconnected neuronal network, incorporating well-characterized ex vivo slice electrophysiology into the functional neuron models and well-documented anatomical connections into the network structure. In addition, since plasticity is foundational to the role of the hippocampus in learning and memory as well as necessary for studying adaptation to injury, we implemented spike-timing-dependent plasticity among the synaptic connections. Our model mimics key features of hippocampal activity, including signal frequencies in the theta and gamma bands and phase-amplitude coupling in area CA1. We also studied the effects of spike-timing-dependent plasticity impairment, a potential consequence of TBI, in our model and found that impairment decreases broadband power in CA3 and CA1 and reduces phase coherence between these two subregions, yet phase-amplitude coupling in CA1 remains intact. Altogether, our work demonstrates characteristic hippocampal activity with a scaled network model of spiking neurons and reveals the sensitive balance of plasticity mechanisms in the circuit through one manifestation of mild traumatic injury.

Dynamical Characteristics of Recurrent Neuronal Networks Are Robust Against Low Synaptic Weight Resolution.

The representation of the natural-density, heterogeneous connectivity of neuronal network models at relevant spatial scales remains a challenge for Computational Neuroscience and Neuromorphic Computing. In particular, the memory demands imposed by the vast number of synapses in brain-scale network simulations constitute a major obstacle. Limiting the number resolution of synaptic weights appears to be a natural strategy to reduce memory and compute load. In this study, we investigate the effects of a limited synaptic-weight resolution on the dynamics of recurrent spiking neuronal networks resembling local cortical circuits and develop strategies for minimizing deviations from the dynamics of networks with high-resolution synaptic weights. We mimic the effect of a limited synaptic weight resolution by replacing normally distributed synaptic weights with weights drawn from a discrete distribution, and compare the resulting statistics characterizing firing rates, spike-train irregularity, and correlation coefficients with the reference solution. We show that a naive discretization of synaptic weights generally leads to a distortion of the spike-train statistics. If the weights are discretized such that the mean and the variance of the total synaptic input currents are preserved, the firing statistics remain unaffected for the types of networks considered in this study. For networks with sufficiently heterogeneous in-degrees, the firing statistics can be preserved even if all synaptic weights are replaced by the mean of the weight distribution. We conclude that even for simple networks with non-plastic neurons and synapses, a discretization of synaptic weights can lead to substantial deviations in the firing statistics unless the discretization is performed with care and guided by a rigorous validation process. For the network model used in this study, the synaptic weights can be replaced by low-resolution weights without affecting its macroscopic dynamical characteristics, thereby saving substantial amounts of memory.

Reconstruction of a Fully Paralleled Auditory Spiking Neural Network and FPGA Implementation.

This paper presents a field-programmable gate array (FPGA) implementation of an auditory system, which is biologically inspired and has the advantages of robustness and anti-noise ability. We propose an FPGA implementation of an eleven-channel hierarchical spiking neuron network (SNN) model, which has a sparsely connected architecture with low power consumption. According to the mechanism of the auditory pathway in human brain, spiking trains generated by the cochlea are analyzed in the hierarchical SNN, and the specific word can be identified by a Bayesian classifier. Modified leaky integrate-and-fire (LIF) model is used to realize the hierarchical SNN, which achieves both high efficiency and low hardware consumption. The hierarchical SNN implemented on FPGA enables the auditory system to be operated at high speed and can be interfaced and applied with external machines and sensors. A set of speech from different speakers mixed with noise are used as input to test the performance our system, and the experimental results show that the system can classify words in a biologically plausible way with the presence of noise. The method of our system is flexible and the system can be modified into desirable scale. These confirm that the proposed biologically plausible auditory system provides a better method for on-chip speech recognition. Compare to the state-of-the-art, our auditory system achieves a higher speed with a maximum frequency of 65.03 MHz and a lower energy consumption of 276.83 μJ for a single operation. It can be applied in the field of brain-computer interface and intelligent robots.

Analysis of cellular and synaptic mechanisms behind spontaneous cortical activity in vitro: Insights from optimization of spiking neuronal network models

Spontaneous network bursts, the intervals of intense network-wide activity interleaved with longer periods of sparse activity, are a hallmark phenomenon observed in cortical networks at postnatal developmental stages. Generation, propagation and termination of network bursts depend on a combination of synaptic, cellular and network mechanisms; however, the interplay between these mechanisms is not fully understood. We study this interplay in silico, using a new data-driven framework for generating spiking neuronal networks fitted to the microelectrode array recordings. We recorded the network bursting activity from rat postnatal cortical networks under several pharmacological conditions. In each condition, the function of specific excitatory and inhibitory synaptic receptors was reduced in order to examine their impact on global network dynamics. The obtained data was used to develop two complementary model fitting protocols for automatic model generation. These protocols allowed us to disentangle systematically the modeled cellular and synaptic mechanisms that affect the observed network bursts. We confirmed that the change in excitatory and inhibitory synaptic transmission in silico, consistent with pharmacological conditions, can account for the changes in network bursts relative to the control data. Reproducing the exact recorded network bursts statistics required adapting both the synaptic transmission and the cellular excitability separately for each pharmacological condition. Our results bring new understanding of the complex interplay between cellular, synaptic and network mechanisms supporting the burst dynamics. While here we focused on analysis of in vitro data, our approach can be applied ex vivo and in vivo given that the appropriate experimental data is available.

Analysis of cellular and synaptic mechanisms behind spontaneous cortical activity in vitro: Insights from optimization of spiking neuronal network models

Analysis of cellular and synaptic mechanisms behind spontaneous cortical activity in vitro: Insights from optimization of spiking neuronal network models

Analysis of cellular and synaptic mechanisms behind spontaneous cortical activity in vitro: Insights from optimization of spiking neuronal network models

Analysis of cellular and synaptic mechanisms behind spontaneous cortical activity in vitro: Insights from optimization of spiking neuronal network models

Analysis of cellular and synaptic mechanisms behind spontaneous cortical activity in vitro: Insights from optimization of spiking neuronal network models

Analysis of cellular and synaptic mechanisms behind spontaneous cortical activity in vitro: Insights from optimization of spiking neuronal network models

NEST Desktop, an Educational Application for Neuroscience.

Simulation software for spiking neuronal network models matured in the past decades regarding performance and flexibility. But the entry barrier remains high for students and early career scientists in computational neuroscience since these simulators typically require programming skills and a complex installation. Here, we describe an installation-free Graphical User Interface (GUI) running in the web browser, which is distinct from the simulation engine running anywhere, on the student’s laptop or on a supercomputer. This architecture provides robustness against technological changes in the software stack and simplifies deployment for self-education and for teachers. Our new open-source tool, NEST Desktop, comprises graphical elements for creating and configuring network models, running simulations, and visualizing and analyzing the results. NEST Desktop allows students to explore important concepts in computational neuroscience without the need to learn a simulator control language before. Our experiences so far highlight that NEST Desktop helps advancing both quality and intensity of teaching in computational neuroscience in regular university courses. We view the availability of the tool on public resources like the European ICT infrastructure for neuroscience EBRAINS as a contribution to equal opportunities.

Bringing Anatomical Information into Neuronal Network Models.

For constructing neuronal network models computational neuroscientists have access to wide-ranging anatomical data that nevertheless tend to cover only a fraction of the parameters to be determined. Finding and interpreting the most relevant data, estimating missing values, and combining the data and estimates from various sources into a coherent whole is a daunting task. With this chapter we aim to provide guidance to modelers by describing the main types of anatomical data that may be useful for informing neuronal network models. We further discuss aspects of the underlying experimental techniques relevant to the interpretation of the data, list particularly comprehensive data sets, and describe methods for filling in the gaps in the experimental data. Such methods of "predictive connectomics" estimate connectivity where the data are lacking based on statistical relationships with known quantities. Exploiting organizational principles that link the plethora of data in a unifying framework can be useful for informing computational models. Besides overarching principles, we touch upon the most prominent features of brain organization that are likely to influence predicted neuronal network dynamics, with a focus on the mammalian cerebral cortex. Given the still existing need for modelers to navigate a complex data landscape full of holes and stumbling blocks, it is vital that the field of neuroanatomy is moving toward increasingly systematic data collection, representation, and publication.

A strategy for mapping biophysical to abstract neuronal network models applied to primary visual cortex.

A fundamental challenge for the theoretical study of neuronal networks is to make the link between complex biophysical models based directly on experimental data, to progressively simpler mathematical models that allow the derivation of general operating principles. We present a strategy that successively maps a relatively detailed biophysical population model, comprising conductance-based Hodgkin-Huxley type neuron models with connectivity rules derived from anatomical data, to various representations with fewer parameters, finishing with a firing rate network model that permits analysis. We apply this methodology to primary visual cortex of higher mammals, focusing on the functional property of stimulus orientation selectivity of receptive fields of individual neurons. The mapping produces compact expressions for the parameters of the abstract model that clearly identify the impact of specific electrophysiological and anatomical parameters on the analytical results, in particular as manifested by specific functional signatures of visual cortex, including input-output sharpening, conductance invariance, virtual rotation and the tilt after effect. Importantly, qualitative differences between model behaviours point out consequences of various simplifications. The strategy may be applied to other neuronal systems with appropriate modifications.

The connections of neocortical pyramidal cells can implement the learning of new categories, attractor memory, and top\u2013down recall and attention

Neocortical pyramidal cells have three key classes of excitatory input: forward inputs from the previous cortical area (or thalamus); recurrent collateral synapses from nearby pyramidal cells; and backprojection inputs from the following cortical area. The neocortex performs three major types of computation: (1) unsupervised learning of new categories, by allocating neurons to respond to combinations of inputs from the preceding cortical stage, which can be performed using competitive learning; (2) short-term memory, which can be performed by an attractor network using the recurrent collaterals; and (3) recall of what has been learned by top–down backprojections from the following cortical area. There is only one type of excitatory neuron involved, pyramidal cells, with these three types of input. It is proposed, and tested by simulations of a neuronal network model, that pyramidal cells can implement all three types of learning simultaneously, and can subsequently usefully categorise the forward inputs; keep them active in short-term memory; and later recall the representations using the backprojection input. This provides a new approach to understanding how one type of excitatory neuron in the neocortex can implement these three major types of computation, and provides a conceptual advance in understanding how the cerebral neocortex may work.

Impact of gyral geometry on cortical responses to surface electrical stimulation: insights from experimental and modeling studies

Objective. Invasive simultaneous stimulation and recording from intracranial electrodes and microwire arrays were used to investigate direct cortical responses to single pulses of electrical stimulation in humans. Approach. Microwire contacts measured surface potentials in cortical microdomains at a distance of 2–6 mm from the intracranial electrode. Direct cortical responses to stimulation (<20 ms) consisted of a larger surface negative potentials. Main results. The latencies of these responses were directly or inversely correlated with distances between the intracranial electrode and microwire contacts. We hypothesize that surface negative potentials reflected local synchronous depolarization of apical dendrites of pyramidal neurons in cortical microdomains in the superficial cortical layer and resulted from the activation of gray matter axons that delivered excitatory inputs to apical dendrites after cortical stimulation. We further hypothesized that the positive or inverse distance-latency correlations of the recorded negative responses were measured depending on whether activation of neurons originated at one (crown) or multiple (crown, lip, bank) sites throughout the gyrus simultaneously. The inverse distance-latency correlations then reflected the spatiotemporal superposition of different nearby sources of neuronal recruitment in the gyrus. To prove this hypothesis, we built an anatomically informed and biophysically realistic cortical network model and simulated early responses of cortical neurons to electrical stimulation in this cortical network model. The model simulations yielded negative potentials in simulated microdomains in the cortical model consistent with those recorded from humans. The model predicted sensitivity of cortical responses to the alignment of the stimulating electrode and microwire array with respect to the cortical gyrus and confirmed that gyral geometry has a major impact on direct neuronal recruitment, the timing, and the time course of neuronal activation in cortical microdomains. Significance. In this work, we demonstrated how the high-resolution forward network models can be used for better understanding and detailed prediction of cortical stimulation effects. Accurate predictive modeling tools are needed for the progress of brain stimulation therapies.

Subspace-based predictive control of Parkinson’s disease: A model-based study

Deep brain stimulation (DBS) of the Basal Ganglia (BG) is an effective treatment to suppress the symptoms of Parkinson’s disease (PD). Using a closed-loop scheme in DBS can not only improve its therapeutic effects but it can also reduce its energy consumption and possible side effects. In this paper, a predictive closed loop control strategy is employed to suppress the PD in real-time. A linear multi-input multi-output (MIMO) state-delayed system is considered as a simplified model of the BG neuronal network relating the stimulation signals as inputs to the beta power of local field potentials as PD biomarkers. The effect of time delay in different areas of the BG is incorporated into this model and a real-time subspace-based identification is implemented to continuously model the state of the BG neuronal network and drive the predictive control strategy. Simulation results show that the proposed MIMO subspace based predictive controller can suppress PD symptoms more effectively and with less power consumption compared to the conventional open-loop DBS and a recently proposed single-input single-output closed loop controller.

Modeling and dynamics of double Hindmarsh–Rose neuron with memristor-based magnetic coupling and time delay* *Project supported by the National Natural Science Foundation of China (Grant No. 61873186).

The firing of a neuron model is mainly affected by the following factors: the magnetic field, external forcing current, time delay, etc. In this paper, a new time-delayed electromagnetic field coupled dual Hindmarsh – Rose neuron network model is constructed. A magnetically controlled threshold memristor is improved to represent the self-connected and the coupled magnetic fields triggered by the dynamic change of neuronal membrane potential for the adjacent neurons. Numerical simulation confirms that the coupled magnetic field can activate resting neurons to generate rich firing patterns, such as spiking firings, bursting firings, and chaotic firings, and enable neurons to generate larger firing amplitudes. The study also found that the strength of magnetic coupling in the neural network also affects the number of peaks in thedischarge of bursting firing. Based on the existing medical treatment background of mental illness, the effects of time lag in the coupling process against neuron firing are studied. The results confirm that the neurons can respond well to external stimuli and coupled magnetic field with appropriate time delay, and keep periodic firing under a wide range of external forcing current.

Super-Selective Reconstruction of Causal and Direct Connectivity With Application to in vitro iPSC Neuronal Networks.

Despite advancements in the development of cell-based in-vitro neuronal network models, the lack of appropriate computational tools limits their analyses. Methods aimed at deciphering the effective connections between neurons from extracellular spike recordings would increase utility of in vitro local neural circuits, especially for studies of human neural development and disease based on induced pluripotent stem cells (hiPSC). Current techniques allow statistical inference of functional couplings in the network but are fundamentally unable to correctly identify indirect and apparent connections between neurons, generating redundant maps with limited ability to model the causal dynamics of the network. In this paper, we describe a novel mathematically rigorous, model-free method to map effective—direct and causal—connectivity of neuronal networks from multi-electrode array data. The inference algorithm uses a combination of statistical and deterministic indicators which, first, enables identification of all existing functional links in the network and then reconstructs the directed and causal connection diagram via a super-selective rule enabling highly accurate classification of direct, indirect, and apparent links. Our method can be generally applied to the functional characterization of any in vitro neuronal networks. Here, we show that, given its accuracy, it can offer important insights into the functional development of in vitro hiPSC-derived neuronal cultures.

Pattern formation in a 2-population homogenized neuronal network model

We study pattern formation in a 2-population homogenized neural field model of the Hopfield type in one spatial dimension with periodic microstructure. The connectivity functions are periodically modulated in both the synaptic footprint and in the spatial scale. It is shown that the nonlocal synaptic interactions promote a finite band width instability. The stability method relies on a sequence of wave-number dependent invariants of 2times 2-stability matrices representing the sequence of Fourier-transformed linearized evolution equations for the perturbation imposed on the homogeneous background. The generic picture of the instability structure consists of a finite set of well-separated gain bands. In the shallow firing rate regime the nonlinear development of the instability is determined by means of the translational invariant model with connectivity kernels replaced with the corresponding period averaged connectivity functions. In the steep firing rate regime the pattern formation process depends sensitively on the spatial localization of the connectivity kernels: For strongly localized kernels this process is determined by the translational invariant model with period averaged connectivity kernels, whereas in the complementary regime of weak and moderate localization requires the homogenized model as a starting point for the analysis. We follow the development of the instability numerically into the nonlinear regime for both steep and shallow firing rate functions when the connectivity kernels are modeled by means of an exponentially decaying function. We also study the pattern forming process numerically as a function of the heterogeneity parameters in four different regimes ranging from the weakly modulated case to the strongly heterogeneous case. For the weakly modulated regime, we observe that stable spatial oscillations are formed in the steep firing rate regime, whereas we get spatiotemporal oscillations in the shallow regime of the firing rate functions.

Distinct effects of heterogeneity and noise on gamma oscillation in a model of neuronal network with different reversal potential

Gamma oscillation is crucial in brain functions such as attentional selection, and is inextricably linked to both heterogeneity and noise (or so-called stochastic fluctuation) in neuronal networks. However, under coexistence of these factors, it has not been clarified how the synaptic reversal potential modulates the entraining of gamma oscillation. Here we show distinct effects of heterogeneity and noise in a population of modified theta neurons randomly coupled via GABAergic synapses. By introducing the Fokker-Planck equation and circular cumulants, we derive a set of two-cumulant macroscopic equations. In bifurcation analyses, we find a stabilizing effect of heterogeneity and a nontrivial effect of noise that results in promoting, diminishing, and shifting the oscillatory region, and is largely dependent on the reversal potential of GABAergic synapses. These findings are verified by numerical simulations of a finite-size neuronal network. Our results reveal that slight changes in reversal potential and magnitude of stochastic fluctuations can lead to immediate control of gamma oscillation, which would results in complex spatio-temporal dynamics for attentional selection and recognition.