Large-scale Neural Recordings Research Articles

Dimensionality reduction beyond neural subspaces with slice tensor component analysis.

Recent work has argued that large-scale neural recordings are often well described by patterns of coactivation across neurons. Yet the view that neural variability is constrained to a fixed, low-dimensional subspace may overlook higher-dimensional structure, including stereotyped neural sequences or slowly evolving latent spaces. Here we argue that task-relevant variability in neural data can also cofluctuate over trials or time, defining distinct 'covariability classes' that may co-occur within the same dataset. To demix these covariability classes, we develop sliceTCA (slice tensor component analysis), a new unsupervised dimensionality reduction method for neural data tensors. In three example datasets, including motor cortical activity during a classic reaching task in primates and recent multiregion recordings in mice, we show that sliceTCA can capture more task-relevant structure in neural data using fewer components than traditional methods. Overall, our theoretical framework extends the classic view of low-dimensional population activity by incorporating additional classes of latent variables capturing higher-dimensional structure.

Selection of experience for memory by hippocampal sharp wave ripples.

Experiences need to be tagged during learning for further consolidation. However, neurophysiological mechanisms that select experiences for lasting memory are not known. By combining large-scale neural recordings in mice with dimensionality reduction techniques, we observed that successive maze traversals were tracked by continuously drifting populations of neurons, providing neuronal signatures of both places visited and events encountered. When the brain state changed during reward consumption, sharp wave ripples (SPW-Rs) occurred on some trials, and their specific spike content decoded the trial blocks that surrounded them. During postexperience sleep, SPW-Rs continued to replay those trial blocks that were reactivated most frequently during waking SPW-Rs. Replay content of awake SPW-Rs may thus provide a neurophysiological tagging mechanism to select aspects of experience that are preserved and consolidated for future use.

Hippocampal replay sequence governed by spontaneous brain-wide dynamics.

Neurons in the hippocampus exhibit spontaneous spiking activity during rest that appears to recapitulate previously experienced events. While this replay activity is frequently linked to memory consolidation and learning, the underlying mechanisms are not well understood. Recent large-scale neural recordings in mice have demonstrated that resting-state spontaneous activity is expressed as quasi-periodic cascades of spiking activity that pervade the forebrain, with each cascade engaging a high proportion of recorded neurons. Hippocampal ripples are known to be coordinated with cortical dynamics; however, less is known about the occurrence of replay activity relative to other brain-wide spontaneous events. Here we analyzed responses across the mouse brain to multiple viewings of natural movies, as well as subsequent patterns of neural activity during rest. We found that hippocampal neurons showed time-selectivity, with individual neurons responding consistently during particular moments of the movie. During rest, the population of time-selective hippocampal neurons showed both forward and time-reversed replay activity that matched the sequence observed in the movie. Importantly, these replay events were strongly time-locked to brain-wide spiking cascades, with forward and time-reversed replay activity associated with distinct cascade types. Thus, intrinsic hippocampal replay activity is temporally structured according to large-scale spontaneous physiology affecting areas throughout the forebrain. These findings shed light on the coordination between hippocampal and cortical circuits thought to be critical for memory consolidation.

Self-motion perception and sequential decision-making: where are we heading?

To navigate and guide adaptive behaviour in a dynamic environment, animals must accurately estimate their own motion relative to the external world. This is a fundamentally multisensory process involving integration of visual, vestibular and kinesthetic inputs. Ideal observer models, paired with careful neurophysiological investigation, helped to reveal how visual and vestibular signals are combined to support perception of linear self-motion direction, or heading. Recent work has extended these findings by emphasizing the dimension of time, both with regard to stimulus dynamics and the trade-off between speed and accuracy. Both time and certainty-i.e. the degree of confidence in a multisensory decision-are essential to the ecological goals of the system: terminating a decision process is necessary for timely action, and predicting one's accuracy is critical for making multiple decisions in a sequence, as in navigation. Here, we summarize a leading model for multisensory decision-making, then show how the model can be extended to study confidence in heading discrimination. Lastly, we preview ongoing efforts to bridge self-motion perception and navigation per se, including closed-loop virtual reality and active self-motion. The design of unconstrained, ethologically inspired tasks, accompanied by large-scale neural recordings, raise promise for a deeper understanding of spatial perception and decision-making in the behaving animal. This article is part of the theme issue 'Decision and control processes in multisensory perception'.

How our understanding of memory replay evolves.

Memory reactivations and replay, widely reported in the hippocampus and cortex across species, have been implicated in memory consolidation, planning, and spatial and skill learning. Technological advances in electrophysiology, calcium imaging, and human neuroimaging techniques have enabled neuroscientists to measure large-scale neural activity with increasing spatiotemporal resolution and have provided opportunities for developing robust analytic methods to identify memory replay. In this article, we first review a large body of historically important and representative memory replay studies from the animal and human literature. We then discuss our current understanding of memory replay functions in learning, planning, and memory consolidation and further discuss the progress in computational modeling that has contributed to these improvements. Next, we review past and present analytic methods for replay analyses and discuss their limitations and challenges. Finally, looking ahead, we discuss some promising analytic methods for detecting nonstereotypical, behaviorally nondecodable structures from large-scale neural recordings. We argue that seamless integration of multisite recordings, real-time replay decoding, and closed-loop manipulation experiments will be essential for delineating the role of memory replay in a wide range of cognitive and motor functions.

Residual dynamics resolves recurrent contributions to neural computation.

Relating neural activity to behavior requires an understanding of how neural computations arise from the coordinated dynamics of distributed, recurrently connected neural populations. However, inferring the nature of recurrent dynamics from partial recordings of a neural circuit presents considerable challenges. Here we show that some of these challenges can be overcome by a fine-grained analysis of the dynamics of neural residuals-that is, trial-by-trial variability around the mean neural population trajectory for a given task condition. Residual dynamics in macaque prefrontal cortex (PFC) in a saccade-based perceptual decision-making task reveals recurrent dynamics that is time dependent, but consistently stable, and suggests that pronounced rotational structure in PFC trajectories during saccades is driven by inputs from upstream areas. The properties of residual dynamics restrict the possible contributions of PFC to decision-making and saccade generation and suggest a path toward fully characterizing distributed neural computations with large-scale neural recordings and targeted causal perturbations.

A detailed behavioral, videographic, and neural dataset on object recognition in mice

Mice adeptly use their whiskers to touch, recognize, and learn about objects in their environment. This behavior is enabled by computations performed by populations of neurons in the somatosensory cortex. To understand these computations, we trained mice to use their whiskers to recognize different shapes while we recorded activity in the barrel cortex, which processes whisker input. Here, we present a large dataset of high-speed video of the whiskers, along with rigorous tracking of the entire extent of multiple whiskers and every contact they made on the shape. We used spike sorting to identify individual neurons, which responded with precise timing to whisker contacts and motion. These data will be useful for understanding the behavioral strategies mice use to explore objects, as well as the neuronal dynamics that mediate those strategies. In addition, our carefully curated labeled data could be used to develop new computer vision algorithms for tracking body posture, or for extracting responses of individual neurons from large-scale neural recordings.

A hybrid autoencoder framework of dimensionality reduction for brain-computer interface decoding

ObjectiveAs the scale of neural recording increases, Brain-computer interfaces (BCIs) are restrained by high-dimensional neural features, so dimensionality reduction is required as a preprocess of neural features. In this context, we propose a novel framework based on deep learning to reduce the dimensionality of neural features that are typically extracted from electrocorticography (ECoG) or local field potential (LFP). ApproachA high-performance autoencoder was implemented by chaining convolutional layers to deal with spatial and frequency dimensions with bottleneck long short-term memory (LSTM) layers to deal with the temporal dimension of the features. Furthermore, this autoencoder is combined with a fully connected layer to regularize the training. Main resultsBy applying the proposed method to two different datasets, we found that this dimensionality reduction method largely outperforms kernel principal component analysis (KPCA), partial least square (PLS), preferential subspace identification (PSID), and latent factor analysis via dynamical systems (LFADS). Besides, the new features obtained by our method can be applied to various BCI decoders, without significant differences in decoding performance. SignificanceA novel method is proposed as a reliable tool for efficient dimensionality reduction of neural signals. Its high performance and robustness are promising to enhance the decoding accuracy and long-term stability of online BCI systems based on large-scale neural recordings.

Motor cortical output for skilled forelimb movement is selectively distributed across projection neuron classes.

The interaction of descending neocortical outputs and subcortical premotor circuits is critical for shaping skilled movements. Two broad classes of motor cortical output projection neurons provide input to many subcortical motor areas: pyramidal tract (PT) neurons, which project throughout the neuraxis, and intratelencephalic (IT) neurons, which project within the cortex and subcortical striatum. It is unclear whether these classes are functionally in series or whether each class carries distinct components of descending motor control signals. Here, we combine large-scale neural recordings across all layers of motor cortex with cell type–specific perturbations to study cortically dependent mouse motor behaviors: kinematically variable manipulation of a joystick and a kinematically precise reach-to-grasp. We find that striatum-projecting IT neuron activity preferentially represents amplitude, whereas pons-projecting PT neurons preferentially represent the variable direction of forelimb movements. Thus, separable components of descending motor cortical commands are distributed across motor cortical projection cell classes.

Large-scale neural recordings with single neuron resolution using Neuropixels probes in human cortex.

Recent advances in multi-electrode array technology have made it possible to monitor large neuronal ensembles at cellular resolution in animal models. In humans, however, current approaches restrict recordings to a few neurons per penetrating electrode or combine the signals of thousands of neurons in local field potential (LFP) recordings. Here we describe a new probe variant and set of techniques that enable simultaneous recording from over 200 well-isolated cortical single units in human participants during intraoperative neurosurgical procedures using silicon Neuropixels probes. We characterized a diversity of extracellular waveforms with eight separable single-unit classes, with differing firing rates, locations along the length of the electrode array, waveform spatial spread and modulation by LFP events such as inter-ictal discharges and burst suppression. Although some challenges remain in creating a turnkey recording system, high-density silicon arrays provide a path for studying human-specific cognitive processes and their dysfunction at unprecedented spatiotemporal resolution.

Large-scale neural recordings call for new insights to link brain and behavior.

Neuroscientists today can measure activity from more neurons than ever before, and are facing the challenge of connecting these brain-wide neural recordings to computation and behavior. In the present review, we first describe emerging tools and technologies being used to probe large-scale brain activity and new approaches to characterize behavior in the context of such measurements. We next highlight insights obtained from large-scale neural recordings in diverse model systems, and argue that some of these pose a challenge to traditional theoretical frameworks. Finally, we elaborate on existing modeling frameworks to interpret these data, and argue that the interpretation of brain-wide neural recordings calls for new theoretical approaches that may depend on the desired level of understanding. These advances in both neural recordings and theory development will pave the way for critical advances in our understanding of the brain.

Modelling the neural code in large populations of correlated neurons.

Neurons respond selectively to stimuli, and thereby define a code that associates stimuli with population response patterns. Certain correlations within population responses (noise correlations) significantly impact the information content of the code, especially in large populations. Understanding the neural code thus necessitates response models that quantify the coding properties of modelled populations, while fitting large-scale neural recordings and capturing noise correlations. In this paper, we propose a class of response model based on mixture models and exponential families. We show how to fit our models with expectation-maximization, and that they capture diverse variability and covariability in recordings of macaque primary visual cortex. We also show how they facilitate accurate Bayesian decoding, provide a closed-form expression for the Fisher information, and are compatible with theories of probabilistic population coding. Our framework could allow researchers to quantitatively validate the predictions of neural coding theories against both large-scale neural recordings and cognitive performance.

Building population models for large-scale neural recordings: Opportunities and pitfalls.

Modern recording technologies now enable simultaneous recording from large numbers of neurons. This has driven the development of new statistical models for analyzing and interpreting neural population activity. Here, we provide a broad overview of recent developments in this area. We compare and contrast different approaches, highlight strengths and limitations, and discuss biological and mechanistic insights that these methods provide.

Dynamics of Neural Microstates in the VTA-Striatal-Prefrontal Loop during Novelty Exploration in the Rat.

Neural activity at the large-scale population level has been suggested to be consistent with a sequence of brief, quasistable spatial patterns. These "microstates" and their temporal dynamics have been linked to myriad cognitive functions and brain diseases. Most of this research has been performed using EEG, leaving many questions, such as the existence, dynamics, and behavioral relevance of microstates at the level of local field potentials (LFPs), unaddressed. Here, we adapted the standard EEG microstate analysis to triple-area LFP recordings from 192 electrodes in rats to investigate the mesoscopic dynamics of neural microstates within and across brain regions during novelty exploration. We performed simultaneous recordings from the prefrontal cortex, striatum, and ventral tegmental area in male rats during awake behavior (object novelty and exploration). We found that the LFP data can be accounted for by multiple, recurring microstates that were stable for ∼60-100 ms. The simultaneous microstate activity across brain regions revealed rhythmic patterns of coactivations, which we interpret as a novel indicator of inter-regional, mesoscale synchronization. Furthermore, these rhythmic coactivation patterns across microstates were modulated by behavioral states such as movement and exploration of a novel object. These results support the existence of a functional mesoscopic organization across multiple brain areas and present a possible link of the origin of macroscopic EEG microstates to zero-lag neuronal synchronization within and between brain areas, which is of particular interest to the human research community.SIGNIFICANCE STATEMENT The coordination of neural activity across the entire brain has remained elusive. Here we combine large-scale neural recordings at fine spatial resolution with the analysis of microstates (i.e., short-lived, recurring spatial patterns of neural activity). We demonstrate that the local activity in different brain areas can be accounted for by only a few microstates per region. These microstates exhibited temporal dynamics that were correlated across regions in rhythmic patterns. We demonstrate that these microstates are linked to behavior and exhibit different properties in the frequency domain during different behavioral states. In summary, LFP microstates provide an insightful approach to studying both mesoscopic and large-scale brain activation within and across regions.

Discovering Precise Temporal Patterns in Large-Scale Neural Recordings through Robust and Interpretable Time Warping

Though the temporal precision of neural computation has been studied intensively, a data-driven determination of this precision remains a fundamental challenge. Reproducible spike patterns may be obscured on single trials by uncontrolled temporal variability in behavior and cognition and may not be time locked to measurable signatures in behavior or local field potentials (LFP). To overcome these challenges, we describe a general-purpose time warping framework that reveals precise spike-time patterns in an unsupervised manner, even when these patterns are decoupled from behavior or are temporally stretched across single trials. We demonstrate this method across diverse systems: cued reaching in nonhuman primates, motor sequence production in rats, and olfaction in mice. This approach flexibly uncovers diverse dynamical firing patterns, including pulsatile responses to behavioral events, LFP-aligned oscillatory spiking, and even unanticipated patterns, such as 7Hz oscillations in rat motor cortex that are not time locked to measured behaviors or LFP.

Unsupervised discovery of temporal sequences in high-dimensional datasets, with applications to neuroscience.

Identifying low-dimensional features that describe large-scale neural recordings is a major challenge in neuroscience. Repeated temporal patterns (sequences) are thought to be a salient feature of neural dynamics, but are not succinctly captured by traditional dimensionality reduction techniques. Here, we describe a software toolbox-called seqNMF-with new methods for extracting informative, non-redundant, sequences from high-dimensional neural data, testing the significance of these extracted patterns, and assessing the prevalence of sequential structure in data. We test these methods on simulated data under multiple noise conditions, and on several real neural and behavioral datas. In hippocampal data, seqNMF identifies neural sequences that match those calculated manually by reference to behavioral events. In songbird data, seqNMF discovers neural sequences in untutored birds that lack stereotyped songs. Thus, by identifying temporal structure directly from neural data, seqNMF enables dissection of complex neural circuits without relying on temporal references from stimuli or behavioral outputs.

An exploratory data analysis method for identifying brain regions and frequencies of interest from large-scale neural recordings.

High-resolution whole brain recordings have the potential to uncover unknown functionality but also present the challenge of how to find such associations between brain and behavior when presented with a large number of regions and spectral frequencies. In this paper, we propose an exploratory data analysis method that sorts through a massive quantity of multivariate neural recordings to quickly extract a subset of brain regions and frequencies that encode behavior. This approach combines existing tools and exploits low-rank approximation of matrices without a priori selection of regions and frequency bands for analysis. In detail, the spectral content of neural activity across all frequencies of each recording contact is computed and represented as a matrix. Then, the rank-1 approximation of the matrix is computed using singular value decomposition and the associated singular vectors are extracted. The temporal singular vector, which captures the salient features of the spectrogram, is then correlated to the trial-varying behavioral signal. The distribution of correlations for each brain region is efficiently computed and used to find a subset of regions and frequency bands of interest for further examination. As an illustration, we apply this approach to a data set of local field potentials collected using stereoelectroencephalography from a human subject performing a reaching task. Using the proposed procedure, we produced a comprehensive set of brain regions and frequencies related to our specific behavior. We demonstrate how this tool can produce preliminary results that capture neural patterns related to behavior and aid in formulating data-driven hypotheses, hence reducing the time it takes for any scientist to transition from the exploratory to the confirmatory phase.

SiNAPS: An implantable active pixel sensor CMOS-probe for simultaneous large-scale neural recordings

Large-scale neural recordings with high spatial and temporal accuracy are instrumental to understand how the brain works. To this end, it is of key importance to develop probes that can be conveniently scaled up to a high number of recording channels. Despite recent achievements in complementary metal-oxide semiconductor (CMOS) multi-electrode arrays probes, in current circuit architectures an increase in the number of simultaneously recording channels would significantly increase the total chip area. A promising approach for overcoming this scaling issue consists in the use of the modular Active Pixel Sensor (APS) concept, in which a small front-end circuit is located beneath each electrode. However, this approach imposes challenging constraints on the area of the in-pixel circuit, power consumption and noise. Here, we present an APS CMOS-probe technology for Simultaneous Neural recording that successfully addresses all these issues for whole-array read-outs at 25 kHz/channel from up to 1024 electrode-pixels. To assess the circuit performances, we realized in a 0.18 μm CMOS technology an implantable single-shaft probe with a regular array of 512 electrode-pixels with a pitch of 28 μm. Extensive bench tests showed an in-pixel gain of 45.4 ± 0.4 dB (low pass, F-3 dB = 4 kHz), an input referred noise of 7.5 ± 0.67 μVRMS (300 Hz to 7.5 kHz) and a power consumption <6 μW/pixel. In vivo acute recordings demonstrate that our SiNAPS CMOS-probe can sample full-band bioelectrical signals from each electrode, with the ability to resolve and discriminate activity from several packed neurons both at the spatial and temporal scale. These results pave the way to new generations of compact and scalable active single/multi-shaft brain recording systems.

Linking Connectivity, Dynamics, and Computations in Low-Rank Recurrent Neural Networks

Large-scale neural recordings have established that the transformation of sensory stimuli into motor outputs relies on low-dimensional dynamics at the population level, while individual neurons exhibit complex selectivity. Understanding how low-dimensional computations on mixed, distributed representations emerge from the structure of the recurrent connectivity and inputs to cortical networks is a major challenge. Here, we study a class of recurrent network models in which the connectivity is a sum of a random part and a minimal, low-dimensional structure. We show that, in such networks, the dynamics are low dimensional and can be directly inferred from connectivity using a geometrical approach. We exploit this understanding to determine minimal connectivity required to implement specific computations and find that the dynamical range and computational capacity quickly increase with the dimensionality of the connectivity structure. This framework produces testable experimental predictions for the relationship between connectivity, low-dimensional dynamics, and computational features of recorded neurons.

Unsupervised Discovery of Demixed, Low-Dimensional Neural Dynamics across Multiple Timescales through Tensor Component Analysis

Perceptions, thoughts, and actions unfold over millisecond timescales, while learned behaviors can require many days to mature. While recent experimental advances enable large-scale and long-term neural recordings with high temporal fidelity, it remains a formidable challenge to extract unbiased and interpretable descriptions of how rapid single-trial circuit dynamics change slowly over many trials to mediate learning. We demonstrate a simple tensor component analysis (TCA) can meet this challenge by extracting three interconnected, low-dimensional descriptions of neural data: neuron factors, reflecting cell assemblies; temporal factors, reflecting rapid circuit dynamics mediating perceptions, thoughts, and actions within each trial; and trial factors, describing both long-term learning and trial-to-trial changes in cognitive state. We demonstrate the broad applicability of TCA by revealing insights intodiverse datasets derived from artificial neural networks, large-scale calcium imaging of rodent prefrontal cortex during maze navigation, and multielectrode recordings of macaque motor cortex during brain machine interface learning.