Modeling realistic extracellular spiking activity in populations of neurons for the purpose of evaluating automatic spike-sorting algorithms

Abstract

The emergence of silicon-based extracellular recording devices with large numbers of electrode contacts, such as multi-shank laminar electrodes or high-density multi-electrode arrays (MEA) now makes it possible to potentially record spiking activity from thousands of neurons simultaneously. With the concomitant increase in amounts and complexity of data, manual spike sorting is no longer an option, and there is a dire need for automatic spike-sorting methods. These methods must be able to correctly and efficiently resolve spikes of individual neurons from the recorded mixture, as discussed in a recent review [1]. For assessing the sorting quality, spike sorting methods should ideally be evaluated against test data with known ground truth, i.e., data for which the underlying spiking activity of each neuron in the recorded population is known. Unfortunately, such data sets cannot easily be acquired from experiments. One remedy is realistic, model-based simulations of extracellular recordings. Position-dependent spike shapes (Figure ​(Figure1A)1A) can straightforwardly be modeled in a biophysically realistic way by means of a recently released modeling tool, LFPy (compneuro.umb.no/LFPy), a Python implementation of a forward-modeling scheme [2] for extracellular potentials based on calculations of transmembrane currents in NEURON [3]. Figure 1 A. Position-dependent extracellular spike shapes in vicinity of a cat L5 pyramidal neuron, obtained using LFPy. B. Schematic of the evaluation of spike-sorting methods against ground-truth test data for a population of hippocampal pyramidal neurons. Test data for arbitrary electrode geometries, model neurons, noise levels and synchronicity levels can be produced at wish. Here we present example results relevant for tetrode and polytrode recordings in cortex and hippocampus. We also present test data for situations where prominent electrical boundary-condition effects significantly modify the recorded potentials, and FEM modeling must be used to solve the electrostatic problem. This is of particular relevance for cell cultures or retinal slices placed on high density MEAs. An algorithm evaluation website has been set up on http://www.g-node.org/spike to facilitate use of such benchmark data to evaluate the performance of spike sorting algorithms, as outlined in Figure ​Figure1B1B.