Decoding of spatiotemporal activity of auditory information in the cortex

Abstract

Animals utilize auditory information for survival and communications of conspecifics. A sequence of sound is analyzed in animals’ brain as elementary components such as notes and syllables. It has been reported that auditory information is represented by spatiotemporal activity of primary auditory cortex [1]. However, how the elementary components of sound are encoded from the spatiotemporal activity of neurons is poorly understood. To address this issue, we present a model of auditory cortex, which performs a hierarchical processing of auditory information. The model consists of three layers of 2-dimensional networks. We show that the aspects of the spatiotemporal activity in the primary cortex are encoded by a combination of feature-detective neurons and then by a dynamical attractor in higher-order cortex. The present study provides a clue for understanding the mechanism of how the information of notes and syllables are constructed from spatiotemporal activity of the primary auditory cortex. We propose a neural network model for hierarchical processing of auditory information, which consists of three networks. The auditory information is encoded with spatiotemporal pattern of neuronal activity in the primary auditory (A1) cortex. The model of A1was made based on the previous model by Taniguch and Yamaguchi [2]. Then the spatiotemporal aspect of the neuronal activity is detected by the feature-detective (FD) neurons in the second layer. These FD neurons integrate the spatiotemporal pattern over a short time period, thereby enabling the second layer to represent the information about notes and about the correlation of notes. The information encoded by the FD neurons is then combined as a linkage of attractors in the feature binding (FB) layer, providing a semantic information such as word.