Tone Sequences Research Articles

The role of duration and frequency of occurrence in perceived pitch structure.

IntroductionTo survive, organisms need to organize perceptual input into coherent, usable structures. Research has illuminated the potential role of frequency of occurrence and duration as cues to extract statistical regularities from our environment. Musical stimuli provide a unique opportunity to study how these cues are used to organize auditory input into higher level perceptual entities, i.e., pitch structure, and to assess the influence of cognitive schema.MethodsTo examine the relative importance of these two cues in pitch structure perception, we constructed novel tone sequences in which frequency of occurrence and duration cues were pitted against each other. We assessed perceived pitch structure in musically trained and untrained listeners using a probe tone paradigm.ResultsIn all experiments, a 3-tiered hierarchy of pitch structure emerged, with highest ratings for tones of longer duration, next highest for shorter, more frequent tones and lowest for probe tones that did not occur in the sequence. The hierarchy did not reflect assimilation to Western tonal schema.DiscussionOur results argue against theories positing the same mechanism for the processing of duration and frequency of occurrence, and that duration is weighted preferentially. We further suggest that the organization of perceptual information will proceed according to whatever information is relevant, available, and most easily acquired.

The Influence of Rate and Accentuation on Subjective Rhythmization

The parsing of undifferentiated tone sequences into groups of qualitatively distinct elements is one of the earliest rhythmic phenomena to have been investigated experimentally (Bolton, 1894). The present study aimed to replicate and extend these findings through online experimentation using a spontaneous grouping paradigm with forced-choice response (from 1 to 12 tones per group). Two types of isochronous sequences were used: equitone sequences, which varied only with respect to signal rate (200, 550, or 950 ms interonset intervals), and accented sequences, in which accents were added every two or three tones to test the effect of induced grouping (duple vs. triple) and accent type (intensity, duration, or pitch). In equitone sequences, participants’ grouping percepts (N = 4,194) were asymmetrical and tempo-dependent, with “no grouping” and groups of four being most frequently reported. In accented sequences, slower rate, induced triple grouping, and intensity accents correlated with increases in group length. Furthermore, the probability of observing a mixed metric type—that is, grouping percepts divisible by both two and three (6 and 12)—was found to be highest in faster sequences with induced triple grouping. These findings suggest that lower-level triple grouping gives rise to binary grouping percepts at higher metrical levels.

Individuals With Autism Have No Detectable Deficit in Neural Markers of Prediction Error When Presented With Auditory Rhythms of Varied Temporal Complexity.

The brain's ability to encode temporal patterns and predict upcoming events is critical for speech perception and other aspects of social communication. Deficits in predictive coding may contribute to difficulties with social communication and overreliance on repetitive predictable environments in individuals with autism spectrum disorder (ASD). Using a mismatch negativity (MMN) task involving rhythmic tone sequences of varying complexity, we tested the hypotheses that (1) individuals with ASD have reduced MMN response to auditory stimuli that deviate in presentation timing from expected patterns, particularly as pattern complexity increases and (2) amplitude of MMN signal is inversely correlated with level of impairment in social communication and repetitive behaviors. Electroencephalography was acquired as individuals (age 6-21 years) listened to repeated five-rhythm tones that varied in the Shannon entropy of the rhythm across three conditions (zero, medium-1 bit, and high-2 bit entropy). The majority of the tones conformed to the established rhythm (standard tones); occasionally the fourth tone was temporally shifted relative to its expected time of occurrence (deviant tones). Social communication and repetitive behaviors were measured using the Social Responsiveness Scale and Repetitive Behavior Scale-Revised. Both neurotypical controls (n = 19) and individuals with ASD (n = 21) show stepwise decreases in MMN as a function of increasing entropy. Contrary to the result forecasted by a predictive coding hypothesis, individuals with ASD do not differ from controls in these neural mechanisms of prediction error to auditory rhythms of varied temporal complexity, and there is no relationship between these signals and social communication or repetitive behavior measures. LAY SUMMARY: We tested the idea that the brain's ability to use previous experience to influence processing of sounds is weaker in individuals with autism spectrum disorder (ASD) than in neurotypical individuals. We found no difference between individuals with ASD and neurotypical controls in brain wave responses to sounds that occurred earlier than expected in either simple or complex rhythms. There was also no relationship between these brain waves and social communication or repetitive behavior scores.

Adult age differences in working memory capacity: Spared central storage but deficits in ability to maximize peripheral storage.

For the first time, we quantify capacities of working memory in young and older adults in a dual-task situation, addressing whether older adults have diminished central or peripheral capacity in working memory. Across 2 experiments, 63 young and 63 old adult participants studied visual arrays of colored squares and sequences of unfamiliar tones in quick succession and were instructed to attend to one or both modalities. Memory was assessed with a single-probe change-detection task. We used a recently developed capacity-estimate model to partition participants' overall working memory capacity into 3 components: a peripheral component dedicated to visual information regardless of attention instruction; a peripheral component similarly dedicated to auditory information; and a central component allocated to either modality, or shared between both, depending on attention instruction. Capacity estimates of the peripheral components were consistently smaller in the older adults than in the young adults, but the central component was stable across both age groups. We contend that older adults are impaired in their ability to strategically encode information in ways that younger adults use to increase peripheral storage, a kind of storage that is immune to loss through bimodal attention costs. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Naming guides how 12-month-old infants encode and remember objects

A foundation of human cognition is the flexibility with which we can represent any object as either a unique individual (my dog Fred) or a member of an object category (dog, animal). This conceptual flexibility is supported by language; the way we name an object is instrumental to our construal of that object as an individual or a category member. Evidence from a new recognition memory task reveals that infants are sensitive to this principled link between naming and object representation by age 12 mo. During training, all infants (n = 77) viewed four distinct objects from the same object category, each introduced in conjunction with either the same novel noun (Consistent Name condition), a distinct novel noun for each object (Distinct Names condition), or the same sine-wave tone sequence (Consistent Tone condition). At test, infants saw each training object again, presented in silence along with a new object from the same category. Infants in the Consistent Name condition showed poor recognition memory at test, suggesting that consistently applied names focused them primarily on commonalities among the named objects at the expense of distinctions among them. Infants in the Distinct Names condition recognized three of the four objects, suggesting that applying distinct names enhanced infants' encoding of the distinctions among the objects. Infants in the control Consistent Tone condition recognized only the object they had most recently seen. Thus, even for infants just beginning to speak their first words, the way in which an object is named guides infants' encoding, representation, and memory for that object.

Dissociated Neural Representations of Content and Ordinal Structure in Auditory Sequence Memory

When retaining a sequence of auditory tones in working memory (WM), two forms of information – frequency (content) and ordinal position (structure) – have to be maintained in the brain. Here, we employed a time-resolved multivariate decoding analysis to examine how content and structure are represented in human WM. We demonstrate that content and structure are stored in a dissociated manner and show distinct characteristics. First, each tone is associated with two separate codes in parallel, characterizing its frequency and ordinal position, respectively. Second, during retention, a structural retrocue reactivates structure but not content, whereas a white noise triggers content but not structure. Third, structure representation remains unchanged whereas content undergoes a transformation throughout memory progress. Finally, content and structure reactivations during retention correlate with WM behavior. Overall, our results support a factorized content-structure representation in auditory WM, which might help efficient memory formation by generalizing stable structure to new auditory inputs.

Manipulation of low-level features modulates grouping strength of auditory objects.

A central challenge of auditory processing involves the segregation, analysis, and integration of acoustic information into auditory perceptual objects for processing by higher order cognitive operations. This study explores the influence of low-level features on auditory object perception. Participants provided perceived musicality ratings in response to randomly generated pure tone sequences. Previous work has shown that music perception relies on the integration of discrete sounds into a holistic structure. Hence, high (versus low) ratings were viewed as indicative of strong (versus weak) object formation. Additionally, participants rated sequences in which random subsets of tones were manipulated along one of three low-level dimensions (timbre, amplitude, or fade-in) at one of three strengths (low, medium, or high). Our primary findings demonstrate how low-level acoustic features modulate the perception of auditory objects, as measured by changes in musicality ratings for manipulated sequences. Secondarily, we used principal component analysis to categorize participants into subgroups based on differential sensitivities to low-level auditory dimensions, thereby highlighting the importance of individual differences in auditory perception. Finally, we report asymmetries regarding the effects of low-level dimensions; specifically, the perceptual significance of timbre. Together, these data contribute to our understanding of how low-level auditory features modulate auditory object perception.

Musical notation in the aspect of the semiotics theory by Charles Morris

Musical notation in the aspect of the semiotics theory by Charles Morris

Linguistic and non-linguistic non-adjacent dependency learning in early development

Non-adjacent dependencies (NADs) are important building blocks for language and extracting them from the input is a fundamental part of language acquisition. Prior event-related potential (ERP) studies revealed changes in the neural signature of NAD learning between infancy and adulthood, suggesting a developmental shift in the learning route for NADs. The present study aimed to specify which brain regions are involved in this developmental shift and whether this shift extends to NAD learning in the non-linguistic domain. In two experiments, 2- and 3-year-old German-learning children were familiarized with either Italian sentences or tone sequences containing NADs and subsequently tested with NAD violations, while functional near-infrared spectroscopy (fNIRS) data were recorded. Results showed increased hemodynamic responses related to the detection of linguistic NAD violations in the left temporal, inferior frontal, and parietal regions in 2-year-old children, but not in 3-year-old children. A different developmental trajectory was found for non-linguistic NADs, where 3-year-old, but not 2-year-old children showed evidence for the detection of non-linguistic NAD violations. These results confirm a developmental shift in the NAD learning route and point to distinct mechanisms underlying NAD learning in the linguistic and the non-linguistic domain.

Recursive music elucidates neural mechanisms supporting the generation and detection of melodic hierarchies

The ability to generate complex hierarchical structures is a crucial component of human cognition which can be expressed in the musical domain in the form of hierarchical melodic relations. The neural underpinnings of this ability have been investigated by comparing the perception of well-formed melodies with unexpected sequences of tones. However, these contrasts do not target specifically the representation of rules generating hierarchical structure. Here, we present a novel paradigm in which identical melodic sequences are generated in four steps, according to three different rules: The Recursive rule, generating new hierarchical levels at each step; The Iterative rule, adding tones within a fixed hierarchical level without generating new levels; and a control rule that simply repeats the third step. Using fMRI, we compared brain activity across these rules when participants are imagining the fourth step after listening to the third (generation phase), and when participants listened to a fourth step (test sound phase), either well-formed or a violation. We found that, in comparison with Repetition and Iteration, imagining the fourth step using the Recursive rule activated the superior temporal gyrus (STG). During the test sound phase, we found fronto-temporo-parietal activity and hippocampal de-activation when processing violations, but no differences between rules. STG activation during the generation phase suggests that generating new hierarchical levels from previous steps might rely on retrieving appropriate melodic hierarchy schemas. Previous findings highlighting the role of hippocampus and inferior frontal gyrus may reflect processing of unexpected melodic sequences, rather than hierarchy generation per se.

Attention capture in birds performing an auditory streaming task.

Numerous animal models have been used to investigate the neural mechanisms of auditory processing in complex acoustic environments, but it is unclear whether an animal’s auditory attention is functionally similar to a human’s in processing competing auditory scenes. Here we investigated the effects of attention capture in birds performing an objective auditory streaming paradigm. The classical ABAB… patterned pure tone sequences were modified and used for the task. We trained the birds to selectively attend to a target stream and only respond to the deviant appearing in the target stream, even though their attention may be captured by a deviant in the background stream. When no deviant appeared in the background stream, the birds experience the buildup of streaming process in a qualitatively similar way as they did in a subjective paradigm. Although the birds were trained to selectively attend to the target stream, they failed to avoid the involuntary attention switch caused by the background deviant, especially when the background deviant was sequentially unpredictable. Their global performance deteriorated more with increasingly salient background deviants, where the buildup process was reset by the background distractor. Moreover, sequential predictability of the background deviant facilitated the recovery of the buildup process after attention capture. This is the first study that addresses the perceptual consequences of the joint effects of top-down and bottom-up attention in behaving animals.

The Selectivity of Musical Advantage

The OPERA hypothesis theorizes how musical experience heightens perceptual acuity to lexical tones. One missing element in the hypothesis is whether musical advantage is general to all or specific to some lexical tones. To further extend the hypothesis, this study investigated whether English musicians consistently outperformed English nonmusicians in perceiving a variety of Cantonese tones. In an AXB discrimination task, the musicians exhibited superior discriminatory performance over the nonmusicians only in the high level, high rising, and mid-level tone contexts. Similarly, in a Cantonese tone sequence recall task, the musicians significantly outperformed the nonmusicians only in the contour tone context but not in the level tone context. Collectively, the results reflect the selectivity of musical advantage—musical experience is only advantageous to the perception of some but not all Cantonese tones, and elements of selectivity can be introduced to the OPERA hypothesis. Methodologically, the findings highlight the need to include a wide variety of lexical tone contrasts when studying music-to-language transfer.

Auditory cognitive training improves prepulse inhibition in serine racemase mutant mice.

Evidence indicates that neuroplasticity-based cognitive training can improve cognition in patients with schizophrenia, but the individual response to training varies greatly between subjects. Hence, there is a need to understand the neurological underpinnings of cognitive training to reveal predictors of treatment response. D-serine is a crucial modulator of neuroplasticity, and decreased levels of D-serine may contribute to deficits in neuroplasticity in schizophrenia. Interestingly, we observed that training mice to identify auditory oddballs increased extracellular levels of D-serine in the hippocampus during training. Serine racemase (Srr) is the only source of brain D-serine; thus, it is possible that Srr may mediate the response to training. To test this hypothesis, we trained mice that have a mutated version of Srr (SrrY269*/SrrY269*) and reduced levels of D-serine in the same auditory training. SrrY269*/SrrY269* mice showed decreased performance during auditory training (defined as the capacity to discriminate an oddball during a sequence of tones). Importantly, auditory training improved prepulse inhibition (PPI) in SrrY269*/SrrY269* but not in wild-type mice. Finally, D-serine (100 mg/kg i.p.) given 30 min before training sessions to SrrY269*/SrrY269* mice improved training performance, but it did not enhance PPI. Taken together, our results show that D-serine is involved in the response to neuroplasticity-based auditory training and that PPI deficits can be improved by auditory oddball training even in the presence of neuroplasticity deficits.

How rests and cyclic sequences influence performance in tone-scramble tasks.

When classifying major versus minor tone-scrambles (random sequences of pure tones), most listeners (70%) perform at chance while the remaining listeners perform nearly perfectly. The current study investigated whether inserting rests and cyclic sequences into the stimuli could heighten sensitivity in such tasks. In separate blocks, listeners classified tone-scramble variants as major versus minor ("3" task) or fourth versus tritone ("4" task). In three "Fast" variants, tones were played at 65 ms/tone as a continuous, random stream ("FR"), or with a rest after every fourth tone ("FRwR"), or as a repeating sequence of four tones with a rest after every fourth tone ("FCwR"). In the "Slow" variant, tones were played at 325 ms/tone in random order. In both the 3 and 4 tasks, performance was ordered from best to worst as follows: FRwR > FR > FCwR > Slow. Post hoc analysis revealed that performance was suppressed in the Slow and FCwR task-variants due to a powerful bias inclining listeners to respond "major" or "fourth" ("minor" or "tritone") if the 4-note sequence defining the stimulus ended on a high (low) note. Overall, the results indicate that inserting regular rests into random tone sequences heightens sensitivity to musical mode.

Spatial cues can support auditory figure-ground segregation.

A study by Tóth, Kocsis, Háden, Szerafin, Shinn-Cunningham, and Winkler [Neuroimage 141, 108 - 119 (2016)] reported that spatial cues (such as interaural differences or ITDs) that differentiate the perceived sound source directions of a target tone sequence (figure) from simultaneous distracting tones (background) did not improve the ability of participants to detect the target sequence. The present study aims to investigate more systematically whether spatially separating a complex auditory "figure" from the background auditory stream may enhance the detection of a target in a cluttered auditory scene. Results of the presented experiment suggest that the previous negative results arose because of the specific experimental conditions tested. Here the authors find that ITDs provide a clear benefit for detecting a target tone sequence amid a mixture of other simultaneous tone bursts.

Musical Experience Shapes Neural Processing

Abstract. Playing a musical instrument professionally has been shown to lead to structural and functional neural adaptations, making musicians valuable subjects for neuroplasticity research. Here, we follow the hypothesis that specific musical demands further shape neural processing. To test this assumption, we subjected groups of professional drummers, professional woodwind players, and nonmusicians to pure tone sequences and drum sequences in which infrequent anticipations of tones or drum beats had been inserted. Passively listening to these sequences elicited a mismatch negativity to the temporally deviant stimuli which was greater in the musicians for tone series and particularly large for drummers for drum sequences. In active listening conditions drummers more accurately and more quickly detected temporally deviant stimuli.

Sensitivity to major versus minor musical modes is bimodally distributed in young infants.

The difference between major and minor scales plays a central role in Western music. However, recent research using random tone sequences ("tone-scrambles") has revealed a dramatically bimodal distribution in sensitivity to this difference: 30% of listeners are near perfect in classifying major versus minor tone-scrambles; the other 70% perform near chance. Here, whether or not infants show this same pattern is investigated. The anticipatory eye-movements of thirty 6-month-old infants were monitored during trials in which the infants heard a tone-scramble whose quality (major versus minor) signalled the location (right versus left) where a subsequent visual stimulus (the target) would appear. For 33% of infants, these anticipatory eye-movements predicted target location with near perfect accuracy; for the other 67%, the anticipatory eye-movements were unrelated to the target location. In conclusion, six-month-old infants show the same distribution as adults in sensitivity to the difference between major versus minor tone-scrambles.

Corrigendum: Dissociable Neural Information Dynamics of Perceptual Integration and Differentiation during Bistable Perception.

At any given moment, we experience a perceptual scene as a single whole and yet we may distinguish a variety of objects within it. This phenomenon instantiates two properties of conscious perception: integration and differentiation. Integration is the property of experiencing a collection of objects as a unitary percept and differentiation is the property of experiencing these objects as distinct from each other. Here, we evaluated the neural information dynamics underlying integration and differentiation of perceptual contents during bistable perception. Participants listened to a sequence of tones (auditory bistable stimuli) experienced either as a single stream (perceptual integration) or as two parallel streams (perceptual differentiation) of sounds. We computed neurophysiological indices of information integration and information differentiation with electroencephalographic and intracranial recordings. When perceptual alternations were endogenously driven, the integrated percept was associated with an increase in neural information integration and a decrease in neural differentiation across frontoparietal regions, whereas the opposite pattern was observed for the differentiated percept. However, when perception was exogenously driven by a change in the sound stream (no bistability), neural oscillatory power distinguished between percepts but information measures did not. We demonstrate that perceptual integration and differentiation can be mapped to theoretically motivated neural information signatures, suggesting a direct relationship between phenomenology and neurophysiology.

Effect of Auditory Predictability on the Human Peripheral Auditory System.

Auditory perception is facilitated by prior knowledge about the statistics of the acoustic environment. Predictions about upcoming auditory stimuli are processed at various stages along the human auditory pathway, including the cortex and midbrain. Whether such auditory predictions are processed also at hierarchically lower stages—in the peripheral auditory system—is unclear. To address this question, we assessed outer hair cell (OHC) activity in response to isochronous tone sequences and varied the predictability and behavioral relevance of the individual tones (by manipulating tone-to-tone probabilities and the human participants’ task, respectively). We found that predictability alters the amplitude of distortion-product otoacoustic emissions (DPOAEs, a measure of OHC activity) in a manner that depends on the behavioral relevance of the tones. Simultaneously recorded cortical responses showed a significant effect of both predictability and behavioral relevance of the tones, indicating that their experimental manipulations were effective in central auditory processing stages. Our results provide evidence for a top-down effect on the processing of auditory predictability in the human peripheral auditory system, in line with previous studies showing peripheral effects of auditory attention.

Stimulus salience determines defensive behaviors elicited by aversively conditioned serial compound auditory stimuli.

Assessing the imminence of threatening events using environmental cues enables proactive engagement of appropriate avoidance responses. The neural processes employed to anticipate event occurrence depend upon which cue properties are used to formulate predictions. In serial compound stimulus (SCS) conditioning in mice, repeated presentations of sequential tone (CS1) and white noise (CS2) auditory stimuli immediately prior to an aversive event (US) produces freezing and flight responses to CS1 and CS2, respectively (Fadok et al., 2017). Recent work reported that these responses reflect learned temporal relationships of CS1 and CS2 to the US (Dong et al., 2019). However, we find that frequency and sound pressure levels, not temporal proximity to the US, are the key factors underlying SCS-driven conditioned responses. Moreover, white noise elicits greater physiological and behavioral responses than tones even prior to conditioning. Thus, stimulus salience is the primary determinant of behavior in the SCS paradigm, and represents a potential confound in experiments utilizing multiple sensory stimuli.