Use Of Temporal Cues Research Articles

When time does not matter: cultures differ in their use of temporal cues to infer agency over action effects.

Sense of agency (SoA) is the sense of having control over one's own actions and through them events in the outside world. Sometimes temporal cues, that is temporal contiguity between action and effect, or temporal expectation regarding the occurrence of the effect are used to infer whether one has agency over an effect. This has mainly been investigated in Western cultures. However, Western and Eastern cultures differ in their time concepts and thus their usage of temporal cues may also differ. We investigated whether Western and Eastern cultures (Austrian vs. Mongolian students) use temporal cues differently. Participants performed adaption blocks in which actions were followed by immediate (immediate effect group) or by delayed (delayed effect group) effects. In subsequent test blocks the action-effect delay was varied and participants' SoA over the effect was assessed. In Austrian students, the immediate effect group experienced more SoA for short action-effect delays, whereas the reverse was true for the delayed effect group. Thus, temporal expectation rather than temporal contiguity is used as predominant agency cue. In Mongolian students, SoA did not significantly differ between different action-effect delays in both groups, indicating that Mongolian students hardly rely on temporal cues. In conclusion, due to linear time concepts in Western cultures, the timing of an effect may be an important agency cue in Austrian students. However, due to cyclical time concepts in some Eastern cultures, it may be a less important agency cue in Mongolian students. Thus, the use of temporal agency cues is culture-dependent.

Assessing mechanisms of frequency discrimination by comparison of different measures over a wide frequency range

It has been hypothesized that auditory detection of frequency modulation (FM) for low FM rates depends on the use of both temporal (phase locking) and place cues, depending on the carrier frequency, while detection of FM at high rates depends primarily on the use of place cues. To test this, FM detection for 2 and 20 Hz rates was measured over a wide frequency range, 1–10 kHz, including high frequencies for which temporal cues are assumed to be very weak. Performance was measured over the same frequency range for a task involving detection of changes in the temporal fine structure (TFS) of bandpass filtered complex tones, for which performance is assumed to depend primarily on the use of temporal cues. FM thresholds were better for the 2- than for the 20-Hz rate for center frequencies up to 4 kHz, while the reverse was true for higher center frequencies. For both FM rates, the thresholds, expressed as a proportion of the center frequency, were roughly constant for center frequencies from 6 to 10 Hz, consistent with the use of place cues. For the TFS task, thresholds worsened progressively with increasing frequency above 4 kHz, consistent with the weakening of temporal cues.

Second Language Experience Facilitates Sentence Recognition in Temporally-Modulated Noise for Non-native Listeners.

Non-native listeners deal with adverse listening conditions in their daily life much harder than native listeners. However, previous work in our laboratories found that native Chinese listeners with native English exposure may improve the use of temporal fluctuations of noise for English vowel identification. The purpose of this study was to investigate whether Chinese listeners can generalize the use of temporal cues for the English sentence recognition in noise. Institute of Electrical and Electronics Engineers (IEEE) sentence recognition in quiet condition, stationary noise, and temporally-modulated noise were measured for native American English listeners (EN), native Chinese listeners in the United States (CNU), and native Chinese listeners in China (CNC). Results showed that in general, EN listeners outperformed the two groups of CN listeners in quiet and noise, while CNU listeners had better scores of sentence recognition than CNC listeners. Moreover, the native English exposure helped CNU listeners use high-level linguistic cues more effectively and take more advantage of temporal fluctuations of noise to process English sentence in severely degraded listening conditions [i.e., the signal-to-noise ratio (SNR) of −12 dB] than CNC listeners. These results suggest a significant effect of language experience on the auditory processing of both speech and noise.

A Psychological Approach to Causal Understanding and the Temporal Asymmetry

This article provides a conceptual account of causal understanding by connecting current psychological research on time and causality with philosophical debates on the causal asymmetry. I argue that causal relations are viewed as asymmetric because they are understood in temporal terms. I investigate evidence from causal learning and reasoning in both children and adults: causal perception, the temporal priority principle, and the use of temporal cues for causal inference. While this account does not suffice for correct inferences of causal structure, I show it to serve as a preliminary understanding of causal concepts as asymmetric, that later incorporates other types of evidence (leading up to difference-making, or causal processes). This approach supplies causal models with an asymmetric concept of causation that underlies hypotheses about causal structure, as I will illustrate from the framework of the knowledge-based causal induction model. I further argue for an integrating perspective, showing how the understanding of causes as preceding their effects underlies both psychological models and philosophical debates over time and the causal asymmetry, particularly regarding problem cases such as simultaneous causation or backwards causation, and the conceptual connection between causation and action.

Does native language temporal experience transfer to audio-visual synchrony perception?

The temporal alignment of what we hear and see is fundamental for the cognitive organization of information from our environment. Research indicates that a perceiver's experience influences sensitivity to audio-visual (AV) synchrony. We theorize that experience that enhances sensitivity to speech sound distinctions in the temporal domain would enhance sensitivity in AV synchrony perception. With this basis, a perceiver whose native language (L1) involves duration-based phonemic distinctions would be expected to be more sensitive to AV synchrony in speech than for an L1 which has less use of temporal cues. In the current study, simultaneity judgment data for the syllable /ba/ were collected with 23 steps of AV alignments: from audio preceding the video (audio-lead) to the audio and video being physically aligned (synchronous) to video preceding the audio (video-lead). Two groups of participants differing in L1 experience with phonemic duration were included: native speakers of Norwegian (binary phonemic quantity distinction) and English (no phonemic quantity distinction). Preliminary results based on measures the audio-lead threshold (ALT) support the hypothesis that native language experience may influence broad mechanisms of timing, such as those moderating AV synchrony perception. Findings contribute to understanding the underpinnings of experience and AV synchrony perception.

Vowel inventory size matters: assessing cue-weighting in L2 vowel perception

To examine whether L1 vowel inventory size could be a contributing factor to the use of temporal cues in L2 vowel perception, this study assessed the perception of English /i-ɪ/ by 66 learners of four different L1s: Danish, Portuguese, Catalan and Russian. The L2 learners performed a forced-choice identification task containing natural and duration-manipulated stimuli. Findings suggest that the participants’ over-reliance on duration cues seem to be partially related to their L1 vowel inventory size. The participants with the greatest L1 vowel inventory (Danish) demonstrated the most native-like vowel perception and the participants with the smallest L1 vowel inventory (Russian) over-relied on duration cues more than the other learners. Interestingly, the participants with somewhat comparable L1 vowel inventories (Portuguese and Catalan) performed similarly.

Infants' and Adults' Use of Temporal Cues in Consonant Discrimination.

Adults can use slow temporal envelope cues, or amplitude modulation (AM), to identify speech sounds in quiet. Faster AM cues and the temporal fine structure, or frequency modulation (FM), play a more important role in noise. This study assessed whether fast and slow temporal modulation cues play a similar role in infants' speech perception by comparing the ability of normal-hearing 3-month-olds and adults to use slow temporal envelope cues in discriminating consonants contrasts. English consonant-vowel syllables differing in voicing or place of articulation were processed by 2 tone-excited vocoders to replace the original FM cues with pure tones in 32 frequency bands. AM cues were extracted in each frequency band with 2 different cutoff frequencies, 256 or 8 Hz. Discrimination was assessed for infants and adults using an observer-based testing method, in quiet or in a speech-shaped noise. For infants, the effect of eliminating fast AM cues was the same in quiet and in noise: a high proportion of infants discriminated when both fast and slow AM cues were available, but less than half of the infants also discriminated when only slow AM cues were preserved. For adults, the effect of eliminating fast AM cues was greater in noise than in quiet: All adults discriminated in quiet whether or not fast AM cues were available, but in noise eliminating fast AM cues reduced the percentage of adults reaching criterion from 71 to 21%. In quiet, infants seem to depend on fast AM cues more than adults do. In noise, adults seem to depend on FM cues to a greater extent than infants do. However, infants and adults are similarly affected by a loss of fast AM cues in noise. Experience with the native language seems to change the relative importance of different acoustic cues for speech perception.

Vowel identification in temporal-modulated noise for native and non-native listeners: Effect of language experience.

A previous study found that English vowel identification in babble was significantly different between Chinese-native listeners in China and in the U.S. One possible explanation is that native English experiences might change Chinese-native listeners' ability to take advantage of the temporal modulation in noise for their English vowel perception. As a follow-up, the current study explored whether there was a difference between the two groups of Chinese listeners in using temporal gaps in noise for English vowel identification. Vowel identification in temporally modulated noise and a temporal modulation transfer function (TMTF) was measured for American-English-native listeners (EN), Chinese-native listeners in the U.S. (CNU), and Chinese-native listeners in China (CNC). The results revealed that TMTFs were similar across the three groups, indicating that psychophysical temporal processing was independent of listeners' language backgrounds. However, for vowel identification in noise, EN and CNU listeners showed significantly greater masking release from the temporal modulation of noise than CNC listeners at low signal-to-noise ratios (e.g., -12 dB). Altogether, native English experiences may change the use of temporal cues in noise for English vowel identification for Chinese-native listeners.

Sentence recognition in temporal modulated noise for native and non-native listeners: Effect of language experience

Speech recognition in adverse listening conditions is more difficult for non-native listeners than native listeners. Previous work in our laboratories found that Chinese-native listeners with native English exposure may improve the use of temporal cues of noise for English vowel identification. The purpose of this study was to investigate whether such benefits of using temporal modulation in noise were also presented in sentence recognition. IEEE sentence recognition in quiet, stationary, and temporally modulated noise were measured for American English native (EN) listeners, Chinese-native listeners in the United States (CNU), and Chinese-native listeners in China (CNC). Results showed that in general, EN listeners outperformed the two groups of CN listeners in quiet and noise, while CNU listeners had better scores of sentence recognition than CNC listeners. Moreover, at low SNRs, the masking release on sentence recognition from the temporal modulation in noise was greatest for EN listeners, and the smallest for CNC listeners with the CNU listeners in between, while at middle and high SNRs, there was no significant group effect on the masking release, consistent with the findings of English vowel perception. The group difference in using temporal modulation of noise may be associated with acoustic differences between Chinese and English speech.

Vowel identification in temporal modulated noise for native and non-native listeners: Effect of language experience

Previous work in our laboratories found vowel identification in babble was significant different between Chinese-native listeners in China and United States. As a follow-up, the current study focused on whether the two groups of Chinese listeners had any difference in using temporal cues of noise for vowel identification. Temporal modulation transfer function and vowel identification in temporal modulated noise were measured for American English native (EN) listeners, Chinese-native listeners in United States (CNU), and Chinese-native listeners in China(CNC). Results revealed that TMTF is similar across three groups, indicating that psychophysical temporal processing is independent of listeners’ language backgrounds. However, for vowel identification in noise, EN and CNU listeners showed significantly greater masking release from temporal modulation of the noise than CNC listeners, especially at low SNR conditions (e.g., −12 dB). Altogether, native English exposure may change the use of temporal cues on English vowel identification for Chinese-native listeners.

Thalamic and parietal brain morphology predicts auditory category learning

Auditory categorization is a vital skill involving the attribution of meaning to acoustic events, engaging domain-specific (i.e., auditory) as well as domain-general (e.g., executive) brain networks. A listener's ability to categorize novel acoustic stimuli should therefore depend on both, with the domain-general network being particularly relevant for adaptively changing listening strategies and directing attention to relevant acoustic cues. Here we assessed adaptive listening behavior, using complex acoustic stimuli with an initially salient (but later degraded) spectral cue and a secondary, duration cue that remained nondegraded. We employed voxel-based morphometry (VBM) to identify cortical and subcortical brain structures whose individual neuroanatomy predicted task performance and the ability to optimally switch to making use of temporal cues after spectral degradation. Behavioral listening strategies were assessed by logistic regression and revealed mainly strategy switches in the expected direction, with considerable individual differences. Gray-matter probability in the left inferior parietal lobule (BA 40) and left precentral gyrus was predictive of “optimal” strategy switch, while gray-matter probability in thalamic areas, comprising the medial geniculate body, co-varied with overall performance. Taken together, our findings suggest that successful auditory categorization relies on domain-specific neural circuits in the ascending auditory pathway, while adaptive listening behavior depends more on brain structure in parietal cortex, enabling the (re)direction of attention to salient stimulus properties.

Auditory lateralization in schizophrenia – Mismatch negativity and behavioral evidence of a selective impairment in encoding interaural time cues

Objective Behavioural evidence suggests that individuals with schizophrenia may exhibit impairment in the encoding of cues to sound location. There are three primary cues used by the auditory system to locate the position of a sound in space: interaural differences in the arrival-time (ITD), phase (IPD), and the loudness (ILD) of the sound at the two ears. The goal in this study was to obtain an electrophysiological index of preattentive detection of change in sound lateralization created by these cues. Methods The amplitude of mismatch negativity (MMN) was measured in 18 individuals with schizophrenia and 19 healthy comparison subjects to changes in sound lateralization produced by interaural temporal cues (ITD and IPD) and interaural loudness cues (ILD). Performance was also investigated on a target detection task, where targets were defined by ITD, IPD, or ILD cues. Results Individuals with schizophrenia had reduced MMN amplitudes and decreased hit rates when deviants were created by interaural temporal cues, but not when loudness cues were used. Conclusions Results from both the MMN and behavioural task revealed a selective impairment in the use of temporal cues to sound lateralization in individuals with schizophrenia. Significance This finding supports previous research that suggests impairment in the encoding of the temporal information in schizophrenia.

The effect of smoothing filter slope and spectral frequency on temporal speech information

It is known that information contained within the filter skirts can provide cues important to speech intelligibility. However, the role of filter slope during temporal smoothing has received little attention. In experiment 1, smoothing filter slope angle was found to have a large effect on the intelligibility of sentences represented by three amplitude-modulated sinusoids. In experiment 2, the use of temporal cues above 16 Hz was examined across various regions of the spectrum. When increases in rate were presented to individual spectral bands, intelligibility only increased when presented in the higher spectral region. This result suggests a greater reliance on higher-rate cues in this region. However, intelligibility was greatest when these cues were distributed across the spectrum, indicating that their effective use is not restricted solely to this region.

Development of infants’ pitch perception

Several studies demonstrate that by 7 months of age infants can hear the pitch of the missing fundamental for tonal complexes and that the same acoustic cues used by adults permit infants to perceive pitch. Infants and adults were tested in an operant conditioning procedure and learned to categorize tonal complexes with differing spectra according to the pitch of the missing fundamental. Responses to spectral manipulations that reduce the salience of pitch suggested that the strength of the pitch percept may be weaker and the use of temporal cues may be poorer for infants than for adults. Other work utilizing an iterated rippled noise stimulus (IRN) attempted to quantify these developmental differences. Applying progressively greater attenuation to the delayed noise in an IRN progressively decreases the strength of the pitch percept evoked by the stimulus. The maximum attenuation for which listeners detect changes in pitch estimates the strength of their pitch percept. Such thresholds revealed that the strength of the pitch percept evoked by IRN was significantly weaker for infants (6.7 dB) than for adults (19.1 dB). In combination, these findings suggest that temporal mechanisms for processing pitch may be particularly immature in infants.

Older listeners' use of temporal cues altered by compression amplification.

This study compared the ability of younger and older listeners to use temporal information in speech when that information was altered by compression amplification. Recognition of vowel-consonant-vowel syllables was measured for four groups of adult listeners (younger normal hearing, older normal hearing, younger hearing impaired, older hearing impaired). There were four conditions. Syllables were processed with wide-dynamic range compression (WDRC) amplification and with linear amplification. In each of those conditions, recognition was measured for syllables containing only temporal information and for syllables containing spectral and temporal information. Recognition of WDRC-amplified speech provided an estimate of the ability to use altered amplitude envelope cues. Syllables were presented with a high-frequency masker to minimize confounding differences in high-frequency sensitivity between the younger and older groups. Scores were lower for WDRC-amplified speech than for linearly amplified speech, and older listeners performed more poorly than younger listeners. When spectral information was unrestricted, the age-related decrement was similar for both amplification types. When spectral information was restricted for listeners with normal hearing, the age-related decrement was greater for WDRC-amplified speech than for linearly amplified speech. When spectral information was restricted for listeners with hearing loss, the age-related decrement was similar for both amplification types. Clinically, these results imply that when spectral cues are available (i.e., when the listener has adequate spectral resolution) older listeners can use WDRC hearing aids to the same extent as younger listeners. For older listeners without hearing loss, poorer scores for compression-amplified speech suggest an age-related deficit in temporal resolution.

Differential use of temporal cues to the /s/-/z/ contrast by native and non-native speakers of English.

This study examined the effect of linguistic experience on perception of the English /s/-/z/ contrast in word-final position. The durations of the periodic ("vowel") and aperiodic ("fricative") portions of stimuli, ranging from peas to peace, were varied in a 5 X 5 factorial design. Forced-choice identification judgments were elicited from two groups of native speakers of American English differing in dialect, and from two groups each of native speakers of French, Swedish, and Finnish differing in English-language experience. The results suggested that the non-native subjects used cues established for the perception of phonetic contrasts in their native language to identify fricatives as /s/ or /z/. Lengthening vowel duration increased /z/ judgments in all eight subject groups, although the effect was smaller for native speakers of French than for native speakers of the other languages. Shortening fricative duration, on the other hand, significantly decreased /z/ judgments only by the English and French subjects. It did not influence voicing judgments by the Swedish and Finnish subjects, even those who had lived for a year or more in an English-speaking environment. These findings raise the question of whether adults who learn a foreign language can acquire the ability to integrate multiple acoustic cues to a phonetic contrast which does not exist in their native language.