Perception Of Temporal Order Research Articles

Independent-channels models of temporal-order judgment revisited: A model comparison

The perception of temporal order or simultaneity of stimuli is almost always explained in terms of independent-channels models, such as perceptual-moment, triggered-moment, and attention-switching models. Independent-channels models generally posit that stimuli are processed in separate peripheral channels and that their arrival-time difference at a central location is translated into an internal state of order (simultaneity) if it reaches (misses) a certain threshold. Non-monotonic and non-parallel psychometric functions in a ternary-response task provided critical evidence against a wide range of independent-channels models. However, two independent-channels models have been introduced in the last decades that can account for such shapes by considering misreports of internal states (response-error model) or by assuming that simultaneity and order judgments rely on distinct sensory and decisional processes (two-stage model). Based on previous ideas, we also consider a two-threshold model, according to which the same arrival-time difference may need to reach a higher threshold for order detection than for successiveness detection. All three models were fitted to various data sets collected over a period of more than a century. The two-threshold model provided the best balance between goodness of fit and parsimony. This preference for the two-threshold model over the two-stage model and the response-error model aligns well with several lines of evidence from cognitive modeling, psychophysics, mental chronometry, and psychophysiology. We conclude that the seemingly deviant shapes of psychometric functions can be explained within the framework of independent-channels models in a simpler way than previously assumed.

The less complex temporal patterns of resting‑state EEG activity, the lower the visual temporal order threshold.

Speech understanding, watching a movie, listening to music etc., requires perception of the temporal order of at least two incoming events. A history of performing these tasks may be reflected in spontaneous brain activity. Here, we examined the relationship between the complexity (temporal dynamics) of resting‑state EEG (rsEEG) signal, assessed using the multivariate MultiScale Entropy (mMSE) algorithm, and the perception of event ordering, indexed by a visual temporal order threshold (TOT), i.e., the minimum duration necessary to correctly identify the before‑after relation between two stimuli. Healthy adolescents and young adults performed a psychophysical task measuring the TOT and underwent an eyes‑closed rsEEG study. The features of mMSE vectors, namely the area under curve (AUC) that represents total signal complexity, as well as the MaxSlope and the AvgEnt, corresponding to the entropy at fine‑ and coarse‑grained timescales, respectively, were obtained for the central (midline), anterior, middle and posterior channel sets. The greater the AUC and AvgEnt values in the central, left and right posterior areas, and the higher AUC in the right middle region, the higher the TOT. The most significant relationships were found for the midline electrodes (Fz, Cz, Pz, Oz). There were no significant correlations between the MaxSlope values and the TOT. To the best of our knowledge, this is the first study demonstrating that spontaneous EEG signal complexity is associated with the temporal order perception of two stimuli presented in rapid succession. Our findings may indicate that low total and coarse entropy levels of rsEEG signal are beneficial for visual temporal order judgments.

Perifoveal and peripheral attentional modulation on order perception.

The present study demonstrates that spatial attention modulates temporal order perception differently in the perifoveal and peripheral regions, with a more pronounced effect in the left peripheral visual field, suggesting a dissociation in attentional systems for event timing at the sub-second level.

The Influence of Personal Harmony Value on Temporal Order Perception.

Empirical studies have demonstrated that self-relevant information affects temporal order perception. Therefore, the question arises of whether personal values-which are the core components of the self-influence temporal order perception. To explore this problem, we chose harmony, one of the most common values in Chinese culture, as the starting point. First, the harmony scale was used to measure the harmony values of the participants, and the participants were divided into high- and low-harmony groups. The validity of the grouping was then verified using an implicit-association test. Furthermore, two temporal order judgment (TOJ) tasks were used to explore the impact of harmony values on temporal order perception. The results revealed that in both TOJ tasks, participants in the high-harmony group tended to perceive harmonious stimuli before non-harmonious stimuli, while the effect was not found in the low-harmony group. We conclude that harmony values affect temporal order perception, and only if the values are important to the individual.

The influence of spatial location on temporal order perception

The influence of spatial location on temporal order perception

Temporal order processing in rats depends on the training protocol.

The perception of temporal order can help infer the causal structure of the world. By investigating the perceptual signatures of audiovisual temporal order in rats, we demonstrate the importance of the protocol design for reliable order processing. Rats trained with both reinforced audiovisual trials and non-reinforced unisensory trials (two consecutive tones or flashes) learned the task surprisingly faster than rats trained with reinforced multisensory trials only. They also displayed signatures of temporal order perception, such as individual biases and sequential effects that are well described in humans, and impaired in clinical populations. We conclude that an experimental protocol requiring individuals to process all stimuli in a sequence is compulsory to ensure temporal order processing. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Temporal Order Judgments in Schizophrenia and Bipolar Disorders – Explicit and Implicit Measures

Abstract Ordering events in time is essential for the understanding of causal relationships between successive events. Incorrect causal links can lead to false beliefs and an altered perception of reality. These symptoms belong to psychosis, which is present in schizophrenia (SZ) spectrum and bipolar (BP) disorder. Experimental results show that patients with SZ have an altered perception of temporal order, while there are no data in patients with BP. We investigated the ability of patients with SZ, BP, and controls to judge the order of stimuli with a 100-ms Stimulus Onset Asynchrony (SOA), and how such large asynchronies facilitate temporal order judgments for small asynchronies. Explicit temporal order effects suggest that patients with SZ perform worse at a long SOA (100 ms) as compared to controls, whereas patients with BP show no difference compared to controls or to patients with SZ. Implicit order effects reveal improved performances in case of identical as compared to different relative order between two successive trials for all groups, with no differences between the groups. We replicated explicit order impairments in patients with SZ compared to controls, while implicit effects appear to be preserved. This difficulty for patients to consciously order stimuli in time might be understood under the light of the loosening-of-associations phenomenon well described in SZ. Further, we showed that patients with BP do not reveal such an explicit order impairment which is consistent with phenomenological descriptions, suggesting a difference in time experience in patients with SZ and BP.

Holistic temporal order judgment of tones requires top-down disentanglement.

How temporal sequence gets organized is a central topic in cognitive processing. In a high-frequency time window of tens of milliseconds, the temporal order is reconstructed rather than mirroring the sequence of events objectively in physical time. Two separate phases or strategies, a holistic coding phase that groups successively presented events as a gestalt and a disentanglement phase that decodes the temporal order of discrete events from the gestalt representation, may presumably be involved in the perception of temporal order across different modalities. With a temporal order adaptation protocol of pure tones using glide adaptors, the present study demonstrated a dissociation between constant discriminability and shifted subjective simultaneity across different adaptor directions. While discriminability of temporal order was not adapted by glides, revealing a constant coding sensitivity of different asynchronies, the shift of subjective simultaneity indicated the recalibration of a top-down disentanglement of the holistic processing under the influence of glide adaptors. The results suggest a dual-phase holistic processing in temporal order perception, supporting two separate cognitive strategies for event timing on the sub-second level.

Human Vision Reconstructs Time to Satisfy Causal Constraints

The goal of perception is to infer the most plausible source of sensory stimulation. Unisensory perception of temporal order, however, appears to require no inference, because the order of events can be uniquely determined from the order in which sensory signals arrive. Here, we demonstrate a novel perceptual illusion that casts doubt on this intuition: In three experiments (N = 607), the experienced event timings were determined by causality in real time. Adult participants viewed a simple three-item sequence, ACB, which is typically remembered as ABC in line with principles of causality. When asked to indicate the time at which events B and C occurred, participants’ points of subjective simultaneity shifted so that the assumed cause B appeared earlier and the assumed effect C later, despite participants’ full attention and repeated viewings. This first demonstration of causality reversing perceived temporal order cannot be explained by postperceptual distortion, lapsed attention, or saccades.

Occipital alpha-TMS causally modulates temporal order judgements: Evidence for discrete temporal windows in vision

Recent advances in neuroscience have challenged the view of conscious visual perception as a continuous process. Behavioral performance, reaction times and some visual illusions all undergo periodic fluctuations that can be traced back to oscillatory activity in the brain. These findings have given rise to the idea of a discrete sampling mechanism in the visual system. In this study we seek to investigate the causal relationship between occipital alpha oscillations and Temporal Order Judgements using neural entrainment via rhythmic TMS in 18 human subjects (9 females). We find that certain phases of the entrained oscillation facilitate temporal order perception of two visual stimuli, whereas others hinder it. Our findings support the idea that the visual system periodically compresses information into discrete packages within which temporal order information is lost. Significance statementNeural entrainment via TMS serves as a valuable tool to interfere with cortical rhythms and observe changes in perception. Here, using α-rhythmic TMS-pulses, we demonstrate the effect of the phase of entrained oscillations on performance in a temporal order judgment task. In extension of previous work, we 1. causally influenced brain rhythms far more directly using TMS, and 2. showed that previous results on discrete perception cannot simply be explained by rhythmic fluctuations in visibility. Our findings support the idea that the temporal organization of visual processing is discrete rather than continuous, and is causally modulated by cortical rhythms. To our knowledge, this is the first study providing causal evidence via TMS for an endogenous periodic modulation of time perception.

Working Memory in Aphasia: The Role of Temporal Information Processing

Aphasia is an acquired impairment of language functions resulting from a brain lesion. It is usually accompanied by deficits in non-linguistic cognitive processes. This study aimed to investigate in patients with aphasia the complex interrelationships between selected cognitive functions: auditory speech comprehension, working memory (WM), and temporal information processing (TIP) in the millisecond time range. Thirty right-handed subjects (20 males) aged from 27 to 82 years suffering from post-stroke aphasia participated in the study. Verbal working memory (VWM) and spatial working memory (SWM) were assessed with: (1) a receptive verbal test and (2) the Corsi Block-Tapping Test, respectively. Both these WM tests used the forward tasks (mainly engaging maintenance processes, i.e., storing, monitoring, and matching information) and backward tasks (engaging both maintenance and manipulation processes, i.e., reordering and updating information). Auditory comprehension was assessed by receptive language tests, and TIP efficiency was assessed by auditory perception of temporal order in the millisecond time range. We observed better performance of forward WM tasks than backward ones, independently of the type of material used. Furthermore, the severity of auditory comprehension impairment correlated with the efficiency on both forward and backward VWM tasks and the backward SWM task. Further analysis revealed that TIP plays a crucial role only in the latter task. These results indicate the divergent pattern of interactions between WM and TIP depending on the type of WM tasks. Level of verbal competency appeared to play an important role in both VWM tasks, whereas TIP (which is associated with manipulation processes) appeared to be important for SWM, but only on the backward task.

Click Trains do not Alter Auditory Temporal Order Judgements

Brief periods of repetitive stimulation (click trains) presented either contiguous or simultaneous to an interval have been previously shown to impact on its perceived duration. In the current investigation we asked whether the perception of temporal order can be altered in a similar way. Participants completed a dichotic spectral temporal order judgement task with the stimuli titrated to their individual thresholds. Immediately prior to the judgement, participants were presented with five seconds of click trains, white noise or silence. We extended previous work on this topic by using each participant’s accuracy and response time data to estimate diffusion model parameters so that the cognitive mechanisms underlying any effect of click trains on the response could be disentangled. There was no effect of stimulation condition on participant’s accuracy, or diffusion model parameters (drift rate, boundary separation or non-decision time). The present findings therefore suggest that click trains do not influence temporal order perception. Additionally, the previous suggestion that click trains induce an increase in the rate of information processing was not supported for this temporal order task. Further work probing the limits and conditions of the click train effect will help to constrain and extend theoretical accounts of subjective timing.

Electrophysiological Dynamics of Visual-Tactile Temporal Order Perception in Early Deaf Adults.

Studies of compensatory plasticity in early deaf (ED) individuals have mainly focused on unisensory processing, and on spatial rather than temporal coding. However, precise discrimination of the temporal relationship between stimuli is imperative for successful perception of and interaction with the complex, multimodal environment. Although the properties of cross-modal temporal processing have been extensively studied in neurotypical populations, remarkably little is known about how the loss of one sense impacts the integrity of temporal interactions among the remaining senses. To understand how auditory deprivation affects multisensory temporal interactions, ED and age-matched normal hearing (NH) controls performed a visual-tactile temporal order judgment task in which visual and tactile stimuli were separated by varying stimulus onset asynchronies (SOAs) and subjects had to discern the leading stimulus. Participants performed the task while EEG data were recorded. Group averaged event-related potential waveforms were compared between groups in occipital and fronto-central electrodes. Despite similar temporal order sensitivities and performance accuracy, ED had larger visual P100 amplitudes for all SOA levels and larger tactile N140 amplitudes for the shortest asynchronous (± 30 ms) and synchronous SOA levels. The enhanced signal strength reflected in these components from ED adults are discussed in terms of compensatory recruitment of cortical areas for visual-tactile processing. In addition, ED adults had similar tactile P200 amplitudes as NH but longer P200 latencies suggesting reduced efficiency in later processing of tactile information. Overall, these results suggest that greater responses by ED for early processing of visual and tactile signals are likely critical for maintained performance in visual-tactile temporal order discrimination.

Differential color tuning of the mesolimbic reward system

Visual wavelengths are not only associated with the subjective experience of color but also have long been thought to regulate affect. Here we examined the attracting rewarding properties of opposite ends of the wavelength spectrum, as well as their individual variation. As reward is multifaceted, we sought convergent evidence from subjective and objective behavioral and attentional indices, as well as its neural reward system bases. On average, short (blue) relative to long (red) wavelengths were judged subjectively more pleasant and had objectively greater behavioral and attentional salience, regulating speed of simple color discriminations and perception of temporal order. Consistent with reward, these color effects were magnified following monetary reinforcement. Pronounced individual differences in color effects were related to reward but not punishment sensitivity, with blue relative to red preference associated with high relative to low reward sensitivity. An fMRI study revealed these individual differences were supported by color-dependent functional coupling between the visual cortices and mesolimbic reward circuitry. Our findings reveal the reward bases of color, demonstrating color is a potent regulator of perception, action, and neural dynamics.

Causal Beliefs and Perception of Temporal Order: The ‘Reordering Effect’

Empirical research on the relationship between temporality and causation is mostly dominated by the question of how temporal information constrains causal cognition. However, Bechlivanidis and Lagnado (2013, Psychol. Sci., 24, 1563–1572; 2016, Cognition, 146, 58–66) recently claimed to have discovered the ‘reordering effect’, in which causal beliefs have an influence on perception of temporal order. This paper argues for an attentional interpretation of this effect and suggests a solution to the circularity that arises from the mutual constraint between causal assumptions and perception of temporal order. Finally, it is shown how the reordering effect may challenge certain philosophical accounts of temporal illusions.

Occipital Alpha-TMS causally modulates Temporal Order Judgements: Evidence for discrete temporal windows in vision

Recent advances in neuroscience have challenged the view of conscious visual perception as a continuous process. Behavioral performance, reaction times and some visual illusions all undergo periodic fluctuations that can be traced back to oscillatory activity in the brain. These findings have given rise to the idea of a discrete sampling mechanism in the visual system. In this study we seek to investigate the causal relationship between occipital alpha oscillations and Temporal Order Judgements using neural entrainment via rhythmic TMS in 18 human subjects (9 females). We find that certain phases of the entrained oscillation facilitate temporal order perception of two visual stimuli, whereas others hinder it. Our findings support the idea that the visual system periodically compresses information into discrete packages within which temporal order information is lost. SIGNIFICANCE STATEMENT: Neural entrainment via TMS serves as a valuable tool to interfere with cortical rhythms and observe changes in perception. Here, using α-rhythmic TMS-pulses, we demonstrate the effect of the phase of entrained oscillations on performance in a temporal order judgment task. In extension of previous work, we 1. causally influenced brain rhythms far more directly using TMS, and 2. showed that previous results on discrete perception cannot simply be explained by rhythmic fluctuations in visibility. Our findings support the idea that the temporal organization of visual processing is discrete rather than continuous, and is causally modulated by cortical rhythms. To our knowledge, this is the first study providing causal evidence via TMS for an endogenous periodic modulation of time perception.

Temporal Metrics of Multisensory Processing Change in the Elderly.

Older adults exhibit greater multisensory response time (RT) facilitation by violating the race model more than young adults; this is commonly interpreted as an enhancement in perception. Older adults typically exhibit wider temporal binding windows (TBWs) and points of subjective simultaneity (PSS) that typically lie farther from true simultaneity as compared to young adults when simultaneity judgment (SJ) and temporal-order judgment (TOJ) tasks are utilized; this is commonly interpreted as an impairment in perception. Here we explore the relation between the three tasks in order to better assess audiovisual multisensory temporal processing in both young and older adults. Our results confirm previous reports showing that audiovisual RT, TBWs and PSSs change with age; however, we show for the first time a significant positive relation between the magnitude of race model violation in young adults as a function of the PSS obtained from the audiovisual TOJ task (r: 0.49, p: 0.007), that is absent in older adults (r: 0.13, p: 0.58). Furthermore, we find no evidence for the relation between race model violation as a function of the PSS obtained from the audiovisual SJ task in both young (r: -0.01, p: 0.94) and older adults (r: 0.1, p: 0.66). Our results confirm previous reports that (i) audiovisual temporal processing changes with age; (ii) distinct processes are likely involved in simultaneity and temporal-order perception; and (iii) common processing between race model violation and temporal-order judgment is impaired in the elderly.

Animals are not cognitively stuck in time.

We argue that animals are not cognitively stuck in time. Evidence pertaining to multisensory temporal order perception strongly suggests that animals can represent at least some temporal relations of perceived events.

Simultaneity and Temporal Order Judgments Are Coded Differently and Change With Age: An Event-Related Potential Study

Multisensory integration is required for a number of daily living tasks where the inability to accurately identify simultaneity and temporality of multisensory events results in errors in judgment leading to poor decision-making and dangerous behavior. Previously, our lab discovered that older adults exhibited impaired timing of audiovisual events, particularly when making temporal order judgments (TOJs). Simultaneity judgments (SJs), however, were preserved across the lifespan. Here, we investigate the difference between the TOJ and SJ tasks in younger and older adults to assess neural processing differences between these two tasks and across the lifespan. Event-related potentials (ERPs) were studied to determine between-task and between-age differences. Results revealed task specific differences in perceiving simultaneity and temporal order, suggesting that each task may be subserved via different neural mechanisms. Here, auditory N1 and visual P1 ERP amplitudes confirmed that unisensory processing of audiovisual stimuli did not differ between the two tasks within both younger and older groups, indicating that performance differences between tasks arise either from multisensory integration or higher-level decision-making. Compared to younger adults, older adults showed a sustained higher auditory N1 ERP amplitude response across SOAs, suggestive of broader response properties from an extended temporal binding window. Our work provides compelling evidence that different neural mechanisms subserve the SJ and TOJ tasks and that simultaneity and temporal order perception are coded differently and change with age.

Still no Evidence for Sustained Effects of Multisensory Integration of Duration.

In studies on temporal order perception, immediate as well as sustained effects of multisensory integration have been demonstrated repeatedly. Regarding duration perception, the corresponding literature reports clear immediate effects of multisensory integration, but evidence on sustained effects of multisensory duration integration is scarce. In fact, a single study [Heron, J. et al. (2013). Aneural hierarchy for illusions of time: Duration adaptation precedes multisensory integration, J.Vis. 13, 1-12.] investigated adaptation to multisensory conflicting intervals, and found no sustained effects of the audiovisual conflict on perceived duration of subsequently presented unimodal visual intervals. In two experiments, we provide independent evidence in support of this finding. In Experiment1, we demonstrate that adaptation to audiovisual conflict does not alter perceived duration of subsequently presented visual test intervals. Thus, replicating the results of Heron et al. (2013), we observed no sustained effect of multisensory duration integration. However, one might argue that the prolonged exposure to consistent multisensory conflict might have prevented or hampered multisensory integration per se. In Experiment2, we rule out this alternative explanation by showing that multisensory integration of audiovisual conflicting intervals is still effective after exposure to audiovisual conflict. This further strengthens the conclusion that multisensory integration of interval duration affects perception in an immediate, but not in a sustained manner.