Temporal Order Judgment Task Research Articles

Differential temporal salience of earning and saving

People are often characterized as poor savers. Here we examined whether cues associated with earning and saving have differential salience for attention and action. We first modeled earning and saving after positive and negative variants of monetary reinforcement, i.e., gains versus avoiding loss. Despite their equivalent absolute magnitude in a monetary incentive task, colors predicting saving were judged to appear after those that predicted earning in a temporal-order judgment task. This saving posteriority effect also occurred when savings were framed as earnings that come slightly later. Colors predicting savings, whether they acquired either negative or positive value, persisted in their posteriority. An attentional asymmetry away from money-saved relative to money-earned, potentially contributes to decreased everyday salience and future wealth.

Higher Tactile Temporal Resolution as a Basis of Hypersensitivity in Individuals with Autism Spectrum Disorder

Many individuals with autism spectrum disorder (ASD) have symptoms of sensory hypersensitivity. Several studies have shown high individual variations in temporal processing of tactile stimuli. We hypothesized that these individual differences are linked to differences in hyper-reactivity among individuals with ASD. Participants performed two tasks as to vibrotactile stimuli: One is a temporal order judgement task, and another is a detection task. We found that individuals with ASD with higher temporal resolution tended to have more severe hypersensitivity symptoms. In contrast, the tactile detection threshold/sensitivity were related to the severities of stereotyped behaviour and restricted interests, rather than to hypersensitivity. Our findings demonstrate that higher temporal resolution to sensory stimuli may contribute to sensory hypersensitivity in individuals with ASD.

Stuck on a Plateau? A Model-Based Approach to Fundamental Issues in Visual Temporal-Order Judgments.

Humans are incapable of judging the temporal order of visual events at brief temporal separations with perfect accuracy. Their performance—which is of much interest in visual cognition and attention research—can be measured with the temporal-order judgment (TOJ) task, which typically produces S-shaped psychometric functions. Occasionally, researchers reported plateaus within these functions, and some theories predict such deviation from the basic S shape. However, the centers of the psychometric functions result from the weakest performance at the most difficult presentations and therefore fluctuate strongly, leaving the existence and exact shapes of plateaus unclear. This study set out to investigate whether plateaus disappear if the data accuracy is enhanced, or if we are “stuck on a plateau”, or rather with it. For this purpose, highly accurate data were assessed by model-based analysis. The existence of plateaus is confidently confirmed and two plausible mechanisms derived from very different models are presented. Neither model, however, performs well in the presence of a strong attention manipulation, and model comparison remains unclear on the question of which of the models describes the data best. Nevertheless, the present study includes the highest accuracy in visual TOJ data and the most explicit models of plateaus in TOJ studied so far.

Perceptual Oscillation of Audiovisual Time Simultaneity.

Action and perception are tightly coupled systems requiring coordination and synchronization over time. How the brain achieves synchronization is still a matter of debate, but recent experiments suggest that brain oscillations may play an important role in this process. Brain oscillations have been also proposed to be fundamental in determining time perception. Here, we had subjects perform an audiovisual temporal order judgment task to investigate the fine dynamics of temporal bias and sensitivity before and after the execution of voluntary hand movement (button-press). The reported order of the audiovisual sequence was rhythmically biased as a function of delay from hand action execution. Importantly, we found that it oscillated at a theta range frequency, starting ∼500 ms before and persisting ∼250 ms after the button-press, with consistent phase-locking across participants. Our results show that the perception of cross-sensory simultaneity oscillates rhythmically in synchrony with the programming phase of a voluntary action, demonstrating a link between action preparation and bias in temporal perceptual judgments.

Simultaneity and Temporal Order Judgments Are Coded Differently and Change With Age: An Event-Related Potential Study

Multisensory integration is required for a number of daily living tasks where the inability to accurately identify simultaneity and temporality of multisensory events results in errors in judgment leading to poor decision-making and dangerous behavior. Previously, our lab discovered that older adults exhibited impaired timing of audiovisual events, particularly when making temporal order judgments (TOJs). Simultaneity judgments (SJs), however, were preserved across the lifespan. Here, we investigate the difference between the TOJ and SJ tasks in younger and older adults to assess neural processing differences between these two tasks and across the lifespan. Event-related potentials (ERPs) were studied to determine between-task and between-age differences. Results revealed task specific differences in perceiving simultaneity and temporal order, suggesting that each task may be subserved via different neural mechanisms. Here, auditory N1 and visual P1 ERP amplitudes confirmed that unisensory processing of audiovisual stimuli did not differ between the two tasks within both younger and older groups, indicating that performance differences between tasks arise either from multisensory integration or higher-level decision-making. Compared to younger adults, older adults showed a sustained higher auditory N1 ERP amplitude response across SOAs, suggestive of broader response properties from an extended temporal binding window. Our work provides compelling evidence that different neural mechanisms subserve the SJ and TOJ tasks and that simultaneity and temporal order perception are coded differently and change with age.

Perceived Simultaneity and Temporal Order of Audiovisual Events Following Concussion.

The central nervous system allows for a limited time span referred to as the temporal binding window (TBW) in order to rapidly determine whether multisensory events correspond with the same event. Failure to correctly identify whether multisensory events occur simultaneously and their sequential order can lead to inaccurate representations of the physical world, poor decision-making and dangerous behavior. Damage to the neural systems that coordinate the relative timing of sensory events may explain some of the long-term consequences associated with concussion. The aim of this study was to investigate whether the perception of simultaneity and the discrimination of temporal order of audiovisual stimuli are impaired in those with a history of concussion. Fifty participants (17 with concussion history) were recruited to complete audiovisual simultaneity judgment (SJ) and temporal order judgment (TOJ) tasks. From these tasks, the TBW and point of subjective simultaneity (PSS) were extracted to assess whether the precision and or the accuracy of temporal perception changes with concussion, respectively. Results demonstrated that those with concussion history have a significantly wider TBW (less precise), with no significant change in the PSS (no change in accuracy), particularly for the TOJ task but no significant differences were found between the SJ and TOJ tasks. Importantly, a negative correlation between the time elapsed since last concussion and TBW width in the TOJ task suggests that precision in temporal perception does improve over time. These findings suggest that those with concussion history display an impairment in the perceived timing of sensory events and that monitoring performance in the SJ and TOJ tasks may be a useful additional assessment tool when making decisions about returning to regular work and play following concussion.

Exploring Behavioral Correlates of Afferent Inhibition.

(1) Background: Afferent inhibition is the attenuation of the muscle response evoked from transcranial magnetic stimulation (TMS) by a prior conditioning electrical stimulus to a peripheral nerve. It is unclear whether the magnitude of afferent inhibition relates to sensation and movement; (2) Methods: 24 healthy, young adults were tested. Short-latency afferent inhibition (SAI) and long-latency afferent inhibition (LAI) were obtained following median and digital nerve stimulation. Temporal tactile acuity was assessed with a temporal order judgement (TOJ) task, spatial tactile acuity was assessed using a grating orientation task (GOT), and fine manual dexterity was assessed with the Pegboard task; (3) Results: Correlation analyses revealed no association between the magnitude of SAI or LAI with performance on the TOJ, GOT, or Pegboard tasks; (4) Conclusion: The magnitude of SAI and LAI does not relate to performance on the sensory and motor tasks tested. Future studies are needed to better understand whether the afferent inhibition phenomenon relates to human behavior.

No perceptual prioritization of non-nociceptive vibrotactile and visual stimuli presented on a sensitized body part

High frequency electrical conditioning stimulation (HFS) is an experimental method to induce increased mechanical pinprick sensitivity in the unconditioned surrounding skin (secondary hyperalgesia). Secondary hyperalgesia is thought to be the result of central sensitization, i.e. increased responsiveness of nociceptive neurons in the central nervous system. Vibrotactile and visual stimuli presented in the area of secondary hyperalgesia also elicit enhanced brain responses, a finding that cannot be explained by central sensitization as it is currently defined. HFS may recruit attentional processes, which in turn affect the processing of all stimuli. In this study we have investigated whether HFS induces perceptual biases towards stimuli presented onto the sensitized arm by using Temporal Order Judgment (TOJ) tasks. In TOJ tasks, stimuli are presented in rapid succession on either arm, and participants have to indicate their perceived order. In case of a perceptual bias, the stimuli presented on the attended side are systematically reported as occurring first. Participants performed a tactile and a visual TOJ task before and after HFS. Analyses of participants’ performance did not reveal any prioritization of the visual and tactile stimuli presented onto the sensitized arm. Our results provide therefore no evidence for a perceptual bias towards tactile and visual stimuli presented onto the sensitized arm.

Multisensory temporal processing in own-body contexts: plausibility of hand ownership does not improve visuo-tactile asynchrony detection.

Tracking one's own body is essential for environmental interaction, and involves integrating multisensory cues with stored information about the body's typical features. Exactly how multisensory information is integrated in own-body perception is still unclear. For example, Ide and Hidaka (Exp Brain Res 228:43-50, 2013) found that participants made less precise visuo-tactile temporal order judgments (TOJ) when viewing hands in a plausible orientation (upright; typical for one's own hand) compared to an implausible orientation (rotated 180°). This suggests that viewing one's own body relaxes the precision for perceived visuo-tactile synchrony. In contrast, visuo-proprioceptive research shows improvements for multisensory temporal perception near one's own body in asynchrony detection tasks, implying an increase in precision. Hence, it is unclear whether viewed hand orientation generally modulates the ability to detect small asynchronies between vision and touch, or if this effect is specific to TOJ tasks. We investigated whether viewed hand orientation affects detection of visuo-tactile asynchrony. In two experiments, participants viewed model hands in anatomically plausible or implausible orientations. In one experiment, we stroked the hands to induce the rubber hand illusion. Participants were asked to detect short delays (40-280ms) between vision (an LED flash on the model hand) and touch (a tap to fingertip of the participant's hidden hand) in a two-interval forced-choice task. Bayesian analyses show that our data provide strong evidence that viewed hand orientation does not affect visuo-tactile asynchrony detection. This study suggests the mechanisms for fine-grained time perception differ between visuo-tactile and visuo-proprioceptive contexts.

Temporal Ventriloquism Reveals Intact Audiovisual Temporal Integration in Amblyopia.

We have shown previously that amblyopia involves impaired detection of asynchrony between auditory and visual events. To distinguish whether this impairment represents a defect in temporal integration or nonintegrative multisensory processing (e.g., cross-modal matching), we used the temporal ventriloquism effect in which visual temporal order judgment (TOJ) is normally enhanced by a lagging auditory click. Participants with amblyopia (n = 9) and normally sighted controls (n = 9) performed a visual TOJ task. Pairs of clicks accompanied the two lights such that the first click preceded the first light, or second click lagged the second light by 100, 200, or 450 ms. Baseline audiovisual synchrony and visual-only conditions also were tested. Within both groups, just noticeable differences for the visual TOJ task were significantly reduced compared with baseline in the 100- and 200-ms click lag conditions. Within the amblyopia group, poorer stereo acuity and poorer visual acuity in the amblyopic eye were significantly associated with greater enhancement in visual TOJ performance in the 200-ms click lag condition. Audiovisual temporal integration is intact in amblyopia, as indicated by perceptual enhancement in the temporal ventriloquism effect. Furthermore, poorer stereo acuity and poorer visual acuity in the amblyopic eye are associated with a widened temporal binding window for the effect. These findings suggest that previously reported abnormalities in audiovisual multisensory processing may result from impaired cross-modal matching rather than a diminished capacity for temporal audiovisual integration.

Do patients with chronic unilateral orofacial pain due to a temporomandibular disorder show increased attending to somatosensory input at the painful side of the jaw?

BackgroundPatients with chronic orofacial pain due to temporomandibular disorders (TMD) display alterations in somatosensory processing at the jaw, such as amplified perception of tactile stimuli, but the underlying mechanisms remain unclear. This study investigated one possible explanation, namely hypervigilance, and tested if TMD patients with unilateral pain showed increased attending to somatosensory input at the painful side of the jaw.MethodsTMD patients with chronic unilateral orofacial pain (n = 20) and matched healthy volunteers (n = 20) performed a temporal order judgment (TOJ) task indicated which one of two tactile stimuli, presented on each side of the jaw, they had perceived first. TOJ methodology allows examining spatial bias in somatosensory processing speed. Furthermore, after each block of trials, the participants rated the perceived intensity of tactile stimuli separately for both sides of the jaw. Finally, questionnaires assessing pain catastrophizing, fear-avoidance beliefs, and pain vigilance, were completed.ResultsTMD patients tended to perceive tactile stimuli at the painful jaw side as occurring earlier in time than stimuli at the non-painful side but this effect did not reach conventional levels of significance (p = .07). In the control group, tactile stimuli were perceived as occurring simultaneously. Secondary analyses indicated that the magnitude of spatial bias in the TMD group is positively associated with the extent of fear-avoidance beliefs. Overall, intensity ratings of tactile stimuli were significantly higher in the TMD group than in the control group, but there was no significant difference between the painful and non-painful jaw side in the TMD patients.DiscussionThe hypothesis that TMD patients with chronic unilateral orofacial pain preferentially attend to somatosensory information at the painful side of the jaw was not statistically supported, although lack of power could not be ruled out as a reason for this. The findings are discussed within recent theories of pain-related attention.

Rapid Improvement on a Temporal Attention Task within a Single Session of High-frequency Transcranial Random Noise Stimulation.

This study explored the modulatory effects of high-frequency transcranial random noise stimulation (tRNS) on visual sensitivity during a temporal attention task. We measured sensitivity to different onset asynchronies during a temporal order judgment task as a function of active stimulation relative to sham. While completing the task, participants were stimulated bilaterally for 20 min over either the TPJ or the human middle temporal area. We hypothesized that tRNS over the TPJ, which is critical to the temporal attention network, would selectively increase cortical excitability and induce cognitive training-like effects on performance, perhaps more so in the left visual field [Matthews, N., & Welch, L. Left visual field attentional advantage in judging simultaneity and temporal order. Journal of Vision, 15, 1-13, 2015; Romanska, A., Rezlescu, C., Susilo, T., Duchaine, B., & Banissy, M. J. High-frequency transcranial random noise stimulation enhances perception of facial identity. Cerebral Cortex, 25, 4334-4340, 2015]. In Experiment 1, we measured the performance of participants who judged the order of Gabors temporally imbedded in flickering discs, presented with onset asynchronies ranging from -75 msec (left disc first) to +75 msec (right disc first). In Experiment 2, we measured whether each participant's temporal sensitivity increased with stimulation by using temporal offsets that the participant initially perceived as simultaneous. We found that parietal cortex stimulation temporarily increased sensitivity on the temporal order judgment task, especially in the left visual field. Stimulation over human middle temporal area did not alter cortical excitability in a way that affected performance. The effects were cumulative across blocks of trials for tRNS over parietal cortex but dissipated when stimulation ended. We conclude that single-session tRNS can induce temporary improvements in behavioral sensitivity and that this shows promising insight into the relationship between cortical stimulation and neural plasticity.

Reward priming eliminates color-driven affect in perception.

Brain and behavior evidence suggests that colors have distinct affective properties. Here, we investigated how reward influences color-driven affect in perception. In Experiment 1, we assessed competition between blue and red patches during a temporal-order judgment (TOJ) across a range of stimulus onset asynchronies (SOAs). During the value reinforcement, reward was linked to either blue (version 1) or red (version 2) in the experiment. The same stimuli then served as test ones in the following unrewarded, unspeeded TOJ task. Our analysis showed that blue patches were consistently seen as occurring first, even when objectively appearing 2nd at short SOAs. This accelerated perception of blue over red was disrupted by prior primes related to reward (vs. neutral) but not perceptional (blue vs. red) priming. Experiment 2 replicated the findings of Experiment 1 while uncoupling action and stimulus values. These results are consistent with the blue-approach and red-avoidance motivation hypothesis and highlight an active nature of the association of reward priming and color processing. Together, the present study implies a link between reward and color affect and contributes to the understanding of how reward influences color affect in visual processing.

Links between temporal acuity and multisensory integration across life span.

The temporal relationship between individual pieces of information from the different sensory modalities is one of the stronger cues to integrate such information into a unified perceptual gestalt, conveying numerous perceptual and behavioral advantages. Temporal acuity, however, varies greatly over the life span. It has previously been hypothesized that changes in temporal acuity in both development and healthy aging may thus play a key role in integrative abilities. This study tested the temporal acuity of 138 individuals ranging in age from 5 to 80. Temporal acuity and multisensory integration abilities were tested both within and across modalities (audition and vision) with simultaneity judgment and temporal order judgment tasks. We observed that temporal acuity, both within and across modalities, improved throughout development into adulthood and subsequently declined with healthy aging, as did the ability to integrate multisensory speech information. Of importance, throughout development, temporal acuity of simple stimuli (i.e., flashes and beeps) predicted individuals' abilities to integrate more complex speech information. However, in the aging population, although temporal acuity declined with healthy aging and was accompanied by declines in integrative abilities, temporal acuity was not able to predict integration at the individual level. Together, these results suggest that the impact of temporal acuity on multisensory integration varies throughout the life span. Although the maturation of temporal acuity drives the rise of multisensory integrative abilities during development, it is unable to account for changes in integrative abilities in healthy aging. The differential relationships between age, temporal acuity, and multisensory integration suggest an important role for experience in these processes. (PsycINFO Database Record

Long-Term Musical Training Alters Tactile Temporal-Order Judgment.

Long-term musical training is an enriched multisensory training environment that can alter uni- and multisensory substrates and abilities. Amongst these altered abilities are faster reaction times for simple and complex sensory tasks. The crossed arm temporal-order judgement (TOJ) task is a complex tactile task in which TOJ error rate increases when arms are crossed. Reaction times (RTs) for this task are typically proportionate to the difficulty of the stimulus onset asynchrony (SOA) and increase more when the arms are crossed than when uncrossed. The objective of this study was to study the impact of musical training on RTs and accuracy for the crossed arm TOJ task. Seventeen musicians and 20 controls were tested. Musicians had significantly faster RTs for all crossed arm conditions and half of the uncrossed conditions. However, musicians had significantly more TOJ errors for the crossed posture. We speculate that faster musician TOJ RTs leave little time to consolidate conflicting internal and external task-related information when crossing the arms, leading to increased incorrect responses. These results provide novel insights on the potential mechanisms underlying the increased TOJ error rates when arms are crossed. Moreover, they add to the growing literature of altered sensory ability in musicians and propose an unexpected consequence of faster reaction times.

The effect of phasic alertness on temporal precision.

Many previous studies have found that there is a close relationship between attention and temporal precision. As a mechanism that regulates the intensity of attention, alertness has beneficial influences on perceptual processing. However, little is known regarding whether and how phasic alertness affects temporal precision. Experiment 1 and Experiment 2 used visual and auditory warning cues in a visual temporal order judgment (TOJ) task and a simultaneity judgment (SJ) task to investigate the phasic alerting effect on temporal precision. Participants in the TOJ and SJ tasks were required to make judgments of two successive and synchronous stimuli at various stimulus onset asynchronies (SOAs). Because of dissension regarding the SJ task, Experiment 3 adopted a dual SJ and TOJ task to create a new indicator of participant performance. Although these tasks may differ in the cognitive mechanism they involve, they all produced consistently decreased just noticeable difference (JND) scores and unaltered point of subjective simultaneity (PSS). This suggests that phasic alertness could significantly improve participants' temporal precision (reduced JNDs) of visual perception, without affecting temporal accuracy (unaltered PSS). We then discuss that the alerting effect on temporal sensitivity might be attributed mainly to transient arousal rather than temporal expectancy. Furthermore, the analysis of response ratios at each SOA could distinguish a heightened temporal precision from a reduction of attentional lapses. According to the previous and present studies, phasic alertness might simultaneously benefited the early perceptual processing and late motor execution of responses.

Age-Related Changes in Sensorimotor Temporal Binding.

The causal relationship between a voluntary movement and a sensory event is crucial for experiencing agency. Sensory events must occur within a certain delay from a voluntary movement to be perceived as self-generated. Therefore, temporal sensitivity, i.e., the ability to discriminate temporal asynchronies between motor and sensory events, is important for sensorimotor binding. Moreover, differences in the physical propagation of external stimuli can sometimes challenge sensorimotor binding, generating illusory asynchrony. To overcome this problem, the brain adjusts the perceptual timing of sensory and motor events. This mechanism, named sensorimotor recalibration, helps keeping causality judgments accurate. As humans age, the broad decline in sensory and motor processing may reduce temporal sensitivity, and compromise sensorimotor recalibration. In the current study, we investigated the effect of aging on sensorimotor temporal binding by measuring changes in both temporal sensitivity and recalibration. Young and elderly adults were exposed to a prolonged physical delay between a voluntary movement (a keypress) and its perceptual consequence (a visual stimulus). Before and after this exposure, participants performed a sensorimotor temporal order judgment (TOJ) task. As expected, elderly adults showed reduced sensorimotor recalibration and sensitivity as compared to young adults, suggesting that aging affects sensorimotor temporal binding.

Multisensory integration and ADHD-like traits: Evidence for an abnormal temporal integration window in ADHD

Abnormalities in multimodal processing have been found in many developmental disorders such as autism and dyslexia. However, surprisingly little empirical work has been conducted to test the integrity of multisensory integration in Attention Deficit Hyperactivity Disorder (ADHD). The main aim of the present study was to examine links between symptoms of ADHD (as measured using a self-report scale in a healthy adult population) and the temporal aspects of multisensory processing. More specifically, a Simultaneity Judgement (SJ) and a Temporal Order Judgement (TOJ) task were used in participants with low and high levels of ADHD-like traits to measure the temporal integration window and Just-Noticeable Difference (JND) (respectively) between the timing of an auditory beep and a visual pattern presented over a broad range of stimulus onset asynchronies. The Point of Subjective Similarity (PSS) was also measured in both cases. In the SJ task, participants with high levels of ADHD-like traits considered significantly fewer stimuli to be simultaneous than participants with high levels of ADHD-like traits, and the former were found to have significantly smaller temporal windows of integration (although no difference was found in the PSS in the SJ or TOJ tasks, or the JND in the latter). This is the first study to identify an abnormal temporal integration window in individuals with ADHD-like traits. Perceived temporal misalignment of two or more modalities can lead to distractibility (e.g., when the stimulus components from different modalities occur separated by too large of a temporal gap). Hence, an abnormality in the perception of simultaneity could lead to the increased distractibility seen in ADHD.

Visual Experience Shapes the Neural Networks Remapping Touch into External Space.

Localizing touch relies on the activation of skin-based and externally defined spatial frames of reference. Psychophysical studies have demonstrated that early visual deprivation prevents the automatic remapping of touch into external space. We used fMRI to characterize how visual experience impacts the brain circuits dedicated to the spatial processing of touch. Sighted and congenitally blind humans performed a tactile temporal order judgment (TOJ) task, either with the hands uncrossed or crossed over the body midline. Behavioral data confirmed that crossing the hands has a detrimental effect on TOJ judgments in sighted but not in early blind people. Crucially, the crossed hand posture elicited enhanced activity, when compared with the uncrossed posture, in a frontoparietal network in the sighted group only. Psychophysiological interaction analysis revealed, however, that the congenitally blind showed enhanced functional connectivity between parietal and frontal regions in the crossed versus uncrossed hand postures. Our results demonstrate that visual experience scaffolds the neural implementation of the location of touch in space.SIGNIFICANCE STATEMENT In daily life, we seamlessly localize touch in external space for action planning toward a stimulus making contact with the body. For efficient sensorimotor integration, the brain has therefore to compute the current position of our limbs in the external world. In the present study, we demonstrate that early visual deprivation alters the brain activity in a dorsal parietofrontal network typically supporting touch localization in the sighted. Our results therefore conclusively demonstrate the intrinsic role that developmental vision plays in scaffolding the neural implementation of touch perception.

Biased visuospatial perception in complex regional pain syndrome

Complex regional pain syndrome (CRPS) is a chronic pain condition associating sensory, motor, trophic and autonomic symptoms in one limb. Cognitive difficulties have also been reported, affecting the patients’ ability to mentally represent, perceive and use their affected limb. However, the nature of these deficits is still a matter of debate. Recent studies suggest that cognitive deficits are limited to body-related information and body perception, while not extending to external space. Here we challenge that statement, by using temporal order judgment (TOJ) tasks with tactile (i.e. body) or visual (i.e. extra-body) stimuli in patients with upper-limb CRPS. TOJ tasks allow characterizing cognitive biases to the advantage of one of the two sides of space. While the tactile TOJ tasks did not show any significant results, significant cognitive biases were observed in the visual TOJ tasks, affecting mostly the perception of visual stimuli occurring in the immediate vicinity of the affected limb. Our results clearly demonstrate the presence of visuospatial deficits in CRPS, corroborating the cortical contribution to the CRPS pathophysiology, and supporting the utility of developing rehabilitation techniques modifying visuospatial abilities to treat chronic pain.