Adaptation Aftereffects Research Articles

Prolonged Aftereffect of Visuomotor Adaptation to Gradually Distorted Reality Displayed on a See-Through Head-Mounted Device

ABSTRACTGrowing evidence suggests that the gradual transformation of visuomotor association drives a distinct learning process from abrupt transformation in humans. In the current study, we developed a novel omnidirectional visuomotor transformation paradigm to study details of such difference in more realistic environment than conventional experimental systems. Participants were asked to perform a repetitive three-dimensional (3D) arm-reaching task to a target on a front touch panel, wearing a video see-through head-mounted device that displayed a rotating view of surrounding images. In the abrupt condition, the images were rotated by 20°; in the gradual condition, the rotation was increased in a stepwise-manner from 0° to 20°. In both conditions, pointing errors were decreased after adaptation. Further, although the aftereffect of adaptation was not different between conditions, the speed of decay of the aftereffect, which was quantified by an exponential fit, was slower in the gradual condition, suggesting longer-lasting aftereffects for the gradual shift.

Adaptation aftereffects reveal representations for encoding of contingent social actions

A hallmark of human social behavior is the effortless ability to relate one's own actions to that of the interaction partner, e.g., when stretching out one's arms to catch a tripping child. What are the behavioral properties of the neural substrates that support this indispensable human skill? Here we examined the processes underlying the ability to relate actions to each other, namely the recognition of spatiotemporal contingencies between actions (e.g., a "giving" that is followed by a "taking"). We used a behavioral adaptation paradigm to examine the response properties of perceptual mechanisms at a behavioral level. In contrast to the common view that action-sensitive units are primarily selective for one action (i.e., primary action, e.g., 'throwing"), we demonstrate that these processes also exhibit sensitivity to a matching contingent action (e.g., "catching"). Control experiments demonstrate that the sensitivity of action recognition processes to contingent actions cannot be explained by lower-level visual features or amodal semantic adaptation. Moreover, we show that action recognition processes are sensitive only to contingent actions, but not to noncontingent actions, demonstrating their selective sensitivity to contingent actions. Our findings show the selective coding mechanism for action contingencies by action-sensitive processes and demonstrate how the representations of individual actions in social interactions can be linked in a unified representation.

Serial dependence in the perception of visual variance.

The recent history of perceptual experience has been shown to influence subsequent perception. Classically, this dependence on perceptual history has been examined in sensory-adaptation paradigms, wherein prolonged exposure to a particular stimulus (e.g., a vertically oriented grating) produces changes in perception of subsequently presented stimuli (e.g., the tilt aftereffect). More recently, several studies have investigated the influence of shorter perceptual exposure with effects, referred to as serial dependence, being described for a variety of low- and high-level perceptual dimensions. In this study, we examined serial dependence in the processing of dispersion statistics, namely variance—a key descriptor of the environment and indicative of the precision and reliability of ensemble representations. We found two opposite serial dependences operating at different timescales, and likely originating at different processing levels: A positive, Bayesian-like bias was driven by the most recent exposures, dependent on feature-specific decision making and appearing only when high confidence was placed in that decision; and a longer lasting negative bias—akin to an adaptation aftereffect—becoming manifest as the positive bias declined. Both effects were independent of spatial presentation location and the similarity of other close traits, such as mean direction of the visual variance stimulus. These findings suggest that visual variance processing occurs in high-level areas but is also subject to a combination of multilevel mechanisms balancing perceptual stability and sensitivity, as with many different perceptual dimensions.

A cortical substrate for the long-term memory of saccadic eye movements calibration

How movements are continuously adapted to physiological and environmental changes is a fundamental question in systems neuroscience. While many studies have elucidated the mechanisms which underlie short-term sensorimotor adaptation (∼10–30 min), how these motor memories are maintained over longer-term (>3–5 days) -and thanks to which neural systems-is virtually unknown. Here, we examine in healthy human participants whether the temporo-parietal junction (TPJ) is causally involved in the induction and/or the retention of saccadic eye movements' adaptation. Single-pulse transcranial magnetic stimulation (spTMS) was applied while subjects performed a ∼15min size-decrease adaptation task of leftward reactive saccades. A TMS pulse was delivered over the TPJ in the right hemisphere (rTPJ) in each trial either 30, 60, 90 or 120 msec (in 4 separate adaptation sessions) after the saccade onset. In two control groups of subjects, the same adaptation procedure was achieved either alone (No-TMS) or combined with spTMS applied over the vertex (SHAM-TMS). While the timing of spTMS over the rTPJ did not significantly affect the speed and immediate after-effect of adaptation, we found that the amount of adaptation retention measured 10 days later was markedly larger (42%) than in both the No-TMS (21%) and the SHAM-TMS (11%) control groups. These results demonstrate for the first time that the cerebral cortex is causally involved in maintaining long-term oculomotor memories.

Direct-effects and after-effects of dynamic adaptation on intralimb and interlimb transfer

After-effects following sensorimotor adaptation are generally considered as evidence for the formation of an internal model, although evidence lacks on whether the absence of after-effects necessarily indicates that the adaptation did not result in the formation of an internal model. Here, we examined direct- and after-effects of dynamic adaptation with one arm at one workspace on subsequent performance with the other arm, as well as the same arm at another workspace. During training, subjects performed reaching movements under a novel dynamic condition with the right arm; during testing, they performed reaching movements with the left or right arm at a new workspace, under either the same dynamic condition (direct-effects) or a normal condition (after-effects). Results showed significant transfer within the same arm in terms of both direct- and after-effects, but significant transfer across the arms only in terms of direct-effects. These findings suggest that the formation of an internal model does not always result in after-effects. They also support the idea that the neural representation developed after sensorimotor adaptation comprise some aspects that are effector independent and other aspects that are effector dependent; and that direct- and after-effects following sensorimotor adaptation mainly reflect the effector-independent and the effector-dependent aspects, respectively.

Brightening and Dimming Aftereffects at Low and High Luminance.

Adaptation to a spatially uniform field that increases or decreases in luminance over time yields a “ramp aftereffect”, whereby a steady, uniform luminance appears to dim or brighten, and an appropriate non-uniform test field appears to move. We measured the duration of this aftereffect of adaptation to ascending and descending luminance for a wide range of temporal frequencies and luminance amplitudes. Three types of luminance ramp profiles were used: linear, logarithmic, and exponential. The duration of the motion aftereffect increased as amplitude increased, regardless of the frequency, slope, or ramp profile of the adapting pattern. At low luminance, this result held for ascending luminance adaptation, but the duration of the aftereffect was significantly reduced for descending luminance adaptation. This reduction in the duration of the aftereffect at low luminance is consistent with differential recruitment of temporally tuned cells of the ON and OFF pathways, but the relative independence of the effect from temporal frequency is not.

知觉负载对注视知觉适应后效的影响 <sup>*</sup>

知觉负载对注视知觉适应后效的影响 <sup>*</sup>

Transsaccadic transfer of distortion adaptation in a natural environment.

Spatially varying distortions in optical elements-for instance prisms and progressive power lenses-modulate the visual world disparately in different visual areas. Saccadic eye movements in such a complexly distorted environment thereby continuously alter the retinal location of the distortions. Yet the visual system achieves perceptual constancy by compensating for distortions irrespective of their retinal relocations at different fixations. Here, we assessed whether the visual system retains its plasticity to distortions across saccades to attain stability. Specifically, we tapped into reference frames of geometric skew-adaptation aftereffects to evaluate the transfer of retinotopic and spatiotopic distortion information across saccades. Adaptation to skew distortion of natural-image content was tested at retinotopic and spatiotopic locations after a saccade was executed between adaptation and test phases. The skew-adaptation information was partially transferred to a new fixation after a saccade. Significant adaptation aftereffects were obtained at both retinotopic and spatiotopic locations. Conceivably, spatiotopic information was used to counterbalance the saccadic retinal shifts of the distortions. Therefore, distortion processing in a natural visual world does not start anew at each fixation; rather, retinotopic and spatiotopic skew information acquired at previous fixations are preserved to mediate stable perception during eye movements.

Rate after-effects fail to transfer cross-modally: Evidence for distributed sensory timing mechanisms

Accurate time perception is critical for a number of human behaviours, such as understanding speech and the appreciation of music. However, it remains unresolved whether sensory time perception is mediated by a central timing component regulating all senses, or by a set of distributed mechanisms, each dedicated to a single sensory modality and operating in a largely independent manner. To address this issue, we conducted a range of unimodal and cross-modal rate adaptation experiments, in order to establish the degree of specificity of classical after-effects of sensory adaptation. Adapting to a fast rate of sensory stimulation typically makes a moderate rate appear slower (repulsive after-effect), and vice versa. A central timing hypothesis predicts general transfer of adaptation effects across modalities, whilst distributed mechanisms predict a high degree of sensory selectivity. Rate perception was quantified by a method of temporal reproduction across all combinations of visual, auditory and tactile senses. Robust repulsive after-effects were observed in all unimodal rate conditions, but were not observed for any cross-modal pairings. Our results show that sensory timing abilities are adaptable but, crucially, that this change is modality-specific - an outcome that is consistent with a distributed sensory timing hypothesis.

Action Recognition in a Crowded Environment.

So far, action recognition has been mainly examined with small point-light human stimuli presented alone within a narrow central area of the observer’s visual field. Yet, we need to recognize the actions of life-size humans viewed alone or surrounded by bystanders, whether they are seen in central or peripheral vision. Here, we examined the mechanisms in central vision and far periphery (40° eccentricity) involved in the recognition of the actions of a life-size actor (target) and their sensitivity to the presence of a crowd surrounding the target. In Experiment 1, we used an action adaptation paradigm to probe whether static or idly moving crowds might interfere with the recognition of a target’s action (hug or clap). We found that this type of crowds whose movements were dissimilar to the target action hardly affected action recognition in central and peripheral vision. In Experiment 2, we examined whether crowd actions that were more similar to the target actions affected action recognition. Indeed, the presence of that crowd diminished adaptation aftereffects in central vision as wells as in the periphery. We replicated Experiment 2 using a recognition task instead of an adaptation paradigm. With this task, we found evidence of decreased action recognition accuracy, but this was significant in peripheral vision only. Our results suggest that the presence of a crowd carrying out actions similar to that of the target affects its recognition. We outline how these results can be understood in terms of high-level crowding effects that operate on action-sensitive perceptual channels.

The involvement of centralized and distributed processes in sub-second time interval adaptation: an ERP investigation of apparent motion.

Accumulating evidence suggests that the timing of brief stationary sounds affects visual motion perception. Recent studies have shown that auditory time interval can alter apparent motion perception not only through concurrent stimulation but also through brief adaptation. The adaptation after-effects for auditory time intervals was found to be similar to those for visual time intervals, suggesting the involvement of a central timing mechanism. To understand the nature of cortical processes underlying such after-effects, we adapted observers to different time intervals using either brief sounds or visual flashes and examined the evoked activity to the subsequently presented visual apparent motion. Both auditory and visual time interval adaptation led to significant changes in the ERPs elicited by the apparent motion. However, the changes induced by each modality were in the opposite direction. Also, they mainly occurred in different time windows and clustered over distinct scalp sites. The effects of auditory time interval adaptation were centred over parietal and parieto-central electrodes while the visual adaptation effects were mostly over occipital and parieto-occipital regions. Moreover, the changes were much more salient when sounds were used during the adaptation phase. Taken together, our findings within the context of visual motion point to auditory dominance in the temporal domain and highlight the distinct nature of the sensory processes involved in auditory and visual time interval adaptation.

Error correction and spatial generalization in human grasp control

The visual processes that support grasp planning are often studied by analyzing averaged kinematics of repeated movements, as in the literature on grasping and visual illusions. However, by recalibrating visuomotor mappings, the sensorimotor system can adjust motor outputs without changing visual processing, which complicates the interpretation of averaged behavior. We developed a dynamic model of grasp planning and adaptation that can explain why some studies find decrements in illusion effects on grasping while others do not. In two experiments, we tested grasping in a standard three-phase adaptation paradigm and analyzed adaptation aftereffects on the maximum grip aperture as well as the error correction parameters estimated by our model. Experiment 1 demonstrated that the model accounts for adaptive responses to positive and negative visual size perturbations. Experiment 2 supported the novel hypothesis that visuomotor mappings for grasp planning can compensate for opposing size perturbations when these perturbations are experienced in separate regions of space. Our findings serve to illustrate how the surprising flexibility of grasp adaptation can hide (especially in session-wise averages) the true effects of visual perturbations on the visual processes that drive grasp planning.

Mentalizing Another's Visual World-A Novel Exploration via Motion Aftereffect.

Past research on level 2 visual perspective-taking (VPT) has mostly focused on understanding the mental rotation involved when one adopts others' perspective; the mechanisms underlying how the visual world of others is mentally represented remain unclear. In three studies, we addressed this question by adopting a novel VPT task with motion stimuli and exploring the aftereffect on motion discrimination from the self-perspective. Overall the results showed a facilitation aftereffect when participants were instructed to take the avatar's perspective. Meanwhile, participants' self-reported perspective-taking tendencies correlated with the aftereffect for both instructed and spontaneous VPT tasks, when the “to-be-adopted” perspective required the participants to mentally transform their self-body clockwise. Specifically, while facilitation was induced for participants with low self-reported perspective-taking tendencies (e.g., viewing a leftward motion stimulus under another's perspective enhanced subsequent perception of leftward motion from the self-perspective), those with high self-reported perspective-taking tendencies showed an adaptation aftereffect (e.g., viewing a leftward motion stimulus under another's perspective weakened subsequent perception of leftward motion from the self-perspective). For these individuals, the adaptation effect indicated the engagement of direction-selective neurons in processing of the subsequent congruent-direction motion from self's perspective. These findings suggest that motion perception from different perspectives (self vs. another) may share the same direction-selective neural circuitry, and this possibility depends on observers' general perspective-taking tendencies.

Properties of intermodal transfer after dual visuo- and auditory-motor adaptation

Previous work documented that sensorimotor adaptation transfers between sensory modalities: When subjects adapt with one arm to a visuomotor distortion while responding to visual targets, they also appear to be adapted when they are subsequently tested with auditory targets. Vice versa, when they adapt to an auditory-motor distortion while pointing to auditory targets, they appear to be adapted when they are subsequently tested with visual targets. Therefore, it was concluded that visuomotor as well as auditory-motor adaptation use the same adaptation mechanism. Furthermore, it has been proposed that sensory information from the trained modality is weighted larger than sensory information from an untrained one, because transfer between sensory modalities is incomplete. The present study tested these hypotheses for dual arm adaptation. One arm adapted to an auditory-motor distortion and the other either to an opposite directed auditory-motor or visuomotor distortion. We found that both arms adapted significantly. However, compared to reference data on single arm adaptation, adaptation in the dominant arm was reduced indicating interference from the non-dominant to the dominant arm. We further found that arm-specific aftereffects of adaptation, which reflect recalibration of sensorimotor transformation rules, were stronger or equally strong when targets were presented in the previously adapted compared to the non-adapted sensory modality, even when one arm adapted visually and the other auditorily. The findings are discussed with respect to a recently published schematic model on sensorimotor adaptation.

Adaptation to Skew Distortions of Natural Scenes and Retinal Specificity of Its Aftereffects.

Image skew is one of the prominent distortions that exist in optical elements, such as in spectacle lenses. The present study evaluates adaptation to image skew in dynamic natural images. Moreover, the cortical levels involved in skew coding were probed using retinal specificity of skew adaptation aftereffects. Left and right skewed natural image sequences were shown to observers as adapting stimuli. The point of subjective equality (PSE), i.e., the skew amplitude in simple geometrical patterns that is perceived to be unskewed, was used to quantify the aftereffect of each adapting skew direction. The PSE, in a two-alternative forced choice paradigm, shifted toward the adapting skew direction. Moreover, significant adaptation aftereffects were obtained not only at adapted, but also at non-adapted retinal locations during fixation. Skew adaptation information was transferred partially to non-adapted retinal locations. Thus, adaptation to skewed natural scenes induces coordinated plasticity in lower and higher cortical areas of the visual pathway.

What role for prism adaptation in the rehabilitation of pure neglect dyslexia?

ABSTRACTPrism adaptation (PA) has been successfully applied in the rehabilitation of spatial neglect, with significant transfer to classic neglect tests and activities of daily living. However, well-controlled studies were unable to replicate these findings, and recent reports suggest that PA may affect selectively visuo-motor symptoms. Here, a patient with pure left neglect dyslexia was tested before, immediately after, and 24 h after PA. Despite a significant adaptation aftereffect adaptation had no effect omissions, substitutions and letter-based errors. PA does not affect pure neglect dyslexia and should therefore be reserved for the rehabilitation of motor-intentional, rather than visual-attentional symptoms.

Impaired processing of facial happiness, with or without awareness, in developmental prosopagnosia.

Developmental prosopagnosia (DP) is associated with severe, lifelong deficits in face recognition, with such cases often cited as support for a dissociation between the processing of facial identity and emotion. Here we examine the evidence against this dissociation and propose that the processing of facial happiness, either with or without awareness, is actually integrated within the same neural network involved in facial identity recognition. We also test this hypothesis on a group of DP cases and neurotypical controls (NT) by adapting them to expressionless neutral faces, intact happy faces and hybrid faces. Despite these hybrid faces being explicitly identified as expressionless due to their higher spatial frequencies taken from a neutral face, their low spatial frequencies convey happy facial expressions that participants are unaware of. After adaptation, participants were asked to judge the facial expressions of face stimuli that were morphed incrementally in varying degrees of sad through to happy. Both groups exhibited emotion adaptation aftereffects to the intact happy faces, although this effect was smaller in DP. Whereas NT produced emotion adaptation aftereffects without awareness of the happy emotion in the hybrid faces; as a group, those with DP did not. Furthermore, our DP cases also exhibited deficits in judging the emotion of the happiest morphed test faces. Our results indicate that the processing of happy facial expressions, with or without awareness, is likely integrated within the face recognition network. We hypothesise that the previously identified abnormalities in the fusiform gyrus in those with DP is the most likely structure responsible for these deficits.

Intensity dependence in high-level facial expression adaptation aftereffect.

Perception of a facial expression can be altered or biased by a prolonged viewing of other facial expressions, known as the facial expression adaptation aftereffect (FEAA). Recent studies using antiexpressions have demonstrated a monotonic relation between the magnitude of the FEAA and adaptor extremity, suggesting that facial expressions are opponent coded and represented continuously from one expression to its antiexpression. However, it is unclear whether the opponent-coding scheme can account for the FEAA between two facial expressions. In the current study, we demonstrated that the magnitude of the FEAA between two facial expressions increased monotonically as a function of the intensity of adapting facial expressions, consistent with the predictions based on the opponent-coding model. Further, the monotonic increase in the FEAA occurred even when the intensity of an adapting face was too weak for its expression to be recognized. These results together suggest that multiple facial expressions are encoded and represented by balanced activity of neural populations tuned to different facial expressions.

Predictive feature remapping before saccadic eye movements.

Saccadic eye movements cause rapid and dramatic displacements of the retinal image of the visual world, yet our conscious perception of the world remains stable and continuous. A popular explanation for this remarkable ability of our visual system to compensate for the displacements is the predictive feature remapping theory. The theory proposes that, before saccades, the representation of a visual stimulus can be predictively transferred from neurons that initially encode the stimulus to neurons whose receptive fields will encompass the stimulus location after the saccade. Visual adaptation aftereffect experiments performed by Melcher (2007) provided psychophysical evidence for this theory. However, it was argued that the visual aftereffects were not measured at the "appropriate" remapped location (Rolfs, Jonikaitis, Deubel, & Cavanagh, 2011). Therefore, whether the remapped representation contains feature information (e.g., orientation, motion direction, or contrast) is still a subject of intense debate. Here, to explore the nature of the predictive transfer during trans-saccadic perception, we measured visual aftereffects (tilt aftereffect, motion aftereffect, and threshold elevation aftereffect) at the appropriate remapped location of adapting stimuli before saccades. We observed a significant tilt aftereffect and motion aftereffect, but little threshold elevation aftereffect. Furthermore, the tilt aftereffect and motion aftereffect exhibited spatial specificity. These findings provide strong evidence for the predictive feature remapping theory and suggest that intermediate visual processing stages (i.e., extrastriate visual cortex) might be critical for feature remapping. Finally, we propose that the feature remapping process might also contribute to the spatiotopic representation of visual features.

Adaptation of social and non-social cues to direction in adults with autism spectrum disorder and neurotypical adults with autistic traits

Perceptual constancy strongly relies on adaptive gain control mechanisms, which shift perception as a function of recent sensory history. Here we examined the extent to which individual differences in magnitude of adaptation aftereffects for social and non-social directional cues are related to autistic traits and sensory sensitivity in healthy participants (Experiment 1); and also whether adaptation for social and non-social directional cues is differentially impacted in adults with Autism Spectrum Disorder (ASD) relative to neurotypical (NT) controls (Experiment 2). In Experiment 1, individuals with lower susceptibility to adaptation aftereffects, i.e. more ‘veridical’ perception, showed higher levels of autistic traits across social and non-social stimuli. Furthermore, adaptation aftereffects were predictive of sensory sensitivity. In Experiment 2, only adaptation to eye-gaze was diminished in adults with ASD, and this was related to difficulties categorizing eye-gaze direction at baseline. Autism Diagnostic Observation Schedule (ADOS) scores negatively predicted lower adaptation for social (head and eye-gaze direction) but not non-social (chair) stimuli. These results suggest that the relationship between adaptation and the broad socio-cognitive processing style captured by ‘autistic traits’ may be relatively domain-general, but in adults with ASD diminished adaptation is only apparent where processing is most severely impacted, such as the perception of social attention cues.