Motion Perception Research Articles

Regenerative Therapy Approaches and Encountered Problems in Sensorineural Hearing Loss.

Hearing loss is one of the most important public health matters worldwide, severely affecting people's social, psychological, and cognitive development. The perception of sound, movement, and balance in vertebrates depends on a special sensory organ called the cochlea, which contains hair cells and supporting cells in the inner ear. Genetic factors, epigenetics, the use of ototoxic drugs (some antibiotics and chemotherapeutics), noise, infections, or even aging can cause loss of hair cells and their related primary neurons, leading to sensorineural hearing loss. Although a sensorineural hearing loss, also known as permanent hearing loss, is treated with hearing aids and cochlear implants, treatment methods are limited. Since even the best implant cannot exhibit the characteristics of the original ear, the permanent sensory deficit will be permanent. For this reason, it has become important to develop regenerative treatment methods to regenerate and replace lost or damaged hair cells and neurons. Developments in stem cell technology have led to promising studies in regenerating damaged/lost hair cells or neurons with endogenous or exogenous cell-based therapies. Epigenetic mechanisms can turn hearing-related genes on and off and determine which proteins to copy. In addition, due to gene silencing, gene replacement, and CRISPR/CAS9 technology, gene therapy methods have accelerated, and studies have been carried out to treat dominant and recessive mutations that cause genetic-induced hearing loss or increase hair cell regeneration. In this paper, potential gene therapy and stem cell applications in the acquisition of cochlear function, which causes sensorineural hearing loss, and the difficulties encountered in these applications are compiled from a bioengineering perspective.

Visual boundaries in sign motion: processing with and without lip-reading cues

Sign languages demonstrate a higher degree of iconicity than spoken languages. Studies on a number of unrelated sign languages show that the event structure of verb signs is reflected in the phonological form of the signs (Wilbur (2008), Malaia & Wilbur (2012), Krebs et al. (2021)). Previous research showed that hearing non-signers (with no prior exposure to sign language) can use the iconicity inherent in the visual dynamics of a verb sign to correctly identify its event structure (telic vs. atelic). In two EEG experiments, hearing non-signers were presented with telic and atelic verb signs unfamiliar to them, which they had to classify in a two-choice lexical decision task in their native language. The first experiment assessed the timeline of neural processing mechanisms in non-signers processing telic/atelic signs without access to lip-reading cues in their native language, to understand the pathways for incorporation of physical perceptual motion features into linguistic processing. The second experiment further probed the impact of visual information provided by lip-reading (speech decoding based on visual information from the face of the speaker, most importantly, the lips) on the processing of telic/atelic signs in non-signers.

Recognising visual perception issues in people with learning disabilities

Sight issues, which can be eye-related or brain-related, are common among people with learning disabilities. Premature birth or subsequent developmental delays can cause damage to the areas of the brain that process vision, leading to cortical visual impairment. Eye-related and brain-related sight issues can manifest as impaired visual perception causing, for example, difficulties with light perception, colour perception, object perception or movement perception. People with learning disabilities may display behaviours indicative of visual perception issues, but such behaviours are often ignored or misinterpreted. This article explains the causes and consequences of cortical visual impairment, describes visual perception issues that commonly arise from ocular/retinal or cortical causes, and outlines how learning disability nurses can detect the presence of visual perception issues in service users.

Form Properties of Moving Targets Bias Smooth Pursuit Target Selection in Monkeys.

During natural viewing, we often recognize multiple objects, detect their motion, and select one object as the target to track. It remains to be determined how such behavior is guided by the integration of visual form and motion perception. To address this, we studied how monkeys made a choice to track moving targets with different forms by smooth pursuit eye movements in a two-target task. We found that pursuit responses were biased toward the motion direction of a target with a hole. By computing the relative weighting, we found that the target with a hole exhibited a larger weight for vector computation. The global hole feature dominated other form properties. This dominance failed to account for changes in pursuit responses to a target with different forms moving singly. These findings suggest that the integration of visual form and motion perception can reshape the competition in sensorimotor networks to guide behavioral selection.

The Associations between Results in Different Domains of Cognitive and Psychomotor Abilities Measured in Medical Students.

We aimed to investigate the associations between intelligence quotient test scores obtained using the Raven's Advanced Progressive Matrices (APM) and psychomotor testing using the Complex Reactionmeter Drenovac (CRD) test battery, while taking into account previous theoretical approaches recognizing intelligent behavior as the cumulative result of a general biological speed factor reflected in the reaction time for perceptual detections and motor decisions. A total of 224 medical students at the University of Split School of Medicine were recruited. Their IQ scores were assessed using Raven's APM, while the computerized tests of CRD-series were used for testing the reaction time of perception to visual stimulus (CRD311), psychomotor limbs coordination task (CRD411), and solving simple arithmetic operations (CRD11). The total test-solving (TTST) and the minimum single-task-solving (MinT) times were analyzed. On the CRD11 test, task-solving times were shorter in students with higher APM scores (r = -0.48 for TTST and r = -0.44 for MinT; p < 0.001 for both). Negative associations between task-solving times and APM scores were reported on CRD311 (r = -0.30 for TTST and r = -0.33 for MinT, p < 0.001 for both). Negative associations between task-solving times in CRD411 and APM scores (r = -0.40 for TTST and r = -0.30 for MinT, p < 0.001 for both) were found. Faster reaction time in psychomotor limbs coordination tasks, the reaction time of perception to visual stimulus, and the reaction time of solving simple arithmetic operations were associated with a higher APM score in medical students, indicating the importance of mental speed in intelligence test performance. However, executive system functions, such as attention, planning, and goal weighting, might also impact cognitive abilities and should be considered in future research.

Cortical encoding of rhythmic kinematic structures in biological motion

Biological motion (BM) perception is of great survival value to human beings. The critical characteristics of BM information lie in kinematic cues containing rhythmic structures. However, how rhythmic kinematic structures of BM are dynamically represented in the brain and contribute to visual BM processing remains largely unknown. Here, we probed this issue in three experiments using electroencephalogram (EEG). We found that neural oscillations of observers entrained to the hierarchical kinematic structures of the BM sequences (i.e., step-cycle and gait-cycle for point-light walkers). Notably, only the cortical tracking of the higher-level rhythmic structure (i.e., gait-cycle) exhibited a BM processing specificity, manifested by enhanced neural responses to upright over inverted BM stimuli. This effect could be extended to different motion types and tasks, with its strength positively correlated with the perceptual sensitivity to BM stimuli at the right temporal brain region dedicated to visual BM processing. Modeling results further suggest that the neural encoding of spatiotemporally integrative kinematic cues, in particular the opponent motions of bilateral limbs, drives the selective cortical tracking of BM information. These findings underscore the existence of a cortical mechanism that encodes periodic kinematic features of body movements, which underlies the dynamic construction of visual BM perception.

Effect of a False Inertial Cue in the Velocity-Storage Circuit on Head Posture and Inertia Perception.

The velocity-storage circuit participates in the vestibulopostural reflex, but its role in the postural reflex requires further elucidation. The velocity-storage circuit differentiates gravitoinertial information into gravitational and inertial cues using rotational cues. This implies that a false rotational cue can cause an erroneous estimation of gravity and inertial cues. We hypothesized the velocity-storage circuit is a common gateway for all vestibular reflex pathways and tested that hypothesis by measuring the postural and perceptual responses from a false inertial cue estimated in the velocity-storage circuit. Twenty healthy human participants (40.5 ± 8.2 years old, 6 men) underwent two different sessions of earth-vertical axis rotations at 120°/s for 60 s. During each session, the participants were rotated clockwise and then counterclockwise with two different starting head positions (head-down and head-up). During the first (control) session, the participants kept a steady head position at the end of rotation. During the second (test) session, the participants changed their head position at the end of rotation, from head-down to head-up or vice versa. The head position and inertial motion perception at the end of rotation were aligned with the inertia direction anticipated by the velocity-storage model. The participants showed a significant correlation between postural and perceptual responses. The velocity-storage circuit appears to be a shared neural integrator for the vestibulopostural reflex and vestibular perception. Because the postural responses depended on the inertial direction, the postural instability in vestibular disorders may be the consequence of the vestibulopostural reflex responding to centrally estimated false vestibular cues.SIGNIFICANCE STATEMENT The velocity-storage circuit appears to participate in the vestibulopostural reflex, which stabilizes the head and body position in space. However, it is still unclear whether the velocity-storage circuit for the postural reflex is in common with that involved in eye movement and perception. We evaluated the postural and perceptual responses to a false inertial cue estimated by the velocity-storage circuit. The postural and perceptual responses were consistent with the inertia direction predicted in the velocity-storage model and were correlated closely with each other. These results show that the velocity-storage circuit is a shared neural integrator for vestibular-driven responses and suggest that the vestibulopostural response to a false vestibular cue is the pathomechanism of postural instability clinically observed in vestibular disorders.

Position representations of moving objects align with real-time position in the early visual response.

When interacting with the dynamic world, the brain receives outdated sensory information, due to the time required for neural transmission and processing. In motion perception, the brain may overcome these fundamental delays through predictively encoding the position of moving objects using information from their past trajectories. In the present study, we evaluated this proposition using multivariate analysis of high temporal resolution electroencephalographic data. We tracked neural position representations of moving objects at different stages of visual processing, relative to the real-time position of the object. During early stimulus-evoked activity, position representations of moving objects were activated substantially earlier than the equivalent activity evoked by unpredictable flashes, aligning the earliest representations of moving stimuli with their real-time positions. These findings indicate that the predictability of straight trajectories enables full compensation for the neural delays accumulated early in stimulus processing, but that delays still accumulate across later stages of cortical processing.

An attention-based deep learning approach for inertial motion recognition and estimation in human-robot collaboration

In line with a human-centric smart manufacturing vision, human-robot collaboration is striving to combine robots’ high efficiency and quality with humans’ rapid adaptability and high flexibility. In particular, perception, recognition and estimation of human motion determine when and what robot to collaborate with humans. This work presents an attention-based deep learning approach for inertial motion recognition and estimation in order to infer when robotic assistance will be requested by the human and to allow the robot to perform partial human tasks. First, in the stage of motion perception and recognition, quaternion-based calibration and forward kinematic analysis methods enable the reconstruction of human motion based on data streaming from an inertial motion capture device. Then, in the stage of motion estimation, residual module and Bidirectional Long Short-Term Memory module are integrated with proposed attention mechanism for estimating arm motion trajectories further. Experimental results show the effectiveness of the proposed approach in achieving better recognition and estimation in comparison with traditional approaches and existing deep learning approaches. It is experimentally verified in a laboratory environment involving a collaborative robot employed in a small part assembly task.

The accuracy of object motion perception during locomotion.

Human observers are capable of perceiving the motion of moving objects relative to the stationary world, even while undergoing self-motion. Perceiving world-relative object motion is complicated because the local optical motion of objects is influenced by both observer and object motion, and reflects object motion in observer coordinates. It has been proposed that observers recover world-relative object motion using global optic flow to factor out the influence of self-motion. However, object-motion judgments during simulated self-motion are biased, as if the visual system cannot completely compensate for the influence of self-motion. Recently, Xie et al. demonstrated that humans are capable of accurately judging world-relative object motion when self-motion is real, actively generated by walking, and accompanied by optic flow. However, the conditions used in that study differ from those found in the real world in that the moving object was a small dot with negligible optical expansion that moved at a fixed speed in retinal (rather than world) coordinates and was only visible for 500 ms. The present study investigated the accuracy of object motion perception under more ecologically valid conditions. Subjects judged the trajectory of an object that moved through a virtual environment viewed through a head-mounted display. Judgments exhibited bias in the case of simulated self-motion but were accurate when self-motion was real, actively generated, and accompanied by optic flow. The findings are largely consistent with the conclusions of Xie et al. and demonstrate that observers are capable of accurately perceiving world-relative object motion under ecologically valid conditions.

Avoiding virtual humans in a constrained environment: Exploration of novel behavioural measures

In computer animation, the creation of believable and engaging virtual characters has been a long-lasting endeavour. While researchers investigated several aspects of character design, not many studies focused on the qualities of biological human motion itself. We approached the perception of motion from the perspective of distinct movement patterns which can be observed on people with neurotic and emotionally stable personality traits. We designed an experiment in virtual reality, using a photo-realistic metro scenario, where we studied the avoidance behaviour of participants when encountering these two types of virtual characters in a constrained environment. We also make a contribution by successfully implementing two behavioural measures in particular: a choice task, and a novel ‘turning point’ metric, which calculates the point in the trajectory when people turned to avoid the character. Our results indicate that users’ behaviour is affected by character’s motion and we propose the use of these behavioural measures to investigate other aspects of character motion in future research.

Developmental differences in the perception of naturalistic human movements.

It is widely believed that we are more attentive towards moving versus static stimuli. However, the neural correlates underlying the perception of human movements have not been extensively investigated in ecologically valid settings, nor has the developmental aspect of this phenomenon. Here, we set forth to investigate how human limb movements displayed in naturalistic videos influence the attentional engagement of children and young adults. Thirty-nine healthy participants (4-26 years old) were presented with naturalistic videos featuring human goal-directed movements, while neural activity was recorded using electroencephalography (EEG). Video scenes were automatically annotated as containing arm, leg or no movement, using a machine learning algorithm. The viewers' attentional engagement was quantified by the intersubject correlation of EEG responses evoked by the videos. Our results demonstrate that scenes featuring limb movements, especially simultaneous arm and leg movements, elicit higher attentional engagement than scenes with no limb movement. Interestingly, this effect was found to diminish with age. Overall, our findings extend previous work on the perception of human motion by implementing naturalistic stimuli in the experimental design and extend the list of factors influencing the viewer's engagement exerted by naturalistic videos.

Atypical influence of biomechanical knowledge in Complex Regional Pain Syndrome-towards a different perspective on body representation

Part of the multifaceted pathophysiology of Complex Regional Pain Syndrome (CRPS) is ascribed to lateralized maladaptive neuroplasticity in sensorimotor cortices, corroborated by behavioral studies indicating that patients present difficulties in mentally representing their painful limb. Such difficulties are widely measured with hand laterality judgment tasks (HLT), which are also used in the rehabilitation of CRPS to activate motor imagery and restore the cortical representation of the painful limb. The potential of these tasks to elicit motor imagery is critical to their use in therapy, yet, the influence of the body’s biomechanical constraints (BMC) on HLT reaction time, supposed to index motor imagery activation, is rarely verified. Here we investigated the influence of BMC on the perception of hand postures and movements in upper-limb CRPS. Patients were slower than controls in judging hand laterality, whether or not stimuli corresponded to their painful hand. Reaction time patterns reflecting BMC were mostly absent in CRPS and controls. A second experiment therefore directly investigated the influence of implicit knowledge of BMC on hand movement judgments. Participants judged the perceived path of movement between two depicted hand positions, with only one of two proposed paths that was biomechanically plausible. While the controls mostly chose the biomechanically plausible path, patients did not. These findings show non-lateralized body representation impairments in CRPS, possibly related to difficulties in using correct knowledge of the body’s biomechanics. Importantly, they demonstrate the challenge of reliably measuring motor imagery with the HLT, which has important implications for the rehabilitation with these tasks.

Naïve Observers and Art Experts Rate Irregular Stochastic Pictures More Dynamic and Beautiful

Abstract Several artists, neuroscientists, and art psychologists have investigated the existence of a relationship between perceived motion and beauty in figurative and abstract paintings. In our study, we created stimulus pictures by combining the same matrices, consisting of modular stochastic polygons, to obtain regular (translational symmetry) and irregular (non-symmetry) combinations. Some of these combinations consisted of many small matrices, making it difficult to read the ‘shapes’ of stochastic polygons. Our sample consisted of both art experts and non-art experts. We hypothesised that irregular combinations, with fewer and greater numbers of the same matrices, would have stimulated more perception of motion, complexity and beauty than regular compositions. Results showed that stochastic irregular combinations are generally dynamic, more complex, and more aesthetically pleasing than stochastic regular compositions. Perhaps the greater dynamism of irregular combinations influences beauty evaluation for compositions with stochastic matrices. Research has shown that specific artistic competence influences the assessment of irregular or asymmetrical stimuli as beautiful. Our study, on the other hand, shows that irregular stochastic combinations are more beautiful for both art experts and non-experts.

Journey through a virtual tunnel: Simulated motion and its effects on the experience of time

This paper examines the relationship between time and motion perception in virtual environments. Previous work has shown that the perception of motion can affect the perception of time. We developed a virtual environment that simulates motion in a tunnel and measured its effects on the estimation of the duration of time, the speed at which perceived time passes, and the illusion of self-motion, also known as vection. When large areas of the visual field move in the same direction, vection can occur; observers often perceive this as self-motion rather than motion of the environment. To generate different levels of vection and investigate its effects on time perception, we developed an abstract procedural tunnel generator. The generator can simulate different speeds and densities of tunnel sections (visibly distinguishable sections that form the virtual tunnel), as well as the degree of embodiment of the user avatar (with or without virtual hands). We exposed participants to various tunnel simulations with different durations, speeds, and densities in a remote desktop and a virtual reality (VR) laboratory study. Time passed subjectively faster under high-speed and high-density conditions in both studies. The experience of self-motion was also stronger under high-speed and high-density conditions. Both studies revealed a significant correlation between the perceived passage of time and perceived self-motion. Subjects in the virtual reality study reported a stronger self-motion experience, a faster perceived passage of time, and shorter time estimates than subjects in the desktop study. Our results suggest that a virtual tunnel simulation can manipulate time perception in virtual reality. We will explore these results for the development of virtual reality applications for therapeutic approaches in our future work. This could be particularly useful in treating disorders like depression, autism, and schizophrenia, which are known to be associated with distortions in time perception. For example, the tunnel could be therapeutically applied by resetting patients’ time perceptions by exposing them to the tunnel under different conditions, such as increasing or decreasing perceived time.

The Effect of Somatosensory Input on Word Recognition in Typical Children and Those With Speech Sound Disorder.

Recent work suggests that speech perception is influenced by the somatosensory system and that oral sensorimotor disruption has specific effects on the perception of speech both in infants who have not yet begun to talk and in older children and adults with ample speech production experience; however, we do not know how such disruptions affect children with speech sound disorder (SSD). Response to disruption of would-be articulators during speech perception could reveal how sensorimotor linkages work for both typical and atypical speech and language development. Such linkages are crucial to advancing our knowledge on how both typically developing and atypically developing children produce and perceive speech. Using a looking-while-listening task, we explored the impact of a sensorimotor restrictor on the recognition of words whose onsets involve late-developing sounds (s, ʃ) for both children with typical development (TD) and their peers with SSD. Children with SSD showed a decrement in performance when they held a restrictor in their mouths during the task, but this was not the case for children with TD. This effect on performance was only observed for the specific speech sounds blocked by the would-be articulators. We argue that these findings provide evidence for altered perceptual motor pathways in children with SSD. https://doi.org/10.23641/asha.21809442.

The gender-based facing bias in 3-D biological motion perception.

In biological motion perception, movements of several point lights can evoke a vivid impression of living animals, including humans. Recent studies have reported that male point-light walkers tend to be perceived as facing toward the viewer more than female walkers, and have hypothesized that the gender-based facing bias arises from motion signals. The purpose of this study was to test this hypothesis under experimental conditions where binocular disparity was added to biological motion stimuli. In the two experiments reported here, participants were presented with disparity-defined female and male point-light figures facing toward or away from the viewer. In Experiment 1, we measured "facing-the-viewer" responses in upright and inverted walker configurations. It was found that the facing bias was greater for the male walker than for the female walker in most disparity magnitudes, regardless of walker inversion. In Experiment 2, the walker stimuli were replaced by static snapshots of the walkers. The results showed that the facing bias did not differ between the female and male static figures. These results suggest that motion signals play an important role in producing the gender-based facing bias, even when binocular disparity is added to biological motion stimuli.

Interaction between spatial perception and temporal perception enables preservation of cause-effect relationship: Visual psychophysics and neuronal dynamics.

Visual perception of moving objects is integral to our day-to-day life, integrating visual spatial and temporal perception. Most research studies have focused on finding the brain regions activated during motion perception. However, an empirically validated general mathematical model is required to understand the modulation of the motion perception. Here, we develop a mathematical formulation of the modulation of the perception of a moving object due to a change in speed, under the formulation of the invariance of causality. We formulated the perception of a moving object as the coordinate transformation from a retinotopic space onto perceptual space and derived a quantitative relationship between spatiotemporal coordinates. To validate our model, we undertook the analysis of two experiments: (i) the perceived length of the moving arc, and (ii) the perceived time while observing moving stimuli. We performed a magnetic resonance imaging (MRI) tractography investigation of subjects to demarcate the anatomical correlation of the modulation of the perception of moving objects. Our theoretical model shows that the interaction between visual-spatial and temporal perception, during the perception of moving object is described by coupled linear equations; and experimental observations validate our model. We observed that cerebral area V5 may be an anatomical correlate for this interaction. The physiological basis of interaction is shown by a Lotka-Volterra system delineating interplay between acetylcholine and dopamine neurotransmitters, whose concentrations vary periodically with the orthogonal phase shift between them, occurring at the axodendritic synapse of complex cells at area V5. Under the invariance of causality in the representation of events in retinotopic space and perceptual space, the speed modulates the perception of a moving object. This modulation may be due to variations of the tuning properties of complex cells at area V5 due to the dynamic interaction between acetylcholine and dopamine. Our analysis is the first significant study, to our knowledge, that establishes a mathematical linkage between motion perception and causality invariance.

THE ACUTE EFFECT OF TISSUE FLOSSING ON PAIN, FUNCTION, AND PERCEPTION OF MOVEMENT

THE ACUTE EFFECT OF TISSUE FLOSSING ON PAIN, FUNCTION, AND PERCEPTION OF MOVEMENT

Prosthetic finger for fingertip tactile sensing via flexible chromatic optical waveguides.

Building prosthetics indistinguishable from human limbs to accurately receive and transmit sensory information to users not only promises to radically improve the lives of amputees, but also shows potential in a range of robotic applications. Currently, a mainstream approach is to embed electrical or optical sensors with force/thermal sensing functions on the surface or inside of prosthetic fingers. Compared with electrical sensing technologies, tactile sensors based on stretchable optical waveguides have the advantages of easy fabrication, chemical safety, environmental stability, and compatibility with prosthetic structural materials. However, so far, research has mainly focused on the perception of finger joint motion or external press, and there is still a lack of study on optical sensors with fingertip tactile capabilities (such as texture, hardness, slip detection, etc.). Here we report a 3D printing prosthetic finger with flexible chromatic optical waveguides implanted at the fingertip. The finger achieves distributed displacement/force sensing detection, and exhibits high sensitivity, fast response and good stability. The finger can be used to conduct active sensory experiments, and the detection parameters include object contour, hardness, slip direction and speed, temperature, etc. Finally, exploratory research on identifying and manipulating objects is carried out with this finger. The developed prosthetic finger can artificially recreate touch perception and realize complex functions such as note-writing analysis and braille recognition.