Visual Cognitive Processing Research Articles

Perceptual decision-making in autism as assessed by “spot the difference” visual cognition tasks

Discriminating between similar figures proves to be a remarkably demanding task due to the limited capacity of our visual cognitive processes. Here we examine how perceptual inference and decision-making are modulated by differences arising from neurodiversity. A large sample of autistic (n = 140) and typical (n = 147) participants completed two forced choice similarity judgement tasks online. Each task consisted of “match” (identical figures) and “mismatch” (subtle differences between figures) conditions. Signal detection theory analyses indicated a response bias by the autism group during conditions of uncertainty. More specifically, autistic participants were more likely to choose the “mismatch” option, thus leading to more hits on the “mismatch” condition, but also more false alarms on the “match” condition. These results suggest differences in response strategies during perceptual decision-making in autism.

In-sensor image memorization and encoding via optical neurons for bio-stimulus domain reduction toward visual cognitive processing

As machine vision technology generates large amounts of data from sensors, it requires efficient computational systems for visual cognitive processing. Recently, in-sensor computing systems have emerged as a potential solution for reducing unnecessary data transfer and realizing fast and energy-efficient visual cognitive processing. However, they still lack the capability to process stored images directly within the sensor. Here, we demonstrate a heterogeneously integrated 1-photodiode and 1 memristor (1P-1R) crossbar for in-sensor visual cognitive processing, emulating a mammalian image encoding process to extract features from the input images. Unlike other neuromorphic vision processes, the trained weight values are applied as an input voltage to the image-saved crossbar array instead of storing the weight value in the memristors, realizing the in-sensor computing paradigm. We believe the heterogeneously integrated in-sensor computing platform provides an advanced architecture for real-time and data-intensive machine-vision applications via bio-stimulus domain reduction.

Hardware and software complex for the detection and identification of informative features in images of means of nonverbal communication

Subject of study. Techniques for identifying informative features in dynamic images (video) of means of nonverbal communication of operators during a joint constructive activity were the subject of this study. Aim of study. This study aimed to develop methods for detecting and identifying significant features of nonverbal communication in the received dynamic (video) images of faces of partners, i.e., key features in the joint activity of partners upon disabling the verbal communication channel. Method. A technique for interaction was developed, with a hardware and software complex designed for identifying communication markers in images of facial expressions and eye movements of partners during a joint play activity, in which nonverbal communication is a key aspect and the speech communication channel is disabled. The joint activity involved one partner searching for a hidden target in the perceived image using a nonverbal clue from the second partner, who views the target position on his screen. Partners were chosen among representatives of two geographically distant cultures—Russian and Chinese. The interactions of the partners during their work with images of the object of activity received via simultaneous video communication in two research centers located in western and eastern Eurasia were evaluated through simultaneously recorded physiological parameters. Main results. A new algorithm for investigating images as a means of nonverbal interaction for ensuring the achievement of a shared goal without the speech communication channel was designed. The effectiveness of eye movements of the partners, which are the key features of nonverbal communication, was demonstrated during the constructive joint activity. The task was presented to Chinese and Russian test subjects in the form of English text. Based on the performed measurements, nonverbal interaction in the task of looking for the target position functions similarly for representatives of both cultures and depends on the roles of the partners and the type of executed task. The correlation between the activities of different neural networks of the brain that ensure the recognition of images during the target search in nonverbal communication was identified. An analysis of the images of eye movement during the communication isolated a classic pattern of eye capture for guided and guiding partners. Constant switching occurs between the assessment of images of partners’ eyes and the target search in the entire image. The obtained results suggest that 1) the cognitive process of recognition of facial expressions is probably the most complex visual cognitive process, and 2) universal behavioral algorithms exist when a common joint activity understandable to both partners is performed. Practical significance. A hardware and software complex for detecting significant features of nonverbal communication in the images of faces was designed. The working capacity of the proposed method for detecting features was demonstrated using clear basic signals of nonverbal communication, thus enabling new methods of training artificial neural networks to ensure intuitive nonverbal communication between machines and humans via the recognition of hidden markers of nonverbal communication.

Comparing Middle School Students’ Scientific Problem-Solving Behavior in Hands-On Manipulation Performance Assessment: Terms by Eye-Tracking Analysis

This study specifically designed an eye-tracking supported scientific problem-solving assessment: hands-on manipulation task system to explore the differences in visual attention and cognitive processes between high and low science achievement groups. Thirteen students with high science achievement and fourteen students with low science achievement participated. Students needed to complete the hands-on manipulation assessment, consisting of three modules, including selecting experimental equipment, experimental design, and building the experimental model. Behavioral and eye movement data were collected during the process. The results showed that the high science achievement group allocated more visual attention to the hands-on manipulation task, acquired more information through visual fixation, and assigned more attention to the key area. In module three of the hands-on manipulation task, the high science achievement group transformed from a visual channel to a tactile channel, and they generated more hands-on behaviors depending on the experimental area. Furthermore, the results showed a high correlation between students’ eye movement behavior and the performance of scientific problem-solving assessments. Eye movement behavior could predict students’ performance in scientific problem-solving. The average fixation duration and the average fixation duration of the interest area were two significant determining parameters. The implications of the experimental results for front-line science education, curriculum designers, and science assessment were also discussed.

Deep Active Visual Attention for Real-Time Robot Motion Generation: Emergence of Tool-Body Assimilation and Adaptive Tool-Use

Sufficiently perceiving the environment is a critical factor in robot motion generation. Although the introduction of deep visual processing models have contributed in extending this ability, existing methods lack in the ability to actively modify what to perceive; humans perform internally during visual cognitive processes. This letter addresses the issue by proposing a novel robot motion generation model, inspired by a human cognitive structure. The model incorporates a state-driven active top-down visual attention module, which acquires attentions that can actively change targets based on task states. We term such attentions as role-based attentions, since the acquired attention directed to targets that shared a coherent role throughout the motion. The model was trained on a robot tool-use task, in which the role-based attentions perceived the robot grippers and tool as identical end-effectors, during object picking and object dragging motions respectively. This is analogous to a biological phenomenon called tool-body assimilation, in which one regards a handled tool as an extension of one’s body. The results suggested an improvement of flexibility in model’s visual perception, which sustained stable attention and motion even if it was provided with untrained tools or exposed to experimenter’s distractions.

Mobile marketing interface layout attributes that affect user aesthetic preference: an eye-tracking study

PurposeThe rapid growth of m-commerce and mobile marketing has flooded the users with homogeneous contents that raise little user interest making the users' browsing pattern on these contents aimless free browsing. However, the interface that presents the mobile marketing contents triggers much user attention, especially the layout. Without significant usability defects, the layout poses influences on the user's aesthetic experience. Identifying the layout attributes that affect user aesthetic preference is critical to the design of mobile marketing interfaces since they influence users' interaction intention, cognitive process, and decision-making.Design/methodology/approachIn this paper, 6 layout attributes that quantify the aesthetic design of the interface layout and 3 eye-movement indicators that connect to human aesthetic preference were identified through literature research. An eye-tracking experiment measuring the 3 eye-movement indicators on 6 pairs of interface layout materials corresponding to the 6 layout attributes was conducted. The experiment was designed to mimic the free browsing context in mobile marketing. The materials were divided into Liked/Disliked preference groups according to the response of the subjects. Analysis of indicators on materials between the L/D groups shows that the attributes of balance, centricity, density, simplicity, and symmetry affect user aesthetic preferences.FindingsAnalysis of the attribute value levels shows that balance, centricity, and density are responsible for addressing users' aesthetic preferences for a disliked interface layout. The study suggests an attribute set for quantitatively optimizing the aesthetic design of mobile marketing system interfaces and provides evidence for the visual attention and cognitive process under the free browsing context.Originality/valueThe study contributes to the field both theoretically and practically: (1) it provides support for optimizing the interface layout of mobile marketing systems quantitatively from the aesthetic perspective. (2) It promotes the cognitive attention theory by providing evidence for the cognitive process of interacting with mobile marketing interfaces from the perspective of visual attention and cognitive fluency. (3) It expands the objects of visual perception from traditional or symbolic artworks (such as logos) to the abstract visual stimuli of interface layout. (4) It suggests an optimization tool of five quantification layout attributes for mobile marketing businesses and platforms to aesthetically improve their marketing interfaces to improve user experiences.

Not any gifted is an expert in mathematics and not any expert in mathematics is gifted

ABSTRACT Mathematical giftedness (MG) is an intriguing phenomenon, the nature of which has yet to be sufficiently explored. This study goes a step further in understanding how MG is related to expertise in mathematics (EM) and general giftedness (G). Cognitive testing was conducted among 197 high school students with different levels of G and of EM. Based on our previous studies, we perceive MG as a combination of G and EM. Exploratory factor analysis of test results revealed five main cognitive factors: visual-serial processing (VSP); arithmetic abilities (AA); pattern recognition (PR); auditory working memory (AWM); visual-spatial working memory (VSWM); and Structural equation modeling (SEM) based on the factor analysis revealed clear differences in the role of cognitive abilities as predictors of EM, G, and MG. The study demonstrates that visual components are especially important for the development of EM and that G students are less dependent on their visual cognitive processing. Based on the study results, we argue that EM, G, and MG, which are often considered equivalent characteristics, are interrelated but different in nature. The paper presents a research-based justification that not any gifted is an expert in mathematics and not any expert in mathematics is gifted.

Research on drivers' hazard perception in plateau environment based on visual characteristics

A good visual search mode is an important prerequisite for a driver to perceive the hazard in the traffic environment timely and accurately. However, hypoxia conditions in the plateau environment might affect drivers' cognitive and judgment ability, posing potential threats to safe driving. This study analyzed the eye movement behaviors of drivers when faced with traffic hazards in the plateau environment, to examine the impact level of altitude on drivers’ perception and reaction. Nine typical traffic hazard scenarios were investigated at four locations with four different altitudes, including Linzhi, Lhasa, Naqu, and Yanghu Scenic Area based on UC-WIN / ROAD driving simulation software. Then, drivers’ visual search modes were analyzed according to drivers’ eye movement data collected by ASL Mobile Eye monocular eye tracker. As the altitude increased, the drivers’ first fixation time and the average saccade amplitude decreased, while the fixation duration percentage increased. Drivers with fewer years of driving experience had a larger percentage of fixation duration and a smaller saccade amplitude. In addition, a shorter acclimation period also negatively influenced the percentage of fixation time. The increase of altitude would weaken the drivers' visual sensitivity and cognitive processing ability of hazard information, which would reduce drivers' hazard perception skills, and the increase of driving experience might help alleviate such negative impacts to some extent. Based on the visual characteristics of traffic hazard scenarios obtained in this paper, the training of highly accident-prone drivers can be guided specifically to improve their visual search strategies, thereby improving driving safety.

Decoding Color Visual Working Memory from EEG Signals Using Graph Convolutional Neural Networks.

Color has an important role in object recognition and visual working memory (VWM). Decoding color VWM in the human brain is helpful to understand the mechanism of visual cognitive process and evaluate memory ability. Recently, several studies showed that color could be decoded from scalp electroencephalogram (EEG) signals during the encoding stage of VWM, which process visible information with strong neural coding. Whether color could be decoded from other VWM processing stages, especially the maintaining stage which processes invisible information, is still unknown. Here, we constructed an EEG color graph convolutional network model (ECo-GCN) to decode colors during different VWM stages. Based on graph convolutional networks, ECo-GCN considers the graph structure of EEG signals and may be more efficient in color decoding. We found that (1) decoding accuracies for colors during the encoding, early, and late maintaining stages were 81.58%, 79.36%, and 77.06%, respectively, exceeding those during the pre-stimuli stage (67.34%), and (2) the decoding accuracy during maintaining stage could predict participants' memory performance. The results suggest that EEG signals during the maintaining stage may be more sensitive than behavioral measurement to predict the VWM performance of human, and ECo-GCN provides an effective approach to explore human cognitive function.

Decrease of event related theta power is more profound in patients with Parkinson's disease dementia in comparison to Alzheimer's disease dementia

AbstractBackgroundAlzheimer's disease dementia (ADD) and Parkinson's disease dementia (PDD) are the most common types of dementia. ADD and PDD have different pathophysiology and clinical profile. It is important to understand mechanisms underlying pathophysiology, clinical symptoms, and the electrophysiological differences between these two types of dementia. Event‐related theta responses during cognitive paradimgs are one of the essential biomarkers that could succfesully show cognitive decline in dementia patients (Yener et al.,2007;Güntekin et al.,2020). The aim of the present study was to investigate the Event‐related theta responses during the visual cognitive task in patients with PDD and ADD in order to find the differentiation between these two types of dementia.MethodEEG recordings of 15 patients with ADD, 15 patients with PDD, and matched 15 healthy elderly controls (HC) were performed during the visual oddball paradigm. Event‐related phase‐locking and power analysis were performed for theta frequency band (4‐7 Hz). Repeated measures of ANOVA was used for statistical analysis (p<0.05).ResultThere were significant differences among groups for both event‐related theta phase‐locking (p=0.004) and theta power (p<0.0001). ADD (p<0.005) and PDD (p<0.005) groups had reduced theta phase‐locking in comparison to the HC group (Figure 1). Especially, this reduction was more pronounced in the PDD group. In addition, the PDD group had decreased theta power as compared to the HC (p<0.0001) and ADD (p<0.005) group (Figure 1). Figure 1 shows the grand average of event‐related theta power (upper part) and phase‐locking (lower part) and in HC, ADD and PDD groups.ConclusionThe present study showed decreased event‐related theta responses during the visual oddball paradigm in patients with dementia. Especially, PDD patients had the worst event‐related theta responses. These findings could be interpreted as the visual cognitive processes are more impaired in PDD patients compared to ADD patients.

Developmental Trajectories of Letter and Speech Sound Integration During Reading Acquisition.

Reading acquisition in alphabetic languages starts with learning the associations between speech sounds and letters. This learning process is related to crucial developmental changes of brain regions that serve visual, auditory, multisensory integration, and higher cognitive processes. Here, we studied the development of audiovisual processing and integration of letter-speech sound pairs with an audiovisual target detection functional MRI paradigm. Using a longitudinal approach, we tested children with varying reading outcomes before the start of reading acquisition (T1, 6.5 yo), in first grade (T2, 7.5 yo), and in second grade (T3, 8.5 yo). Early audiovisual integration effects were characterized by higher activation for incongruent than congruent letter-speech sound pairs in the inferior frontal gyrus and ventral occipitotemporal cortex. Audiovisual processing in the left superior temporal gyrus significantly increased from the prereading (T1) to early reading stages (T2, T3). Region of interest analyses revealed that activation in left superior temporal gyrus (STG), inferior frontal gyrus and ventral occipitotemporal cortex increased in children with typical reading fluency skills, while poor readers did not show the same development in these regions. The incongruency effect bilaterally in parts of the STG and insular cortex at T1 was significantly associated with reading fluency skills at T3. These findings provide new insights into the development of the brain circuitry involved in audiovisual processing of letters, the building blocks of words, and reveal early markers of audiovisual integration that may be predictive of reading outcomes.

Guiding search in 3D volumes with 2D synthesized images

Introduction: Three-dimensional volumetric images have become prevalent for cancer detection tasks by allowing radiologists to segment features of interest from anatomical background noise (e.g., breast parenchyma). However, spatially small 3D targets that are hard to detect in the visual periphery are often not foveated and then missed. Radiologists are routinely presented with a 2D synthesized image (2D-S) of the 3D volumetric images to assist the 3D search. We investigate the visual-cognitive processes by which the 2D-S benefits the 3D search for small and large targets. Methods: Six trained observers participated in a hybrid Yes/No, rating, and localization search task. They searched for either a small (0.15 deg) or large (0.5 deg) target in 3D volumes (100 slices) with or without an additional 2D-S. We applied a high pass filter and a pixel-wise maximum operation across the 3D slices to produce the 2D-S image. Results: The presence of the 2D-S image improved observers’ hit rate (ΔHR= 0.31, p<.001) and correct localization rate (ΔCL= 0.278, p<.001) of small targets in the 3D images. For larger targets, there was a smaller improvement (ΔHR= 0.115, p>.05). Eye movement analysis showed significantly fewer search errors in the 2D-S + 3D condition relative to the 3D condition for the small target (M3D+2D-S= .15, M3D= .45, p<.001). The presence of the 2D-S image resulted in a pattern of search consistent with guided drilling behavior: fewer eye movements to foveate the small target (M3D+2D-S = 24.5, M3D = 44.9, p<.05), fewer reversals in scrolls (M3D+2D-S = 7.5, M3D = 14.29, p<.01), and shorter response times (M3D+2D-S = 22.81 sec., M3D = 34.92 sec., p<.01). Conclusion: Our results suggest that 2D synthetic images effectively guide 3D search towards likely target locations, resulting in guided drilling behavior and reduced search errors for small targets difficult to detect in the periphery.

A Computational Dual-Process Model of Fixation-Duration Control in Natural Scene Viewing

Research on eye-movement control during natural scene viewing has investigated the degree to which the duration of individual fixations can be immediately adjusted to ongoing visual-cognitive processing demands. Results from several studies using the fixation-contingent scene quality paradigm suggest that the timing of fixations adapts to stimulus changes that occur on a fixation-to-fixation basis. Analysis of fixation-duration distributions has revealed that saccade-contingent degradations and enhancements of the scene stimulus have two qualitatively distinct types of influence. The surprise effect begins early in a fixation and is tied to surprising visual events such as unexpected stimulus changes. The encoding effect is tied to difficulties in visual-cognitive processing and occurs relatively late within a fixation. Here, we formalize an existing descriptive account of these two effects (referred to as the dual-process account) by using stochastic simulations. In the computational model, surprise and encoding related influences are implemented as time-dependent changes in the rate at which saccade timing and programming are completed during critical fixations. The model was tested on data from two experiments in which the luminance of the scene image was either decreased or increased during selected critical fixations (Walshe & Nuthmann, Vision Research, 100, 38–46, 2014). A counterfactual method was used to remove model components and to identify their specific influence on the fixation-duration distributions. The results suggest that the computational dual-process model provides a good account for the data from the luminance-change studies. We describe how the simulations can be generalized to explain a diverse set of experimental results.

Resting state dynamic functional connectivity in children with attention deficit/hyperactivity disorder

Attention deficit/hyperactivity disorder (ADHD) is characterized by inattention, hyperactivity and impulsivity. In this study, we investigated group differences in dynamic functional connectivity (dFC) between 113 children with inattentive (46 ADHDI) and combined (67 ADHDC) ADHD and 76 typically developing (TD) children using resting-state functional MRI data. For dynamic connectivity analysis, the data were first decomposed into 100 independent components, among which 88 were classified into eight well-known resting-state networks (RSNs). Three discrete FC states were then identified using k-means clustering and used to estimate transition probabilities between states in both patient and control groups using a hidden Markov model. Our results showed state-dependent alterations in intra and inter-network connectivity in both ADHD subtypes in comparison with TD. Spending less time than healthy controls in state 1, both ADHDI and ADHDC were characterized with weaker intra-hemispheric connectivity with functional asymmetries. In this state, ADHDI further showed weaker inter-hemispheric connectivity. The patients spent more time in state 2, exhibiting characteristic abnormalities in corticosubcortical and corticocerebellar connectivity. In state 3, a less frequently state observed across the ADHD and TD children, ADHDC was differentiated from ADHDI by significant alterations in FC between bilateral temporal regions and other brain areas in comparison with TD. Across all three states, several strategic brain regions, mostly bilateral, exhibited significant alterations in both static functional connectivity (sFC) and dFC in the ADHD groups compared to TD, including inferior, middle and superior temporal gyri, middle frontal gyri, insula, anterior cingulum cortex, precuneus, calcarine, fusiform, superior motor area, and cerebellum. Our results show distributed abnormalities in sFC and dFC between different large-scale RSNs including cortical and subcortical regions in both ADHD subtypes compared to TD. Our findings show that the dynamic changes in brain FC can better explain the underlying pathophysiology of ADHD such as deficits in visual cognition, attention, memory and emotion processing, and cognitive and motor control.

Leading indicators of mental representation in construction hazard recognition

ABSTRACT Hazard recognition is mainly a visual search and cognitive process. Mental representations of hazards may impact mental states of hazard recognition. We assessed the effects of critical indicators of mental presentations of construction hazards on prefrontal cortex activation, a proxy for the mental states of hazard recognition. Students participated in a hazard inspection experiment, with near-infrared spectroscopy (NIRS) used to record prefrontal cortex activation. The effects of critical indicators of the hazards’ mental representations on prefrontal activation were analyzed. Results demonstrated that site familiarity, risk tolerance and safety knowledge have significant effects on medial prefrontal activation for hazards at a low visual clutter level. High levels of site familiarity and risk tolerance reduced medial prefrontal activation and saved cognitive resources. Theoretically, the findings supplement the knowledge of safety hazards’ mental representations; and practically, the findings guide provision of individual-specific guidance for improving workers’ hazard inspection performance.

Real Life Data on Patient-Reported Outcomes and Neuro-Cognitive Functioning of Lung Cancer Patients: The PRO-Long Study.

IntroductionThis report investigates the impact of systemic treatments (chemotherapy or immunotherapy) with(out) loco-regional radiotherapy, on HRQoL, toxicity and neurocognitive functioning (NCF) in locally advanced and metastatic non-small cell lung cancer patients enrolled in the PRO-Long study.Materials and MethodsData on patient-reported HRQoL and fourteen toxicities was collected, while NCF was tested, up to one-year post-treatment. HRQoL was assessed using the European Organisation for Research and Treatment of Cancer QLQ-C30. Lung cancer, treatment and neuro-psychological related toxicities were scored with the Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events. NCF was evaluated with six neurocognitive tests. Mixed model analyses were conducted to determine statistical significance (p = .01). Meaningful clinical important differences (MCIDs) were applied for changes in HRQoL and NCF data, while toxicities were compared to baseline values.ResultsIn total, 50 patients were enrolled. Overall HRQoL (p = .357) nor its domains (physical, p = .643; role, p = .069; emotional, p = .254; cognitive, p = 494; social, p = .735) changed significantly over time. Meaningful improvements in overall HRQoL were seen in 22, 38 and 39% and deteriorations in 22, 5 and 28% of patients at 2–3, 6 and 12 months respectively post-treatment. Overall toxicity (p = .007), lack of appetite (p = .001), nausea (p = .004) and dysphagia (p = .000) significantly decreased over time. Treatment caused acute toxicity, such as dyspnoea (45%) and memory problems (42%), but also alleviated pre-existing symptoms, including lack of appetite (32%), anxiety (29%) and depression (28%) at 2/3 months. The NCF domains of visual memory (p = .000) and cognitive processing speed (p = .000) showed significant improvements over time. In terms of MCIDs, at 2–3 months (18%) and 6 months (15%), verbal memory was particularly impacted; at 12 months, visual memory (18%) and executive function (18%) deteriorated primarily.ConclusionThe results suggest that therapy has no significant negative impact on overall HRQoL, its domains, and NCF. About one-third of patients reported a meaningful improved HRQoL at 1 year post-treatment. Treatment caused toxicity, but also alleviated pre-existing symptoms.

Do categorical representations modulate early perceptual or later cognitive visual processing? An ERP study

Encoding of perceptual categorical information has been observed in later cognitive processing like memory encoding and maintenance, starting around 300 ms after stimulus onset (P300). However, it remains open whether categorical information is also encoded in early perceptual processing steps (reflected in the mismatch negativity component; vMMN). The main goal of this study was to assess the influence of categorical information on both early perceptual (i.e., vMMN component) and later cognitive (i.e., P300 component) processing within one paradigm. Hence, we combined an oddball paradigm with a delayed memory task. We used five-dot patterns belonging to different categories even though categorical information is not mirrored in their physical characteristics. Distinct vMMNs were observed for patterns belonging to the same as compared to different categories, suggesting that abstract categorical information was encoded during early perceptual processing. However, inconsistent with prior studies, we observed no effect of categories on the P300, indicating no additional encoding of categorical information in later cognitive stages of processing. Our findings emphasize that the encoding of categorical information depends on specific task demands and hence is more flexible and dynamic than previously suggested.

What is the difference between augmented reality and 2D navigation electronic maps in pedestrian wayfinding?

ABSTRACT Augmented reality (AR) navigation aids have become widely used in pedestrian navigation, yet few studies have verified their usability from the perspective of human spatial cognition, such as visual attention, cognitive processing, and spatial memory. We conducted an empirical study in which smartphone-based AR aids were compared with a common two-dimensional (2D) electronic map. We conducted eye-tracking wayfinding experiments, in which 73 participants used either a 2D electronic map or AR navigation aids. We statistically compared participants’ wayfinding performance, visual attention, and route memory between two groups (AR and 2D map navigation aids). The results showed their wayfinding performance did not differ significantly. Regarding visual attention, the participants using AR tended to have significantly shorter fixation durations, greater saccade amplitudes, and smaller pupil sizes on average than the 2D map participants, which indicates lower average cognitive workloads throughout the wayfinding process. Considering attention on environmental objects, the participants using AR paid less visual attention to buildings but more to persons than the participants using 2D maps. Sketched routes results revealed that it was more difficult for AR participants to form a clear memory of the route. The aim of this study is to inspire more usability research on AR navigation.

Reliability of the Dynavision task in virtual reality to explore visuomotor phenotypes

Daily-life behaviors strongly rely on visuomotor integration, a complex sensorimotor process with obvious plasticity. Visual-perceptive and visual-cognitive functions are degraded by neurological disorders and brain damage, but are improved by vision training, e.g. in athletes. Hence, developing tools to evaluate/improve visuomotor abilities has found echo among psychologists, neurophysiologists, clinicians and sport professionals. Here we implemented the Dynavision visuomotor reaction task in virtual reality (VR) to get a flexible tool to place high demands on visual-perceptive and visual-cognitive processes, and explore individual abilities in visuomotor integration. First, we demonstrated high test–retest reliability for the task in VR among healthy physically-active students (n = 64, 32 females). Second, the capture of head movements thanks to the VR-headset sensors provided new and reliable information on individual visual-perceptual strategies, which added significant value to explore visuomotor phenotypes. A factor analysis of mixed data and hierarchical clustering on principal components points to head movements, video-games practice and ball-tracking sports as critical cues to draw visuomotor phenotypes among our participants. We conclude that the visuomotor task in VR is a reliable, flexible and promising tool. Since VR nowadays can serve e.g. to modulate multisensorial integration by creating visual interoceptive-exteroceptive conflicts, or placing specifically designed cognitive demand, much could be learned on complex integrated visuomotor processes through VR experiments. This offers new perspectives for post brain injury risk evaluation, rehabilitation programs and visual-cognitive training.

The nature effect in motion: visual exposure to environmental scenes impacts cognitive load and human gait kinematics.

Prolonged exposure to urban environments requires higher cognitive processing resources than exposure to nature environments, even if only visual cues are available. Here, we explored the moment-to-moment impact of environment type on visual cognitive processing load, measuring gait kinematics and reaction times. In Experiment 1, participants (n = 20) walked toward nature and urban images projected in front of them, one image per walk, and rated each image for visual discomfort. Gait speed and step length decreased for exposure to urban as compared with nature scenes in line with gait changes observed during verbal cognitive load tasks. We teased apart factors that might contribute to cognitive load: image statistics and visual discomfort. Gait changes correlated with subjective ratings of visual discomfort and their interaction with the environment but not with low-level image statistics. In Experiment 2, participants (n = 45) performed a classic shape discrimination task with the same environmental scenes serving as task-irrelevant distractors. Shape discrimination was slower when urban scenes were presented, suggesting that it is harder to disengage attention from urban than from nature scenes. This provides converging evidence that increased cognitive demands posed by exposure to urban scenes can be measured with gait kinematics and reaction times even for short exposure times.