Perception Of Visual Stimuli Research Articles

Toward metacognition: subject-aware contrastive deep fusion representation learning for EEG analysis.

We propose a subject-aware contrastive learning deep fusion neural network framework for effectively classifying subjects' confidence levels in the perception of visual stimuli. The framework, called WaveFusion, is composed of lightweight convolutional neural networks for per-lead time-frequency analysis and an attention network for integrating the lightweight modalities for final prediction. To facilitate the training of WaveFusion, we incorporate a subject-aware contrastive learning approach by taking advantage of the heterogeneity within a multi-subject electroencephalogram dataset to boost representation learning and classification accuracy. The WaveFusion framework demonstrates high accuracy in classifying confidence levels by achieving a classification accuracy of 95.7% while also identifying influential brain regions.

A registered report of a crossover study on the effects of face masks on walking adaptability in people with Parkinson's disease and multiple sclerosis.

Face masks protrude into the lower visual field causing reduced perception of visual stimuli, potentially making obstacle avoidance during walking more difficult and increasing fall risk. Recommendations on walking and mask wearing for older adults have been debated, with no clear consensus on the various factors interacting and influencing walking safety while wearing a face mask. It is particularly important to address this issue in populations at an increased risk of falls. Therefore, this study aims to investigate the effects of mask-wearing on objectively measured walking adaptability in people with Parkinson's disease and Multiple Sclerosis. 50 patients with either Parkinson's disease or Multiple Sclerosis attending inpatient neurorehabilitation will be recruited to participate in this crossover study. Performance during a standardized gait adaptability (C-Gait) test on a VR-based treadmill (C-Mill+VR), as well as during clinical mobility tests (10-meter walk test, Timed Up & Go test, and stair ambulation) will be measured with and without an FFP2- mask (order randomized). In addition, participants will be asked about their perceived performance and perceived safety during the tests with and without a mask. Performance on the seven C-Gait subtests is based on centre of pressure-derived measures of foot placement in relation to the different tasks. These are averaged and added to a cognitive C-Gait task to give the overall composite score (primary outcome). Secondary outcomes will include the different subscores and clinical mobility tests. This study will make an important contribution to an ongoing debate regarding recommendations persons with and without a neurological disease should be given regarding wearing a face mask while walking. Furthermore, the study will complement the existing scientific discourse with clinical data from people with a neurological disease for whom falls, mobility deficits and mask wearing may be more frequent, which can help inform evidence-based recommendations. German clinical trial register: DRKS00030207.

The Influence of Protective Headgear on the Peripheral Vision Reaction Time of Recreational-Level Skiers

Alpine skiing is characterized by specific and dynamic conditions and demands constant processing of visual information and fast decision-making. A fast response time is necessary for protective movements which reduce the number and severity of additional head impacts. The apparent detriments to visual performance caused by protective headgear are concerning and should be considered moving forward in recreational alpine skiing. The aim of this study was to examine the effects of wearing the three most common combinations of protective headgear in skiing on the timing of visual stimuli perception and adequate response when simulating on-the-slope situations. The sample consisted of 45 recreational-level skiers (27 M, 18 F; age 30.6 ± 8.19 years) who had finished basic alpine skiing school, had been skiing 6–10 years continuously, and were students of Faculty of Kinesiology, University of Zagreb. They did not report any serious medical conditions regarding vision. The overall testing was conducted in the winter season during January and February of 2022. Reaction time on perceived visual stimuli was observed in a way that a skier was approaching behind a participant’s back from both the left and right side. A 2 × 3 (helmet*condition) mixed-model repeated-measures ANOVA was used to determine differences between helmet users and non-users in each tested condition. When observing the results, it was confirmed that the response time of the participants was the slowest when wearing a ski helmet and goggles combined. Furthermore, one of the most important findings was the determined differences in reaction time between helmet users and non-users, i.e., prior helmet users tended to react faster to the upcoming visual stimuli when wearing combined ski helmet and goggles. In the design and construction of the goggles, it is also necessary to pay attention to reducing the thickness of the frame in order to reduce the distance between the eye and the lens, which consequently reduces interference in the peripheral parts of the field of vision. In future studies, the same testing protocol with all the possible combinations of wearing a ski cap, a helmet, sunglasses, and goggles is necessary to gain a clearer insight into the effect of each item of headgear separately and in various combinations.

50.2: Invited Paper: A Closer Look: Advancements in Near‐Eye Display Testing and Metrology

This paper discusses the importance of optical testing metrology for near‐eye displays (NED) used in virtual reality (VR) and augmented reality (AR) environments. The accuracy of parameters such as resolution, contrast, field of view, and color accuracy is critical to the effectiveness of NED. However, existing testing methods for these parameters may not consider the visual characteristics of NED. The paper proposes innovative testing methods for evaluating contrast, pupil swim, and pixel per degree (PPD) in NED. The proposed ANSI contrast test method is found to be more suitable for evaluating the contrast of VR headsets than traditional methods. The paper also proposes two advanced PPD testing methods that take into account lens design and image rendering, providing a more accurate and comprehensive evaluation of pixel distribution on screens at different viewing angles. These testing methods have the potential to improve the development of high‐resolution displays and advance our understanding of the perception of visual stimuli.

Sounding and imagining sounds improve visual time perception: Application of the modality effect of time perception.

This study examines whether the modality effect can be used to improve visual time perception. In Experiment 1, we used a time-reproduction task to explore the accuracy (i.e., deviation of reproduced time from veridical time) and precision (i.e., variability of reproduced time) of time perception under auditory, visual, or audiovisual conditions. Results confirmed the existence of a modality effect. Experiments 2a and 2b and Experiment 3 examined whether adding auditory stimuli improves visual time perception. In Experiments 2a and 2b, participants were required to sound when the visual stimuli appeared. Results showed that the addition of sound to visual stimuli perception is associated with higher time perception accuracy than viewing visual stimuli alone. Given that sounding is not always applicable, we conducted Experiment 3, with participants asked to imagine sounds instead of sounding. Results showed that imaginary sounds improved accuracy. However, in Experiments 2a, 2b, and 3, neither sounding nor imagining sounds changed the precision of time perception. The findings of this study indicate that adding auditory stimuli reliably improves the accuracy of visual-time perception, irrespective of whether the sound is real or imagined.

A survey of neurophysiological differentiation across mouse visual brain areas and timescales.

Neurophysiological differentiation (ND), a measure of the number of distinct activity states that a neural population visits over a time interval, has been used as a correlate of meaningfulness or subjective perception of visual stimuli. ND has largely been studied in non-invasive human whole-brain recordings where spatial resolution is limited. However, it is likely that perception is supported by discrete neuronal populations rather than the whole brain. Therefore, here we use Neuropixels recordings from the mouse brain to characterize the ND metric across a wide range of temporal scales, within neural populations recorded at single-cell resolution in localized regions. Using the spiking activity of thousands of simultaneously recorded neurons spanning 6 visual cortical areas and the visual thalamus, we show that the ND of stimulus-evoked activity of the entire visual cortex is higher for naturalistic stimuli relative to artificial ones. This finding holds in most individual areas throughout the visual hierarchy. Moreover, for animals performing an image change detection task, ND of the entire visual cortex (though not individual areas) is higher for successful detection compared to failed trials, consistent with the assumed perception of the stimulus. Together, these results suggest that ND computed on cellular-level neural recordings is a useful tool highlighting cell populations that may be involved in subjective perception.

Local image descriptor developed from Fechner’s law

Human perception of visual stimulus and its physical characteristics have a nonlinear-logarithmic relation as stated in Fechner’s law, which is a psychophysical law of perception (i.e., subjective sensation). Inspired by Fechner’s law, we use the salient differences among pixels in images as the physical characteristics to mimic the human pattern perception and propose a Fechner local image descriptor (FLID) for face image representation. FLID is a nonlinear descriptor, so the represented image is more hierarchical than the general linear one. In addition, a threshold method is used to divide the features into four different intervals, which can effectively reduce the effects of noise and illumination. However, considering that FLID only extracts the local features of single-scale blocks, we incorporate multi-scale block into FLID and propose a multi-scale block Fechner local image descriptor (MB-FLID) to extract more global structural features. In the experimental part, we verified the performance of FLID and MB-FLID on the Face Recognition Technology (FERET), extended Yale-B, Olivetti Research Laboratories, Yale, and AR face databases, and compared them with a host of other local feature descriptors. The experimental results show that the proposed FLID and MB-FLID outperform the compared descriptors.

Complexity, Performance, and Search Efficiency: An Eye-Tracking Study on Assembly-Based Tasks among Construction Workers (Pipefitters)

Past studies have used eye-tracking glasses to analyze people’s perception of visual stimuli, usually regarding wayfinding, safety, or visual appeal. Some industries, such as the automotive industry, studied the effects of visual stimuli on task completion. However, the architecture and construction industries have mainly conducted eye-tracking experiments with surveys or search tasks instead of performing a task. This paper uses eye-tracking glasses to analyze people’s perception of visual stimuli while completing tangible tasks that simulate real-world applications. This research studies how people look at visual stimuli that influence their ability to interpret drawings with varying degrees of complexity, assess task completion performance, and inspect how people search for information. Twenty pipefitters wore eye-tracking glasses to record their eye movement patterns while completing a model pipe spool assembly. The eye-tracking glasses and Visual Eyes software measured visit metrics, fixations, fixation durations, convex hull coverage, assembly time, rework, and errors. Unlike previous studies, convex hull areas are calculated and used to measure search efficiency. This research found that people interacted more frequently with more complex visual stimuli but did not necessarily require more time to complete a task. People with lower search efficiency visited the drawings more frequently than people with higher search efficiency. People with higher search efficiency made fewer mistakes, redid less work, and completed tasks quicker than those with lower search efficiency. Search efficiency was found to be a good predictor of task performance.

Attenuated perception of visual stimuli synthesized from subspace neural activity

Attenuated perception of visual stimuli synthesized from subspace neural activity

More than a feeling: Scalp EEG and eye signals in conscious tactile perception

Understanding the neural basis of consciousness is a fundamental goal of neuroscience, and sensory perception is often used as a proxy for consciousness in empirical studies. However, most studies rely on reported perception of visual stimuli. Here we present behavior, high density scalp EEG and eye metric recordings collected simultaneously during a novel tactile threshold perception task. We found significant N80, N140 and P300 event related potentials in perceived trials and in perceived versus not perceived trials. Significance was limited to a P100 and P300 in not perceived trials. We also found an increase in pupil diameter and blink rate and a decrease in microsaccade rate following perceived relative to not perceived tactile stimuli. These findings support the use of eye metrics as a measure of physiological arousal associated with conscious perception. Eye metrics may also represent a novel path toward the creation of tactile no-report tasks in the future.

Spike timing neural network model of conscious visual perception

The aim of the paper is to investigate the influence of thalamo-cortical connectivity on the conscious perception of visual stimuli. We conducted simulation experiments changing the key parameters of our spike timing neural network model of visual perception and decision making that are supposed to be related to conscious perception, namely bottom-up and top-down connections between thalamic relay, including Thalamic reticulate nucleus (TRN) and Lateral geniculate nucleus (LGN), and primary visual cortex (V1). The model output, that is perceptual based decision in the lateral intrapareital (LIP) area of the brain for left or right saccade generation, was observed. Conclusions about the influence of altered key parameters on the ability of our model to take proper decision were commented in respect to the observed activity in the brain areas responsible for conscious visual perception and decision making.

Does Creativity Influence Visual Perception? - An Event-Related Potential Study With Younger and Older Adults.

We do not know enough about the cognitive background of creativity despite its significance. Using an active oddball paradigm with unambiguous and ambiguous portrait paintings as the standard stimuli, our aim was to examine whether: creativity in the figural domain influences the perception of visual stimuli; any stages of visual processing; or if healthy aging has an effect on these processes. We investigated event related potentials (ERPs) and applied ERP decoding analyses in four groups: younger less creative; younger creative; older less creative; and older creative adults. The early visual processing did not differ between creativity groups. In the later ERP stages the amplitude for the creative compared with the less creative groups was larger between 300 and 500 ms. The stimuli types were clearly distinguishable: within the 300–500 ms range the amplitude was larger for ambiguous rather than unambiguous paintings, but this difference in the traditional ERP analysis was only observable in the younger, not elderly groups, who also had this difference when using decoding analysis. Our results could not prove that visual creativity influences the early stage of perception, but showed creativity had an effect on stimulus processing in the 300–500 ms range, in indexing differences in top-down control, and having more flexible cognitive control in the younger creative group.

Lower Extremity Open Skill Training Effects on Perception of Visual Stimuli, Cognitive Processing, and Performance

This study investigates if lower extremity open-skill training impacts perception and cognitive processing abilities or just influences task related motor abilities. Twenty-two participants (24.7 ± 2.4years; 11 males, 11 females) were randomly allocated either into the group that trained on a computerized device or to the control group. Prior to and following the 4-week study period, motor performance was assessed using drop jump, hexagon test, postural control and lower extremity choice reaction. Perception, cognitive processing and task inhibition were captured using validated neurocognitive tests. Repeated measurements analyses of co-variances (ANCOVAs) were performed. They revealed a time (before and after intervention) × group (training vs. control) effect on lower extremity choice reaction and hexagon (p < .05). No effects on group differences or between groups in cognitive performance were found. A detrimental effect of training on accuracy of task inhibition (lower percentage of correct inhibitions) was detected. Computerized open skill training affects specific movement patterns without increasing task-relevant cognitive or perceptual abilities. Indicated by the lower percentage of correct inhibitions, the training might further detrimentally influence the risk-taking behavior during choice reaction tasks.

Seeing or not Seeing Where Your Hands Are. The Influence of Visual Feedback About Hand Position on the Interaction Between Nociceptive and Visual Stimuli.

Examining the mechanisms underlying crossmodal interaction between nociceptive and visual stimuli is crucial to understand how humans handle potential bodily threats in their environment. It has recently been shown that nociceptive stimuli can affect the perception of visual stimuli, provided that they occur close together in external space. The present study addresses the question whether these crossmodal interactions between nociceptive and visual stimuli are mediated by the visually perceived proximity between the visual stimuli and the limb on which nociceptive stimuli are applied, by manipulating the presence vs. absence of visual feedback about the position of the stimulated limb. Participants performed temporal order judgments on pairs of visual stimuli, shortly preceded by nociceptive stimuli, either applied on one hand or both hands simultaneously. The hands were placed near the visual stimuli and could either be seen directly, seen through a glass barrier, or hidden from sight with a wooden board. Unilateral nociceptive stimuli induced spatial biases to the advantage of visual stimuli presented near the stimulated hand, which were greater in the conditions in which the hands were seen than in the condition in which vision was prevented. Spatial biases were not modulated by the presence of the glass barrier, minimizing the possibility that the differential effect between the vision and no-vision conditions is solely due to the presence of the barrier between the hands and the visual stimuli. These findings highlight the importance of visual feedback for determining spatial mapping between nociceptive and visual stimuli for crossmodal interaction.

Transcranial alternating current stimulation (tACS) at 40 Hz enhances face and object perception

Neurophysiological evidence suggests that face and object recognition relies on the coordinated activity of neural populations (i.e., neural oscillations) in the gamma-band (>30 Hz) range over the occipito-temporal cortex. To test the causal effect of gamma-band oscillations on face and object perception we applied transcranial Alternating Current Stimulation (tACS) in healthy volunteers (N = 60). In this single-blind, sham-controlled study, we examined whether the administration of offline tACS at gamma-frequency (40 Hz) over the right occipital cortex enhances performance of perception and memory of face and object stimuli. We hypothesized that gamma tACS would enhance the perception of both categories of visual stimuli. Results, in line with our hypothesis, show that 40 Hz tACS enhanced both face and object perception. This effect is process-specific (i.e., it does not affect memory), frequency-specific (i.e., stimulation at 5 Hz did not cause any behavioural change), and site-specific (i.e., stimulation of the sensory-motor cortex did not affect performance). Our findings show that high-frequency tACS modulates human visual perception, and it is in line with neurophysiological studies showing that the perception of visual stimuli (i.e., faces and objects) is mediated by oscillations in the gamma-band range. Furthermore, this study adds insight about the design of effective neuromodulation protocols that might have implications for interventions in clinical settings.

Temporal predictions provided by musical rhythm influence visual memory encoding

Selective attention plays a key role in determining what aspects of our environment are encoded into long-term memory. Auditory rhythms with a regular beat provide temporal expectations that entrain attention and facilitate perception of visual stimuli aligned with the beat. The current study investigated whether entrainment to background auditory rhythms also facilitates higher-level cognitive functions such as episodic memory. In a series of experiments, we manipulated temporal attention through the use of rhythmic, instrumental music. In Experiment 1A and 1B, we found that background musical rhythm influenced the encoding of visual targets into memory, evident in enhanced subsequent memory for targets that appeared in-synchrony compared to out-of-synchrony with the background beat. Response times at encoding did not differ for in-synchrony compared to out-of-synchrony stimuli, suggesting that the rhythmic modulation of memory does not simply reflect rhythmic effects on perception and action. Experiment 2 investigated whether rhythmic effects on response times emerge when task procedures more closely match prior studies that have demonstrated significant auditory entrainment effects. Responses were faster for in-synchrony compared to out-of-synchrony stimuli when participants performed a more perceptually-oriented task that did not contain intervening recognition memory tests, suggesting that rhythmic effects on perception and action depend on the nature of the task demands. Together, these results support the hypothesis that rhythmic temporal regularities provided by background music can entrain attention and influence the encoding of visual stimuli into memory.

Single trial prestimulus oscillations predict perception of the sound-induced flash illusion.

In the sound-induced flash illusion, auditory input affects the perception of visual stimuli with a large inter- and intraindividual variability. Crossmodal influence in this illusion has been shown to be associated with activity in visual and temporal areas. In this electroencephalography study, we investigated the relationship between oscillatory brain activity prior to stimulus presentation and subsequent perception of the illusion on the level of single trials. Using logistic regression, we modeled the perceptual outcome dependent on oscillatory power. We found that 25 Hz to 41 Hz activity over occipital electrodes from 0.17 s to 0.05 s prior to stimulus onset predicted the perception of the illusion. A t-test of power values, averaged over the significant cluster, between illusion and no-illusion trials showed higher power in illusion trials, corroborating the modeling result. We conclude that the observed power modulation predisposes the integration of audiovisual signals, providing further evidence for the governing role of prestimulus brain oscillations in multisensory perception.

Variations in the proliferative activity of the peripheral retina correlate with postnatal ocular growth in squamate reptiles.

The retina is a complex, multilayered tissue responsible for the perception of visual stimuli from the environment. Contrary to mammals, the capacity for postnatal eye growth in fish and amphibians, and to a lower extent in birds, is coordinated with a progenitor population residing in the ciliary marginal zone (CMZ) at the retinal peripheral margin. However, little is known about embryonic retinogenesis and postnatal retinal growth in squamates (lizards, snakes), despite their exceptional array of ecologies and ocular morphologies. Here, we address this gap by performing the first large‐scale study assessing both ontogenetic and adult changes in the stem/progenitor activity of the squamate peripheral retina. Our study reveals for the first time that squamates exhibit a source of proliferating progenitors persisting post embryogenesis in a newly identified retinociliary junction anteriorly adjacent to the retina. This region is strikingly similar to the vertebrate CMZ by its peripheral location and pseudostratified nature, and shares a common pattern of slow‐cycling cells, spatial differentiation gradient, and response to postnatal ocular growth. Additionally, its proliferative activity varies considerably among squamate species, in correlation with embryonic and postnatal differences in eye size and growth. Together our data indicate that squamates possess a proliferative peripheral retina that acts as a source of progenitors to compensate, at least in part, for postnatal ocular growth. Our findings also highlight the remarkable variation in activity and location of vertebrate retinal progenitors, indicating that the currently accepted scenario of reduced CMZ activity over the course of evolution is too simplistic.

Effect of range of heading differences on human visual-inertial heading estimation.

Both visual and inertial cues are salient in heading determination. However, optic flow can ambiguously represent self-motion or environmental motion. It is unclear how visual and inertial heading cues are determined to have common cause and integrated vs perceived independently. In four experiments visual and inertial headings were presented simultaneously with ten subjects reporting visual or inertial headings in separate trial blocks. Experiment 1 examined inertial headings within 30° of straight-ahead and visual headings that were offset by up to 60°. Perception of the inertial heading was shifted in the direction of the visual stimulus by as much as 35° by the 60° offset, while perception of the visual stimulus remained largely uninfluenced. Experiment 2 used ± 140° range of inertial headings with up to 120° visual offset. This experiment found variable behavior between subjects with most perceiving the sensory stimuli to be shifted towards an intermediate heading but a few perceiving the headings independently. The visual and inertial headings influenced each other even at the largest offsets. Experiments 3 and 4 had similar inertial headings to experiments 1 and 2, respectively, except subjects reported environmental motion direction. Experiment 4 displayed similar perceptual influences as experiment 2, but in experiment 3 percepts were independent. Results suggested that perception of visual and inertial stimuli tend to be perceived as having common causation in most subjects with offsets up to 90° although with significant variation in perception between individuals. Limiting the range of inertial headings caused the visual heading to dominate the perception.

Atypical event-related potentials revealed during the passive parts of a Go-NoGo task in autism spectrum disorder: a case-control study

BackgroundThe core features of autism spectrum disorder (ASD) are easily recognizable in non-structured clinical and real-life situations. The features are often difficult to capture in structured laboratory settings, and the results from tests do not necessarily reflect symptom severity. We investigated neurophysiological processing in the passive parts of a cued Go-NoGo task, using the active parts of the test as a comparator.MethodsForty-nine adolescents diagnosed with ASD and 49 typically developing (TD) adolescents (age 12–21 years) were included. Daily life executive function was assessed with the Behavior Rating Inventory of Executive Function (BRIEF). We applied a visual cued Go-NoGo task and recorded event-related potentials (ERPs). We investigated occipital N1, a component related to early perception of visual stimuli, and P3a, a fronto-central component related to switching of attention, in the passive and active parts of the test.ResultsDuring the passive parts, the ASD group had statistically significantly longer N1 latency (p < 0.001, Cohens d = 0.75) and enhanced amplitude of P3a (p = 0.002, Cohens d = 0.64) compared to the TD, while no significant differences were observed in the active parts. Both components correlated significantly with the Behavioral Regulation Index of the BRIEF (partial correlation r = 0.35, p = 0.003).ConclusionDelayed N1 response, indicating altered visual perception, and enhanced P3a response, indicating increased neural activation related to attention allocation, were found during the passive parts of a Go-NoGo task in ASD participants. These abnormal ERP signals in the non-structured settings were associated with everyday executive function, suggesting that neurophysiolocal measures related to atypical control of alertness and “hyper-awareness” underlie daily life dysfunction in ASD. Assessments during passive settings have a potential to reveal core neurobiological substrates of ASD.