Static Visual Stimuli Research Articles

Possible evidence for the Law of General Intelligence in honeybees (Apis mellifera)

Finke, Scheiner, Giurfa, and Avarguès-Weber (2023) published correlational data on the performance of honeybees (Apis mellifera) in three learning tasks (associative, reversal, and negative patterning, capturing the domains of operant conditioning, executive-functioning-like ability, and inhibition plus configural processing, respectively) evaluated under both visual and olfactory stimulus conditions. They speculate that general cognitive ability (GCA) may be weakly causing all-positive correlations between performance in these different learning modalities, but do not formally test this possibility. A factor-analytic model applied to Finke et al. (2023) data revealed the presence of two perfectly congruent GCA factors (one for each stimulus condition). Both exhibited all-positive loadings, with the visual factor accounting for 46.8% of the performance variance and the olfactory factor accounting for 52.3%. Diagnostic statistics confirmed that in both stimulus conditions, the correlation matrices were adequate for factor analysis. These findings support extant hypotheses that GCA influences covariation between cognitive measures in honeybees, and constitute the first formal potential demonstration of GCA in an invertebrate. It is argued that GCA might be ubiquitous with respect to metazoans possessing organized nervous systems, perhaps because it convergently evolved multiple times in independent phylogenies, this being a key prediction of Christopher Chabris' Law of General Intelligence. Indeed, GCA has now been identified in insect, avian, mammal, and fish taxa. Some “primordial” aspects of GCA may even by basal to metazoans, and experiments employing Caenorhabditis elegans are suggested that could potentially shed light on such aspects. The findings are also strikingly inconsistent with evolutionary and comparative psychological theories positing a “modules first” understanding of cognitive evolution, such as one recent proposal that smaller brains cannot accommodate structures that give rise to GCA. Other theoretical implications of these findings are discussed.

A novel methodology based on static visual stimuli and kinesthetic motor imagery for upper limb neurorehabilitation

A novel methodology based on static visual stimuli and kinesthetic motor imagery for upper limb neurorehabilitation

Learning Fixed Points of Recurrent Neural Networks by Reparameterizing the Network Model.

In computational neuroscience, recurrent neural networks are widely used to model neural activity and learning. In many studies, fixed points of recurrent neural networks are used to model neural responses to static or slowly changing stimuli, such as visual cortical responses to static visual stimuli. These applications raise the question of how to train the weights in a recurrent neural network to minimize a loss function evaluated on fixed points. In parallel, training fixed points is a central topic in the study of deep equilibrium models in machine learning. A natural approach is to use gradient descent on the Euclidean space of weights. We show that this approach can lead to poor learning performance due in part to singularities that arise in the loss surface. We use a reparameterization of the recurrent network model to derive two alternative learning rules that produce more robust learning dynamics. We demonstrate that these learning rules avoid singularities and learn more effectively than standard gradient descent. The new learning rules can be interpreted as steepest descent and gradient descent, respectively, under a non-Euclidean metric on the space of recurrent weights. Our results question the common, implicit assumption that learning in the brain should be expected to follow the negative Euclidean gradient of synaptic weights.

Selective activations and functional connectivities to the sight of faces, scenes, body parts and tools in visual and non-visual cortical regions leading to the human hippocampus

Connectivity maps are now available for the 360 cortical regions in the Human Connectome Project Multimodal Parcellation atlas. Here we add function to these maps by measuring selective fMRI activations and functional connectivity increases to stationary visual stimuli of faces, scenes, body parts and tools from 956 HCP participants. Faces activate regions in the ventrolateral visual cortical stream (FFC), in the superior temporal sulcus (STS) visual stream for face and head motion; and inferior parietal visual (PGi) and somatosensory (PF) regions. Scenes activate ventromedial visual stream VMV and PHA regions in the parahippocampal scene area; medial (7m) and lateral parietal (PGp) regions; and the reward-related medial orbitofrontal cortex. Body parts activate the inferior temporal cortex object regions (TE1p, TE2p); but also visual motion regions (MT, MST, FST); and the inferior parietal visual (PGi, PGs) and somatosensory (PF) regions; and the unpleasant-related lateral orbitofrontal cortex. Tools activate an intermediate ventral stream area (VMV3, VVC, PHA3); visual motion regions (FST); somatosensory (1, 2); and auditory (A4, A5) cortical regions. The findings add function to cortical connectivity maps; and show how stationary visual stimuli activate other cortical regions related to their associations, including visual motion, somatosensory, auditory, semantic, and orbitofrontal cortex value-related, regions.

Rhythmically Modulating Neural Entrainment during Exposure to Regularities Influences Statistical Learning.

The ability to discover regularities in the environment, such as syllable patterns in speech, is known as statistical learning. Previous studies have shown that statistical learning is accompanied by neural entrainment, in which neural activity temporally aligns with repeating patterns over time. However, it is unclear whether these rhythmic neural dynamics play a functional role in statistical learning or whether they largely reflect the downstream consequences of learning, such as the enhanced perception of learned words in speech. To better understand this issue, we manipulated participants' neural entrainment during statistical learning using continuous rhythmic visual stimulation. Participants were exposed to a speech stream of repeating nonsense words while viewing either (1) a visual stimulus with a "congruent" rhythm that aligned with the word structure, (2) a visual stimulus with an incongruent rhythm, or (3) a static visual stimulus. Statistical learning was subsequently measured using both an explicit and implicit test. Participants in the congruent condition showed a significant increase in neural entrainment over auditory regions at the relevant word frequency, over and above effects of passive volume conduction, indicating that visual stimulation successfully altered neural entrainment within relevant neural substrates. Critically, during the subsequent implicit test, participants in the congruent condition showed an enhanced ability to predict upcoming syllables and stronger neural phase synchronization to component words, suggesting that they had gained greater sensitivity to the statistical structure of the speech stream relative to the incongruent and static groups. This learning benefit could not be attributed to strategic processes, as participants were largely unaware of the contingencies between the visual stimulation and embedded words. These results indicate that manipulating neural entrainment during exposure to regularities influences statistical learning outcomes, suggesting that neural entrainment may functionally contribute to statistical learning. Our findings encourage future studies using non-invasive brain stimulation methods to further understand the role of entrainment in statistical learning.

Relationship between individual differences in pain empathy and task- and resting-state EEG

Pain empathy is a complex form of psychological inference that enables us to understand how others feel in the context of pain. Since pain empathy may be grounded in our own pain experiences, it exhibits huge inter-individual variability. However, the neural mechanisms behind the individual differences in pain empathy and its association with pain perception are still poorly understood. In this study, we aimed to characterize brain mechanisms associated with individual differences in pain empathy in adult participants (n = 24). The 32-channel electroencephalography (EEG) was recorded at rest and during a pain empathy task, and participants viewed static visual stimuli of the limbs submitted to painful and nonpainful stimulation to solicit empathy. The pain sensitivity of each participant was measured using a series of direct current stimulations. In our results, the N2 of Fz and the LPP of P3 and P4 were affected by painful pictures. We found that both delta and alpha bands in the frontal and parietal cortex were involved in the regulation of pain empathy. For the delta band, a close relationship was found between average power, either in the resting or task state, and individual differences in pain empathy. It suggested that the spectral power in Fz's delta band may reflect subjective pain empathy across individuals. For the alpha band, the functional connectivity between Fz and P3 under painful picture stimulation was correlated to individuals' pain sensitivity. It indicated that the alpha band may reflect individual differences in pain sensitivity and be involved in pain empathy processing. Our results suggested the distinct role of the delta and alpha bands of EEG signals in pain empathy processing and may deepen our understanding of the neural mechanisms underpinning pain empathy.

Same/different discrimination of motion by pigeons.

Telling that one object or moment is different from another one is fundamental to cognition and intelligent behavior. Most investigations examining same/different (S/D) concepts in animals have relied on testing static visual stimuli. To move beyond this limitation, we investigated how five pigeons learned and performed a motion S/D discrimination. Using a go/no-go task, dynamic motion fields built from dot elements were presented in sequence to display repeating (same) or changing (different) motions. Each trial consisted of 10 motion segments presented in succession using the direction and rate of dot movement in the motion field to exemplify the S/D relations. The pigeons learned this motion S/D discrimination. We further tested their performance by varying the number and persistence of the dots in the motion fields. The results indicated the pigeons likely extracted globally integrated perceptual summaries of the motions for comparison across the segments. Testing differing organizations of the S/D relations across segments indicated that this discrimination could be determined from as few as two segments and involved an updating comparison of at least four or more segments of the sequence during their presentation. Collectively, the experiments establish for the first time that pigeons can use motion features to classify sequential same and different experiences. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Functional changes in fusional vergence-related brain areas and correlation with clinical features in intermittent exotropia using functional magnetic resonance imaging.

To explore the functional changes of the frontal eye field (FEF) and relevant brain regions and its role in the pathogenesis of intermittent exotropia (IXT) children via functional magnetic resonance imaging (fMRI). Twenty-four IXT children (mean age, 11.83 ± 1.93 years) and 28 normal control (NC) subjects (mean age, 11.11 ± 1.50 years) were recruited. During fMRI scans, the IXT children and NCs were provided with static visual stimuli (to evoke sensory fusion) and dynamic visual stimuli (to evoke motor fusion and vergence eye movements) with binocular disparity. Brain activation in the relevant brain regions and clinical characteristics were evaluated. Group differences of brain activation and brain-behavior correlations were investigated. For dynamic and static visual disparity relative to no visual disparity, reduced brain activation in the right FEF and right inferior occipital gyrus (IOG), and increased brain activation in the left middle temporal gyrus complex (MT+) were found in the IXT children compared with NCs. Significant positive correlations between the fusional vergence amplitude and the brain activation values were found in the right FEF, right IPL, and left cerebellum in the NC group. Positive correlations between brain activation values and Newcastle Control Scores (NCS) were found in the left MT+ in the IXT group. For dynamic visual disparity relative to static visual disparity, reduced brain activation in the right middle occipital gyrus, left cerebellum, and bilateral IPL was found in the IXT children compared with NCs. Significant positive correlations between brain activation values and the fusional vergence amplitude were found in the right FEF and right cerebellum in the NC group. Negative correlations between brain activation values and NCS were found in the right middle occipital gyrus, right cerebellum, left IPL, and right FEF in the IXT group. These results suggest that the reduced brain activation in the right FEF, left IPL, and cerebellum may play an important role in the pathogenesis of IXT by influencing fusional vergence function. While the increased brain activation in the left MT+ may compensate for this dysfunction in IXT children.

Dynamic audio-visual correspondence in musicians and non-musicians

Most previous audio-visual crossmodal correspondence studies focused on static visual or auditory stimuli. Moreover, some researchers have found that music training can effectively improve the interaction between auditory and visual channels by enhancing neural plasticity. This study focused on whether crossmodal correspondence occurs when people face dynamic visual and auditory stimuli, and whether it is affected by musical training. Participants were asked to judge different changes in pitch (rise and drop) by showing them different patterns of visual circle motion (enlarged, reduced, and unchanged). The results revealed that the audio-visual congruent combinations (the pitch rise when the circle was enlarged and the pitch drop when the circle was reduced) significantly shortened participants’ response times, whereas the audio-visual neutral combinations (the unchanged shape) had the highest accuracy. Participants with musical training were faster than participants without musical training to judge pitch changes in conditions where the association between pitch and shape size was incongruent. These findings provide empirical evidence for dynamic audio-visual crossmodal correspondence and shed light on the bright prospect of using congruent audio-visual stimuli in animation.

The influence of flow velocity on the response of rheophilic fish to visual cues.

The strong association with visual cues exhibited by fish that prefer to inhabit flowing water (rheophilic species) may help reduce the energetic costs of maintaining position due to the provision of spatial points of reference. If this "Station Holding Hypothesis" is true, a positive relationship between the association with visual cues and flow velocity is expected. This hypothesis was tested experimentally by quantifying the response of common minnow (Phoxinus phoxinus) and brown trout (Salmo trutta) to visual cues under three flow velocities. In contradiction to the prediction, there was no evidence that the association with strong visual cues was positively related to flow velocity when fish were presented with vertical black stripes in an open channel flume, although interspecific variation in response was observed. The association with visual cues was relatively weak in trout, compared to minnow that spent 660% more time associated with the zone in which visual cues were present during the treatment, than the control when visual cues were absent. Trout tended to be more exploratory and made short visits to the area where visual cues were present, whereas minnow associated with the cues for longer. The strong association with visual cues independent of flow velocity exhibited by minnow and the weak association across all velocities by trout suggest that this behaviour is unlikely to reflect a strategy to minimise the energetic cost of maintaining position in flowing water. Minnow may have used the visual cues as a proxy indicator of physical structure that provides alternative benefits, such as refuge from predators. Trout may have employed alternative cues (e.g. mechanosensory) to seek more energetically favourable regions of the experimental area, reducing the importance of stationary visual stimuli.

EXPRESS: Visual Movement Impairs Duration Discrimination at Short Intervals.

The classic advantage of audition over vision in time processing has been recently challenged by studies using continuously moving visual stimuli such as bouncing balls. Bouncing balls drive beat-based synchronization better than static visual stimuli (flashes) and as efficiently as auditory ones (beeps). It is yet unknown how bouncing balls modulate performance in duration perception. Our previous study addressing this was inconclusive: there were no differences among bouncing balls, flashes, and beeps, but this could have been due to the fact that intervals were too long to allow sensitivity to modality (visual vs. auditory). In the present study, we conducted a first experiment to determine whether shorter intervals elicit cross-stimulus differences. We found that short (mean 157 ms) but not medium (326 ms) intervals made duration perception worse for bouncing balls compared to flashes and beeps. In a second experiment, we investigated whether the lower efficiency of bouncing balls was due to experimental confounds, lack of realism, or movement. We ruled out the experimental confounds and found support for the hypothesis that visual movement - be it continuous or discontinuous - impairs duration perception at short interval lengths. Therefore, unlike beat-based synchronization, duration perception does not benefit from continuous visual movement, which may even have a detrimental effect at short intervals.

Compatibility effects with destination and origin of motion.

Previous studies highlighted spatial compatibility effects other than those strictly arising from stimulus-response locations. In particular, the so-called Destination Compatibility (DC) effect refers to faster responses for dynamic (i.e., moving) stimuli the end point of which is spatially compatible with the response key. Four experiments examined whether the DC effect also occurs with static visual stimuli symbolically representing either motion destination alone (Experiment 1a), or both motion origin and destination (Experiments 1b, 2a, and 2b). Overall, our results are consistent in showing a DC effect; most importantly, the present findings reveal a predominance of the effect of destination of motion over that of origin, even when both the starting and ending positions of the stimulus are symbolically represented and participants are instructed to respond according to motion origin. This finding suggests that the DC effect is independent from other stimulus-response compatibility (SRC) effects.

Improvement of brain–computer interface in motor imagery training through the designing of a dynamic experiment and FBCSP

Motor imagery (MI) can produce a specific brain pattern when the subject imagines performing a particular action without any actual body movements. According to related previous research, the improvement of the training of MI brainwaves can be adopted by feedback methods in which the analysis of brainwave characteristics is very important. The aim of this study was to improve the subject's MI and the accuracy of classification. In order to ameliorate the accuracy of the MI of the left and right hand, the present study designed static and dynamic visual stimuli in experiments so as to evaluate which one can improve subjects' imagination training. Additionally, the filter bank common spatial pattern (FBCSP) method was used to divide the frequency band range of the brainwaves into multiple segments, following which linear discriminant analysis (LDA) was adopted for classification. The results revealed that the averaged false positive rate (FPR) under FBCSP–LDA in the dynamic MI experiment was the lowest FPR (23.76%). As such, this study suggested that a combination of the dynamic MI experiment and the FBCSP–LDA method improved the overall prediction error rate and ameliorated the performance of the MI brain–computer interface.

Cortical origins of MacKay-type visual illusions: A case for the non-linearity

To study the interaction between retinal stimulation by redundant geometrical patterns and the cortical response in the primary visual cortex (V1), we focus on the MacKay effect (Nature, 1957) and Billock and Tsou's experiments (PNAS, 2007). We use a controllability approach to describe these phenomena starting from a classical biological model of neuronal field equations with a non-linear response function. The external input containing a localised control function is interpreted as a cortical representation of the static visual stimuli used in these experiments. We prove that while the MacKay effect is essentially a linear phenomenon (i.e., the nonlinear nature of the activation does not play any role in its reproduction), the phenomena reported by Billock and Tsou are wholly nonlinear and depend strongly on the shape of the nonlinearity used to model the response function.

Exposure to multisensory and visual static or moving stimuli enhances processing of nonoptimal visual rhythms

Research has shown that visual moving and multisensory stimuli can efficiently mediate rhythmic information. It is possible, therefore, that the previously reported auditory dominance in rhythm perception is due to the use of nonoptimal visual stimuli. Yet it remains unknown whether exposure to multisensory or visual-moving rhythms would benefit the processing of rhythms consisting of nonoptimal static visual stimuli. Using a perceptual learning paradigm, we tested whether the visual component of the multisensory training pair can affect processing of metric simple two integer-ratio nonoptimal visual rhythms. Participants were trained with static (AVstat), moving-inanimate (AVinan), or moving-animate (AVan) visual stimuli along with auditory tones and a regular beat. In the pre- and posttraining tasks, participants responded whether two static-visual rhythms differed or not. Results showed improved posttraining performance for all training groups irrespective of the type of visual stimulation. To assess whether this benefit was auditory driven, we introduced visual-only training with a moving or static stimulus and a regular beat (Vinan). Comparisons between Vinan and Vstat showed that, even in the absence of auditory information, training with visual-only moving or static stimuli resulted in an enhanced posttraining performance. Overall, our findings suggest that audiovisual and visual static or moving training can benefit processing of nonoptimal visual rhythms.

The sight of one's own body: Could qEEG help predict the treatment response in anorexia nervosa?

Aims of the studyThe study aims to identify the differences in brain activity between participants with anorexia nervosa and healthy control using visual stimulus conditions combined with the quantitative dense-array EEG recording analysis method called Brain Activation Sequences (BAS).Materials and methods23 participants with anorexia nervosa and 21 healthy controls were presented with visual stimuli, including the subject’s facial expressions and body images. The 128-channel EEG data were processed using BAS and displayed as activity in up to 66 brain regions. Subsequent cluster analysis was used to identify groups of participants exhibiting area-specific activation patterns.ResultsCluster analysis identified three distinct groups: one including all healthy controls (HC) and two consisting of all participants with anorexia (AN-I with 19 participants and AN-II with four participants). The AN-I and AN-II groups differed in their response to treatment. Comparisons of HC vs. AN confirmed the dominance of the right cerebral hemisphere in participants with anorexia nervosa in two of the three reported conditions. The facial expressions condition, specifically the facial reaction expressing disgust, indicates the existence of a social attentional bias toward faces, whereas emotions remained undetected in participants. High limbic activity, medial frontal gyrus involvement, low fusiform cortex activity, and milder visual cortex activity in healthy controls compared to participants indicate that the facial expression stimulus is perceived by healthy subjects primarily as an emotion, not as the face itself. In the body image condition, participants showed higher activity in the fusiform gyrus and right insula, indicating activation of the brain’s “fear network.”ConclusionThe study describes a specific pattern of brain activation in response to facial expression of disgust and body images that likely contributes to social-cognitive and behavioral impairments in anorexia. In addition, the substantial difference in the pattern of brain activation within the participants with AN and its association with treatment resistance deserves special attention because of its potential to develop a clinically useful prediction tool and identify potential targets for, for example, neuromodulatory treatments and/or individualized psychotherapy.

Strategies and Tools to Enhance the Use of Dynamic Audiovisual Stimuli in Academic Advertising Research

Advertisers and marketers increasingly adopt and invest in audiovisual formats for their communications. In contrast, academic researchers often rely on static visual stimuli to test advertising- and marketing-related research questions. In this research note, we discuss whether and how academic research could benefit from the ability to develop and use dynamic audiovisual stimuli and we consider the validity-related trade-offs inherent in their use. We first outline the components researchers should consider in constructing dynamic audiovisual stimuli. Then, in an attempt to reduce barriers to creation of dynamic audiovisual stimuli in advertising research, we review tools researchers can use to design realistic dynamic stimuli. We conclude with ways in which the use of dynamic stimuli can open new research approaches, thus expanding advertising-related theory.

Seeing and speaking: How verbal "description length" encodes visual complexity.

What is the relationship between complexity in the world and complexity in the mind? Intuitively, increasingly complex objects and events should give rise to increasingly complex mental representations (or perhaps a plateau in complexity after a certain point). However, a counterintuitive possibility with roots in information theory is an inverted-U-shaped relationship between the "objective" complexity of some stimulus and the complexity of its mental representation, because excessively complex patterns might be characterized by surprisingly short computational descriptions (e.g., if they are represented as having been generated randomly). Here, we demonstrate that this is the case, using a novel approach that takes the notion of "description" literally. Subjects saw static and dynamic visual stimuli whose objective complexity could be carefully manipulated, and they described these stimuli in their own words by giving free-form spoken descriptions of them. Across three experiments totaling over 10,000 speech clips, spoken descriptions of shapes (Experiment 1), dot arrays (Experiment 2), and dynamic motion paths (Experiment 3) revealed a striking quadratic relationship between the raw complexity of these stimuli and the length of their spoken descriptions. In other words, the simplest and most complex stimuli received the shortest descriptions, while those stimuli with a medium degree of complexity received the longest descriptions. Follow-up analyses explored the particular words used by subjects, allowing us to further explore how such stimuli were represented. We suggest that the mind engages in a kind of lossy compression for overly complex stimuli, and we discuss the utility of such free-form responses for exploring foundational questions about mental representation. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Panoramic spatial vision in the bay scallop Argopecten irradians.

We have a growing understanding of the light-sensing organs and light-influenced behaviours of animals with distributed visual systems, but we have yet to learn how these animals convert visual input into behavioural output. It has been suggested they consolidate visual information early in their sensory-motor pathways, resulting in them being able to detect visual cues (spatial resolution) without being able to locate them (spatial vision). To explore how an animal with dozens of eyes processes visual information, we analysed the responses of the bay scallop Argopecten irradians to both static and rotating visual stimuli. We found A. irradians distinguish between static visual stimuli in different locations by directing their sensory tentacles towards them and were more likely to point their extended tentacles towards larger visual stimuli. We also found that scallops track rotating stimuli with individual tentacles and with rotating waves of tentacle extension. Our results show, to our knowledge for the first time that scallops have both spatial resolution and spatial vision, indicating their sensory-motor circuits include neural representations of their visual surroundings. Exploring a wide range of animals with distributed visual systems will help us learn the different ways non-cephalized animals convert sensory input into behavioural output.

The response of common minnows, Phoxinus phoxinus, to visual cues under flowing and static water conditions

While fixed visual cues provide reliable reference points for navigation in static water, it remains unclear whether fish energetically benefit from their presence in flowing water. Furthermore, benefits of visual feedback from fixed sources may be less for group members that can gain additional information from others. Using an open-channel flume, this study investigated how the response of fish to stationary visual stimuli is influenced by flow and group membership under two treatments: vertical black and white stripes placed on (1) both side walls of the channel or (2) one side wall only compared to a control where both walls were uniform white. The responses were compared in flowing and static water, and between individuals and groups of five. Fish exhibited a positive affiliation for the visual cues, travelling more slowly and spending more time closer to the striped walls. Fish were more edge oriented under flowing conditions, presumably utilizing the lower velocities at the wall boundary to reduce energy expenditure. When only one wall presented visual cues, individual fish spent more time associated with it in flowing water, suggesting some energetic benefit in lotic conditions. This may result from a greater ability to maintain station or control position relative to a reference point and/or the use of visual stimuli as a proxy indicator of physical structure which may provide drag-reducing refuge. A lesser association with the striped wall in static water suggests that visual cues provide other nonhydrodynamic benefits, such as physical refuge from predators or opportunities for crypsis. Conversely, less association of shoals with the striped walls may reflect a greater dependence on information provided by conspecifics or increased security associated with being part of a group. This study indicates that fixed visual cues likely provide several benefits that vary depending on flow and group membership.