Stimulus Configuration Research Articles

Inferring visual space from ultra-fine extra-retinal knowledge of gaze position

It has long been debated how humans resolve fine details and perceive a stable visual world despite the incessant fixational motion of their eyes. Current theories assume these processes to rely solely on the visual input to the retina, without contributions from motor and/or proprioceptive sources. Here we show that contrary to this widespread assumption, the visual system has access to high-resolution extra-retinal knowledge of fixational eye motion and uses it to deduce spatial relations. Building on recent advances in gaze-contingent display control, we created a spatial discrimination task in which the stimulus configuration was entirely determined by oculomotor activity. Our results show that humans correctly infer geometrical relations in the absence of spatial information on the retina and accurately combine high-resolution extraretinal monitoring of gaze displacement with retinal signals. These findings reveal a sensory-motor strategy for encoding space, in which fine oculomotor knowledge is used to interpret the fixational input to the retina.

Envelope following responses for hearing diagnosis: Robustness and methodological considerations

Recent studies have found that envelope following responses (EFRs) are a marker of age-related and noise- or ototoxic-induced cochlear synaptopathy (CS) in research animals. Whereas the cochlear injury can be well controlled in animal research studies, humans may have an unknown mixture of sensorineural hearing loss [SNHL; e.g., inner- or outer-hair-cell (OHC) damage or CS] that cannot be teased apart in a standard hearing evaluation. Hence, a direct translation of EFR markers of CS to a differential CS diagnosis in humans might be compromised by the influence of SNHL subtypes and differences in recording modalities between research animals and humans. To quantify the robustness of EFR markers for use in human studies, this study investigates the impact of methodological considerations related to electrode montage, stimulus characteristics, and presentation, as well as analysis method on human-recorded EFR markers. The main focus is on rectangularly modulated pure-tone stimuli to evoke the EFR based on a recent auditory modelling study that showed that the EFR was least affected by OHC damage and most sensitive to CS in this stimulus configuration. The outcomes of this study can help guide future clinical implementations of electroencephalography-based SNHL diagnostic tests.

Gamification and sensory stimuli in eco-driving research: A field experiment to reduce energy consumption in electric vehicles

Gamification can create meaningful engagement for users and foster desired behaviors. In gamification research, however, the importance of sensory stimuli often has been overlooked. We examine and discuss how the variation of visual and auditory stimuli in gamified driving influences users’ eco-driving behavior. We conducted a field experiment where eco-driving is the field of application and energy consumption the dependent variable. Participants performed test drives with a battery electric car whilst using a mobile application that supports participants to drive more eco-friendly. We varied the extent to which the application employs visual and auditory stimuli. Our results of an analysis of covariance (ANCOVA) and multivariate analysis of variance (MANOVA) show that, depending on the stimuli configuration, participants expose different levels of energy consumption and experience different levels of enjoyment as well as different intentions to actually use this mobile application. More specifically, through the ANCOVA, we find significant differences of the energy consumption between the control group, who drove without the gamified application, and the visual-auditory group, as well as between the visual-only and the visual-auditory group, both at a p-value of 0.02. Further, the MANOVA reveals significant differences between the visual-only and visual-auditory group at a p-value of 0.01 for both perceived enjoyment and intention to use. Due to the significant impact of the varied sensory stimuli on the outcomes, we conclude that the choice and design of sensory stimuli play an increasingly important role in real-time gamification in safety critical situations.

The removal and addition of cues does not impair spatial retrieval and leads to a different metabolic activity of the limbic network in female rats

The retrieval of spatial memories does not always occur in an environment with the same stimuli configuration where the memory was first formed. However, re-exposure to a partial portion of the previously encountered cues can elicit memory successfully. Navigation with contextual changes has received little attention, especially in females. Thus, we aimed to assess memory retrieval using the Morris Water Maze spatial reference protocol in female adult Wistar rats. Rats were trained with five allocentric cues, and retrieval was explored one week later either with the same cues, or with four removed, or with three added cues. We studied the underlying brain oxidative metabolism of the hippocampus, prefrontal, parietal, retrosplenial, entorhinal, and perirhinal cortices through cytochrome c oxidase (CCO) histochemistry. Neither cue removal nor cue addition impaired retrieval performance. Retrieval with a degraded subset of cues led to increased prefrontal, hippocampal, retrosplenial, parietal, and perirhinal CCO activity. Retrieval with extra cues led to an enhancement of CCO activity in the hippocampus and retrosplenial cortex. Different patterns of network intercorrelations were found. The cue-removal group presented a closed reciprocal network, while the group with extra cues had separate parallel networks. Both groups showed a simpler network than the group with no cue modifications. Future research is needed to delve into behavioral and brain-related functions of spatial memory processes under modified environmental conditions.

Detection and discrimination of achromatic contrast: A ganglion cell perspective.

The magnocellular (MC) pathway in the primate has much higher achromatic contrast sensitivity than the parvocellular (PC) pathway, and is implicated in luminance contrast detection. But MC pathway responses tend to saturate at lower achromatic contrast than do PC pathway responses. It has been proposed that the PC pathway plays a major role in discriminating suprathreshold achromatic contrast, because the MC pathway is in saturation. This has been termed the pulsed-pedestal protocol. To test this hypothesis, responses of MC and PC pathway ganglion cells have been examined under suprathreshold conditions with stimulus configurations similar to those in psychophysical tests. For MC cells, response saturation was much less for flashed or moving edges than for sinusoidal modulation, and MC cell thresholds predicted for these stimuli were similar to psychophysical discrimination (and detection) data. Results suggest the protocol is not effective in segregating MC and PC function.

Subsampling of cues in associative learning.

Theories of learning distinguish between elemental and configural stimulus processing depending on whether stimuli are processed independently or as whole configurations. Evidence for elemental processing comes from findings of summation in animals where a compound of two dissimilar stimuli is deemed to be more predictive than each stimulus alone, whereas configural processing is supported by experiments using similar stimuli in which summation is not found. However, in humans the summation effect is robust and impervious to similarity manipulations. In three experiments in human predictive learning, we show that summation can be obliterated when partially reinforced cues are added to the summands in training and tests. This lack of summation only holds when the partially reinforced cues are similar to the reinforced cues (experiment 1) and seems to depend on participants sampling only the most salient cue in each trial (experiments 2a and 2b) in a sequential visual search process. Instead of attributing our and others' instances of lack of summation to the customary idea of configural processing, we offer a formal subsampling rule that might be applied to situations in which the stimuli are hard to parse from each other.

Roles of temporal proximity between sound edges in the perceptual organization of veridical and illusory auditory events

The gap transfer illusion is an auditory illusion in which a temporal gap in a long glide is perceived as if it had transferred to a physically continuous shorter glide. The illusion typically occurs when the long and the shorter glide cross each other at their temporal midpoints, where the long glide is physically divided by the gap. The occurrence of the gap transfer illusion was investigated in stimuli in which the duration and the slope of the long glide were 5000 ms and ∼0.8 oct/s. The shorter glide was given different frequency ranges and different temporal ranges, and thus its time-frequency slope was also varied. The overlap configuration of these crossing glides was varied as well. As control stimuli, we used stimuli in which a continuous long glide crossed a shorter glide with a gap, i.e., the opposite configuration of the gap-transfer stimuli as above, as well as stimuli in which both crossing glides were continuous. The perception of two crossing tones tended to be facilitated when the glides differed in duration and/or slope. When the glides were relatively similar in duration and slope, however, bouncing percepts appeared more often. Similarity between the crossing tones thus promoted auditory bouncing, while dissimilarity between them facilitated the crossing percept. If the crossing percept dominated in gap-transfer stimuli, the gap transfer illusion took place in a typical manner, but the illusory transfer of the gap could occur even when the crossing percept was not dominant. When the shorter glide was as short as 500 ms, the crossing percept and the gap transfer illusion were robust. The mechanism of the illusion was examined in terms of factors that can influence the perceptual integration of auditory stimulus edges, i.e., onsets and offsets, of physically different sounds. Much like the perceptual construction of speech units, we suggest that the auditory system utilizes a rough time window of several hundreds of milliseconds to construct an initial skeleton percept of auditory events. The present data indicated the importance of the temporal proximity, rather than the frequency proximity, between sound edges in the illusory tone construction.

Novel Hybrid Brain-Computer Interface for Virtual Reality Applications Using Steady-State Visual-Evoked Potential-Based Brain-Computer Interface and Electrooculogram-Based Eye Tracking for Increased Information Transfer Rate.

Brain–computer interfaces (BCIs) based on electroencephalogram (EEG) have recently attracted increasing attention in virtual reality (VR) applications as a promising tool for controlling virtual objects or generating commands in a “hands-free” manner. Video-oculography (VOG) has been frequently used as a tool to improve BCI performance by identifying the gaze location on the screen, however, current VOG devices are generally too expensive to be embedded in practical low-cost VR head-mounted display (HMD) systems. In this study, we proposed a novel calibration-free hybrid BCI system combining steady-state visual-evoked potential (SSVEP)-based BCI and electrooculogram (EOG)-based eye tracking to increase the information transfer rate (ITR) of a nine-target SSVEP-based BCI in VR environment. Experiments were repeated on three different frequency configurations of pattern-reversal checkerboard stimuli arranged in a 3 × 3 matrix. When a user was staring at one of the nine visual stimuli, the column containing the target stimulus was first identified based on the user’s horizontal eye movement direction (left, middle, or right) classified using horizontal EOG recorded from a pair of electrodes that can be readily incorporated with any existing VR-HMD systems. Note that the EOG can be recorded using the same amplifier for recording SSVEP, unlike the VOG system. Then, the target visual stimulus was identified among the three visual stimuli vertically arranged in the selected column using the extension of multivariate synchronization index (EMSI) algorithm, one of the widely used SSVEP detection algorithms. In our experiments with 20 participants wearing a commercial VR-HMD system, it was shown that both the accuracy and ITR of the proposed hybrid BCI were significantly increased compared to those of the traditional SSVEP-based BCI in VR environment.

Reference frames in language and cognition: cross-population mismatches

AbstractNumerous studies have found evidence of a speech community’s referential practices in discourse being predictive of its members’ behavior in nonverbal tasks. In this article, we discuss a series of exceptions to this alignment pattern, drawing on data from eleven populations of Asia, Europe, the Middle East, North and Central America, and Oceania. These exceptions have not been discussed in conjunction with one another and the striking commonalities across the findings of these studies have gone unnoticed: (a) in discourses referring to small-scale space, either intrinsic frame use is dominant or both relative and geocentric frames are used frequently in addition to intrinsic frames; and (b) in recall/recognition memory, geocentric coding is more common than egocentric coding (in tasks that involve stationary stimulus configurations) in nine of the populations, while in the remaining two, there is evidence of extensive intrinsic coding even in nonverbal cognition. We discuss these findings in light of Haun’s innate geocentrism hypothesis (Haun, D. B. M., C. Rapold, J. Call, G. Janzen & S. C. Levinson. 2006. Cognitive cladistics and cultural override in hominid spatial cognition.Proceedings of the National Academy of Sciences103(46). 17568–17573). Our data offers partial support for this hypothesis, but simultaneously calls into question whether any extrinsic reference frames are available innately.

Attentional demand induced by visual crowding modulates the anger superiority effect.

Previous research on emotional bias in face perception has shown inconsistent findings, proposing either angry or happy faces to be detected more efficiently. A recent study showed that the anger superiority effect (ASE), which showed in the high attentional demand condition, vanished in the low attentional demand condition. The authors thus proposed an attentional demands modulation hypothesis to interpret the inconsistent findings. The present study tested this hypothesis in a visual crowding task in which participants were instructed to determine whether the target face was happy or angry. Attentional demands were manipulated by changing the strength of crowding, including presenting stimuli in different configurations (Experiment 1), and setting different target-flanker separations and presenting stimuli in different eccentricities (Experiment 2). Experiment 1 showed an ASE when the stimulus configuration incurred a high attentional demand. Intriguingly, the ASE became weaker and then disappeared as the attentional demand became lower. Experiment 2 replicated this finding and showed that the ASE decreased as the target-flanker separation became larger. Together, these results suggest that the emergence and magnitude of ASE is modulated by attentional demands, which supports the attentional demands modulation hypothesis.

Simultaneous modeling of reaction times and brain dynamics in a spatial cueing task.

Understanding how brain activity translates into behavior is a grand challenge in neuroscientific research. Simultaneous computational modeling of both measures offers to address this question. The extension of the dynamic causal modeling (DCM) framework for blood oxygenation level‐dependent (BOLD) responses to behavior (bDCM) constitutes such a modeling approach. However, only very few studies have employed and evaluated bDCM, and its application has been restricted to binary behavioral responses, limiting more general statements about its validity. This study used bDCM to model reaction times in a spatial attention task, which involved two separate runs with either horizontal or vertical stimulus configurations. We recorded fMRI data and reaction times (n= 26) and compared bDCM with classical DCM and a behavioral Rescorla–Wagner model using Bayesian model selection and goodness of fit statistics. Results indicate that bDCM performed equally well as classical DCM when modeling BOLD responses and as good as the Rescorla–Wagner model when modeling reaction times. Although our data revealed practical limitations of the current bDCM approach that warrant further investigation, we conclude that bDCM constitutes a promising method for investigating the link between brain activity and behavior.

The Global Configuration of Visual Stimuli Alters Co-Fluctuations of Cross-Hemispheric Human Brain Activity.

We tested how a stimulus gestalt, defined by the neuronal interaction between local and global features of a stimulus, is represented within human primary visual cortex (V1). We used high-resolution fMRI, which serves as a surrogate of neuronal activation, to measure co-fluctuations within subregions of V1 as (male and female) subjects were presented with peripheral stimuli, each with different global configurations. We found stronger cross-hemisphere correlations when fine-scale V1 cortical subregions represented parts of the same object compared with different objects. This result was consistent with the vertical bias in global processing and, critically, was independent of the task and local discontinuities within objects. Thus, despite the relatively small receptive fields of neurons within V1, global stimulus configuration affects neuronal processing via correlated fluctuations between regions that represent different sectors of the visual field.SIGNIFICANCE STATEMENT We provide the first evidence for the impact of global stimulus configuration on cross-hemispheric fMRI fluctuations, measured in human primary visual cortex. Our results are consistent with changes in the level of γ-band synchrony, which has been shown to be affected by global stimulus configuration, being reflected in the level fMRI co-fluctuations. These data help narrow the gap between knowledge of global stimulus configuration encoding at the single-neuron level versus at the behavioral level.

Sensory Percepts Elicited by Chronic Macro-Sieve Electrode Stimulation of the Rat Sciatic Nerve.

Objective: Intuitive control of conventional prostheses is hampered by their inability to provide the real-time tactile and proprioceptive feedback of natural sensory pathways. The macro-sieve electrode (MSE) is a candidate interface to amputees’ truncated peripheral nerves for introducing sensory feedback from external sensors to facilitate prosthetic control. Its unique geometry enables selective control of the complete nerve cross-section by current steering. Unlike previously studied interfaces that target intact nerve, the MSE’s implantation requires transection and subsequent regeneration of the target nerve. Therefore, a key determinant of the MSE’s suitability for this task is whether it can elicit sensory percepts at low current levels in the face of altered morphology and caliber distribution inherent to axon regeneration. The present in vivo study describes a combined rat sciatic nerve and behavioral model developed to answer this question.Approach: Rats learned a go/no-go detection task using auditory stimuli and then underwent surgery to implant the MSE in the sciatic nerve. After healing, they were trained with monopolar electrical stimuli with one multi-channel and eight single-channel stimulus configurations. Psychometric curves derived by the method of constant stimuli (MCS) were used to calculate 50% detection thresholds and associated psychometric slopes. Thresholds and slopes were calculated at two time points 3 weeks apart.Main Results: For the multi-channel stimulus configuration, the average current required for stimulus detection was 19.37 μA (3.87 nC) per channel. Single-channel thresholds for leads located near the nerve’s center were, on average, half those of leads located near the periphery (54.92 μA vs. 110.71 μA, or 10.98 nC vs. 22.14 nC). Longitudinally, 3 of 5 leads’ thresholds decreased or remained stable over the 3-week span. The remaining two leads’ thresholds increased by 70–74%, possibly due to scarring or device failure.Significance: This work represents an important first step in establishing the MSE’s viability as a sensory feedback interface. It further lays the groundwork for future experiments that will extend this model to the study of other devices, stimulus parameters, and task paradigms.

Dissecting (un)crowding.

In crowding, perception of a target deteriorates in the presence of nearby flankers. Surprisingly, perception can be rescued from crowding if additional flankers are added (uncrowding). Uncrowding is a major challenge for all classic models of crowding and vision in general, because the global configuration of the entire stimulus is crucial. However, it is unclear which characteristics of the configuration impact (un)crowding. Here, we systematically dissected flanker configurations and showed that (un)crowding cannot be easily explained by the effects of the sub-parts or low-level features of the stimulus configuration. Our modeling results suggest that (un)crowding requires global processing. These results are well in line with previous studies showing the importance of global aspects in crowding.

Perceptual learning as a result of concerted changes in prefrontal and visual cortex

Our perceptual ability remarkably improves with training. Some studies on visual perceptual learning have shown refined neural representation of the trained stimulus in the visual cortex, whereas others have exclusively argued for improved readout and decision-making processes in the frontoparietal cortex. The mixed results have rendered the underlying neural mechanisms puzzling and hotly debated. By simultaneously recording from monkey visual area V4 and ventrolateral prefrontal cortex (PFC) implanted with microelectrode arrays, we dissected learning-induced cortical changes over the course of training the monkeys in a global form detection task. Decoding analysis dissociated two distinct components of neuronal population codes that were progressively and markedly enhanced in both V4 and PFC. One component was closely related to the target stimulus feature and was subject to task-dependent top-down modulation; it emerged earlier in V4 than PFC and its enhancement was specific to the trained configuration of the target stimulus. The other component of the neural code was entirely related to the animal's behavioral choice; it emerged earlier in PFC than V4 and its enhancement completely generalized to an untrained stimulus configuration. These results implicate two concurrent and synergistic learning processes: a perceptual process that is specific to the details of the trained stimulus feature and a cognitive process that is dependent on the total amount of learning experience in the trained task. When combined, these two learning processes were well predictive of the animal's learning behavior.

The search for correlates of age-related cochlear synaptopathy: Measures of temporal envelope processing and spatial release from speech-on-speech masking

Older adults often experience difficulties understanding speech in adverse listening conditions. It has been suggested that for listeners with normal and near-normal audiograms, these difficulties may, at least in part, arise from age-related cochlear synaptopathy. The aim of this study was to assess if performance on auditory tasks relying on temporal envelope processing reveal age-related deficits consistent with those expected from cochlear synaptopathy. Listeners aged 20 to 66 years were tested using a series of psychophysical, electrophysiological, and speech-perception measures using stimulus configurations that promote coding by medium- and low-spontaneous-rate auditory-nerve fibers. Cognitive measures of executive function were obtained to control for age-related cognitive decline. Results from the different tests were not significantly correlated with each other despite a presumed reliance on common mechanisms involved in temporal envelope processing. Only gap-detection thresholds for a tone in noise and spatial release from speech-on-speech masking were significantly correlated with age. Increasing age was related to impaired cognitive executive function. Multivariate regression analyses showed that individual differences in hearing sensitivity, envelope-based measures, and scores from nonauditory cognitive tests did not significantly contribute to the variability in spatial release from speech-on-speech masking for small target/masker spatial separation, while age was a significant contributor.

Latent cause inference during extinction learning in trauma-exposed individuals with and without PTSD.

Problems in learning that sights, sounds, or situations that were once associated with danger have become safe (extinction learning) may explain why some individuals suffer prolonged psychological distress following traumatic experiences. Although simple learning models have been unable to provide a convincing account of why this learning fails, it has recently been proposed that this may be explained by individual differences in beliefs about the causal structure of the environment. Here, we tested two competing hypotheses as to how differences in causal inference might be related to trauma-related psychopathology, using extinction learning data collected from clinically well-characterised individuals with varying degrees of post-traumatic stress (N = 56). Model parameters describing individual differences in causal inference were related to multiple post-traumatic stress disorder (PTSD) and depression symptom dimensions via network analysis. Individuals with more severe PTSD were more likely to assign observations from conditioning and extinction stages to a single underlying cause. Specifically, greater re-experiencing symptom severity was associated with a lower likelihood of inferring that multiple causes were active in the environment. We interpret these results as providing evidence of a primary deficit in discriminative learning in participants with more severe PTSD. Specifically, a tendency to attribute a greater diversity of stimulus configurations to the same underlying cause resulted in greater uncertainty about stimulus-outcome associations, impeding learning both that certain stimuli were safe, and that certain stimuli were no longer dangerous. In the future, better understanding of the role of causal inference in trauma-related psychopathology may help refine cognitive therapies for these disorders.

A neural correlate of visual feature binding in primate lateral prefrontal cortex

We effortlessly perceive visual objects as unified entities, despite the preferential encoding of their various visual features in separate cortical areas. A ‘binding’ process is assumed to be required for creating this unified percept, but the underlying neural mechanism and specific brain areas are poorly understood. We investigated ‘feature-binding’ across two feature dimensions, using a novel stimulus configuration, designed to disambiguate whether a given combination of color and motion direction is perceived as bound or unbound. In the “bound” condition, two behaviorally relevant features (color and motion) belong to the same object, while in the “unbound” condition they belong to different objects. We recorded local field potentials from the lateral prefrontal cortex (lPFC) in macaque monkeys that actively monitored the different stimulus configurations. Our data show a neural representation of visual feature binding especially in the 4–12 Hz frequency band and a transmission of binding information between different lPFC neural subpopulations. This information is linked to the animal's reaction time, suggesting a behavioral relevance of the binding information. Together, our results document the involvement of the prefrontal cortex, targeted by the dorsal and ventral visual streams, in binding visual features from different dimensions, in a process that includes a dynamic modulation of low frequency inter-regional communication.

Inside Touch: Presentation of Tactile Feeling Inside Virtual Object Using Finger-Mounted Pin-Array Display

Previously, tactile displays focused on the tactile presentation of the surface of a virtual object. In contrast, this study attempts to provide a tactile feeling on the space inside a virtual object when fingers penetrate it. Our previous study developed a finger-mounted pin-array display with the smallest pin pitch, representing the highest spatial resolution. Using the display, we attempt to present the tactile impression of “Rough,” “Grainy,” and “Sparse” which correspond to Japanese onomatopoeia of “Zara-Zara,” “Tsubu-Tsubu,” or “Chiri-Chiri” with simple patterned stimuli arranged in 3D space. A series of experiments were conducted in this study to determine the following: (1) the stimuli that can provide users with different tactile impressions inside objects and (2) the effect of tactile display spatial resolution on the recognition of tactile impressions inside objects. The results clarified that we could provide three different tactile impressions in space with certain stimuli configurations. Besides, the results demonstrated that participants recognized the tactile impression better with a larger spatial resolution configuration of the device. This study reveals a new field of tactile presentation, that is, tactile presentation inside an object.

The Role of Physiological Responses in a VR-Based Sound Localization Task

Virtual reality (VR) has recently emerged as a platform that can be employed in the context of e-health applications. Even though the majority of VR-based applications focus on visual stimuli as the main content, audio also plays a very important role. If someone has an issue with auditory processing, the comprehension of auditory information is compromised. This condition reflects negatively on one’s quality of life, given the impact of audio perception on one’s ability to communicate effectively or to differentiate and ignore “noise”. This work aims to design a VR application that can be used to: (a) optimize multimodal VR experiences based on user trials (b) extract user data continuously throughout the experiment (c) evaluate a user’s auditory processing ability. To accomplish this goal, participants are required to localise a sound source in space in the presence of multiple listening conditions with simple and complex sound stimuli configurations. Data collected from users consists of physiological and objective metrics. The results of this study highlight the relationship between user behaviour (head movement, fixation points) and performance in the sound localisation task. This information can be used to design future applications with the purpose of training one’s auditory localisation ability. In addition, the evaluation compared the impact of using two interaction methods to perform this task: using a pointer or eye gaze to indicate the location of the target source. The findings from this study show statistically significant differences in terms of physiological response when subjects are exposed to different interaction methods, with greater immersion and performance for the pointer group.