Prior Visual Experience Research Articles

On prior visual experience in mental map navigation using allocentric and egocentric perspectives in the visually impaired.

Using new developments in the mental comparison task paradigm, this study addresses the question of the influence of prior visual experience in the natural use of mental perspective to achieve mental spatial tasks without any protocol-imposed perspective. During the experiment, 39 participants (11 early blind, 13 late blind, and 15 blindfolded-sighted) explored two corridor maps to memorise the spatial arrangement of 10 objects disposed along corridors. After the learning phase, several tasks addressing spatial memory and reasoning used in the mental spatial representation were performed. Blindfolded-sighted participants preferred an egocentric perspective, while the two visually impaired groups showed no overriding preference between egocentric and allocentric perspectives. Results showed a performance advantage for egocentric over allocentric perspectives, regardless of visual experience. Our results shed light on previous assumptions regarding cognitive mental map construction, suggesting the need to reflect on previous results and their dependence on imposed mental perspectives.

Prior visual experience increases children's use of effective haptic exploration strategies in audio-tactile sound-shape correspondences

Prior visual experience increases children's use of effective haptic exploration strategies in audio-tactile sound-shape correspondences

Decomposing geographical judgments into spatial, temporal and linguistic components

When mentally exploring maps representing large-scale environments (e.g., countries or continents), humans are assumed to mainly rely on spatial information derived from direct perceptual experience (e.g., prior visual experience with the geographical map itself). In the present study, we rather tested whether also temporal and linguistic information could account for the way humans explore and ultimately represent this type of maps. We quantified temporal distance as the minimum time needed to travel by train across Italian cities, while linguistic distance was retrieved from natural language through cognitively plausible AI models based on non-spatial associative learning mechanisms (i.e., distributional semantic models). In a first experiment, we show that temporal and linguistic distances capture with high-confidence real geographical distances. Next, in a second behavioral experiment, we show that linguistic information can account for human performance over and above real spatial information (which plays the major role in explaining participants’ performance) in a task in which participants have to judge the distance between cities (while temporal information was found to be not relevant). These findings indicate that, when exploring maps representing large-scale environments, humans do take advantage of both perceptual and linguistic information, suggesting in turn that the formation of cognitive maps possibly relies on a strict interplay between spatial and non-spatial learning principles.

The Influence of Memory on Visual Perception in Infants, Children, and Adults.

Perception is not an independent, in-the-moment event. Instead, perceiving involves integrating prior expectations with current observations. How does this ability develop from infancy through adulthood? We examined how prior visual experience shapes visual perception in infants, children, and adults. Using an identical task across age groups, we exposed participants to pairs of colorful stimuli and implicitly measured their ability to discriminate relative saturation levels. Results showed that adult participants were biased by previously experienced exemplars, and exhibited weakened in-the-moment discrimination between different levels of saturation. In contrast, infants and children showed less influence of memory in their perception, and they actually outperformed adults in discriminating between current levels of saturation. Our findings suggest that as humans develop, their perception relies more on prior experience and less on current observation.

Visual hindsight bias for abnormal mammograms in radiologists.

Hindsight bias-where people falsely believe they can accurately predict something once they know about it-is a pervasive decision-making phenomenon, including in the interpretation of radiological images. Evidence suggests it is not only a decision-making phenomenon but also a visual perception one, where prior information about an image enhances our visual perception of the contents of that image. The current experiment investigates to what extent expert radiologists perceive mammograms with visual abnormalities differently when they know what the abnormality is (a visual hindsight bias), above and beyond being biased at a decision level. experienced mammography readers were presented with a series of unilateral abnormal mammograms. After each case, they were asked to rate their confidence on a 6-point scale that ranged from confident mass to confident calcification. We used the random image structure evolution method, where the images repeated in an unpredictable order and with varied noise, to ensure any biases were visual, not cognitive. Radiologists who first saw an original image with no noise were more accurate in the max noise level condition [area under the curve ] than those who first saw the degraded images (; difference: ), suggesting that radiologists' visual perception of medical images is enhanced by prior visual experience with the abnormality. Overall, these results provide evidence that expert radiologists experience not only decision level but also visual hindsight bias, and have potential implications for negligence lawsuits.

Flexible cue anchoring strategies enable stable head direction coding in both sighted and blind animals

Vision plays a crucial role in instructing the brain’s spatial navigation systems. However, little is known about how vision loss affects the neuronal encoding of spatial information. Here, recording from head direction (HD) cells in the anterior dorsal nucleus of the thalamus in mice, we find stable and robust HD tuning in rd1 mice, a model of photoreceptor degeneration, that go blind by approximately one month of age. In contrast, placing sighted animals in darkness significantly impairs HD cell tuning. We find that blind mice use olfactory cues to maintain stable HD tuning and that prior visual experience leads to refined HD cell tuning in blind rd1 adult mice compared to congenitally blind animals. Finally, in the absence of both visual and olfactory cues, the HD attractor network remains intact but the preferred firing direction of HD cells drifts over time. These findings demonstrate flexibility in how the brain uses diverse sensory information to generate a stable directional representation of space.

Visual Stimulation Induces Distinct Forms of Sensitization of On-Off Direction-Selective Ganglion Cell Responses in the Dorsal and Ventral Retina.

Experience-dependent modulation of neuronal responses is a key attribute in sensory processing. In the mammalian retina, the On-Off direction-selective ganglion cell (DSGC) is well known for its robust direction selectivity. However, how the On-Off DSGC light responsiveness dynamically adjusts to the changing visual environment is underexplored. Here, we report that On-Off DSGCs tuned to posterior motion direction [i.e. posterior DSGCs (pDSGCs)] in mice of both sexes can be transiently sensitized by prior stimuli. Notably, distinct sensitization patterns are found in dorsal and ventral pDSGCs. Although responses of both dorsal and ventral pDSGCs to dark stimuli (Off responses) are sensitized, only dorsal cells show the sensitization of responses to bright stimuli (On responses). Visual stimulation to the dorsal retina potentiates a sustained excitatory input from Off bipolar cells, leading to tonic depolarization of pDSGCs. Such tonic depolarization propagates from the Off to the On dendritic arbor of the pDSGC to sensitize its On response. We also identified a previously overlooked feature of DSGC dendritic architecture that can support dendritic integration between On and Off dendritic layers bypassing the soma. By contrast, ventral pDSGCs lack a sensitized tonic depolarization and thus do not exhibit sensitization of their On responses. Our results highlight a topographic difference in Off bipolar cell inputs underlying divergent sensitization patterns of dorsal and ventral pDSGCs. Moreover, substantial crossovers between dendritic layers of On-Off DSGCs suggest an interactive dendritic algorithm for processing On and Off signals before they reach the soma.SIGNIFICANCE STATEMENT Visual neuronal responses are dynamically influenced by the prior visual experience. This form of plasticity reflects the efficient coding of the naturalistic environment by the visual system. We found that a class of retinal output neurons, On-Off direction-selective ganglion cells, transiently increase their responsiveness after visual stimulation. Cells located in dorsal and ventral retinas exhibit distinct sensitization patterns because of different adaptive properties of Off bipolar cell signaling. A previously overlooked dendritic morphologic feature of the On-Off direction-selective ganglion cell is implicated in the cross talk between On and Off pathways during sensitization. Together, these findings uncover a topographic difference in the adaptive encoding of upper and lower visual fields and the underlying neural mechanism in the dorsal and ventral retinas.

The Spatial Musical Association of Response Codes does not depend on a normal visual experience: A study with early blind individuals.

Converging evidence suggests that the perception of auditory pitch exhibits a characteristic spatial organization. This pitch-space association can be demonstrated experimentally by the Spatial Musical Association of Response Codes (SMARC) effect. This is characterized by faster response times when a low-positioned key is pressed in response to a low-pitched tone, and a high-positioned key is pressed in response to a high-pitched tone. To investigate whether the development of this pitch-space association is mediated by normal visual experience, we tested a group of early blind individuals on a task that required them to discriminate the timbre of different instrument sounds with varying pitch. Results revealed a comparable pattern in the SMARC effect in both blind participants and sighted controls, suggesting that the lack of prior visual experience does not prevent the development of an association between pitch height and vertical space.

Emotion processing in early blind and sighted individuals.

Emotion processing is known to be mediated by a complex network of cortical and subcortical regions with evidence of specialized hemispheric lateralization within the brain. In light of prior evidence indicating that lateralization of cognitive functions (such as language) may depend on normal visual development, we investigated whether the lack of prior visual experience would have an impact on the development of specialized hemispheric lateralization in emotional processing. We addressed this issue by comparing performance in early blind and sighted controls on a dichotic listening task requiring the detection of specific emotional vocalizations (i.e., suggestive of happiness or sadness) presented independently to either ear. Consistent with previous studies, we found that sighted individuals showed enhanced detection of positive vocalizations when presented in the right ear (i.e., processed within the left hemisphere) and negative vocalizations when presented in the left ear (i.e., right hemisphere). It is interesting to note that although blind individuals were as accurate as sighted controls in detecting the valance of the vocalization, performance was not consistent with any pattern of specialized hemispheric lateralization. Overall, these results suggest that although the lack of prior visual experience may not lead to impaired emotion processing performance, the underlying neurophysiological substrate (i.e., degree of special hemispheric lateralization) may depend on normal visual development. (PsycINFO Database Record

Category selectivity in human visual cortex: Beyond visual object recognition

Human ventral temporal cortex shows a categorical organization, with regions responding selectively to faces, bodies, tools, scenes, words, and other categories. Why is this? Traditional accounts explain category selectivity as arising within a hierarchical system dedicated to visual object recognition. For example, it has been proposed that category selectivity reflects the clustering of category-associated visual feature representations, or that it reflects category-specific computational algorithms needed to achieve view invariance. This visual object recognition framework has gained renewed interest with the success of deep neural network models trained to “recognize” objects: these hierarchical feed-forward networks show similarities to human visual cortex, including categorical separability. We argue that the object recognition framework is unlikely to fully account for category selectivity in visual cortex. Instead, we consider category selectivity in the context of other functions such as navigation, social cognition, tool use, and reading. Category-selective regions are activated during such tasks even in the absence of visual input and even in individuals with no prior visual experience. Further, they are engaged in close connections with broader domain-specific networks. Considering the diverse functions of these networks, category-selective regions likely encode their preferred stimuli in highly idiosyncratic formats; representations that are useful for navigation, social cognition, or reading are unlikely to be meaningfully similar to each other and to varying degrees may not be entirely visual. The demand for specific types of representations to support category-associated tasks may best account for category selectivity in visual cortex. This broader view invites new experimental and computational approaches.

Anticipatory action planning in blind and sighted individuals

Several studies on visually guided reach-to-grasp movements have documented that how objects are grasped differs depending on the actions one intends to perform subsequently. However, no previous study has examined whether this differential grasping may also occur without visual input. In this study, we used motion capture technology to investigate the influence of visual feedback and prior visual experience on the modulation of kinematics by intention in sighted (in both full-vision and no-vision conditions), early-blind and late-blind participants. Results provide evidence of modulation of kinematics by intention to a similar degree under both full-vision and no-vision conditions. Moreover, they demonstrate that prior visual experience has little impact on the tailoring of grasping movements to intention. This suggests that sequential action planning does not depend on visual input, and may instead be ascribed to the function of multisensory-motor cortical network that operates and develops not only in light, but also in darkness.

Prior Visual Experience Modulates Learning of Sound Localization Among Blind Individuals

Cross-modal learning requires the use of information from different sensory modalities. This study investigated how the prior visual experience of late blind individuals could modulate neural processes associated with learning of sound localization. Learning was realized by standardized training on sound localization processing, and experience was investigated by comparing brain activations elicited from a sound localization task in individuals with (late blind, LB) and without (early blind, EB) prior visual experience. After the training, EB showed decreased activation in the precuneus, which was functionally connected to a limbic-multisensory network. In contrast, LB showed the increased activation of the precuneus. A subgroup of LB participants who demonstrated higher visuospatial working memory capabilities (LB-HVM) exhibited an enhanced precuneus-lingual gyrus network. This differential connectivity suggests that visuospatial working memory due to the prior visual experience gained via LB-HVM enhanced learning of sound localization. Active visuospatial navigation processes could have occurred in LB-HVM compared to the retrieval of previously bound information from long-term memory for EB. The precuneus appears to play a crucial role in learning of sound localization, disregarding prior visual experience. Prior visual experience, however, could enhance cross-modal learning by extending binding to the integration of unprocessed information, mediated by the cognitive functions that these experiences develop.

The Roles for Prior Visual Experience and Age on the Extraction of Egocentric Distance.

In a well-lit room, observers can generate well-constrained estimates of the distance to an object on the floor even with just a fleeting glimpse. Performance under these conditions is typically characterized by some underestimation but improves when observers have previewed the room. Such evidence suggests that information extracted from longer durations may be stored to contribute to the perception of distance at limited time frames. Here, we examined the possibility that this stored information is used differentially across age. Specifically, we posited that older adults would rely more than younger adults on information gathered and stored at longer glimpses to judge the distance of briefly glimpsed objects. We collected distance judgments from younger and older adults after brief target glimpses. Half of the participants were provided 20-s previews of the testing room in advance; the other half received no preview. Performance benefits were observed for all individuals with prior visual experience, and these were moderately more pronounced for the older adults. The results suggest that observers store contextual information gained from longer viewing durations to aid in the perception of distance at brief glimpses, and that this memory becomes more important with age.

Can blind persons accurately assess body size from the voice?

Vocal tract resonances provide reliable information about a speaker's body size that human listeners use for biosocial judgements as well as speech recognition. Although humans can accurately assess men's relative body size from the voice alone, how this ability is acquired remains unknown. In this study, we test the prediction that accurate voice-based size estimation is possible without prior audiovisual experience linking low frequencies to large bodies. Ninety-one healthy congenitally or early blind, late blind and sighted adults (aged 20-65) participated in the study. On the basis of vowel sounds alone, participants assessed the relative body sizes of male pairs of varying heights. Accuracy of voice-based body size assessments significantly exceeded chance and did not differ among participants who were sighted, or congenitally blind or who had lost their sight later in life. Accuracy increased significantly with relative differences in physical height between men, suggesting that both blind and sighted participants used reliable vocal cues to size (i.e. vocal tract resonances). Our findings demonstrate that prior visual experience is not necessary for accurate body size estimation. This capacity, integral to both nonverbal communication and speech perception, may be present at birth or may generalize from broader cross-modal correspondences.

Dog owners show experience-based viewing behaviour in judging dog face approachability.

Our prior visual experience plays a critical role in face perception. We show superior perceptual performance for differentiating conspecific (vs non-conspecific), own-race (vs other-race) and familiar (vs unfamiliar) faces. However, it remains unclear whether our experience with faces of other species would influence our gaze allocation for extracting salient facial information. In this eye-tracking study, we asked both dog owners and non-owners to judge the approachability of human, monkey and dog faces, and systematically compared their behavioural performance and gaze pattern associated with the task. Compared to non-owners, dog owners assessed dog faces with shorter time and fewer fixations, but gave higher approachability ratings. The gaze allocation within local facial features was also modulated by the ownership. The averaged proportion of the fixations and viewing time directed at the dog mouth region were significantly less for the dog owners, and more experienced dog owners tended to look more at the dog eyes, suggesting the adoption of a prior experience-based viewing behaviour for assessing dog approachability. No differences in behavioural performance and gaze pattern were observed between dog owners and non-owners when judging human and monkey faces, implying that the dog owner's experience-based gaze strategy for viewing dog faces was not transferable across faces of other species.

The effects of age and set size on the fast extraction of egocentric distance

ABSTRACTAngular direction is a source of information about the distance to floor-level objects that can be extracted from brief glimpses (near one's threshold for detection). Age and set size are two factors known to impact the viewing time needed to directionally localize an object, and these were posited to similarly govern the extraction of distance. The question here was whether viewing durations sufficient to support object detection (controlled for age and set size) would also be sufficient to support well-constrained judgments of distance. Regardless of viewing duration, distance judgments were more accurate (less biased towards underestimation) when multiple potential targets were presented, suggesting that the relative angular declinations between the objects are an additional source of useful information. Distance judgments were more precise with additional viewing time, but the benefit did not depend on set size and accuracy did not improve with longer viewing durations. The overall pattern suggests that distance can be efficiently derived from direction for floor-level objects. Controlling for age-related differences in the viewing time needed to support detection was sufficient to support distal localization but only when brief and longer glimpse trials were interspersed. Information extracted from longer glimpse trials presumably supported performance on subsequent trials when viewing time was more limited. This outcome suggests a particularly important role for prior visual experience in distance judgments for older observers.

Neocortical Rebound Depolarization Enhances Visual Perception.

Animals are constantly exposed to the time-varying visual world. Because visual perception is modulated by immediately prior visual experience, visual cortical neurons may register recent visual history into a specific form of offline activity and link it to later visual input. To examine how preceding visual inputs interact with upcoming information at the single neuron level, we designed a simple stimulation protocol in which a brief, orientated flashing stimulus was subsequently coupled to visual stimuli with identical or different features. Using in vivo whole-cell patch-clamp recording and functional two-photon calcium imaging from the primary visual cortex (V1) of awake mice, we discovered that a flash of sinusoidal grating per se induces an early, transient activation as well as a long-delayed reactivation in V1 neurons. This late response, which started hundreds of milliseconds after the flash and persisted for approximately 2 s, was also observed in human V1 electroencephalogram. When another drifting grating stimulus arrived during the late response, the V1 neurons exhibited a sublinear, but apparently increased response, especially to the same grating orientation. In behavioral tests of mice and humans, the flashing stimulation enhanced the detection power of the identically orientated visual stimulation only when the second stimulation was presented during the time window of the late response. Therefore, V1 late responses likely provide a neural basis for admixing temporally separated stimuli and extracting identical features in time-varying visual environments.

What you see is what you expect: rapid scene understanding benefits from prior experience

Although we are able to rapidly understand novel scene images, little is known about the mechanisms that support this ability. Theories of optimal coding assert that prior visual experience can be used to ease the computational burden of visual processing. A consequence of this idea is that more probable visual inputs should be facilitated relative to more unlikely stimuli. In three experiments, we compared the perceptions of highly improbable real-world scenes (e.g., an underwater press conference) with common images matched for visual and semantic features. Although the two groups of images could not be distinguished by their low-level visual features, we found profound deficits related to the improbable images: Observers wrote poorer descriptions of these images (Exp. 1), had difficulties classifying the images as unusual (Exp. 2), and even had lower sensitivity to detect these images in noise than to detect their more probable counterparts (Exp. 3). Taken together, these results place a limit on our abilities for rapid scene perception and suggest that perception is facilitated by prior visual experience.

Neural correlates associated with superior tactile symmetry perception in the early blind

Symmetry is an organizational principle that is ubiquitous throughout the visual world. However, this property can also be detected through non-visual modalities such as touch. The role of prior visual experience on detecting tactile patterns containing symmetry remains unclear. We compared the behavioral performance of early blind and sighted (blindfolded) controls on a tactile symmetry detection task. The tactile patterns used were similar in design and complexity as in previous visual perceptual studies. The neural correlates associated with this behavioral task were identified with functional magnetic resonance imaging (fMRI). In line with growing evidence demonstrating enhanced tactile processing abilities in the blind, we found that early blind individuals showed significantly superior performance in detecting tactile symmetric patterns compared to sighted controls. Furthermore, comparing patterns of activation between these two groups identified common areas of activation (e.g. superior parietal cortex) but key differences also emerged. In particular, tactile symmetry detection in the early blind was also associated with activation that included peri-calcarine cortex, lateral occipital (LO), and middle temporal (MT) cortex, as well as inferior temporal and fusiform cortex. These results contribute to the growing evidence supporting superior behavioral abilities in the blind, and the neural correlates associated with crossmodal neuroplasticity following visual deprivation.

Virtual environments for the transfer of navigation skills in the blind: a comparison of directed instruction vs. video game based learning approaches.

For profoundly blind individuals, navigating in an unfamiliar building can represent a significant challenge. We investigated the use of an audio-based, virtual environment called Audio-based Environment Simulator (AbES) that can be explored for the purposes of learning the layout of an unfamiliar, complex indoor environment. Furthermore, we compared two modes of interaction with AbES. In one group, blind participants implicitly learned the layout of a target environment while playing an exploratory, goal-directed video game. By comparison, a second group was explicitly taught the same layout following a standard route and instructions provided by a sighted facilitator. As a control, a third group interacted with AbES while playing an exploratory, goal-directed video game however, the explored environment did not correspond to the target layout. Following interaction with AbES, a series of route navigation tasks were carried out in the virtual and physical building represented in the training environment to assess the transfer of acquired spatial information. We found that participants from both modes of interaction were able to transfer the spatial knowledge gained as indexed by their successful route navigation performance. This transfer was not apparent in the control participants. Most notably, the game-based learning strategy was also associated with enhanced performance when participants were required to find alternate routes and short cuts within the target building suggesting that a ludic-based training approach may provide for a more flexible mental representation of the environment. Furthermore, outcome comparisons between early and late blind individuals suggested that greater prior visual experience did not have a significant effect on overall navigation performance following training. Finally, performance did not appear to be associated with other factors of interest such as age, gender, and verbal memory recall. We conclude that the highly interactive and immersive exploration of the virtual environment greatly engages a blind user to develop skills akin to positive near transfer of learning. Learning through a game play strategy appears to confer certain behavioral advantages with respect to how spatial information is acquired and ultimately manipulated for navigation.