Area V1 Research Articles

Full-reference quality assessment of stereoscopic images by learning binocular visual properties.

Stereoscopic imaging technology has been growingly prevalent driven by both the entertainment industry and scientific applications in today's world. But objective quality assessment of stereoscopic images is a challenging task. In this paper, we propose a novel stereoscopic image quality assessment (SIQA) method by jointly considering monocular perception and binocular interaction. As the most significant contribution of this study, binocular perceptual properties of simple and complex cells are considered for full-reference (FR) SIQA. Specifically, the proposed scheme first simulates the receptive fields of simple cells (one class of V1 neurons) using a push-pull combination of receptive fields response, which is used to represent a monocular cue. Further, the receptive fields of complex cells (the other class of V1 neurons) are simulated by using binocular energy response and binocular rivalry response, which are used to represent a binocular cue. Subsequently, various quality-aware features are extracted from the response of area V1 by calculating the self-weighted histogram of the local binary pattern on four types of feature maps of similarity measurement that will change in the presence of distortions. Finally, kernel ridge regression is used to simulate a nonlinear relationship between the quality-aware features and objective quality scores. The performance of our method is evaluated over popular stereoscopic image databases and shown to be competitive with the state-of-the-art FR SIQA algorithms.

Increase in MST activity correlates with visual motion learning: A functional MRI study of perceptual learning

Repeated practice of a specific task can improve visual performance, but the neural mechanisms underlying this improvement in performance are not yet well understood. Here we trained healthy participants on a visual motion task daily for 5 days in one visual hemifield. Before and after training, we used functional magnetic resonance imaging (fMRI) to measure the change in neural activity. We also imaged a control group of participants on two occasions who did not receive any task training. While in the MRI scanner, all participants completed the motion task in the trained and untrained visual hemifields separately. Following training, participants improved their ability to discriminate motion direction in the trained hemifield and, to a lesser extent, in the untrained hemifield. The amount of task learning correlated positively with the change in activity in the medial superior temporal (MST) area. MST is the anterior portion of the human motion complex (hMT+). MST changes were localized to the hemisphere contralateral to the region of the visual field, where perceptual training was delivered. Visual areas V2 and V3a showed an increase in activity between the first and second scan in the training group, but this was not correlated with performance. The contralateral anterior hippocampus and bilateral dorsolateral prefrontal cortex (DLPFC) and frontal pole showed changes in neural activity that also correlated with the amount of task learning. These findings emphasize the importance of MST in perceptual learning of a visual motion task. Hum Brain Mapp 39:145–156, 2018. © 2017 Wiley Periodicals, Inc.

V4 shape features for contour representation and object detection

Cortical area V4 lies in the middle of the visual pathway involved with object recognition. Neurons in V4 selectively respond to different curve fragments along the object contour. In this paper, we propose a computational model that captures the shape features extracted by V4 neurons. The computational model emulated the information processing mechanism in the visual cortex. It extracted curve segments that V4 neurons respond to and quantitatively represented features of the curve segments. The proposed V4 shape features could describe object contours accurately and efficiently. With quantitative evaluation using the MPEG7 shape dataset, we showed that complex shapes could be represented with a very limited number of V4 shape features. Based on V4 features, we further developed a self-organizing map neural network to learn object shape models. The shape model was defined by a group of V4 features with constraints on their spatial relationships. The model was evaluated in object detection experiments using ETHZ objects and INRIA horses datasets. The proposed model could learn to recognize objects by shapes and accurately outline the object contour in the images. Thus, this model provides insight into the neural mechanisms of shape-based object recognition.

Area Prostriata in the Human Brain

Area prostriata is a cortical area at the fundus of the calcarine sulcus, described anatomically in humans [1-5] and other primates [6-9]. It is lightly myelinated and lacks the clearly defined six-layer structure evident throughout the cerebral cortex, with a thinner layer 4 and thicker layer 2 [10], characteristic of limbic cortex [11]. In the marmoset and rhesus monkey, area prostriata has cortical connections with MT+ [12], the cingulate motor cortex [8], the auditory cortex [13], the orbitofrontal cortex, and the frontal polar cortices [14]. Here we use functional magnetic resonance together with a wide-field projection system tostudy its functional properties in humans. With population receptive field mapping [15], we show that area prostriata has a complete representation of the visual field, clearly distinct from the adjacent area V1. As in the marmoset, the caudal-dorsal border of human prostriata-abutting V1-represents the far peripheral visual field, with eccentricities decreasing toward its rostral boundary. Area prostriata responds strongly to very fast motion, greater than 500°/s. The functional properties of area prostriata suggest that it may serve to alert the brain quickly to fast visual events, particularly in the peripheral visual field.

Texture features for object salience

Although texture is important for many vision-related tasks, it is not used in most salience models. As a consequence, there are images where all existing salience algorithms fail. We introduce a novel set of texture features built on top of a fast model of complex cells in striate cortex, i.e., visual area V1. The texture at each position is characterised by the two-dimensional local power spectrum obtained from Gabor filters which are tuned to many scales and orientations. We then apply a parametric model and describe the local spectrum by the combination of two one-dimensional Gaussian approximations: the scale and orientation distributions. The scale distribution indicates whether the texture has a dominant frequency and what frequency it is. Likewise, the orientation distribution attests the degree of anisotropy. We evaluate the features in combination with the state-of-the-art VOCUS2 salience algorithm. We found that using our novel texture features in addition to colour improves AUC by 3.8% on the PASCAL-S dataset when compared to the colour-only baseline, and by 62% on a novel texture-based dataset.

Dynamic representation of partially occluded objects in primate prefrontal and visual cortex.

Successful recognition of partially occluded objects is presumed to involve dynamic interactions between brain areas responsible for vision and cognition, but neurophysiological evidence for the involvement of feedback signals is lacking. Here, we demonstrate that neurons in the ventrolateral prefrontal cortex (vlPFC) of monkeys performing a shape discrimination task respond more strongly to occluded than unoccluded stimuli. In contrast, neurons in visual area V4 respond more strongly to unoccluded stimuli. Analyses of V4 response dynamics reveal that many neurons exhibit two transient response peaks, the second of which emerges after vlPFC response onset and displays stronger selectivity for occluded shapes. We replicate these findings using a model of V4/vlPFC interactions in which occlusion-sensitive vlPFC neurons feed back to shape-selective V4 neurons, thereby enhancing V4 responses and selectivity to occluded shapes. These results reveal how signals from frontal and visual cortex could interact to facilitate object recognition under occlusion.

Latent Binocular Interactions in Cortical Area V1 of Human Amblyopia

Latent Binocular Interactions in Cortical Area V1 of Human Amblyopia

Spatial specificity of the functional MRI blood oxygenation response relative to neuronal activity

Previous attempts at characterizing the spatial specificity of the blood oxygenation level dependent functional MRI (BOLD fMRI) response by estimating its point-spread function (PSF) have conventionally relied on retinotopic spatial representations of visual stimuli in area V1. Consequently, their estimates were confounded by the width and scatter of receptive fields of V1 neurons. Here, we circumvent these limits by instead using the inherent cortical spatial organization of ocular dominance columns (ODCs) to determine the PSF for both Gradient Echo (GE) and Spin Echo (SE) BOLD imaging at 7 Tesla.By applying Markov chain Monte Carlo sampling on a probabilistic generative model of imaging ODCs, we quantified the PSFs that best predict the spatial structure and magnitude of differential ODCs' responses. Prior distributions for the ODC model parameters were determined by analyzing published data of cytochrome oxidase patterns from post-mortem histology of human V1 and of neurophysiological ocular dominance indices. The average PSF full-widths at half-maximum obtained from differential ODCs’ responses following the removal of voxels influenced by contributions from macroscopic blood vessels were 0.86 mm (SE) and 0.99 mm (GE). Our results provide a quantitative basis for the spatial specificity of BOLD fMRI at ultra-high fields, which can be used for planning and interpretation of high-resolution differential fMRI of fine-scale cortical organizations.

The Detection of Phase Amplitude Coupling during Sensory Processing.

There is increasing interest in understanding how the phase and amplitude of distinct neural oscillations might interact to support dynamic communication within the brain. In particular, previous work has demonstrated a coupling between the phase of low frequency oscillations and the amplitude (or power) of high frequency oscillations during certain tasks, termed phase amplitude coupling (PAC). For instance, during visual processing in humans, PAC has been reliably observed between ongoing alpha (8–13 Hz) and gamma-band (>40 Hz) activity. However, the application of PAC metrics to electrophysiological data can be challenging due to numerous methodological issues and lack of coherent approaches within the field. Therefore, in this article we outline the various analysis steps involved in detecting PAC, using an openly available MEG dataset from 16 participants performing an interactive visual task. Firstly, we localized gamma and alpha-band power using the Fieldtrip toolbox, and extracted time courses from area V1, defined using a multimodal parcelation scheme. These V1 responses were analyzed for changes in alpha-gamma PAC, using four common algorithms. Results showed an increase in alpha (7–13 Hz)–gamma (40–100 Hz) PAC in response to the visual grating stimulus, though specific patterns of coupling were somewhat dependent upon the algorithm employed. Additionally, post-hoc analyses showed that these results were not driven by the presence of non-sinusoidal oscillations, and that trial length was sufficient to obtain reliable PAC estimates. Finally, throughout the article, methodological issues and practical guidelines for ongoing PAC research will be discussed.

Latent binocular function in amblyopia

Recently, psychophysical studies have shown that humans with amblyopia do have binocular function that is not normally revealed due to dominant suppressive interactions under normal viewing conditions. Here we use magnetoencephalography (MEG) combined with dichoptic visual stimulation to investigate the underlying binocular function in humans with amblyopia for stimuli that, because of their temporal properties, would be expected to bypass suppressive effects and to reveal any underlying binocular function.We recorded contrast response functions in visual cortical area V1 of amblyopes and normal observers using a steady state visually evoked responses (SSVER) protocol. We used stimuli that were frequency-tagged at 4Hz and 6Hz that allowed identification of the responses from each eye and were of a sufficiently high temporal frequency (>3Hz) to bypass suppression. To characterize binocular function, we compared dichoptic masking between the two eyes in normal and amblyopic participants as well as interocular phase differences in the two groups.We observed that the primary visual cortex responds less to the stimulation of the amblyopic eye compared to the fellow eye. The pattern of interaction in the amblyopic visual system however was not significantly different between the amblyopic and fellow eyes. However, the amblyopic suppressive interactions were lower than those observed in the binocular system of our normal observers. Furthermore, we identified an interocular processing delay of approximately 20ms in our amblyopic group.To conclude, when suppression is greatly reduced, such as the case with our stimulation above 3Hz, the amblyopic visual system exhibits a lack of binocular interactions.

Joint coding of shape and blur in area V4

Edge blur, a prevalent feature of natural images, is believed to facilitate multiple visual processes including segmentation and depth perception. Furthermore, image descriptions that explicitly combine blur and shape information provide complete representations of naturalistic scenes. Here we report the first demonstration of blur encoding in primate visual cortex: neurons in macaque V4 exhibit tuning for both object shape and boundary blur, with observed blur tuning not explained by potential confounds including stimulus size, intensity, or curvature. A descriptive model wherein blur selectivity is cast as a distinct neural process that modulates the gain of shape-selective V4 neurons explains observed data, supporting the hypothesis that shape and blur are fundamental features of a sufficient neural code for natural image representation in V4.

Stimulus and task dependence of response latencies in primate area V4

Stimulus and task dependence of response latencies in primate area V4

Neural responses to shape and texture stimuli in macaque area V4

Neural responses to shape and texture stimuli in macaque area V4

Area prostriata in the human brain

Summary Area prostriata is a cortical area at the fundus of the calcarine sulcus, described anatomically in humans [1–5] and other primates [6–9]. It is lightly myelinated and lacks the clearly defined six-layer structure evident throughout the cerebral cortex, with a thinner layer 4 and thicker layer 2 [10], characteristic of limbic cortex [11]. In the marmoset and rhesus monkey, area prostriata has cortical connections with MT+ [12], the cingulate motor cortex [8], the auditory cortex [13], the orbitofrontal cortex, and the frontal polar cortices [14]. Here we use functional magnetic resonance together with a wide-field projection system to study its functional properties in humans. With population receptive field mapping [15], we show that area prostriata has a complete representation of the visual field, clearly distinct from the adjacent area V1. As in the marmoset, the caudal-dorsal border of human prostriata—abutting V1—represents the far peripheral visual field, with eccentricities decreasing toward its rostral boundary. Area prostriata responds strongly to very fast motion, greater than 500°/s. The functional properties of area prostriata suggest that it may serve to alert the brain quickly to fast visual events, particularly in the peripheral visual field.

A quantitative theory of gamma synchronization in macaque V1.

Gamma-band synchronization coordinates brief periods of excitability in oscillating neuronal populations to optimize information transmission during sensation and cognition. Commonly, a stable, shared frequency over time is considered a condition for functional neural synchronization. Here, we demonstrate the opposite: instantaneous frequency modulations are critical to regulate phase relations and synchronization. In monkey visual area V1, nearby local populations driven by different visual stimulation showed different gamma frequencies. When similar enough, these frequencies continually attracted and repulsed each other, which enabled preferred phase relations to be maintained in periods of minimized frequency difference. Crucially, the precise dynamics of frequencies and phases across a wide range of stimulus conditions was predicted from a physics theory that describes how weakly coupled oscillators influence each other's phase relations. Hence, the fundamental mathematical principle of synchronization through instantaneous frequency modulations applies to gamma in V1 and is likely generalizable to other brain regions and rhythms.

Global motion perception is associated with motor function in 2-year-old children

The dorsal visual processing stream that includes V1, motion sensitive area V5 and the posterior parietal lobe, supports visually guided motor function. Two recent studies have reported associations between global motion perception, a behavioural measure of processing in V5, and motor function in pre-school and school aged children. This indicates a relationship between visual and motor development and also supports the use of global motion perception to assess overall dorsal stream function in studies of human neurodevelopment. We investigated whether associations between vision and motor function were present at 2 years of age, a substantially earlier stage of development. The Bayley III test of Infant and Toddler Development and measures of vision including visual acuity (Cardiff Acuity Cards), stereopsis (Lang stereotest) and global motion perception were attempted in 404 2-year-old children (±4 weeks). Global motion perception (quantified as a motion coherence threshold) was assessed by observing optokinetic nystagmus in response to random dot kinematograms of varying coherence. Linear regression revealed that global motion perception was modestly, but statistically significantly associated with Bayley III composite motor (r2=0.06, P<0.001, n=375) and gross motor scores (r2=0.06, p<0.001, n=375). The associations remained significant when language score was included in the regression model. In addition, when language score was included in the model, stereopsis was significantly associated with composite motor and fine motor scores, but unaided visual acuity was not statistically significantly associated with any of the motor scores. These results demonstrate that global motion perception and binocular vision are associated with motor function at an early stage of development. Global motion perception can be used as a partial measure of dorsal stream function from early childhood.

Long-Lasting Enhancement of Visual Perception with Repetitive Noninvasive Transcranial Direct Current Stimulation.

Understanding processes performed by an intact visual cortex as the basis for developing methods that enhance or restore visual perception is of great interest to both researchers and medical practitioners. Here, we explore whether contrast sensitivity, a main function of the primary visual cortex (V1), can be improved in healthy subjects by repetitive, noninvasive anodal transcranial direct current stimulation (tDCS). Contrast perception was measured via threshold perimetry directly before and after intervention (tDCS or sham stimulation) on each day over 5 consecutive days (24 subjects, double-blind study). tDCS improved contrast sensitivity from the second day onwards, with significant effects lasting 24 h. After the last stimulation on day 5, the anodal group showed a significantly greater improvement in contrast perception than the sham group (23 vs. 5%). We found significant long-term effects in only the central 2–4° of the visual field 4 weeks after the last stimulation. We suspect a combination of two factors contributes to these lasting effects. First, the V1 area that represents the central retina was located closer to the polarization electrode, resulting in higher current density. Second, the central visual field is represented by a larger cortical area relative to the peripheral visual field (cortical magnification). This is the first study showing that tDCS over V1 enhances contrast perception in healthy subjects for several weeks. This study contributes to the investigation of the causal relationship between the external modulation of neuronal membrane potential and behavior (in our case, visual perception). Because the vast majority of human studies only show temporary effects after single tDCS sessions targeting the visual system, our study underpins the potential for lasting effects of repetitive tDCS-induced modulation of neuronal excitability.

Focal cortical seizures start as standing waves and propagate respecting homotopic connectivity

Focal epilepsy involves excessive cortical activity that propagates both locally and distally. Does this propagation follow the same routes as normal cortical activity? We pharmacologically induced focal seizures in primary visual cortex (V1) of awake mice, and compared their propagation to the retinotopic organization of V1 and higher visual areas. We used simultaneous local field potential recordings and widefield imaging of a genetically encoded calcium indicator to measure prolonged seizures (ictal events) and brief interictal events. Both types of event are orders of magnitude larger than normal visual responses, and both start as standing waves: synchronous elevated activity in the V1 focus and in homotopic locations in higher areas, i.e. locations with matching retinotopic preference. Following this common beginning, however, seizures persist and propagate both locally and into homotopic distal regions, and eventually invade all of visual cortex and beyond. We conclude that seizure initiation resembles the initiation of interictal events, and seizure propagation respects the connectivity underlying normal visual processing.

Learning and surface boundary feedbacks for colour natural scene perception

Boundary detection and segmentation are essential stages in object recognition and scene understanding. In this paper, we present a bio-inspired neural model of the ventral pathway for colour contour and surface perception, called LPREEN (Learning and Perceptual boundaRy rEcurrent dEtection Neural architecture). LPREEN models colour opponent processes and feedback interactions between cortical areas V1, V2, V4, and IT, which produce top-down and bottom-up information fusion. We suggest three feedback interactions that enhance and complete boundaries. Our proposed neural model contains a contour learning feedback that enhances the most probable contour positions in V1 according to a previous experience, and generates a surface perception in V4 through diffusion processes. We compared the proposed model with another bio-inspired model and two well-known contour extraction methods, using the Berkeley Segmentation Benchmark. LPREEN showed better performance than two methods and slightly worse performance than another one.

Mechanisms for shaping receptive field in monkey area TE.

Visual object information is conveyed from V1 to area TE along the ventral visual pathway with increasing receptive field (RF) sizes. The RFs of TE neurons are known to be large, but it is largely unknown how large RFs are shaped along the ventral visual pathway. In this study, we addressed this question in two aspects, static and dynamic mechanisms, by recording neural responses from macaque area TE and V4 to object stimuli presented at various locations in the visual field. As a component related to static mechanisms, we found that in area TE, but not in V4, response latency to objects presented at fovea were different from objects in periphery. As a component of the dynamic mechanisms, we examined effects of spatial attention on the RFs of TE neurons. Spatial attention did not affect response latency but modulated response magnitudes depending on attended location, shifting of the longitudinal axis of RFs toward the attended locations. In standard models of large RF formation, downstream neurons pool information from nearby RFs, and this process is repeated across the visual field and at each step along the ventral visual pathway. The present study revealed that this mechanism is not that simple: 1) different circuit mechanisms for foveal and peripheral visual fields may be situated between V4 and area TE, and 2) spatial attention dynamically changes the shape of RFs.NEW & NOTEWORTHY Receptive fields (RFs) of neurons are progressively increased along the ventral visual pathway so that an RF at the final stage, area TE, covers a large area of the visual field. We explored the mechanism and suggested involvement of parallel circuit mechanisms between V4 and TE for foveal and peripheral parts of visual field. We also found a dynamic component of RF shape formation through attentional modulation of responses in a location-dependent manner.