Luminance Modulation Research Articles

62‐2: Invited Paper: Measurement of Visual Resolution of Display Screens

This paper explains and illustrates the meaning of luminance modulation (aka Michelson contrast) of visual display screens as basis for the perception of presented visual information and as basis for objective visual performance evaluation and rating of display screens according to the 2016 IDMS updates.

Focus of spatial attention during spatial working memory maintenance: Evidence from pupillary light response

ABSTRACTIn this experiment, we demonstrate modulation of the pupillary light response by spatial working memory (SWM). The pupillary light response has previously been shown to reflect the focus of covert attention, as demonstrated by smaller pupil sizes when a subject covertly attends a location on a bright background compared to a dark background. We took advantage of this modulation of the pupillary light response to measure the focus of attention during a SWM delay. Subjects performed two tasks in which a stimulus was presented in the periphery on either the bright or the dark half of a black and white display. Importantly, subjects had to remember the exact location of the stimulus in only one of the two tasks. We observed a modulation of pupil size by background luminance in the delay period, but only when subjects had to remember the exact location. We interpret this as evidence for a tight coupling between spatial attention and maintaining information in SWM. Interestingly, we observed particularly strong modulation of background luminance at the beginning and end of the delay, but not in between. This is suggestive of strategic guidance of spatial attention by the content of spatial working memory when it is task relevant.

Spatial and Global Sensory Suppression Mapping Encompassing the Central 10° Field in Anisometropic Amblyopia.

We investigate the efficacy of a novel dichoptic mapping paradigm in evaluating visual function of anisometropic amblyopes. Using standard clinical measures of visual function (visual acuity, stereo acuity, Bagolini lenses, and neutral density filters) and a novel quantitative mapping technique, 26 patients with anisometropic amblyopia (mean age = 19.15 ± 4.42 years) were assessed. Two additional psychophysical interocular suppression measurements were tested with dichoptic global motion coherence and binocular phase combination tasks. Luminance reduction was achieved by placing neutral density filters in front of the normal eye. Our study revealed that suppression changes across the central 10° visual field by mean luminance modulation in amblyopes as well as normal controls. Using simulation and an elimination of interocular suppression, we identified a novel method to effectively reflect the distribution of suppression in anisometropic amblyopia. Additionally, the new quantitative mapping technique was in good agreement with conventional clinical measures, such as interocular acuity difference (P < 0.001) and stereo acuity (P = 0.005). There was a good consistency between the results of interocular suppression with dichoptic mapping paradigm and the results of the other two psychophysical methods (suppression mapping versus binocular phase combination, P < 0.001; suppression mapping versus global motion coherence, P = 0.005). The dichoptic suppression mapping technique is an effective method to represent impaired visual function in patients with anisometropic amblyopia. It offers a potential in "micro-"antisuppression mapping tests and therapies for amblyopia.

Phase-Dependent Interactions in Visual Cortex to Combinations of First- and Second-Order Stimuli.

Many visual cortex neurons exhibit orientation-selective responses to boundaries defined by differences either in luminance or in texture contrast. Previous studies have examined responses to either type of boundary in isolation, but here we measured systematically responses of cortical neurons to the spatial relationship between superimposed periodic luminance-modulated (LM) and contrast-modulated (CM) stimuli with contrasts adjusted to give equated responses. We demonstrate that neuronal responses to these compound stimuli are highly dependent on the relative phase between the LM and CM components. Diversity in the degree of such phase dependence could help to disambiguate different kinds of boundaries in natural scenes, for example, those arising from surface reflectance changes or from illumination gradients such as shading or shadows.

Visual acuity measured with luminance-modulated and contrast-modulated noise letter stimuli in young adults and adults above 50 years old

The human visual system is sensitive in detecting objects that have different luminance level from their background, known as first-order or luminance-modulated (LM) stimuli. We are also able to detect objects that have the same mean luminance as their background, only differing in contrast (or other attributes). Such objects are known as second-order or contrast-modulated (CM), stimuli. CM stimuli are thought to be processed in higher visual areas compared to LM stimuli, and may be more susceptible to ageing. We compared visual acuities (VA) of five healthy older adults (54.0±1.83 years old) and five healthy younger adults (25.4±1.29 years old) with LM and CM letters under monocular and binocular viewing. For monocular viewing, age had no effect on VA [F(1, 8)= 2.50, p> 0.05]. However, there was a significant main effect of age on VA under binocular viewing [F(1, 8)= 5.67, p< 0.05]. Binocular VA with CM letters in younger adults was approximately two lines better than that in older adults. For LM, binocular summation ratios were similar for older (1.16±0.21) and younger (1.15±0.06) adults. For CM, younger adults had higher binocular summation ratio (1.39±0.08) compared to older adults (1.12±0.09). Binocular viewing improved VA with LM letters for both groups similarly. However, in older adults, binocular viewing did not improve VA with CM letters as much as in younger adults. This could reflect a decline of higher visual areas due to ageing process, most likely higher than V1, which may be missed if measured with luminance-based stimuli alone.

Visual acuity measured with luminance-modulated and contrast-modulated noise letter stimuli in young adults and adults above 50 years old.

The human visual system is sensitive in detecting objects that have different luminance level from their background, known as first-order or luminance-modulated (LM) stimuli. We are also able to detect objects that have the same mean luminance as their background, only differing in contrast (or other attributes). Such objects are known as second-order or contrast-modulated (CM), stimuli. CM stimuli are thought to be processed in higher visual areas compared to LM stimuli, and may be more susceptible to ageing. We compared visual acuities (VA) of five healthy older adults (54.0±1.83 years old) and five healthy younger adults (25.4±1.29 years old) with LM and CM letters under monocular and binocular viewing. For monocular viewing, age had no effect on VA [F(1, 8)= 2.50, p> 0.05]. However, there was a significant main effect of age on VA under binocular viewing [F(1, 8)= 5.67, p< 0.05]. Binocular VA with CM letters in younger adults was approximately two lines better than that in older adults. For LM, binocular summation ratios were similar for older (1.16±0.21) and younger (1.15±0.06) adults. For CM, younger adults had higher binocular summation ratio (1.39±0.08) compared to older adults (1.12±0.09). Binocular viewing improved VA with LM letters for both groups similarly. However, in older adults, binocular viewing did not improve VA with CM letters as much as in younger adults. This could reflect a decline of higher visual areas due to ageing process, most likely higher than V1, which may be missed if measured with luminance-based stimuli alone.

65-5L:Late-News Paper: Sparkle Evaluation with Visual Weighting

We introduce a new method for evaluation of sparkle of the combination of display and AG-layer by application of a weighting of the Fourier amplitudes of the random luminance modulations that are perceived as sparkle, according to the contrast sensitivity function of the human visual system. This new approach provides improved sensitivity to small sparkle variations, better control of parasitic low frequency components caused by non-uniformities of display illumination and an improved match to visual ratings with subtle differences in the low sparkle region.

Dependence of chromatic responses in V1 on visual field eccentricity and spatial frequency: an fMRI study

Psychophysical sensitivity to red-green chromatic modulation decreases with visual eccentricity, compared to sensitivity to luminance modulation, even after appropriate stimulus scaling. This is likely to occur at a central, rather than a retinal, site. Blood-oxygenation-level-dependent (BOLD) functional magnetic resonance imaging (fMRI) responses to stimuli designed to separately stimulate different afferent channels' [red-green, luminance, and short-wavelength (S)-cone] circular gratings were recorded as a function of visual eccentricity (±10 deg) and spatial frequency (SF) in human primary visual cortex (V1) and further visual areas (V2v, V3v). In V1, the SF tuning of BOLD fMRI responses became coarser with eccentricity. For red-green and luminance gratings, similar SF tuning curves were found at all eccentricities. The pattern for S-cone modulation differed, with SF tuning changing more slowly with eccentricity than for the other two modalities. This may be due to the different retinal distribution with eccentricity of this receptor type. A similar pattern held in V2v and V3v. This would suggest that transformation or spatial filtering of the chromatic (red-green) signal occurs beyond these areas.

Contrast adaptation to luminance and brightness modulations.

Perceptual brightness and color contrast decrease after seeing a light temporally modulating along a certain direction in a color space, a phenomenon known as contrast adaptation. We investigated whether contrast adaptation along the luminance direction arises from modulation of luminance signals or apparent brightness signals. The stimulus consisted of two circles on a gray background presented on a CRT monitor. In the adaptation phase, the luminance and chromaticity of one circle were temporally modulated, while the other circle was kept at a constant luminance and color metameric with an equal-energy white. We employed two types of temporal modulations, namely, in luminance and brightness. Chromaticity was sinusoidally modulated along the L-M axis, leading to dissociation between luminance and brightness (the Helmholtz-Kohlrausch effect). In addition, luminance modulation was minimized in the brightness modulation, while brightness modulation was minimized in the luminance modulation. In the test phase, an asymmetric matching method was used to measure the magnitude of contrast adaptation for both modulations. Our results showed that, although contrast adaptation along the luminance direction occurred for both modulations, contrast adaptation for luminance modulation was significantly stronger than that for the brightness modulation regardless of the temporal frequency of the adaptation modulation. These results suggest that luminance modulation is more influential in contrast adaptation than brightness modulation.

間接照明を用いたタスク・アンビエント照明方式の有効性の検証

General lighting has been widely used for office rooms in Japan. However, to reduce energy consumption it is important to use task and ambient lighting (TAL) systems in office rooms. It is known that TAL systems can minimize electric energy consumption without compromising lighting quality in office rooms To make TAL systems be used more widely in office rooms, it is important to take any measures to improve lighting quality, especially perceived room brightness in office rooms which employ TAL systems. We conducted two experiments in a real office room and 1/10-scale office model rooms. In the real office experiment, we employed a proposed TAL system that adopts suspended indirect luminaires as ambient lighting. This is because we hypothesized that the proposed TAL system could reduce gloomy non-lit areas by the indirect ambient lighting and therefore increase perceived room brightness. We measured the energy consumption of the office room and evaluated the quality of the working environment by using questionnaires. From the results, we found that the proposed TAL system with indirect ambient lighting helped reduce deep shadows and discomfort glare, and therefore improved its lighting quality. In addition, the TAL system with indirect ambient lighting reduced lighting energy by about 40% from conventional general lighting. In the additional laboratory experiment using 1/10-scale models, we compared the lighting quality of the TAL system using indirect ambient lighting with a TAL system using direct ambient lighting, a TAL system with dimmed ambient lighting, and a general lighting system. In this experiment, we confirmed the results of the real size field experiment and found the lighting quality of the TAL with indirect ambient lighting to be better than the other lighting systems. However, this study found the brightness uniformity of the TAL with indirect ambient lighting to be worse than the general lighting and TAL with direct ambient lighting systems. On the other hand, physical indexes such as luminance uniformity (minimum luminance over average luminance) and luminance variation coefficient (luminance standard variation over average luminance) showed better performances for the TAL system with indirect ambient lighting than for the other lighting systems. This implies that luminance modulations within a certain special frequency range may influence perceived brightness uniformity and therefore perceived room brightness. Further research is needed to investigate the mechanisms of how people evaluate uniformity of luminance distributions in lit office rooms.

Blue Light Protects Against Temporal Frequency Sensitive Refractive Changes.

Time spent outdoors is protective against myopia. The outdoors allows exposure to short-wavelength (blue light) rich sunlight, while indoor illuminants can be deficient at short-wavelengths. In the current experiment, we investigate the role of blue light, and temporal sensitivity, in the emmetropization response. Five-day-old chicks were exposed to sinusoidal luminance modulation of white light (with blue; N = 82) or yellow light (without blue; N = 83) at 80% contrast, at one of six temporal frequencies: 0, 0.2, 1, 2, 5, 10 Hz daily for 3 days. Mean illumination was 680 lux. Changes in ocular components and corneal curvature were measured. Refraction, eye length, and choroidal changes were dependent on the presence of blue light (P < 0.03, all) and on temporal frequency (P < 0.03, all). In the presence of blue light, refraction did not change across frequencies (mean change -0.24 [diopters] D), while in the absence of blue light, we observed a hyperopic shift (>1 D) at high frequencies, and a myopic shift (>-0.6 D) at low frequencies. With blue light there was little difference in eye growth across frequencies (77 μm), while in the absence of blue light, eyes grew more at low temporal frequencies and less at high temporal frequencies (10 vs. 0.2 Hz: 145 μm; P < 0.003). Overall, neonatal astigmatism was reduced with blue light. Illuminants rich in blue light can protect against myopic eye growth when the eye is exposed to slow changes in luminance contrast as might occur with near work.

Specific innovative semi-transparent solar cell for indoor and outdoor LiFi applications.

Research in light-fidelity (LiFi), also called visible light communication (VLC), has gained huge interest. In such a communication system, an optical sensor translates the received luminous modulation flux into an electrical signal which is decoded. To consider LiFi as an alternative solution for wireless communication, the receiver must be operational in indoor and outdoor configurations. Photovoltaic modules could appear as a solution to this issue. In this paper, we present signal-to-noise ratio (SNR) response in the frequency of two different kinds of photovoltaic modules. We characterize in detail the SNR by using an experimental setup which connects a software-based direct current optical (DCO)-orthogonal frequency division multiiplexing emitter and receiver to hardware optical front ends. We analyze LiFi performances under different lighting conditions. We prove that the available bandwidth depends drastically on ambient lighting configurations. Under specific lighting conditions, a bandwidth around 4 MHz corresponding a data rate around 8 Mbit/s could be achieved. We present the lighting saturation effects and we prove that the semi-transparent solar cell under study improves their performances (both bandwidth and data rate) in high ambient lighting environments.

Shading Beats Binocular Disparity in Depth from Luminance Gradients: Evidence against a Maximum Likelihood Principle for Cue Combination.

Perceived depth is conveyed by multiple cues, including binocular disparity and luminance shading. Depth perception from luminance shading information depends on the perceptual assumption for the incident light, which has been shown to default to a diffuse illumination assumption. We focus on the case of sinusoidally corrugated surfaces to ask how shading and disparity cues combine defined by the joint luminance gradients and intrinsic disparity modulation that would occur in viewing the physical corrugation of a uniform surface under diffuse illumination. Such surfaces were simulated with a sinusoidal luminance modulation (0.26 or 1.8 cy/deg, contrast 20%-80%) modulated either in-phase or in opposite phase with a sinusoidal disparity of the same corrugation frequency, with disparity amplitudes ranging from 0’-20’. The observers’ task was to adjust the binocular disparity of a comparison random-dot stereogram surface to match the perceived depth of the joint luminance/disparity-modulated corrugation target. Regardless of target spatial frequency, the perceived target depth increased with the luminance contrast and depended on luminance phase but was largely unaffected by the luminance disparity modulation. These results validate the idea that human observers can use the diffuse illumination assumption to perceive depth from luminance gradients alone without making an assumption of light direction. For depth judgments with combined cues, the observers gave much greater weighting to the luminance shading than to the disparity modulation of the targets. The results were not well-fit by a Bayesian cue-combination model weighted in proportion to the variance of the measurements for each cue in isolation. Instead, they suggest that the visual system uses disjunctive mechanisms to process these two types of information rather than combining them according to their likelihood ratios.

A New Data Transfer Method via Signal-Rich-Art Code Images Captured by Mobile Devices

A new type of signal-rich-art image for applications of data transfer, called signal-rich-art code image, is proposed. The created code image is visually similar to a preselected target image and, with a given message embedded, achieves the effect of the so-called signal-rich art. With its function similar to that of a QR code, such a type of image is produced by encoding the message into a binary bit stream, representing the bits by binary code patterns of $2 \times 2$ blocks, and injecting the patterns into the target image by a novel image-block luminance modulation scheme. Each signal-rich-art code image may be printed or displayed and then is recaptured using a mobile-device camera. Skillful techniques for counting the number of pattern blocks and recognition of code patterns are also proposed for message extraction from the recaptured version of the signal-rich-art code image. Good experimental results and a comparison of them with those of an existing alternative method show the feasibility and superiority of the proposed new data transfer method.

Area summation of first- and second-order modulations of luminance.

To extend our understanding of the early visual hierarchy, we investigated the long-range integration of first- and second-order signals in spatial vision. In our first experiment we performed a conventional area summation experiment where we varied the diameter of (a) luminance-modulated (LM) noise and (b) contrast-modulated (CM) noise. Results from the LM condition replicated previous findings with sine-wave gratings in the absence of noise, consistent with long-range integration of signal contrast over space. For CM, the summation function was much shallower than for LM suggesting, at first glance, that the signal integration process was spatially less extensive than for LM. However, an alternative possibility was that the high spatial frequency noise carrier for the CM signal was attenuated by peripheral retina (or cortex), thereby impeding our ability to observe area summation of CM in the conventional way. To test this, we developed the "Swiss cheese" stimulus of Meese and Summers (2007) in which signal area can be varied without changing the stimulus diameter, providing some protection against inhomogeneity of the retinal field. Using this technique and a two-component subthreshold summation paradigm we found that (a) CM is spatially integrated over at least five stimulus cycles (possibly more), (b) spatial integration follows square-law signal transduction for both LM and CM and (c) the summing device integrates over spatially-interdigitated LM and CM signals when they are co-oriented, but not when cross-oriented. The spatial pooling mechanism that we have identified would be a good candidate component for a module involved in representing visual textures, including their spatial extent.

A common framework for the analysis of complex motion? Standstill and capture illusions.

A series of illusions was created by presenting stimuli, which consisted of two overlapping surfaces each defined by textures of independent visual features (i.e., modulation of luminance, color, depth, etc.). When presented concurrently with a stationary 2-D luminance texture, observers often fail to perceive the motion of an overlapping stereoscopically defined depth-texture. This illusory motion standstill arises due to a failure to represent two independent surfaces (one for luminance and one for depth textures) and motion transparency (the ability to perceive motion of both surfaces simultaneously). Instead the stimulus is represented as a single non-transparent surface taking on the stationary nature of the luminance-defined texture. By contrast, if it is the 2D-luminance defined texture that is in motion, observers often perceive the stationary depth texture as also moving. In this latter case, the failure to represent the motion transparency of the two textures gives rise to illusionary motion capture. Our past work demonstrated that the illusions of motion standstill and motion capture can occur for depth-textures that are rotating, or expanding / contracting, or else spiraling. Here I extend these findings to include stereo-shearing. More importantly, it is the motion (or lack thereof) of the luminance texture that determines how the motion of the depth will be perceived. This observation is strongly in favor of a single pathway for complex motion that operates on luminance-defines texture motion signals only. In addition, these complex motion illusions arise with chromatically-defined textures with smooth transitions between their colors. This suggests that in respect to color motion perception the complex motions' pathway is only able to accurately process signals from isoluminant colored textures with sharp transitions between colors, and/or moving at high speeds, which is conceivable if it relies on inputs from a hypothetical dual opponent color pathway.

Alouatta trichromatic color vision: cone spectra and physiological responses studied with microspectrophotometry and single unit retinal electrophysiology.

The howler monkeys (Alouatta sp.) are the only New World primates to exhibit routine trichromacy. Both males and females have three cone photopigments. However, in contrast to Old World monkeys, Alouatta has a locus control region upstream of each opsin gene on the X-chromosome and this might influence the retinal organization underlying its color vision. Post-mortem microspectrophotometry (MSP) was performed on the retinae of two male Alouatta to obtain rod and cone spectral sensitivities. The MSP data were consistent with only a single opsin being expressed in each cone and electrophysiological data were consistent with this primate expressing full trichromacy. To study the physiological organization of the retina underlying Alouatta trichromacy, we recorded from retinal ganglion cells of the same animals used for MSP measurements with a variety of achromatic and chromatic stimulus protocols. We found MC cells and PC cells in the Alouatta retina with similar properties to those previously found in the retina of other trichromatic primates. MC cells showed strong phasic responses to luminance changes and little response to chromatic pulses. PC cells showed strong tonic response to chromatic changes and small tonic response to luminance changes. Responses to other stimulus protocols (flicker photometry; changing the relative phase of red and green modulated lights; temporal modulation transfer functions) were also similar to those recorded in other trichromatic primates. MC cells also showed a pronounced frequency double response to chromatic modulation, and with luminance modulation response saturation accompanied by a phase advance between 10–20 Hz, characteristic of a contrast gain mechanism. This indicates a very similar retinal organization to Old-World monkeys. Cone-specific opsin expression in the presence of a locus control region for each opsin may call into question the hypothesis that this region exclusively controls opsin expression.

Random per-element luminance modulation for improved visual tracking.

Using random per-element luminance modulation can increase the visual salience of details in a range of visualizations (2D, 3D, and ND scalar, vector, and tensor fields). Although random luminance has been used in specific designs, its wide applicability isn't reflected in visualizations, perhaps because it hasn't yet been presented as a cross-cutting technique. Adding random-luminance contrast can benefit both static and animated visualizations. The article presents perceptual reasons for this technique's effectiveness. This article has two accompanying videos, at http://youtu.be/TTaSFMvBgvg and http://youtu.be/Rx1oPMTpPA4, showing animations of cones moving through a weather simulation, with and without random luminance modulation.

A contrast and surface code explains complex responses to black and white stimuli in V1.

We investigated the cortical mechanisms underlying the visual perception of luminance-defined surfaces and the preference for black over white stimuli in the macaque primary visual cortex, V1. We measured V1 population responses with voltage-sensitive dye imaging in fixating monkeys that were presented with white or black squares of equal contrast around a mid-gray. Regions corresponding to the squares' edges exhibited higher activity than those corresponding to the center. Responses to black were higher than to white, surprisingly to a much greater extent in the representation of the square's center. Additionally, the square-evoked activation patterns exhibited spatial modulations along the edges and corners. A model comprised of neural mechanisms that compute local contrast, local luminance temporal modulations in the black and white directions, and cortical center-surround interactions, could explain the observed population activity patterns in detail. The model captured the weaker contribution of V1 neurons that respond to positive (white) and negative (black) luminance surfaces, and the stronger contribution of V1 neurons that respond to edge contrast. Also, the model demonstrated how the response preference for black could be explained in terms of stronger surface-related activation to negative luminance modulation. The spatial modulations along the edges were accounted for by surround suppression. Overall the results reveal the relative strength of edge contrast and surface signals in the V1 response to visual objects.

Form-cue invariant second-order neuronal responses to contrast modulation in primate area V2.

A fundamental task of the visual system is to extract figure-ground boundaries between images of objects, which in natural scenes are often defined not only by luminance differences but also by "second-order" contrast or texture differences. Responses to contrast modulation (CM) and other second-order stimuli have been extensively studied in human psychophysics, but the neuronal substrates of second-order responses in nonhuman primates remain poorly understood. In this study, we have recorded single neurons in area V2 of macaque monkeys, using both CM patterns as well as conventional luminance modulation (LM) gratings. CM stimuli were constructed from stationary sine wave grating carrier patterns, which were modulated by drifting envelope gratings of a lower spatial frequency. We found approximately one-third of visually responsive V2 neurons responded to CM stimuli with a pronounced selectivity to carrier spatial frequencies, and often orientations, that were clearly outside the neurons' passbands for LM gratings. These neurons were "form-cue invariant" in that their tuning to CM envelope spatial frequency and orientation was very similar to that for LM gratings. Neurons were tuned to carrier spatial frequencies that were typically 2-4 octaves higher than their optimal envelope spatial frequencies, similar to results from human psychophysics. These results are distinct from CM responses arising from surround suppression, but could be understood in terms of a filter-rectify-filter model. Such neurons could provide a functionally useful and explicit representation of segmentation boundaries as well as a plausible neural substrate for human perception of second-order boundaries.