Luminance Modulation Research Articles

Temporal properties of the visual responses to luminance and contrast modulated noise

Vision is sensitive to first-order luminance modulations and second-order modulations of carrier contrast. Our knowledge of the temporal properties of second-order vision is insufficient and contradictory. Using temporal summation and reaction time paradigms, we found that the type of visual noise (static or dynamic) determines the temporal properties of the responses to luminance and contrast modulations. In the presence of static noise, the temporal responses to both types of modulation of low and higher spatial frequencies were transient. When dynamic noise was used, the temporal responses to luminance and contrast modulations of higher spatial frequencies were sustained. At low spatial frequency, however, luminance modulations elicited transient responses, while contrast modulated dynamic noise produced sustained responses. The reaction times to near-threshold contrast modulations of low spatial frequency were slower than those to first-order patterns and they did not significantly differ at modulations of higher spatial frequency. The results suggest that the temporal characteristics of first-stage linear filters which feed the second-order pathway may determine the temporal responses to contrast modulated noise.

Sensitivity to contrast modulation: the spatial frequency dependence of second-order vision

We consider the overall shape of the second-order modulation sensitivity function (MSF). Because second-order modulations of local contrast or orientation require a carrier signal, it is necessary to evaluate modulation sensitivity against a variety of carriers before reaching a general conclusion about second-order sensitivity. Here we present second-order sensitivity functions for new carrier types (low pass (1/ f) noise, and high pass noise) and demonstrate that, when first-order artefacts have been accounted for, the shape of the resulting MSFs are similar to one another and to those for white and broad band noise. They are all low pass with a likely upper frequency limit in the range 10–20 c/deg, suggesting that detection of second-order stimuli is relatively insensitive to the structure of the carrier signal. This result contrasts strongly with that found for (first-order) luminance modulations of the same noise types. Here the noise acts as mask and each noise type masks most those frequencies that are dominant in its spectrum. Thus the shape of second-order MSFs are largely independent of the spectrum of their noise carrier, but first-order CSFs depend on the spectrum of an additive noise mask. This provides further evidence for the separation of first- and second-order vision and characterises second-order vision as a low pass mechanism.

Surface current measurements using airborne visible image time series

Measurements of nearshore water currents are important for a number of reasons, including understanding sediment transport and beach erosion, planning and evaluation of littoral construction projects, and military operations in very shallow water. Because direct measurements are difficult and expensive to make, remote sensing techniques are of great interest. A digital camera system has been used to remotely measure ocean surface currents from an aircraft by estimating the Doppler shift of gravity waves. Navigational data are used to map each of a sequence of images to a geodetic reference frame at the level of the mean ocean surface. The 3-D frequency-wave number spectrum of the luminance modulations in subsets of these mapped data exhibits the dispersion relation for surface gravity waves, and the 2-D velocity vector is retrieved by estimating the Doppler shift of the higher frequency waves in this spectrum, wavelengths in the band of about 5–30 m. The relationship of this technique to that of tracking visible surface features between image pairs is examined with examples. Current retrievals in shallow water outside the surf on a quasi-linear beach and in an exposed tidal inlet channel are favorably compared with simultaneous in situ current measurements, with errors of ∼10% in magnitude and ∼5° in direction.

Refractive compensation to optical defocus depends on the temporal profile of luminance modulation of the environment.

The refractive state of hatchling chicks rapidly compensates to applied optical defocus through alteration in eye growth. The mechanism is capable of sensing whether the plane of focus lies in front of or behind the photoreceptors, however, its nature and site of action within the retina are unknown. We attempted to create an imbalance in the adaptation of the retinal ON and OFF mechanisms previously implicated in refractive control through pharmacological interventions, by rearing chicks from 4 to 9 days of age with a monocular +10 D, 0 D or -10 D lens, in an environment illuminated by a moving or stationary plaid of luminance gradients. When the plaid moved in one direction a local Fast-ON sawtooth luminance modulation was produced, while plaid motion in the other direction resulted in a Fast-OFF sawtooth modulation. Significantly reduced refractive compensation accompanied +10 D lens/Fast-OFF and -10 D lens/Fast-ON rearing, but not for the other conditions. Thus the refractive compensation mechanism depends on the nature of the temporal contrast of the environment, suggesting a relationship between the sign of defocus and the state of adaptation of the retinal ON and OFF subsystems.

Colour and luminance interactions in the visual perception of motion.

We sought to determine the extent to which red-green, colour-opponent mechanisms in the human visual system play a role in the perception of drifting luminance-modulated targets. Contrast sensitivity for the directional discrimination of drifting luminance-modulated (yellow-black) test sinusoids was measured following adaptation to isoluminant red-green sinusoids drifting in either the same or opposite direction. When the test and adapt stimuli drifted in the same direction, large sensitivity losses were evident at all test temporal frequencies employed (1-16 Hz). The magnitude of the loss was independent of temporal frequency. When adapt and test stimuli drifted in opposing directions, large sensitivity losses were evident at lower temporal frequencies (1-4 Hz) and declined with increasing temporal frequency. Control studies showed that this temporal-frequency-dependent effect could not reflect the activity of achromatic units. Our results provide evidence that chromatic mechanisms contribute to the perception of luminance-modulated motion targets drifting at speeds of up to at least 32 degrees s(-1). We argue that such mechanisms most probably lie within a parvocellular-dominated cortical visual pathway, sensitive to both chromatic and luminance modulation, but only weakly selective for the direction of stimulus motion.

Spatiochromatic Properties of Natural Images and Human Vision

The human visual system shows a relatively greater response to low spatial frequencies of chromatic spatial modulation than to luminance spatial modulation. However, previous work has shown that this differential sensitivity to low spatial frequencies is not reflected in any differential luminance and chromatic content of general natural scenes. This is contrary to the prevailing assumption that the spatial properties of human vision ought to reflect the structure of natural scenes. Now, colorimetric measures of scenes suggest that red-green (and perhaps blue-yellow) color discrimination in primates is particularly suited to the encoding of specific scenes: reddish or yellowish objects on a background of leaves. We therefore ask whether the spatial, as well as chromatic, properties of such scenes are matched to the different spatial-encoding properties of color and luminance modulation in human vision. We show that the spatiochromatic properties of a wide class of scenes, which contain reddish objects (e.g., fruit) on a background of leaves, correspond well to the properties of the red-green (but not blue-yellow) systems in human vision, at viewing distances commensurate with typical grasping distance. This implies that the red-green system is particularly suited to encoding both the spatial and the chromatic structure of such scenes.

Shading and texture: separate information channels with a common adaptation mechanism?

We outline a scheme for the way in which early vision may handle information about shading (luminance modulation, LM) and texture (contrast modulation, CM). Previous work on the detection of gratings has found no sub-threshold summation, and no cross-adaptation, between LM and CM patterns. This strongly implied separate channels for the detection of LM and CM structure. However, we now report experiments in which adapting to LM (or CM) gratings creates tilt aftereffects of similar magnitude on both LM and CM test gratings, and reduces the perceived strength (modulation depth) of LM and CM gratings to a similar extent. This transfer of aftereffects between LM and CM might suggest a second stage of processing at which LM and CM information is integrated. The nature of this integration, however, is unclear and several simple predictions are not fulfilled. Firstly, one might expect the integration stage to lose identity information about whether the pattern was LM or CM. We show instead that the identity of barely detectable LM and CM patterns is not lost. Secondly, when LM and CM gratings are combined in-phase or out-of-phase we find no evidence for cancellation, nor for 'phase-blindness'. These results suggest that information about LM and CM is not pooled or merged--shading is not confused with texture variation. We suggest that LM and CM signals are carried by separate channels, but they share a common adaptation mechanism that accounts for the almost complete transfer of perceptual aftereffects.

Feature detection algorithm based on a visual system model

An algorithm for the detection of visually relevant luminance features is presented. The algorithm is motivated and directed by current models of the visual system. The algorithm detects edges (sharp luminance transitions) and narrow bars (luminance cusps) and marks them with the proper polarity. The image is first bandpass filtered with oriented filters at a number of scales an octave apart. The suprathreshold image contrast details at each scale are then identified and are compared across scales to find locations in which the signal polarity (sign) is identical at all scales, representing a minimal level of phase congruence across scales. These locations maintain the polarity of the bandpass-filtered image. The result is a polarity-preserving features map representing the edges with pairs of light and dark lines or curves on corresponding sides of the contour. Similarly, bar features are detected and represented with single curves of the proper polarity. The algorithm is implemented without free (fitted) parameters. All parameters are directly derived from visual models and from measurements on human observers. The algorithm is shown to be robust with respect to variations in filter parameters and requires no use of quadrature filters or Hilbert transforms. The possible utility of such an algorithm within the visual system and in computer vision applications is discussed.

On the perceived location of global motion

We measured the effects of coherent motion of one set of dots on the perceived location of Gaussian envelopes formed by luminance modulation of a second set of dots. Perceived shifts in envelope location in the direction of coherent motion were obtained even when the dots forming the envelopes did not physically move in the direction of coherent motion. In such cases, perceived shifts coincided with stimulus configurations that permitted motion integration of the envelope dots with the coherently moving dots, for example, when envelope dots moved in random directions as opposed to being static. In subsequent experiments we explored the type of motion integration underlying the positional shifts obtained. We discounted the possibility that the visual system incorrectly attributes motion signals associated with coherently moving dots to envelope dots by demonstrating that positional shifts could be obtained even when the coherent dots were laterally displaced to either side of the envelope dots such that the regions occupied by the dots did not overlap. We also discounted spatio-temporal summation within the receptive fields of low-spatial-frequency motion-sensitive mechanisms by demonstrating that positional shifts persisted even when the dot displays were high-pass filtered. These results, coupled with the observation that the proportion of coherently moving dots required to produce positional shifts correlated well with global motion thresholds measured for the same dot configurations, suggests that visual processes which underlie motion-dependent positional shifts are based at least in part on cooperative interactions of the type implicated in global motion.

Monocular unmasking of noise-embedded patterns.

Binocular disparity cues may help an observer "unmask" a target in a background, thereby enhancing its detectability (e.g., Moraglia & Schneider, 1992). Here, we sought to determine whether similar effects could be produced by monocular displacement cues resulting from a two-frame sequential presentation of a Gabor pattern (a sinusoidal modulation of luminance combined with a Gaussian modulation of local contrast) embedded in an unvarying field of two-dimensional Gaussian noise. The Gabor in the second frame was spatially displaced relative to its location in the first frame; the horizontal displacement corresponded to a phase shift of the peak spatial frequency of the Gabor of 0 degree, 90 degrees, 180 degrees, 360 degrees, or 540 degrees. Monocular detection thresholds for the Gabor were appreciably lower for the 90 degrees, 180 degrees, and 540 degrees shift, than for the 0 degree and 360 degrees values. We explain these findings in terms of a model that constitutes the monocular analog of our summation model of binocular unmasking.

Motion of contrast envelopes: peace and noise.

We examined the effect of changing the composition of the carrier on the perception of motion in a drifting contrast envelope. Human observers were required to discriminate the direction of motion of contrast modulations of an underlying carrier as a function of temporal frequency and scaled (carrier) contrast. The carriers were modulations of both color and luminance, defined within a cardinal color space. Random-noise carriers had either binary luminance profiles or flat (gray-scale-white) or 1/f (pink) spectral power functions. Independent variables investigated were the envelope spatial frequency and temporal-drift frequency and the fundamental spatial frequency, color, and temporal-update frequency of the carrier. The results show that observers were able to discriminate correctly the direction of envelope motion for binary-noise carriers at both high (16 Hz) and low (2 Hz) temporal-drift frequencies. Changing the carrier format from binary noise to a flat (gray-scale) or 1/f amplitude profile reduced discrimination performance slightly but only in the high-temporal-frequency condition. Manipulation of the fundamental frequency of the carrier elicited no change in performance at the low temporal frequencies but produced ambiguous or reversed motion at the higher temporal frequencies as soon as the fundamental frequency was higher than the envelope modulation frequency. We found that envelope motion detection was sensitive to the structure of the carrier.

Blur tolerance for luminance and chromatic stimuli.

We investigated the blur tolerance of human observers for stimuli modulated along the isoluminant red-green, the isoluminant yellow-blue, and the luminance (black-white) direction in color space. We report the following results: (i) Blur difference thresholds for red-green and luminance stimuli (of equal cone contrast) are very similar and as low as 0.5 min of visual angle; for yellow-blue the lowest blur thresholds are much higher (1.5 min of visual angle). (ii) The smallest blur thresholds are found for slightly blurred square waves (reference blur of 1 arc min) and not for sharp edges. (iii) Blur thresholds for red-green and black-white follow a Weber law for reference (pedestal) blurs greater than the optimum blur. (iv) Using the model proposed by Watt and Morgan [Vision Res. 24, 1387 (1984)] we estimated the internal blur of the visual system for the black-white and the red-green color directions and arrived at the following estimates: 1.2 arc min for black-white stimuli at 10% contrast and 0.9 arc min for red-green stimuli at 10% cone contrast. Blur tolerance for yellow-blue is independent of external blur and cannot be predicted by the model. (v) The contrast dependence of blur sensitivity is similar for red-green and luminance modulations (slopes of -0.15 and -0.16 in log-log coordinates, respectively) and slightly stronger for yellow-blue (slope = -0.75). Blur discrimination thresholds are not predicted by the contrast sensitivity function of the visual system. Our findings are useful for predicting blur tolerance for complex images and provide a spatial frequency cutoff point when Gaussian low-pass filters are used for noise removal in colored images. They are also useful as a baseline for the study of visual disorders such as amblyopia.

29.4L: Late‐News Paper: Image Synchronized Brightness Control

AbstractA novel image synchronized brightness control (ISBC) method for active matrix liquid crystal display (AMLCD) was developed, where automatic modulation of the backlight luminance is performed according to the gray distribution of image data. The ISBC can deliver a peak luminance of 500 ∼ 600 nits, which is very comparable to that of cathode ray tubes (CRTs) and is 2 to 3 times higher than that of normal LCD. The dynamic CR is over 700. With this ISBC method we can display a vivid moving image, while maintaining the same level of power consumption and a backlight.

Visual calibration of CRT monitors

In this paper, we develop and test a technique for calibrating a computer-controlled television monitor using a visual comparison instead of a photometer. The basic principle of the calibration is to compare a patch of pixels that are uniformly driven for an adjustable voltage with a patch in which a predetermined fraction of the pixels are set to the maximum voltage and the remainder are set to the minimum. By adjusting the voltage to make the two patches appear equally bright we get an estimate of the voltage that produces the predetermined fraction of the maximum luminance. Smooth functions were fit to the relationship between the DAC output and the fraction of illuminated pixels using a least-squares method, and used to estimate the function relating screen luminance to voltage. This function was then used to calculate lookup tables for linearisation. Sinusoidal and beat (sum of two sinusoids) luminance modulations were generated from the calibrated lookup tables and their profiles were measured with a photometer in order to check the calibrations. We find that visual calibration is sufficiently reliable to be used as an alternative to calibration using a photometer. It is easier and cheaper than using a photometer: a good photometer can be more expensive than the combined cost of the computer, graphics card and monitor.

The spatial transformation of color in the primary visual cortex of the macaque monkey.

Perceptually, color is used to discriminate objects by hue and to identify color boundaries. The primate retina and the lateral geniculate nucleus (LGN) have cell populations sensitive to color modulation, but the role of the primary visual cortex (V1) in color signal processing is uncertain. We re-evaluated color processing in V1 by studying single-neuron responses to luminance and to equiluminant color patterns equated for cone contrast. Many neurons respond robustly to both equiluminant color and luminance modulation (color-luminance cells). Also, there are neurons that prefer luminance (luminance cells), and a few neurons that prefer color (color cells). Surprisingly, most color-luminance cells are spatial-frequency tuned, with approximately equal selectivity for chromatic and achromatic patterns. Therefore, V1 retains the color sensitivity provided by the LGN, and adds spatial selectivity for color boundaries.

The properties of the motion-detecting mechanisms mediating perceived direction in stochastic displays

Previous studies [e.g. Baker & Hess, 1998. Vision Research, 38, 1211–1222] have shown that perceived direction in displays composed of multiple, limited-lifetime, Gabor micropatterns (G) is influenced by movement both at the fine spatial scale of the internal luminance modulation (first-order motion) and the coarse spatial scale of the Gaussian, contrast window (second-order motion). However it is presently indeterminate as to whether this pattern of results is indicative of the processes by which first-order and second-order motion signals interact within the visual system per se or those by which motion information, irrespective of how it is defined, is utilised across different spatial scales. To address this issue, and more generally the properties of the mechanisms that analyse motion in such displays, we employed stochastic motion sequences composed of either G, G added to a static carrier (G+C) or G multiplied with a carrier (G*C). Crucially G*C, unlike both G and G+C, micropatterns contain no net first-order motion and second-order motion only at the scale of the internal contrast modulation. For small displacements perceived direction in all cases showed a dependence on the internal sinusoidal spatial structure of the micropatterns and characteristic oscillations were typically observed, consistent with models in which first-order motion and second-order motion are encoded on the basis of similar low-level mechanisms. Importantly for larger displacements, and also when the internal spatial structure was randomised on successive exposures (so that motion at this spatial scale was unreliable), performance tended to be veridical for all types of micropattern, even though under these conditions displacements of the G*C micropatterns should have been invisible to current, low-level, motion-detecting schemes. This suggests that both low-level motion sensors and mechanisms utilising a different motion-detecting strategy such as high-level, attentive, feature-tracking may mediate perceptual judgements in stochastic displays.

The temporal properties of first- and second-order vision

Vision is sensitive to first-order modulations of luminance and second-order modulations of image contrast. There is now a body of evidence that the two types of modulation are detected by separate mechanisms. Some previous experiments on motion detection have suggested that the second-order system is quite sluggish compared to the first-order system. Here we derive temporal properties of first- and second-order vision at threshold from studies of temporal integration and two-pulse summation. Three types of modulation were tested: luminance gratings alone, luminance modulations added to dynamic visual noise, and contrast modulations of dynamic noise. Data from the two-pulse summation experiment were used to derive impulse response functions for the three types of stimulus. These were then used to predict performance in the temporal integration experiment. Temporal frequency response functions were obtained as the Fourier transform of impulse responses derived from data averaged across two observers. The response to noise-free luminance gratings of 2 c/deg was bi-phasic and transient in the time domain, and bandpass in the frequency domain. The addition of dynamic noise caused the response to become mono-phasic, sustained and low-pass. The response to contrast modulated noise (second-order) was also mono-phasic, sustained and low-pass, with only a slightly longer integration time than in the first-order case. The ultimate roll-off at high frequencies was about the same as for the first-order case. We conclude that second-order vision may not be as sluggish as previously thought.

Probability summation for multiple patches of luminance modulation

When components of a compound pattern stimulate different visual mechanisms, psychophysical performance typically improves by a small amount consistent with probability summation amongst independent detectors. Here we extend previous summation experiments by (i) plotting full psychometric functions; and (ii) using compound stimuli with components that varied in up to three stimulus dimensions: spatial frequency (1, 4, 5 or 11 c/deg), orientation (0°, ±45°), and position. Stimulus components were isolated circular sine-phase patches of grating centred on up to four corners of an imaginary square surrounding a fixation-point. Combinations of component patches produced compound stimuli made from up to 16 components that differed in various combinations of the three stimulus dimensions. Other than when the spatial frequency was 11 c/deg, results were well described using: (i) probabilistic summation of individual psychometric functions; (ii) the Quick pooling formula; and (iii) the signal detection analysis for 2IFC developed by Tyler and Chen (2000) [Signal detection theory in the 2AFC paradigm: attention, channel uncertainty and probability summation (under review)]. We conclude that in general, nonlinear spatial summation is consistent with probabilistic summation across independent detecting mechanisms that vary in spatial frequency (a range of at least 1–5 c/deg), orientation (a range of 90°) and position (a range of at least 24 cycles at 4 c/deg). In further experiments, results were found to be consistent with probability summation for pairs of orthogonally oriented step-edge stimuli and a matrix of randomly oriented 11 c/deg sine-wave patches. This casts doubt on the generality of a recent suggestion that local interactions between colinearly oriented detectors within a spatial neighbourhood of around four cycles may contribute to nonlinear spatial summation [Bonneh & Sagi, 1998; Vision Research, 38, 3541–3553].

Detection of chromoluminance patterns on chromoluminance pedestals I: threshold measurements

Measurement of the detection thresholds of patterns on pedestals of various kinds has the potential of providing insight into the mechanisms that mediate pattern vision. This study is concerned with chromoluminance patterns, that is, patterns that vary over space in luminance, chromaticity, or both. Contrast thresholds for 1 c/deg Gabor patterns (targets) were measured as a function of the contrast of Gabor pedestal patterns (TvC functions), where the pedestals paired with each target were modulated in a wide range of directions in color space. For most target-pedestal pairs, the TvC function decreased (facilitation) and then increased as pedestal contrast increased. The increase went above the absolute contrast threshold (masking) for all target-pedestal pairs except in cases where facilitation occurred at the upper end of the pedestal contrast range. The specific form of the TvC function varied greatly with the target and pedestal, consistent with a general model of pedestal effects proposed by Foley [Journal of the Optical Society of America A, 1994, 11(6)]. There were two sets of target-pedestal pairs for which facilitation did not occur, but masking did occur: pairs in which the target was a luminance modulation and the pedestals were individually isoluminant and pairs in which the pedestal was blue/yellow and the target was in any of our directions except blue/yellow.

Does early non-linearity account for second-order motion?

A contrast-modulated (CM) pattern is formed when a modulating or envelope function imposes local contrast variations on a higher-frequency carrier. Motion may be seen when the envelope drifts across a stationary carrier and this has been attributed to a second-order pathway for motion. However, an early compressive response to luminance (e.g. in the photoreceptors) would introduce a distortion product at the modulating frequency. We used a nulling method to measure the distortion product, and then asked whether this early distortion could account for perception of second-order motion. The first stimulus sequence consisted of alternate frames of CM (100% modulation) and luminance-modulated (LM) patterns. Carriers were either 2-D binary noise (4×4 min arc dots) or a 4 c/deg grating, both modulated at 0.6 c/deg. The carrier was stationary while the phase of the modulating signal (LM alternating with CM) stepped successively through 90° to the left or right. Motion was seen in a direction opposite to the phase stepping, consistent with early compressive distortion that induces an out-of-phase LM component into the CM stimulus. We measured distortion amplitude by adding LM to the CM frames to null the perceived motion. Distortion increased as the square of carrier contrast, as predicted by the compressive transducer. It also increased with modulation drift rate, implying that the transducer is time-dependent, not static. Thus early compressive non-linearity does induce first-order artefacts into second-order stimuli. Nevertheless this does not account for second-order motion, since perceived motion of second-order sequences (CM in every frame) could in general not be nulled by adding LM components. We conclude that two pathways for motion do exist.