Luminance Modulation Research Articles

Pre-Exposure to Moving Form Enhances Static Form Sensitivity

BackgroundMotion-defined form can seem to persist briefly after motion ceases, before seeming to gradually disappear into the background. Here we investigate if this subjective persistence reflects a signal capable of improving objective measures of sensitivity to static form.Methodology/Principal FindingsWe presented a sinusoidal modulation of luminance, masked by a background noise pattern. The sinusoidal luminance modulation was usually subjectively invisible when static, but visible when moving. We found that drifting then stopping the waveform resulted in a transient subjective persistence of the waveform in the static display. Observers' objective sensitivity to the position of the static waveform was also improved after viewing moving waveforms, compared to viewing static waveforms for a matched duration. This facilitation did not occur simply because movement provided more perspectives of the waveform, since performance following pre-exposure to scrambled animations did not match that following pre-exposure to smooth motion. Observers did not simply remember waveform positions at motion offset, since removing the waveform before testing reduced performance.Conclusions/SignificanceMotion processing therefore interacts with subsequent static visual inputs in a way that can improve performance in objective sensitivity measures. We suggest that the brief subjective persistence of motion-defined forms that can occur after motion offsets is a consequence of the decay of a static form signal that has been transiently enhanced by motion processing.

Monocular signals in human lateral geniculate nucleus reflect the Craik-Cornsweet-O'Brien effect

The human visual system has a remarkable ability to accurately estimate the relative brightness of adjacent objects despite large variations in illumination. However, the lightness of two identical equiluminant gray regions can appear quite different when a light-dark luminance transition falls between them. This illusory brightness "filling-in" phenomenon, the Craik-Cornsweet-O'Brien (CCOB) illusion, exposes fundamental assumptions made by the visual system in estimating lightness, but its neural basis remains unclear. While the responses of high-level visual cortex can be correlated with perception of the CCOB, simple computational models suggest that the effect may originate from a much lower level, possibly subcortical. Here, we used high spatial resolution functional magnetic resonance imaging to show that the CCOB illusion is strongly correlated with signals recorded from the human lateral geniculate nucleus. Moreover, presenting the light and dark luminance transitions that induce the CCOB effect separately to each eye abolishes the illusion, suggesting that it depends on eye-specific signals. Our observations suggest that the CCOB effect arises from signals in populations of monocular neurons very early in the human geniculostriate visual pathway.

Liquid crystal display response time estimation for medical applications

Accurate characterization of diagnosis instruments is crucial in medical applications such as radiology and clinical neurosciences. While classical CRT medical displays have been replaced almost exclusively with liquid crystal devices (LCDs), the assessment of their temporal properties (response times) is still largely based on heuristic methods, which have not been evaluated thoroughly yet. The authors introduce a novel approach and show that it improves the accuracy and reliability compared to the common heuristic recommended by ISO 9241-305 substantially for a wide range of settings. The approach is based on disentangling the signal from the modulatory backlight through division (division approach). They evaluated this method in two different ways: First, they applied both methods to luminance transition measurements of different LCD monitors. Second, they simulated LCD luminance transitions by modeling the LCD optical responses according to a physical liquid crystal director orientation model. The simulated data were generated for four different response times, each with four different backlight modulation frequencies. Both the novel and the ISO convolution method were applied to the data. Application of the methods to the simulated data shows a bias of up to 46% for the ISO approach, while the novel division approach is biased at most 2%. In accordance with the simulations, estimates for real measurements show differences in the two approaches of more than 200% for some LCD panels. The division approach is robust against periodic backlight fluctuations and can reliably estimate even very short response times or small transitions. Unlike the established method, it meets the accuracy requirements of medical applications. In contrast, the popular convolution approach for estimating response times is prone to misestimations of time by several orders of magnitude and tend to further worsen as advances in LCD technology lead to shorter response times.

Analytic solution to remove flickers on a liquid crystal display television

Flickers have been critical issues on liquid crystal displays (LCDs) which use a backlight unit (BLU) under a panel. The luminance modulation of the backlight and the transmittance of the panel are independently investigated in frequency domain to look for an analytic solution to remove flickers on the LCD panel. The transmittance of the panel depends on how to drive the LC molecules and how the LC molecules respond. We shows there are three frequency components caused by only the panel driving. It is shown that the flicker can be generated by the inter-modulation effect between two different frequency groups from the BLU and the panel. To remove flickers on LCD TV panels, the frequency of the PWM backlight signal should be carefully chosen so that the inter-modulation frequencies may be higher than 60 Hz. It is shown that it is impossible to perceive flickers on an LCDTV operating at 120 Hz refresh rate if the frequency of the PWM signal is 120 Hz or 180 Hz.

Three-dimensional shape from second-order orientation flows

In images of textured surfaces, orientation flows formed by perspective convergence invariably convey 3D shape. We show that orientation flows formed by contrast-modulated (CM) and illusory contours (IC) convey 3D shape, and that both stimulus types induce 3D shape aftereffects on CM and IC test stimuli. Adaptation to luminance-modulated (LM) orientation flows induce robust 3D shape aftereffects on CM and IC tests, however, aftereffects using CM/IC adapting stimuli on LM tests were substantially weaker. These results can be explained by the adaptation of 3D shape-selective neurons that invariantly extract first- and second-order orientation flows from striate and extra-striate signals, which receive stronger input from neurons selective for first-order orientation flows.

Evaluation of motion performance on scanning‐backlight LCDs

The scanning‐backlight technique to improve the motion performance of LCDs is introduced. This technique, however, has some drawbacks such as double edges and color aberration, which may become visible in moving patterns. A method combining accurate measurements of temporal luminance transitions with the simulation of human‐eye tracking and spatiotemporal integration is used to model the motion‐induced profile of an edge moving on a scanning‐backlight LCD‐TV panel that exhibits the two drawbacks mentioned above. The model results are validated with a perception experiment including different refresh rates, and a high correspondence is found between the simulated apparent edge and the one that is perceived during actual motion. Apart from the motion‐induced edge blur, the perception of a moving line or square‐wave grating can also be predicted by the same method starting from the temporal impulse and frame‐sequential response curves, respectively. Motion‐induced image degradation is evaluated for both a scanning‐ and continuous‐backlight mode based on three different characteristics: edge blur, line spreading, and modulation depth of square‐wave grating. The results indicate that the scanning‐backlight mode results in better motion performance.

Evaluation of motion performance on scanning‐backlight LCDs

Abstract— The scanning‐backlight technique to improve the motion performance of LCDs is introduced. This technique, however, has some drawbacks such as double edges and color aberration, which may become visible in moving patterns. A method combining accurate measurements of temporal luminance transitions with the simulation of human‐eye tracking and spatiotemporal integration is used to model the motion‐induced profile of an edge moving on a scanning‐backlight LCD‐TV panel that exhibits the two drawbacks mentioned above. The model results are validated with a perception experiment including different refresh rates, and a high correspondence is found between the simulated apparent edge and the one that is perceived during actual motion. Apart from the motion‐induced edge blur, the perception of a moving line or square‐wave grating can also be predicted by the same method starting from the temporal impulse and frame‐sequential response curves, respectively. Motion‐induced image degradation is evaluated for both a scanning‐ and continuous‐backlight mode based on three different characteristics: edge blur, line spreading, and modulation depth of square‐wave grating. The results indicate that the scanning‐backlight mode results in better motion performance.

Motion transparency from opposing luminance modulated and contrast modulated gratings

Two luminance gratings of identical orientation and opposite directions of motion are seen as moving across one another (i.e. moving transparently) only if they differ in spatial frequency (SF) by a factor of four or more. Identical SF gratings produce counter-phase flicker. This suggests that opposite motions cancel each other at the level of motion detection. Here we show that motion transparency is perceived with two gratings of the same SF and orientation moving in opposite directions, when one grating is a first-order, luminance modulated (LM) stimulus and the other is a second-order, contrast modulated (CM) stimulus. Participants were presented with various combinations of LM and CM gratings. In experiment 1, the test stimulus contained the summation of oppositely moving LM and CM gratings. In order to assess the simultaneous perception of both motions, we used a paradigm where observers were required to discriminate the direction of motion of each component from counter-phase flicker. Results show that observers can accurately discriminate both LM and CM directions of motion in a transparent configuration. We next measured the effect of varying the contrast/modulation depth of LM and CM gratings on the perception of transparency. The perception of motion transparency depends upon the relative contrast/modulation depth of the component gratings: raising the contrast of the LM component necessitates a greater modulation depth for the CM component if motion transparency is to be perceived. Our results are consistent with a motion system comprised of two separate, but not wholly independent, pathways for the encoding of LM and CM signals. We hypothesise that the observed contrast dependence is the result of contrast gain control mechanisms that receive inputs from separate motion systems.

Invisible motion contributes to simultaneous motion contrast

The purpose of the present study was two-fold. First we examined whether visible motion appearance was altered by the spatial interaction between invisible and visible motion. We addressed this issue by means of simultaneous motion contrast, in which a horizontal test grating with a counterphase luminance modulation was seen to have the opposite motion direction to a peripheral inducer grating with unidirectional upward or downward motion. Using a mirror stereoscope, observers viewed the inducer and test gratings with one eye, and continuous flashes of colorful squares forming an annulus shape with the other eye. The continuous flashes rendered the inducer subjectively invisible. The observers’ task was to report whether the test grating moved upward or downward. Consequently, simultaneous motion contrast was observed even when the inducer was invisible (Experiment 1). Second, we examined whether the observers could correctly respond to the direction of invisible motion: It was impossible (Experiment 2).

Document Image Processing for Paper Side Communications

This paper proposes the use of higher order statistical moments in document image processing to improve the performance of systems which transmit side information through the print and scan channel. Examples of such systems are multilevel 2-D bar codes and certification via text luminance modulation. These systems print symbols with different luminances, according to the target side information. In previous works, the detection of a received symbol is usually performed by evaluating the average luminance or spectral characteristics of the received signal. This paper points out that, whenever halftoning algorithms are used in the printing process, detection can be improved by observing that third and fourth order statistical moments of the transmitted symbol also change, depending on the luminance level. This work provides a thorough analysis for those moments used as detection metrics. A print and scan channel model is exploited to derive the relationship between the modulated luminance level and the higher order moments of a halftone image. This work employs a strategy to merge the different moments into a single metric to achieve a reduced detection error rate. A transmission protocol for printed documents is proposed which takes advantage of the resulting higher robustness achieved with the combined detection metrics. The applicability of the introduced document image analysis approach is validated by comprehensive computer simulations.

Distinct position assignment mechanisms revealed by cross-order motion

Motion perception influences perceived position. It has been shown that first-order (luminance defined) motion shifts perceived position across a wide range of spatial and temporal frequencies. On the other hand, second-order (contrast defined) motion shifts perceived position over a narrow range of temporal frequencies, regardless of spatial frequency [Bressler, D. W., & Whitney, D. (2006). Second-order motion shifts perceived position. Vision Research, 46(6–7), 1120–1128]. These results suggest the presence of distinct position assignment mechanisms for first- and second-order motion. We investigated whether the first- and second-order systems independently encode and assign the position of a moving stimulus. To measure motion induced position shift we presented two horizontally offset Gabors placed above and below a central fixation point, with sine wave carriers drifting in opposite directions. Subjects judged the position of the top Gabor relative to the bottom one. We used both first-order Gabors (sinusoidal luminance modulation of a dynamic noise carrier enveloped by a static Gaussian) and second-order Gabors (sinusoidal contrast modulation of a dynamic noise carrier enveloped by a static Gaussian). Results showed a strong position shift in the direction of the carrier motion when both Gabors were first-order, a weak position shift when both Gabors were second-order, and no appreciable position shift when one Gabor was first-order and the other was second-order (cross-order motion). The absence of a position shift using cross-order motion supports the hypothesis that the two motion systems independently encode and assign the position of a moving object. These results are consistent with those of experiments investigating global spatial interactions between static first-order and second-order Gabor patches, indicating a commonality in the underlying spatial integration processes.

The impulse response of S-cone pathways in detection of increments and decrements.

Impulse response functions (IRFs) were obtained from two-pulse detection thresholds using isoluminant stimuli that produced increments or decrements in S-cone excitation. The pulses were chromatically modulated at constant luminance (based on 18 Hz heterochromatic flicker photometry). Chromatic stimuli were presented as a Gaussian patch (+/-1 SD = 2.3 degrees) in one of four quadrants around a central fixation cross on a CRT screen. Each of the two pulses (6.67 ms) was separated by an inter-stimulus interval (ISI) from 20 to 360 ms. Chromaticity of the pulses was changed from the equal-energy white of the background to a bluish or yellowish color along individually determined tritan lines (based on color matching under strong S-cone adaptation from a 420 nm background superimposed in Maxwellian view). Chromatic detection thresholds were determined by a four-alternative forced-choice method with staircases for each ISI interleaved in each session. Measurements were repeated in at least four sessions for each observer. IRFs were calculated by varying four parameters of an exponentially-damped sinewave. Both S-cone increment and decrement IRFs are characterized by a single excitatory phase and a much longer time course compared with IRFs derived for luminance modulation using the same apparatus and observers. S-cone increment IRFs are faster than S-cone decrement IRFs; the time to peak amplitude of S-cone increment and decrement IRFs is 50-70 and 100-120 ms, respectively. These results were used to derive the temporal contrast sensitivity for human observers of putative ON- and OFF-channels carrying signals from S-cones.

Redundant target effect and the processing of colour and luminance

The redundant target effect is the observation that people typically respond faster to double targets (two targets presented simultaneously) than to either of the targets presented alone. This difference in latency is termed the redundancy gain (RG). Chromatic targets may be accompanied with luminance changes at their onset and offset. We have used a dynamic random luminance modulation technique to mask out luminance components of chromatic signals. Here we report on the presence of a significant RG for visual targets defined by their combined luminance and chromatic components as well as their chromatic content in isolation. Reaction times were measured to the onset of three classes of stimuli, namely, Long- and Short-wavelength cone sensitive (L- and S-cone) targets matched for saliency as well as luminance-defined targets. Analysis of the cumulative distributions of reaction time data showed that a neural coactivation model could fit the experimental data for chromatic targets only. When a luminance component is present, the reaction time data can be explained by a probability summation account also known as the race model.

A YC‐separation‐type projector: High dynamic range with double modulation

Abstract— An experimental projector that features double modulation to obtain high‐resolution (4096 × 2160 pixels) and high‐dynamic‐range images has been developed. Although a conventional projector contains three modulators for red, green, and blue and outputs light after combining the modulated light from these three sources, our projector has an additional modulator for luminance that modulates the combined RGB modulated light. It can display high‐resolution color images by combining three low‐resolution panels for chrominance modulation and one high‐resolution panel for luminance modulation. In addition, the dynamic range is dramatically improved because the double‐modulation scheme minimizes black levels in projected images. The projector demonstrates an extremely high dynamic range of 1.1 million to 1 and 10‐bit tone reproduction.

Temporal Frequency and the Magnocellular and Parvocellular Systems

Can the magnocellular system be stimulated exclusively, or predominantly, by using a particular temporal frequency? There are two problems. (1) Many researchers have confused contrast reversal rates with luminance modulation frequencies, even though it is the latter (which is half the reversal rate) that may be compared to neuronal responses. (2) Many of the frequencies used are too low to selectively activate magnocellular neurons. While a pure magnocellular response may be obtained by employing particular combinations of temporal frequency, spatial frequency and contrast, however, this possibility is limited to stimuli close to detection threshold, and such stimuli give only weak responses.

The temporal properties of the response of macaque ganglion cells and central mechanisms of flicker detection

This analysis assesses sensitivity of primate ganglion cells to sinusoidal modulation as a function of temporal frequency, based on the structure of their impulse trains; sensitivity to luminance and chromatic modulation was compared to human psychophysical sensitivity to similar stimuli. Each stimulus cycle was Fourier analyzed, and response amplitudes subjected to neurometric analysis; this assumes a detector with duration inversely proportional to frequency, that is, the stimulus epoch analyzed is a single cycle rather than a fixed duration, and provides an upper bound for a detection by an observer who bases judgments on a single cell. Signal-to-noise ratio for a given Fourier amplitude rapidly decreased with temporal frequency. This is a consequence of the statistics of impulse trains making up the response; at higher temporal frequencies, there are fewer impulses per cycle. Performance of this "single-cell" observer was then compared with that of modeled central detection mechanisms of fixed duration. For chromatic modulation, a filter/detector with a time constant of approximately 40 ms operating upon the parvocellular (PC) pathway provided a match to psychophysical results, whereas for luminance modulation, a filter/detection mechanism operating upon the magnocellular (MC) pathway with a time constant of approximately 5-10 ms provided a suitable match. The effects of summation and nonlinear interactions between cell inputs to detection are also considered in terms of enhanced sensitivity and "sharpness" of thresholds, that is, the steepness of the neurometric function. For both luminance (MC cells) and chromatic modulation (PC cells), restricted convergence (<20 cells) appears adequate to provide sharp thresholds and sensitivity comparable to psychophysical performance.

The vergence eye movements induced by radial optic flow: Some fundamental properties of the underlying local-motion detectors

Radial optic flow applied to large random dot patterns is known to elicit horizontal vergence eye movements at short latency, expansion causing convergence and contraction causing divergence: the Radial Flow Vergence Response (RFVR). We elicited RFVRs in human subjects by applying radial motion to concentric circular patterns whose radial luminance modulation was that of a square wave lacking the fundamental: the missing fundamental ( mf) stimulus. The radial motion consisted of successive ¼–wavelength steps, so that the overall pattern and the 4 n+1 harmonics (where n = integer) underwent radial expansion (or contraction), whereas the 4 n−1 harmonics—including the strongest Fourier component (the 3rd harmonic)—underwent the opposite radial motion. Radial motion commenced only after the subject had fixated the center of the pattern. The initial RFVRs were always in the direction of the 3rd harmonic, e.g., expansion of the mf pattern causing divergence. Thus, the earliest RFVRs were strongly dependent on the motion of the major Fourier component, consistent with early spatio-temporal filtering prior to motion detection, as in the well-known energy model of motion analysis. If the radial mf stimulus was reduced to just two competing harmonics—the 3rd and 5th—the initial RFVRs showed a nonlinear dependence on their relative contrasts: when the two harmonics differed in contrast by more than about an octave then the one with the higher contrast completely dominated the RFVRs and the one with lower contrast lost its influence: winner-take-all. We suggest that these nonlinear interactions result from mutual inhibition between the mechanisms sensing the motion of the different competing harmonics. If single radial-flow steps were used, a brief inter-stimulus interval resulted in reversed RFVRs, consistent with the idea that the motion detectors mediating these responses receive a visual input whose temporal impulse response function is strongly biphasic. Lastly, all of these characteristics of the RFVR, which we attribute to the early cortical processing of visual motion, are known to be shared by the Ocular Following Response (OFR)—a conjugate tracking (version) response elicited at short-latency by linear motion—and even the quantitative details are generally very similar. Thus, although the RFVR and OFR respond to very different patterns of global motion—radial vs. linear—they have very similar local spatiotemporal properties as though mediated by the same low-level, local-motion detectors, which we suggest are in the striate cortex.

Asymmetric transfer of the dynamic motion aftereffect between first- and second-order cues and among different second-order cues

Recent work on motion processing has suggested a distinction between first-order cues (such as luminance modulation [LM]) and second-order cues (such as local contrast modulation [CM]). We studied interactions between moving LM, CM, and orientation modulation (OM) first comparing their spatial- and temporal-frequency sensitivity. We then tested for the transfer of the dynamic motion aftereffect (dMAE) between the three cues, matched for visibility. Observers adapted to moving, 0.5-c/deg horizontal modulations for 2 min (with 10 s top-ups). Relatively strong dMAEs were found when the adaptation and test patterns were defined by the same cue (i.e., both LM, both CM, or both OM); these effects were tuned for spatial frequency in the case of LM and CM. There was a partial transfer of the dMAE from LM to CM and OM; this transferred effect seemed to lose its tuning. The aftereffect transferred well from CM to OM and retained its tuning. There was little or no transfer from CM to LM or from OM to CM or LM. This asymmetric transfer of the dMAE between first- and second-order cues and between the second-order cues suggests some degree of separation between the mechanisms that process them.

39.1: Adaptive Dimming and Boosting Backlight for LCD‐TV Systems

AbstractThe limited transmittance of LCD panels can be observed as a waste of energy, leading to a limited brightness. Light leaking through LCD panels driven to black, can be observed as a poor black‐level, limiting the contrast ratio.Adaptive Dimming Backlight technology can be applied to attenuate the backlight luminance, improving local contrast, black‐level and saving power.The optical crosstalk between the controllable backlight segments has a negative impact on the dimming performance, limiting the spatial backlight luminance modulation. Crosstalk Compensation can partly compensate this artifact, enhancing the spatial modulation of the segments.Adaptive Boosting Backlight technology can be applied to boost the output of the panel over 100%. This improves the local brightness and contrast for a sparkling picture, still saving power.Crosstalk compensation enables deeper dimming. Deeper dimming improves on contrast and enables more boosting for an even brighter picture. So when these technologies are combined: The contrast may increase up to 5 times (CCFL/EEFL). The brightness may double and contrast may increase up to 20 times (HCFL). Alternatively, for 2D‐Dimming the spatial contrast may increase up to a factor of 100 and the temporal contrast may increase to infinite (LED). At the same time, up to 50% average power can be saved!

Maturation of the sensitivity for luminance and contrast modulated patterns during development of normal and pathological human children

Any object may contain at least two spatio-temporal components referred to as first- and second-order, respectively, defined by spatial-temporal luminance modulation or by contrast, texture or depth modulation. This study investigates form sensitivity of infants, normals, premature or strabismic. A two-alternative forced-choice preferential looking procedure was used in monocular and binocular condition. Maturation profile for both stimuli was similar in the control group. Strabismic infants showed a vertical offset in maturation, which affected the second-order more severely. The pre-term group showed a lag of second-order sensitivity. Our results underline differences between first- and second-order processing.