Color Filter Research Articles

Customized Structural Color Filters by Pixel‐Level Electrothermal Regulation

AbstractReflective structural colors have backlight‐free supremacy and can provide energy‐efficient and environmental‐friendly color production for many applications. However, they are hindered by the complex process and incorrect colors after fabrication. Here, a pixelated electrothermal oxidation technique is proposed that can precisely tailor and produce reflective structural colors covering the entire visible range, providing the possibility for customized structural color filter arrays from a titanium canvas. Furthermore, as a demonstration, a photonic‐firework‐like color filter array is achieved in a single step via thermal engineering. Based on this one‐step‐forming color array, a computational spectrometer is also realized featuring a resolvability of 10 nm and operating bandwidth covering the whole visible range. Considering its compactness and mass production capability, this method has numerous potential applications in, e.g., imaging, anti‐counterfeiting, printing, color display, and spectroscopy.

Determination and use of external color filter for improved camera colorimetry

Most digital cameras have spectral characteristics that make it impossible for the camera to provide accurate colorimetric information of a recorded scene. We extend previous work on using multiple filtered exposures by the use of a newly available capability of creating manufacturable filters using online software. Multiple criteria are considered in the determination of an optimal color filter on a training dataset. These criteria include the Vora-Value, figure of merit (FOM), training average ΔE, and training maximum ΔE. Our method includes the use of a realistic imaging noise model. We use two optimization methods: minimum mean square error (MMSE), which requires knowledge of the color sensitivities of the camera’s internal RGB filters and knowledge of the covariance matrices of the data ensemble and the noise, and a pseudoinverse method that uses only the recorded data and knowledge of the values of the training data. Filters were selected using the training data and the performance is measured on independent testing data. The results from both optimization methods show that filters chosen using the training ΔE criteria consistently outperformed the theoretical FOMs. It is also shown that the MMSE method is very sensitive to small perturbations of the internal filter sensitivities. Real camera images were recorded using the optimally determined filters from both methods. Measured errors provide confirmation of the simulated results.

Scalable Superabsorbers and Color Filters Based on Earth-Abundant Materials.

Optical materials based on unconventional plasmonic metals (e.g., magnesium) have lately driven rising research interest for the quest of possibilities in nanophotonic applications. Several favorable attributes of Mg, such as earth abundancy, lightweight, biocompatibility/biodegradability, and its active reactions with water or hydrogen, have underpinned its emergence as an alternative nanophotonic material. Here, we experimentally demonstrate a thin film-based optical device composed exclusively of earth-abundant and complementary metal-oxide semiconductor (CMOS)-compatible materials (i.e., Mg, a-Si, and SiO2). The devices can exhibit a spectrally selective and tunable near-unity resonant absorption with an ultrathin a-Si absorbing layer due to the strong interference effect in this high-index and lossy film. Alternatively, they can generate diverse reflective colors by appropriate tuning of the a-Si and SiO2 layer thicknesses, including all the primary colors for RGB (red, green, blue) and CMY (cyan, magenta, yellow) color spaces. In addition, the reflective hues of the devices can be notably altered in a zero power-consumption fashion by immersing them in water due to the resulted dissolution of the Mg back-reflection layer. These compelling features in combination with the lithography-free and scalable fabrication steps may promise their adoption in various photonic applications including solar energy harvesting, optical information security, optical modulation, and filtering as well as structure reuse and recycling.

The Tartan Ribbon or Further Experiments of Maxwell’s Disappointment/Sutton’s Accident

On 17 May 1861, James Clerk Maxwell delivered a lecture at the Royal Society where he demonstrated, using a lantern slide projection, his theory for colour perception in the human eye via the additive colour process known today as RGB. Three images from three separate lantern slide projectors were projected onto a surface. The same colour filters with which the object had been photographed where then placed in front of each projection lens, carefully realigned, and what has been called “the first colour photograph” was supposed to have been created. It was a series of happy accidents, during capture and exposure, and a misinterpretation of the results—mostly long after the event itself—that has invented this commonly referred to fictional “First Ever” title. In the following retelling of the historical details in their chronological order and through a series of experiments with historically correct emulsions, we will clearly outline the errors and where they occurred.

Color performance of 0.8 um CMOS image sensor with CMY color filters

Modern digital cameras capture images with a subsampling method via mosaic color filter array (CFA). Of particular interest is the CFA with Cyan-Magenta-Yellow (CMY) color filters. Despite the improvement of the sensitivity, images reconstructed from CMY CFA usually suffer from lower color fidelity compared to the conventional Red-Green-Blue (RGB) color filters. In this paper, we proposed a CMY CFA with novel spectral sensitivities (CMY2.0), which were carefully designed to overcome the shortcomings of previous CMY CFA (CMY1.0). A CMY CMOS image sensor (CIS) with such optimized spectral sensitivities is then realized in order to evaluate the color performance and signal-to-noise ratio (SNR). As a result, the camera equipped with the CMY CFA with proposed spectral sensitivities (CMY2.0) features both an improved sensitivity and a high color fidelity, which is suitable for a wide range of applications, such as low-light photography, under-screen cameras and automotive cameras.

Machine learning estimation of camera spectral sensitivity functions with non-RGB color filters

The spectral sensitivity functions of a digital image sensor determine the sensor’s color response to scene-radiated light. Knowing these spectral sensitivity functions is very important for applications that require accurate color, such as computer vision. Traditional measurements of these functions are time consuming, and require expensive lab equipment to generate narrow-band monochromatic light. Previous works have shown that sensitivity curves can be estimated using images of a color checker chart with known spectral reflectances, using either numerical optimization or machine learning. However, previous works in the literature have not considered sensitivity functions for CFAs (color filter arrays) other than RGB, such as RCCB (Red Clear Blue) or RYYCy (Red Yellow Cyan). Non-RGB CFAs have been shown to be useful for automotive and security camera applications, especially in low light situations. We propose a machine learning method to estimate the sensitivity curves of sensors with non-RGB filters, in addition to the RGB filters addressed previously in the literature, using a single image of a color chart under unknown illumination. Including non-RGB filters makes the estimation problem much more challenging, since the resulting space of color filters is no longer modelled by simple Gaussian shapes.

The case for an LMS camera

Consumer color cameras employ sensors that do not mimic human cone spectral sensitivities, and more generally do not meet the Luther condition since the accompanying color correction substantially amplifies noise in the red channel. This begs the question: if cone spectral sensitivities yield low SNR, why has the Human Visual System so evolved? We answer the above question by noting that since modern ISPs - and the ancient HVS - remove virtually all chrominance noise, chrominance denoising artifacts rather than the chrominance noise itself should be considered. While sensor green, blue are reasonable analogs of the human M, S cones, the spectral sensitivity of red is much narrower than that of L and does not overlap much with green. An imager employing L instead of red suffers from increased red noise but is also more sensitive. This allows a high SNR (L + M)/2 luminance image to be reconstructed and used for denoising. Modeling the color filter array on the human retina, with a higher density of L pixels at the expense of S pixels, further improves the red SNR without the accompanying loss of blue quality being perceptible. The resulting LMS camera outperforms conventional RGB cameras in color accuracy and luminance SNR while being competitive in chrominance quality.

Multicolor detour phase holograms based on an Al plasmonic color filter.

The remarkable advances in nanofabrication that have occurred over the last decade present opportunities for the realization of new types of holograms. In this work, for the first time to the best of our knowledge, a method for phase multicolor holograms based on nanohole arrays is described. The nanoholes are in an aluminum film that is interposed between the glass substrate and a silicon dioxide layer. The nanoholes serve as color filters for blue, green, and red wavelengths and provide the necessary phase distribution via the detour phase method. Our nanohole arrays are optimized to maximize the transmission efficiency of the red, green, and blue channels and to minimize the cross-talk between them. We design two multicolor holograms based on these filters and simulate their performance. The results show good fidelity to the desired holographic images. The proposed structure has the advantages of being very compact, of requiring only a simple fabrication method with one lithography step, and of employing materials (aluminum and silicon dioxide) that are compatible with standard CMOS technology.

Efficient Quantum Dot Color Conversion Layer with Mixed Spherical/Rod-Shaped Scattering Particles

A quantum dot (QD) color conversion layer (CCL) with mixed-shaped scattering nanoparticles exhibits enhanced light conversion and reduced blue leakage in QD-organic light-emitting diodes (OLEDs). In this study, nontoxic bright red QDs and spherical and rod-shaped zinc oxide (ZnO) nanoparticles were mixed in an ultraviolet-curable resin without aggregation. The mixture of spherical and rod-shaped ZnO nanoparticles enhanced the blue light scattering inside the QD CCL, which results in an increase of the blue absorption by the QDs and a dramatic improvement of the color conversion. Extraction of the converted red light was also attributed to the Mie scattering of the rod-shaped scattering nanoparticles. The QD CCL with 15 wt % mixed-shaped scattering particles showed seven times increase of red intensity and four times decrease of blue intensity compared to that without scattering particles. We fabricated direct coat-type QD-OLEDs and confirmed that the color conversion and output/input efficiencies were improved and the blue leakage was decreased with increasing number of QD CCLs. This method improves the color conversion efficiency without increasing the amount of QDs and reducing the blue leakage without using a color filter.

Adversarial Image Color Transformations in Explicit Color Filter Space

Deep Neural Networks have been shown to be vulnerable to adversarial images. Conventional attacks strive for indistinguishable adversarial images with strictly restricted perturbations. Recently, researchers have moved to explore distinguishable yet non-suspicious adversarial images and demonstrated that color transformation attacks are effective. In this work, we propose Adversarial Color Filter (AdvCF), a novel color transformation attack that is optimized with gradient information in the parameter space of a simple color filter. In particular, our color filter space is explicitly specified so that we are able to provide a systematic analysis of model robustness against adversarial color transformations, from both the attack and defense perspectives. In contrast, existing color transformation attacks do not offer the opportunity for systematic analysis due to the lack of such an explicit space. We further demonstrate the effectiveness of our AdvCF in fooling image classifiers and also compare it with other color transformation attacks regarding their robustness to defenses and image acceptability through an extensive user study. We also highlight the human-interpretability of AdvCF and show its superiority over the state-of-the-art human-interpretable color transformation attack on both image acceptability and efficiency. Additional results provide interesting new insights into model robustness against AdvCF in another three visual tasks.

Guided Colorization Using Mono-Color Image Pairs.

Compared to color images captured by conventional RGB cameras, monochrome (mono) images usually have higher signal-to-noise ratios (SNR) and richer textures due to the lack of color filter arrays in mono cameras. Therefore, using a mono-color stereo dual-camera system, we can integrate the lightness information of target monochrome images with the color information of guidance RGB images to accomplish image enhancement in a colorization manner. In this work, based on two assumptions, we introduce a novel probabilistic-concept guided colorization framework. First, adjacent contents with similar luminance are likely to have similar colors. By lightness matching, we can utilize colors of the matched pixels to estimate the target color value. Second, by matching multiple pixels from the guidance image, if more of these matched pixels have similar luminance values to the target one, we can estimate colors with more confidence. Based on the statistical distribution of multiple matching results, we retain the reliable color estimates as initial dense scribbles and then propagate them to the rest of the mono image. However, for a target pixel, the color information provided by its matching results is quite redundant. Hence, we introduce a patch sampling strategy to accelerate the colorization process. Based on the analysis of the posteriori probability distribution of the sampling results, we can use much fewer matches for color estimation and reliability assessment. To alleviate incorrect color propagation in the sparsely scribbled regions, we generate extra color seeds according to the existed scribbles to guide the propagation process. Experimental results show that, our algorithm can efficiently and effectively restore color images with higher SNR and richer details from the mono-color image pairs, and achieves good performance in solving the color bleeding problem.

Dielectric chiral metasurfaces for enhanced circular dichroism spectroscopy at near infrared regime.

Numerous applications of chiro-optical effects can be found in nanophotonics, including imaging and spin-selective absorption, particularly in sensing for separating and detecting chiral enantiomers. Flat single-layer metasurfaces composed of chiral or achiral sub-wavelength structures offer unique properties to manipulate the light due to their extraordinary light-matter interaction. However, at optical wavelengths, the generation of strong chirality is found to be challenging via conventional chiral metasurface approaches. This work intends to design and optimize a dielectric chiral meta-nano-surface based on a diatomic design strategy to comprehend giant chiro-optical effects in the near-infrared (NIR) regime for potential application in circular dichroism (CD) spectroscopy. Instead of using a single chiral structure that limits the CD value at optical wavelengths, the proposed metasurface used a diatomic (two meta-atoms with distinct geometric parameters) chiral structure as a building block to significantly enhance the chiro-optical effect. Combining both meta-atoms in a single periodicity of the building block introduces constructive and destructive interferences to attain the maximum circular dichroism value exceeding 75%. Moreover, using multipolar resonance theory, the physics behind the generation of giant chiro-optical effects have also been investigated. The proposed dielectric chiral meta-platform based on the extra degree of freedom can find application in compact integrated optical setups for CD spectroscopy, enantiomer separation and detection, spin-dependent color filters, and beam splitters.

Multispectral Filter Array Design by Optimal Sphere Packing.

Multispectral imaging (MSI) collects a datacube of spatio-spectral information of a scene. Many acquisition methods for spectral imaging use scanning, preventing its widespread usage for dynamic scenes. On the other hand, the conventional color filter array (CFA) method often used to sample color images has also been extended to snapshot MSI using a Multispectral Filter Array (MSFA), which is a mosaic of selective spectral filters placed over the Focal Plane Array (FPA). However, even state-of-the-art MSFAs coding patterns produce artifacts and distortions in the reconstructed spectral images, which might be due to the nonoptimal distribution of the spectral filters. To reduce the appearance of artifacts and provide tools for the optimal design of MSFAs, this paper proposes a novel mathematical framework to design MSFAs using a Sphere Packing (SP) approach. By assuming that each sampled filter can be represented by a sphere within the discrete datacube, SP organizes the position of the equal-size and disjoint spheres's centers in a cubic container. Our method is denoted Multispectral Filter Array by Optimal Sphere Packing (MSFA-OSP), which seeks filter positions that maximize the minimum distance between the spheres's centers. Simulation results show an image quality improvement of up to 2 dB and a remarkable boost in spectral similarity when using our proposed MSFA design approach for a variety of reconstruction algorithms. Moreover, MSFA-OSP notably reduces the appearance of false colors and zipper effect artifacts, often seen when using state-of-the-art demosaicking algorithms. Experiments using synthetic and real data prove that the proposed MSFA-OSP outperforms state-of-the-art MSFAs in terms of spatial and spectral fidelity. The code that reproduces the figures of this article is available at https://github.com/nelson10/DemosaickingMultispectral3DSpherePacking.git.

Universal Demosaicking for Interpolation-Friendly RGBW Color Filter Arrays

Interpolation-friendly RGBW color filter arrays (CFAs) and the popular sequential demosaicking contain the idea of computational photography, where the CFA and the demosaicking method are co-designed. Due to the advantages, interpolation-friendly RGBW CFAs have been extensively used in commercial color cameras. However, most associated demosaicking methods rely on strict assumptions or are limited to a few specific CFAs with a given camera. In this paper, we propose a universal demosaicking method for interpolation-friendly RGBW CFAs, which enables the comparison of different CFAs. Our new method belongs to sequential demosaicking, i.e., W channel is interpolated first and then RGB channels are reconstructed with guidance from the interpolated W channel. Specifically, it first interpolates the W channel using only available W pixels followed by an aliasing reduction technique to remove aliasing artifacts. Then it employs an image decomposition model to built relations between W channel and each of RGB channels with known RGB values, which can be easily generalized to the full-size demosaicked image. We apply the linearized alternating direction method (LADM) to solve it with convergence guarantee. Our demosaicking method can be applied to all interpolation-friendly RGBW CFAs with varying color cameras and lighting conditions. Extensive experiments confirm the universal property and advantage of our proposed method with both simulated and real raw images.

Reflective high-efficiency color filters for wide color gamut LCD

Reflective high-efficiency color filters for wide color gamut LCD

High color saturation and angle-insensitive ultrathin color filter based on effective medium theory

High color saturation and angle-insensitive ultrathin color filter based on effective medium theory

Методика расчета параметров антиалайсинговых фильтров для коррекции спектральных характеристик в зависимости от используемых структур дискретизации массива светофильтров

When developing algorithms and methods for generating and processing image signals (IS) used in devices based on single-matrix light-to-signal converters (LSC), the effects of not only the elements of the system included in the optical pathway (OP) located directly between the exposed image and device sensor, but also the specifics of the structure of color filter arrays (CFA) used in such cameras, applied to the surface of the matrix. In this article analyzed the most popular SSF subsampling structures and their impact on the spatial characteristics of the generated images. Based on the model for constructing these characteristics, a method is given for calculating the optimal parameters of anti-aliasing filters that match the properties of the OP and the sensor for a given characteristic of the optical system. Specific examples of calculating and optimizing such filters and evaluating their impact on the amplitude characteristics of signals are given. Based on the results of applying the developed method, formulated recommendations for the design of the CFA.

Flexible micro-LED display and its application in Gbps multi-channel visible light communication

A flexible full-color micro-LED display with high mechanical robustness was fabricated by printing quantum dots (QDs) on a blue micro-LED array using standard photolithography. The red and green colors yielded from QDs exhibit a better color gamut than conventional color filters. The light conversion efficiency was enhanced by adding TiO2 nanoparticles to the QD-photoresist composite. This full-color micro-LED display was successfully mounted on various unusual substrates such as curved glass, fabrics, and human skin, enabling diverse optoelectronic applications. In addition, wireless multi-channel visible light communication (VLC) based on the wavelength-division-multiplexing orthogonal-frequency-division-multiplexing (WDM-OFDM) technique was demonstrated using a QD-based color micro-LED panel. A high data transmission rate of 1.9 Gbps was successfully obtained owing to the high electrical–optical modulation bandwidth of the QD-based micro-LED panel.

Optical Tunability and Characterization of Mg-Al, Mg-Ti, and Mg-Ni Alloy Hydrides for Dynamic Color Switching Devices.

Mg shows great potential as a metal hydride for switchable optical response and hydrogen detection due to its ability to stably incorporate significant amounts of hydrogen into its lattice. However, this thermodynamic stability makes hydrogen removal difficult. By alloying Mg with secondary elements, the hydrogenation kinetics can be increased. Here, we report the dynamic optical, loading, and stress properties of three Mg alloy systems (Mg-Al, Mg-Ti, and Mg-Ni) and present several novel phenomena and three distinct device designs that can be achieved with them. We find that these materials all have large deviations in refractive index when exposed to H2 gas, with a wide range of potential properties in the hydride state. The magnitude and sign of the optical property change for each of the alloys are similar, but the differences have dramatic effects on device design. We show that Mg-Ti alloys perform well as both switchable windows and broadband switchable light absorbers, where Mg0.87Ti0.13 and Mg0.85Ti0.15 can achieve a 40% transmission change as a switchable window and a 55% absorption change as a switchable solar absorber. We also show how different alloys can be used for dynamically tunable color filters, where both the reflected and transmitted colors depend on the hydrogenation state. We demonstrate how small changes in the alloy composition (e.g., with Mg-Ni) can lead to dramatically different color responses upon hydrogenation (red-shifting vs blue-shifting of the resonance). Our results establish the potential for these Mg alloys in a variety of applications relating to hydrogen storage, detection, and optical devices, which are necessary for a future hydrogen economy.

Monolithically integrated high-resolution full-color GaN-on-Si micro-LED microdisplay

Full-color micro-LED displays are being widely developed and regarded as a primary option in current microdisplay technologies to fulfill the urgent demands of metaverse applications in the next decade. In this paper, a monolithic full-color micro-LED microdisplay with a resolution of 423 pixels per inch is demonstrated through the integration of a blue GaN-on-Si display module and a quantum dots photoresist (QDs-PR) color conversion module. The 400 × 240 active-matrix blue micro-LED display with a dominant wavelength of 440 nm was monolithically fabricated using GaN-on-Si epiwafers and flip-chip bonded on a custom-designed complementary metal-oxide semiconductor backplane. A color conversion module was independently fabricated on a 4-in. sapphire substrate by applying red and green QDs-PR arrays and a color filter array through the standard lithography process. Combining the blue GaN-on-Si micro-LED display module and the lithography-based QDs-PR color conversion module, a full-color micro-LED display was achieved with a wide color gamut up to 104% of the standard red, green, and blue and a maximum brightness of over 500 nits. The influence of blue light leakage resulting from the possible misalignment of flip-chip bonding and crosstalk in the bottom GaN-on-Si display was investigated in which the percentages of efficient pumping light for the blue, green, and red subpixels are around 95%, 89%, and 92%, respectively. This prototype demonstrates potential scalability and low-cost volume production of high-resolution full-color micro-LED microdisplays soon.