Complementary Metal Oxide Semiconductor Camera Research Articles

Pixel response function experimental techniques and analysis of active pixel sensor star cameras

The pixel response function (PRF) of a pixel within a focal plane is defined as the pixel intensity with respect to the position of a point source within the pixel. One of its main applications is in the field of astrometry, which is a branch of astronomy that deals with positioning data of a celestial body for tracking movement or adjusting the attitude of a spacecraft. Complementary metal oxide semiconductor (CMOS) image sensors generally offer better radiation tolerance to protons and heavy ions than CCDs making them ideal candidates for space applications aboard satellites, but like all image sensors they are limited by their spatial frequency response, better known as the modulation transfer function. Having a well-calibrated PRF allows us to eliminate some of the uncertainty in the spatial response of the system providing better resolution and a more accurate centroid estimation. This paper describes the experimental setup for determining the PRF of a CMOS image sensor and analyzes the effect on the oversampled point spread function (PSF) of an image intensifier, as well as the effects due to the wavelength of light used as a point source. It was found that using electron bombarded active pixel sensor (EBAPS) intensification technology had a significant impact on the PRF of the camera being tested as a result of an increase in the amount of carrier diffusion between collection sites generated by the intensification process. Taking the full width at half maximum (FWHM) of the resulting data, it was found that the intensified version of a CMOS camera exhibited a PSF roughly 16.42% larger than its nonintensified counterpart.

Protection performance evaluation regarding imaging sensors hardened against laser dazzling

Electro-optical imaging sensors are widely distributed and used for many different purposes, including civil security and military operations. However, laser irradiation can easily disturb their operational capability. Thus, an adequate protection mechanism for electro-optical sensors against dazzling and damaging is highly desirable. Different protection technologies exist now, but none of them satisfies the operational requirements without any constraints. In order to evaluate the performance of various laser protection measures, we present two different approaches based on triangle orientation discrimination on the one hand and structural similarity on the other hand. For both approaches, image analysis algorithms are applied to images taken of a standard test scene with triangular test patterns which is superimposed by dazzling laser light of various irradiance levels. The evaluation methods are applied to three different sensors: a standard complementary metal oxide semiconductor camera, a high dynamic range camera with a nonlinear response curve, and a sensor hardened against laser dazzling.

Silicon-Nitride-Based Integrated Optofluidic Biochemical Sensors Using a Coupled-Resonator Optical Waveguide

Silicon nitride (SiN) is a promising material platform for integrating photonic components and microfluidic channels on a chip for label-free, optical biochemical sensing applications in the visible to near-infrared wavelengths. The chip-scale SiN-based optofluidic sensors can be compact due to a relatively high refractive index contrast between SiN and the fluidic medium, and low-cost due to the complementary metal-oxide-semiconductor (CMOS)-compatible fabrication process. Here, we demonstrate SiN-based integrated optofluidic biochemical sensors using a coupled-resonator optical waveguide (CROW) in the visible wavelengths. The working principle is based on imaging in the far field the out-of-plane elastic-light-scattering patterns of the CROW sensor at a fixed probe wavelength. We correlate the imaged pattern with reference patterns at the CROW eigenstates. Our sensing algorithm maps the correlation coefficients of the imaged pattern with a library of calibrated correlation coefficients to extract a minute change in the cladding refractive index. Given a calibrated CROW, our sensing mechanism in the spatial domain only requires a fixed-wavelength laser in the visible wavelengths as a light source, with the probe wavelength located within the CROW transmission band, and a silicon digital charge-coupled device (CCD) / CMOS camera for recording the light scattering patterns. This is in sharp contrast with the conventional optical microcavity-based sensing methods that impose a strict requirement of spectral alignment with a high-quality cavity resonance using a wavelength-tunable laser. Our experimental results using a SiN CROW sensor with eight coupled microrings in the 680nm wavelength reveal a cladding refractive index change of ~1.3 × 10^-4 refractive index unit (RIU), with an average sensitivity of ~281 ± 271 RIU-1 and a noise-equivalent detection limit (NEDL) of 1.8 ×10^-8 RIU ~ 1.0 ×10^-4 RIU across the CROW bandwidth of ~1 nm.

Microtexture Road Profiling System Using Photometric Stereo

ABSTRACT This paper presents the design and development of a stationary microtexture road profiling system using the photometric stereo (PS) technique. The structure of the developed system is simple, mainly consisting of a digital single-lens reflex (DSLR) camera with a macro lens and multiple light-emitting diodes (LEDs). The camera with the lens is oriented perpendicularly to the pavement texture and takes images each with a different LED turned on at a time. With the pavement texture images with diverse shadings, the PS technique is applied by inverting the image-forming process locally (pixel-wise) to associate the measured image intensities with the known lighting directions to estimate the gradients for each pixel-corresponding surface patch of the pavement texture. Surface normal integration (SNI) is then employed to reconstruct the three-dimensional (3D) road surface in the microtexture scale. The PS-based system has several intrinsic advantages. First, it could achieve high accuracy for surfaces with most diffuse reflection. Second, the measurement speed is fast because of its area-scanning nature. Third, the spatial resolution is high because of the usage of a high-resolution complementary metal-oxide semiconductor DSLR camera. In addition, it can be less sensitive to effects from specularities and shadows compared with most optical-based methods, since images captured under diverse lighting directions in PS provide more cues for detection purposes. Last but not least, the hardware of the system can be made compact at low cost because of its simple structure and can be adapted for direct measurement on the pavement. Parametric studies for the Lambertian-based PS technique were first investigated analytically and numerically, and these investigations yielded the design of the system having eight LEDs with the same zenith angle of 30 degrees and uniformly distributed azimuth angles in 360 degrees. Several experimental results on various types of surfaces have demonstrated that the developed system could achieve the accuracy in the order of 10 microns.

Rapid wide‐field heterodyne interferometry with custom 2D CMOS camera

A wide-field pseudo-heterodyne interference contrast microscope is described, which employs a complementary metal–oxide semiconductor (CMOS) phase-sensitive camera. The use of multiple wells in the camera enables extremely rapid measurement of a full phase field at high resolution and the modulation frequency is not limited by the camera frame rate. The high data acquisition frequency allows the effects of microphonics to be frozen to mitigate the effect of low-frequency disturbance.

UHD 방송용 LED 조명의 조도제어 방법

This paper proposes a dimming method and a hybrid LED driving circuit suitable for the ultra high definition (UHD) broadcasting. There are major two problems during the dimming control for traditional LED broadcast lightings; one is a flicker that occurred when camera filming to these lightings, and the other is that linear control is impossible for LED luminous intensity under 10% due to LED electrical characteristics. The proposed dimming method and the driving circuit are designed to solve two problems simultaneously. For high level dimming control region from 10 to 100%, the analog control method was applied to the switching regulator constructed by MOSFET operated in the saturation region. For low level dimming control region under 10%, the fast PWM control method with the linear regulator constructed by MOSFET in the ohmic region was used.BR We verified experimentally that the dimming method is able to control the luminous intensity linearly from 1 to 100% and the flicker disappears on images taken by the charge coupled device (CCD) and the complementary metal oxide semiconductor (CMOS) cameras. Therefore, the proposed method is suitable for the UHD broadcasting.

Sub-μs time resolution in wide-field time-correlated single photon counting microscopy obtained from the photon event phosphor decay

Fast frame rate complementary metal–oxide–semiconductor cameras in combination with photon counting image intensifiers can be used for microsecond resolution wide-field fluorescence lifetime imaging with single photon sensitivity, but the time resolution is limited by the camera exposure time. We show here how the image intensifier's P20 phosphor afterglow can be exploited for accurate timing of photon arrival well below the camera exposure time. By taking ratios of the intensity of the photon events in two subsequent frames, photon arrival times were determined with 300 ns precision with 18.5 μs frame exposure time (54 kHz camera frame rate). Decays of ruthenium and iridium-containing compounds with around 1 μs lifetimes were mapped with this technique, including in living HeLa cells, using excitation powers below 0.5 μW. Details of the implementation to calculate the arrival time from the photon event intensity ratio are discussed, and we speculate that by using an image intensifier with a faster phosphor decay to match a higher camera frame rate, photon arrival time measurements on the nanosecond time scale could be possible.

Camera selection for real-time in vivo radiation treatment verification systems using Cherenkov imaging.

To identify achievable camera performance and hardware needs in a clinical Cherenkov imaging system for real-time, in vivo monitoring of the surface beam profile on patients, as novel visual information, documentation, and possible treatment verification for clinicians. Complementary metal-oxide-semiconductor (CMOS), charge-coupled device (CCD), intensified charge-coupled device (ICCD), and electron multiplying-intensified charge coupled device (EM-ICCD) cameras were investigated to determine Cherenkov imaging performance in a clinical radiotherapy setting, with one emphasis on the maximum supportable frame rate. Where possible, the image intensifier was synchronized using a pulse signal from the Linac in order to image with room lighting conditions comparable to patient treatment scenarios. A solid water phantom irradiated with a 6 MV photon beam was imaged by the cameras to evaluate the maximum frame rate for adequate Cherenkov detection. Adequate detection was defined as an average electron count in the background-subtracted Cherenkov image region of interest in excess of 0.5% (327 counts) of the 16-bit maximum electron count value. Additionally, an ICCD and an EM-ICCD were each used clinically to image two patients undergoing whole-breast radiotherapy to compare clinical advantages and limitations of each system. Intensifier-coupled cameras were required for imaging Cherenkov emission on the phantom surface with ambient room lighting; standalone CMOS and CCD cameras were not viable. The EM-ICCD was able to collect images from a single Linac pulse delivering less than 0.05 cGy of dose at 30 frames/s (fps) and pixel resolution of 512 × 512, compared to an ICCD which was limited to 4.7 fps at 1024 × 1024 resolution. An intensifier with higher quantum efficiency at the entrance photocathode in the red wavelengths [30% quantum efficiency (QE) vs previous 19%] promises at least 8.6 fps at a resolution of 1024 × 1024 and lower monetary cost than the EM-ICCD. The ICCD with an intensifier better optimized for red wavelengths was found to provide the best potential for real-time display (at least 8.6 fps) of radiation dose on the skin during treatment at a resolution of 1024 × 1024.

Compound auroral micromorphology: ground-based high-speed imaging

Auroral microphysics still remains partly unexplored. Cutting-edge ground-based optical observations using scientific complementary metal-oxide semiconductor (sCMOS) cameras recently enabled us to observe the fine-scale morphology of bright aurora at magnetic zenith for a variety of rapidly varying features for long uninterrupted periods. We report two interesting examples of combinations of fine-scale rapidly varying auroral features as observed by the sCMOS cameras installed at Poker Flat Research Range (PFRR), Alaska, in February 2014. The first example shows that flickering rays and pulsating modulation simultaneously appeared at the middle of a surge in the pre-midnight sector. The second example shows localized flickering aurora associated with growing eddies at the poleward edge of an arc in the midnight sector.

Communication: time- and space-sliced velocity map electron imaging.

We develop a new method to achieve slice electron imaging using a conventional velocity map imaging apparatus with two additional components: a fast frame complementary metal-oxide semiconductor camera and a high-speed digitizer. The setup was previously shown to be capable of 3D detection and coincidence measurements of ions. Here, we show that when this method is applied to electron imaging, a time slice of 32 ps and a spatial slice of less than 1 mm thick can be achieved. Each slice directly extracts 3D velocity distributions of electrons and provides electron velocity distributions that are impossible or difficult to obtain with a standard 2D imaging electron detector.

Wide-field time-correlated single-photon counting (TCSPC) lifetime microscopy with microsecond time resolution.

A 1 MHz frame rate complementary metal-oxide semiconductor (CMOS) camera was used in combination with an image intensifier for wide-field time-correlated single-photon counting (TCSPC) imaging. The system combines an ultrafast frame rate with single-photon sensitivity and was employed on a fluorescence microscope to image decays of ruthenium compound Ru(dpp) with lifetimes from around 1 to 5 μs. A submicrowatt excitation power over the whole field of view is sufficient for this approach, and compatibility with live-cell imaging was demonstrated by imaging europium-containing beads with a lifetime of 570 μs in living HeLa cells. A standard two-photon excitation scanning fluorescence lifetime imaging (FLIM) system was used to independently verify the lifetime for the europium beads. This approach brings together advantageous features for time-resolved live-cell imaging such as low excitation intensity, single-photon sensitivity, ultrafast camera frame rates, and short acquisition times.

A green data transmission mechanism for wireless multimedia sensor networks using information fusion

In recent years, the workmanship of manufacturing sensors has achieved great success. The wide application of inexpensive hardware, such as complementary metal oxide semiconductor cameras and tiny microphones, has contributed to the development of WMSNs. WMSNs are composed of wirelessly connected devices that are able to collect information from the environment at any time. Most often, the types of information collected by WMSNs are video and audio streams, still images, and scalar sensor data. As with wireless sensor networks, the sensor devices in WMSNs are also strictly constrained in terms of memory, processing capability, storage capability, and especially energy. Although batteries can provide wireless sensors with energy, the energy is extremely limited. In practical applications, it is impossible for WMSNs to upload all of the multimedia data to users in remote regions. Hence, it is significant to develop energy-efficient techniques for data communication in WMSNs by in-network processing. In this article, a mechanism based on information fusion is proposed for reducing the volume of data being transferred. The mechanism is a trade-off between uploading the results of in-network data processing and uploading all of the raw data. Based on users' requirements, proper data will be uploaded, and the accuracy of querying will be as good as, or better than, uploading all of the raw data. Finally, the shortcomings and challenges of the mechanism are also described.

On the feasibility of tomographic-PIV with low pulse energy illumination in a lifted turbulent jet flame

Tomographic particle image velocimetry (tomographic-PIV) is a recently developed measurement technique used to acquire volumetric velocity field data in liquid and gaseous flows. The technique relies on line-of-sight reconstruction of the rays between a 3D particle distribution and a multi-camera imaging system. In a turbulent flame, however, index-of-refraction variations resulting from local heat-release may inhibit reconstruction and thereby render the technique infeasible. The objective of this study was to test the efficacy of tomographic-PIV in a turbulent flame. An additional goal was to determine the feasibility of acquiring usable tomographic-PIV measurements in a turbulent flame at multi-kHz acquisition rates with current-generation laser and camera technology. To this end, a setup consisting of four complementary metal oxide semiconductor cameras and a dual-cavity Nd:YAG laser was implemented to test the technique in a lifted turbulent jet flame. While the cameras were capable of kHz-rate image acquisition, the laser operated at a pulse repetition rate of only 10 Hz. However, use of this laser allowed exploration of the required pulse energy and thus power for a kHz-rate system. The imaged region was 29 × 28 × 2.7 mm in size. The tomographic reconstruction of the 3D particle distributions was accomplished using the multiplicative algebraic reconstruction technique. The results indicate that volumetric velocimetry via tomographic-PIV is feasible with pulse energies of 25 mJ, which is within the capability of current-generation kHz-rate diode-pumped solid-state lasers.

Wobbly strings: calculating the capture rate of a webcam using the rolling shutter effect in a guitar

In this paper I propose a method of calculating the time between line captures in a standard complementary metal-oxide-semiconductor (CMOS) webcam using the rolling shutter effect when filming a guitar. The exercise links the concepts of wavelength and frequency, while outlining the basic operation of a CMOS camera through vertical line capture.

Moisture effect of fingerprint using total internal reflection digital in-line holography

Total internal reflection (TIR) is normally important in an optical fingerprint scanner. The moisture effect in a fingerprint scanner based on TIR has been explored by using digital in-line holography (DIH). First, the reflection and the transmission technique set up for DIH have been explored by using a positive resolution test target with a line width of 200 μm. From experimental results, the reconstructed image of the reflected DIH is perfect as the image of the transmitted DIH. Due to the advantage for opaque object imaging of the reflected DIH, reflected DIH based on TIR has been selected to investigate the moisture effect of the fingerprint. Fingerprints with moistures of 39%, 54%, 69%, and a soaked finger have been observed. A laser diode of 635 nm and a complementary metal oxide semiconductor camera were used in all of the experimental setups in this research. The reconstructed image of the fingerprint gives a sharper image than the directed recorded image. The fingerprint with higher moisture provided a darker fingerprint image, while the optimum amount of moisture that gives the most complete finger pattern is 54%.

191 Advancement of Optical Mapping through Automated Algorithms and Second Generation CMOS Detectors to Reveal Murine Atrial Activation Patterns and Regional Variation of Action Potential Duration

IntroductionTo improve temporal and spatial resolution in optical imaging in cardiac electrophysiology we used a second generation complementary metal–oxide–semiconductor camera and novel algorithms to analyse electrical activation.MethodsMurine hearts were perfused...

Influence of welding parameters on weld bead in laser arc hybrid welding process using coaxial monitoring system and image processing

The productivity and weld quality of a welding process are closely related to the cost and reliability of the end products. A laser arc hybrid welding process can be used to improve the two significant factors because one welding process compensates for the disadvantages of the other welding process. In this research, a coaxial weld monitoring system for laser arc hybrid welding was designed using a complementary metal oxide semiconductor (CMOS) camera. The optical components were optimised to obtain reliable images. Experiments with varying laser power, welding speed, and arc current were carried out while real time images were captured. The bead width was extracted from the images using image processing and a median filter. The analysis of variation technique was then used to identify the influence of the process variables on the bead width and to verify the monitoring system.

LED transceivers with beehive-shaped reflector for visible light communication

This paper proposes a novel beehive-shaped reflector for application to light-emitting diode (LED) transceivers for illumination and bi-directional visible light communication (VLC). By using a diffuse propagation model extended to line-of-sight and direct signals, the distribution of illuminance and the path loss of the transceiver are investigated to evaluate the performance of the beehive-shaped reflector. To verify bi-directional communication, a VLC-based image capture system, comprising a complementary metal-oxide semiconductor (CMOS) image sensor and video processor unit, is demonstrated. Real-time images captured by the CMOS camera are successfully transmitted to the monitoring system via a free-space channel at a rate of 115.2 kbps.

English

Digital image–based colorimetry (DIC) coupled with artificial neural network (ANN) was studied for the determination of phosphorus in natural rubber (NR) latex. The method is based on the RGB (Red, Green, and Blue) value of an image of phosphorus standard solution reacted with molybdenum blue solution. The picture of the complex solution was captured by using a complementary metal oxide semiconductor (CMOS) camera. Because of a colloidal property of NR latex, phosphorus residue could not be directly determined by this technique. Therefore, a UV digestion unit was designed and fabricated for the digestion of NR latex before color developing and processing with DIC-ANN. The digestion time needed for complete digestion was 50 min. The digestion capability of the UV digester to process 10 samples simultaneously led to an acceptable samples analysis frequency of 12 h-1. Quantitative measurement of phosphorus was made in the range 0.1 to 1.0 mg L-1. The proposed method was successfully applied to the determination of total phosphorus in NR latex and it was found to be simple, rapid, accurate, precise and low cost method. Key words: Digital image-based colorimetry, artificial neural network, UV digestion, natural rubber latex, phosphorus.

Chapter 3 - Assessing camera performance for quantitative microscopy

Charge-coupled device and, increasingly, scientific complementary metal oxide semiconductor cameras are the most common digital detectors used for quantitative microscopy applications. Manufacturers provide technical specification data on the average or expected performance characteristics for each model of camera. However, the performance of individual cameras may vary, and many of the characteristics that are important for quantitation can be easily measured. Though it may seem obvious, it is important to remember that the digitized image you collect is merely a representation of the sample itself--and no camera can capture a perfect representation of an optical image. A clear understanding and characterization of the sources of noise and imprecision in your camera are important for rigorous quantitative analysis of digital images. In this chapter, we review the camera performance characteristics that are most critical for generating accurate and precise quantitative data and provide a step-by-step protocol for measuring these characteristics in your camera.