CMOS Image Research Articles

FBG Interrogator Using a Dispersive Waveguide Chip and a CMOS Camera.

Optical sensors using fiber Bragg gratings (FBGs) have become an alternative to traditional electronic sensors thanks to their immunity against electromagnetic interference, their applicability in harsh environments, and other advantages. However, the complexity and high cost of the FBG interrogation systems pose a challenge for the wide deployment of such sensors. Herein, we present a clean and cost-effective method for interrogating an FBG temperature sensor using a micro-chip called the waveguide spectral lens (WSL) and a standard CMOS camera. This interrogation system can project the FBG transmission spectrum onto the camera without any free-space optical components. Based on this system, an FBG temperature sensor is developed, and the results show good agreement with a commercial optical spectrum analyzer (OSA), with the respective wavelength-temperature sensitivity measured as 6.33 pm/°C for the WSL camera system and 6.32 pm/°C for the commercial OSA. Direct data processing on the WSL camera system translates this sensitivity to 0.44 μm/°C in relation to the absolute spatial shift of the FBG spectra on the camera. Furthermore, a deep neural network is developed to train the spectral dataset, achieving a temperature resolution of 0.1 °C from 60 °C to 120 °C, while direct processing on the valley/dark line detection yields a resolution of 7.84 °C. The proposed hardware and the data processing method may lead to the development of a compact, practical, and low-cost FBG interrogator.

An 11-bit low power column-parallel single slope ADC with comparator toggle prediction technique for CMOS image sensor

This paper proposes an 11-bit low power column-parallel SS ADC with DCDS for CMOS image sensors. The proposed SS ADC reduces the power consumption in three ways. Firstly, using a combination of coarse and fine quantization can reduce power consumption of counter. Secondly, changing the operation state can remove the bit width inverter. Thirdly, the comparator power is reduced by making each column of comparators switch off after the end of the comparison function. The proposed ADC is fabricated in a 110 nm 1P4M CMOS technology and has a DNL of +0.64/−0.54 LSB and an INL of +0.04/−6.7 LSB at a sampling frequency of 29.9 kS/s. The single column SS ADC has the power consumption ranging from 39.6 μW to 74.87 μW. Compared with the conventional SS ADC, the minimum and the maximum reduction of the power consumption are 20.1 % and 43.8 %, respectively. The average power saving is 34.5 %.

Tracking performances of the ePIC detector at the Electron-Ion Collider

The ePIC (electron–Proton/Ion Collider) experiment is a future facility at the Electron-Ion Collider (EIC) complex, located at the Brookhaven National Laboratory, USA. It will use ∼70% longitudinally polarized beam of electrons, protons, and light ions to study their collisions to understand the properties of the quarks, gluons, and the strong force responsible for the formation of the nucleus. The layout of the central detector of the ePIC experiment is not symmetric along the beams axis consisting of barrel, forward, and backward detectors to achieve a wide pseudorapidity (|η|< 3.5) coverage. There are further far-forward and far-backward tracking detectors to measure the luminosity and reconstruct the particles and fragments for the study of the exclusive deep-inelastic scattering (DIS) processes. The experiment has a challenging environment due to the presence of the background radiations (synchrotron radiation, beam-gas interactions, minimum-bias events, etc.) which will produce additional background hits on the tracker. The synchrotron radiation is suppressed to some extent by coating the beampipe with a 5μm gold layer. The experiment uses state-of-the-art bent wafer-scale silicon monolithic active pixel sensors (MAPS) with a ∼5μs acquisition window, micro-pattern gas detector (MPGD) with a good time resolution (∼20–30ns), and time-of-flight detectors based on AC-LGAD sensors (time resolution ∼30ps). The timing information of each detector will play a crucial role in track finding and rejecting the background hits utilizing the 4-dimensional tracking (space, time) to ensure the excellent performance of the experiment. The article presents the expected tracking performance of the ePIC detector using the modular ePIC software stack for simulation, reconstruction, and analysis. The Geant4 toolkit is employed for full detector simulations, alongside DD4hep (Detector Description for High Energy Physics) for geometry definition and exchange. The reconstruction incorporates the JANA2 framework, in addition to the tracking and vertexing algorithms inherited from A Common Tracking Software (ACTS).

X-ray spectral performance of the Sony IMX290 CMOS sensor near Fano limit after a per-pixel gain calibration

X-ray spectral performance of the Sony IMX290 CMOS sensor near Fano limit after a per-pixel gain calibration

Model based optimization for refractive index mismatched light sheet imaging

Selective plane illumination microscopy (SPIM) is an optical sectioning imaging approach based on orthogonal light pathways for excitation and detection. The excitation pathway has an inverse relation between the optical sectioning strength and the effective field of view (FOV). Multiple approaches exist to extend the effective FOV, and here we focus on remote focusing to axially scan the light sheet, synchronized with a CMOS camera’s rolling shutter. A typical axially scanned SPIM configuration for imaging large samples utilizes a tunable optic for remote focusing, paired with air objectives focused into higher refractive index media. To quantitatively explore the effect of remote focus choices and sample space refractive index mismatch on light sheet intensity distributions, we developed an open-source computational approach for integrating ray tracing and field propagation. We validate our model’s performance against experimental light sheet profiles for various SPIM configurations. Our findings indicate that optimizing the position of the sample chamber relative to the excitation optics can enhance image quality by balancing aberrations induced by refractive index mismatch. We validate this prediction using a home-built, large sample axially scanned SPIM configuration and calibration samples. Our open-source, extensible modeling software can easily extend to explore optimal imaging configurations in diverse light sheet imaging settings.

Dynamics of a single cavitation bubble near an oscillating boundary

Cavitation and its effects are well investigated, especially single bubble cavitation and its collapse near rigid and elastic boundaries. In our current article, we investigated novel experiments of a single cavitation bubble near an oscillatory boundary. We generated the cavitation bubble by laser focusing in water. A flat glass plate was fixed to the shaft of the magnetostriction oscillator coil. We investigated the dynamics of bubbles at two relative wall distances (ratio of the distance between the bubble center and plate surface to the maximum radius of the bubble) of the bubble from the glass plate in combination with four modes of oscillation. Each mode has specific frequency and amplitude of oscillation. The high-speed camera captured the dynamics of the bubble using the back-illumination method with a framing rate of 120Kfps and simultaneously we used an optical CMOS sensor to measure the oscillation of the glass plate. We presented a clear comparison among the bubble dynamics near stationary and oscillating plates with parameters such as oscillating modes and direction. We correlated the dynamics of the bubble with the motion of the plate. In addition, we highlighted the differences including the characteristics of bubble shape and jetting that occurred during the collapse phase. The comparison of the time histories of the bubble’s equivalent size postulated that the bubble’s collapse times vary significantly in some cases compared to the bubble’s dynamics near the stationary plate. In all cases, we noticed the shortening of the bubble’s collapsing time, i.e. accelerated collapses. In our findings, we noticed a collapse times reduction of about 4–15%. Our finding signifies the importance of introducing the oscillation of the boundaries to obtain effective energy concentration over the time during the collapse. Our study also suggests that forced oscillation of boundaries is undesirable for destructive cavitation effects. The method we suggested for the manipulation of bubble dynamics holds potential for enhancing the efficiency of applications such as lithotripsy in biomedical devices, actuation and micro pumping in microfluidic devices, and effective semiconductor surface cleaning. Not but least, obtained results can be used as benchmark in future for validating numerical methods.

Motion-free high-resolution on-chip microscopy using LED matrix

Lensless microscopy is an imaging technique that allows high-resolution imaging over a large field of view with a cost-effective design. Conventional lensless microscopy often utilizes multi-height phase retrieval and pixel-super-resolution algorithms to reconstruct high-resolution images, requiring mechanical stages for three-dimensional relative movements between a light source, camera, and sample. However, the excessive use of stages inevitably increases the bulkiness of the system and extends the image acquisition time. Here, we propose a motion-free lensless microscope that incorporates an RGB LED matrix array. A high-resolution holographic image is reconstructed from subpixel-shifted color images obtained with LED illuminations without any mechanical movement. Using a prototype system, we have demonstrated a spatial-bandwidth product of 30 megapixels with a resolution of 0.87 µm and a field of view of 24 mm2. The usability of the proposed method has been further tested for histopathologic examination. Our system features a compact and high-performance design with inexpensive optoelectronic elements, a conventional CMOS sensor and an LED matrix, which are well-aligned with the original design motivation of lensless imaging methods.

Radiation tolerance of a single-photon counting complementary metal-oxide semiconductor image sensor

Radiation tolerance of a single-photon counting complementary metal-oxide semiconductor image sensor

Characterization of analogue Monolithic Active Pixel Sensor test structures implemented in a 65 nm CMOS imaging process

Analogue test structures were fabricated using the Tower Partners Semiconductor Co. CMOS 65 nm ISC process. The purpose was to characterize and qualify this process and to optimize the sensor for the next generation of Monolithic Active Pixels Sensors for high-energy physics. The technology was explored in several variants which differed by: doping levels, pixel geometries and pixel pitches (10–25 μm). These variants have been tested following exposure to varying levels of irradiation up to 3 MGy and 1016 1 MeV neq cm−2. Here the results from prototypes that feature direct analogue output of a 4 × 4 pixel matrix are reported, allowing the systematic and detailed study of charge collection properties. Measurements were taken both using 55Fe X-ray sources and in beam tests using minimum ionizing particles. The results not only demonstrate the feasibility of using this technology for particle detection but also serve as a reference for future applications and optimizations.

Comparison of displacement damage effects on the dark signal in CMOS image sensors induced by CSNS back-n and XAPR neutrons

Comparison of displacement damage effects on the dark signal in CMOS image sensors induced by CSNS back-n and XAPR neutrons

A calibration method for a wireless real-time CMOS pixel medical dosimeter

This study introduces and validates a novel calibration function for wireless wearable dosimeters, crucial for real-time dosimetry in interventional radiology. Focusing on enhancing accuracy and safety, it compares data from threshold-based wireless dosimeters with a full-data-read detector. The research involves a central detector and four lateral wireless dosimeters, each equipped with an identically-typed CMOS Image Sensor (CIS), subjected to various photon dose rates and doses from a certified beam. Two key calibration functions were developed: one that correlates the pixel count over a threshold with the dose rate, and the other that links the cumulative pixel value above the threshold to the total absorbed dose. These functions are essential in converting raw CIS data into precise dosimetric information.The study findings reveal that the single-pixel sensitivity of wireless prototypes is approximately 8.5 ± 0.8 ADC/nGy. Following the application of calibration functions, the responses of these prototypes align consistently with the TLD dosimeter measurements. In particular, for three of the prototypes, this calibration ensures that the measurement uncertainty remains within 6% for the dose rate and within 8% for the dose.This research confirms the effectiveness and feasibility of pixel-based wireless dosimeters in interventional radiology, highlighting the importance of integrating offline data processing for enhanced measurement precision.

The 4D Camera: An 87 kHz Direct Electron Detector for Scanning/Transmission Electron Microscopy

Abstract We describe the development, operation, and application of the 4D Camera—a 576 by 576 pixel active pixel sensor for scanning/transmission electron microscopy which operates at 87,000 Hz. The detector generates data at ∼480 Gbit/s which is captured by dedicated receiver computers with a parallelized software infrastructure that has been implemented to process the resulting 10–700 Gigabyte-sized raw datasets. The back illuminated detector provides the ability to detect single electron events at accelerating voltages from 30 to 300 kV. Through electron counting, the resulting sparse data sets are reduced in size by 10--300× compared to the raw data, and open-source sparsity-based processing algorithms offer rapid data analysis. The high frame rate allows for large and complex scanning diffraction experiments to be accomplished with typical scanning transmission electron microscopy scanning parameters.

Estimating Power, Performance, and Area for On-Sensor Deployment of AR/VR Workloads Using an Analytical Framework

Augmented Reality and Virtual Reality have emerged as the next frontier of intelligent image sensors and computer systems. In these systems, 3D die stacking stands out as a compelling solution, enabling in situ processing capability of the sensory data for tasks such as image classification and object detection at low power, low latency, and a small form factor. These intelligent 3D CMOS Image Sensor (CIS) systems present a wide design space, encompassing multiple domains (e.g., computer vision algorithms, circuit design, system architecture, and semiconductor technology, including 3D stacking) that have not been explored in-depth so far. This article aims to fill this gap. We first present an analytical evaluation framework, STAR-3DSim, dedicated to rapid pre-RTL evaluation of 3D-CIS systems capturing the entire stack from the pixel layer to the on-sensor processor layer. With STAR-3DSim, we then propose several knobs for PPA (power, performance, area) improvement of the Deep Neural Network (DNN) accelerator that can provide up to 53%, 41%, and 63% reduction in energy, latency, and area, respectively, across a broad set of relevant AR/VR workloads. Last, we present full-system evaluation results by taking image sensing, cross-tier data transfer, and off-sensor communication into consideration.

Optical Image Sensors for Smart Analytical Chemiluminescence Biosensors.

Optical biosensors have emerged as a powerful tool in analytical biochemistry, offering high sensitivity and specificity in the detection of various biomolecules. This article explores the advancements in the integration of optical biosensors with microfluidic technologies, creating lab-on-a-chip (LOC) platforms that enable rapid, efficient, and miniaturized analysis at the point of need. These LOC platforms leverage optical phenomena such as chemiluminescence and electrochemiluminescence to achieve real-time detection and quantification of analytes, making them ideal for applications in medical diagnostics, environmental monitoring, and food safety. Various optical detectors used for detecting chemiluminescence are reviewed, including single-point detectors such as photomultiplier tubes (PMT) and avalanche photodiodes (APD), and pixelated detectors such as charge-coupled devices (CCD) and complementary metal-oxide-semiconductor (CMOS) sensors. A significant advancement discussed in this review is the integration of optical biosensors with pixelated image sensors, particularly CMOS image sensors. These sensors provide numerous advantages over traditional single-point detectors, including high-resolution imaging, spatially resolved measurements, and the ability to simultaneously detect multiple analytes. Their compact size, low power consumption, and cost-effectiveness further enhance their suitability for portable and point-of-care diagnostic devices. In the future, the integration of machine learning algorithms with these technologies promises to enhance data analysis and interpretation, driving the development of more sophisticated, efficient, and accessible diagnostic tools for diverse applications.

High Voltage Monolithic Active Pixel Sensors for the MOLLER experiment

The MOLLER experiment [1] aims to measure the parity-violating asymmetry (APV) in electron–electron scattering at 11 GeV, and thus determine the weak charge of the electron to a high precision (2.4%). Two of the key sub-systems in the experimental apparatus are the main detector array, consisting of 224 fused silica detector modules and an electron beam Compton polarimeter. The main detector array can be operated in either pulsed mode for particle tracking, or integration mode for the asymmetry measurement at high rate detection. A subset of these detector modules will be equipped with an array of High Voltage Monolithic Active Pixel Sensors (HVMAPS), to be used in particle tracking and allowing for real-time monitoring of the event profile in the main Møller region. HVMAPS are also used for the Compton polarimeter, consisting of four-plane planes of HVMAPS chips, housed in a vacuum chamber upstream of the interaction point. An overview of the implementation of the HVMAPS for the main detectors and Compton polarimeter is provided.

Super-resolved fluorescence imaging utilising accessible stochastic optical reconstruction microscopy (easySTORM) implemented on a low-cost, modular open-source (openFrame) microscope

Abstract Optical super-resolution microscope is a powerful tool for the life sciences, including cell biology and pathology yielding information on, e.g., biological structure and protein distribution in the nano-scale range. In recent years, there has been an exponential rise in the interest to apply super-resolution microscopes in diverse areas, but its wider utility is hindered by the cost of purchasing and maintaining super-resolved microscopes. In this paper we present the implementation of easySTORM, an accessible implementation of stochastic optical reconstruction microscopy (STORM) at Indian Institute of Technology Guwahati (IITG), India, in a flexible, user friendly and cost-effective manner using a state-of-the-art, modular, open-source, optical microscope platform called: "openFrame". Providing comparable imaging performance to commercial optical super-resolution microscopes, the openFrame-based implementation of easySTORM uses in-expensive multimode diode lasers and industry grade CMOS cameras, and the open-source and modular nature of the instrument makes it easy to maintain and to upgrade. To demonstrate its successful implementation at IITG, we image quantum dots and actin-tubulin structure in both normal and cancer cells, resolved features separated by a few tens of nanometers. This work demonstrates that openFrame-enabled easySTORM instrumentation can be widely accessible to provide affordable, research grade super-resolution microscopy capability for academic and medical research.&amp;#xD;

Impact of proton radiation and annealing of CMOS image sensors on star sensor performance

Star sensors play a crucial role as high-precision optical attitude navigation devices in satellite attitude control systems. The CMOS image sensor is an important component of the imaging system of the star sensor and experiences performance degradation due to the total ionizing dose effect and displacement damage effect in the radiation environment of its long-term operational workspace. As a result, the detection capability and attitude positioning accuracy of the star sensor gradually deteriorate. The performance of CMOS image sensors can be partially restored after annealing but the impact on the performance of star sensors is unclear. This study conducted 100 MeV proton irradiation experiments with different fluences on CMOS image sensors and performed room temperature and high temperature annealing treatments. By testing and analyzing the performance of star sensors equipped with irradiated and different annealing treatments on CMOS image sensors, the impact mechanism of CMOS image sensor radiation damage and annealing recovery on the performance variation of star sensors was obtained. This study provides theoretical support for reliability of long-term in-orbit star sensors.

Developing time-resolved x-ray diffraction diagnostics at the National Ignition Facility (invited).

As part of a program to measure phase transition timescales in materials under dynamic compression, we have designed new x-ray imaging diagnostics to record multiple x-ray diffraction measurements during a single laser-driven experiment. Our design places several ns-gated hybrid CMOS (hCMOS) sensors within a few cm of a laser-driven target. The sensors must be protected from an extremely harsh environment, including debris, electromagnetic pulses, and unconverted laser light. Another key challenge is reducing the x-ray background relative to the faint diffraction signal. Building on the success of our predecessor (Target Diffraction In Situ), we implemented a staged approach to platform development. First, we built a demonstration diagnostic (Gated Diffraction Development Diagnostic) with two hCMOS sensors to confirm we could adequately protect them from the harsh environment and also acquire acceptable diffraction data. This allowed the team to quickly assess the risks and address the most significant challenges. We also collected scientifically useful data during development. Leveraging what we learned, we recently developed a much more ambitious instrument (Flexible Imaging Diffraction Diagnostic for Laser Experiments) that can field up to eight hCMOS sensors in a flexible geometry and participate in back-to-back shots at the National Ignition Facility (NIF). The design also allows for future iterations, such as faster hCMOS sensors and an embedded x-ray streak camera. The enhanced capabilities of the new instrument required a much more complex design, and the unexpected issues encountered on the first few shots at NIF remind us that complexity has consequences. Our progress in addressing these challenges is described herein, as is our current focus on improving data quality by reducing x-ray background and quantifying the uncertainties of our diffraction measurements.

Pixel Circuit Design for X-ray Detection Utilizing a-IGZO Thin-Film Transistors

Abstract In recent advancements, X-ray detectors have made significant progress. Active pixel sensors exhibit superior Signal-to-Noise Ratio (SNR) compared to passive counterparts. The conventional pixel circuit for X-ray detectors has three transistors and one capacitor. We focused on simplifying this pixel to enhance resolution. Our research introduces and verifies a novel pixel circuit developed for high-resolution X-ray detectors. The proposed pixel circuit is composed by two n-type thin-film transistors and one capacitor. It requires two scan pulses and three operational stages. This structure can effectively reduce the component area of the pixel circuit. We designed RPI LEVEL = 35 amorphous TFT model and simulated for verify our proposed pixel circuit. In results, proposed pixel circuit successfully operated and shows 2.5 μV when the equivalent resistance of detector (RDetector) is 10 MΩ, and 8.38 V when RDetector is 1 MΩ. To minimize the harmful effects of X-ray exposure, reducing the dosage is essential. Sensitivity and low noise are crucial factors, and the proposed circuit offers a compact design, increased sensitivity, and higher output voltage.

Portable, smartphone-linked, and miniaturized photonic resonator absorption microscope (PRAM Mini) for point-of-care diagnostics.

We report the design, development, and characterization of a miniaturized version of the photonic resonator absorption microscope (PRAM Mini), whose cost, size, and functionality are compatible with point-of-care (POC) diagnostic assay applications. Compared to previously reported versions of the PRAM instrument, the PRAM Mini components are integrated within an optical framework comprised of an acrylic breadboard and plastic alignment fixtures. The instrument incorporates a Raspberry Pi microprocessor and Bluetooth communication circuit board for wireless control and data connection to a linked smartphone. PRAM takes advantage of enhanced optical absorption of ∼80 nm diameter gold nanoparticles (AuNP) whose localized surface plasmon resonance overlaps with the ∼625 nm resonant reflection wavelength of a photonic crystal (PC) surface. When illuminated with wide-field low-intensity collimated light from a ∼617 nm wavelength red LED, each AuNP linked to the PC surface results in locally reduced reflection intensity, which is visualized by observing dark spots in the PC-reflected image with an inexpensive CMOS image sensor. Each AuNP in the image field of view can be easily counted with digital resolution. We report upon the selection of optical/electronic components, image processing algorithm, and contrast achieved for single AuNP detection. The instrument is operated via a wireless connection to a linked mobile device using a custom-developed software application that runs on an Android smartphone. As a representative POC application, we used the PRAM Mini as the detection instrument for an assay that measures the presence of antibodies against SARS-CoV-2 infection in cat serum samples, where each dark spot in the image represents a complex between one immobilized viral antigen, one antibody molecule, and one AuNP tag. With dimensions of 23 × 21 × 10 cm3, the PRAM Mini offers a compact detection instrument for POC diagnostics.