Single-photon Avalanche Diode Array Research Articles

Airborne single-photon LiDAR towards a small-sized and low-power payload

Single-photon light detection and ranging (LiDAR) has played an important role in areas ranging from target identification and 3D imaging to remote sensing. Its high sensitivity provides the feasibility of lightweight LiDAR systems for the resource-limited airborne and spaceborne platforms. Here, we design and demonstrate an airborne single-photon LiDAR towards the compact, small-sized, and low-power payload. To reduce the system size, we utilize small telescopes with an optical aperture of 47 mm and develop the sub-pixel scanning approach to enhance the imaging resolution. With the fine scanning mirrors, we validate the super-resolution ability in the ground experiment by surpassing the system’s resolution by 2.5 times and achieve high-resolution 3D imaging in the airborne experiment. To realize low-power LiDAR, we employ photon-efficient computational algorithms and high-quality single-photon avalanche diode (SPAD) arrays. This enables us to reconstruct images from noisy data even under challenging conditions of two signal photons per pixel. Using the airborne single-photon LiDAR system, we demonstrate 3D imaging during daytime over a large area for remote sensing applications and show the capability to reveal the detailed features of various landforms and objects.

A time-correlated single photon counting SPAD array camera with a bespoke data-processing algorithm for lightsheet fluorescence lifetime imaging (FLIM) and FLIM videos

A wide-field microscope with epi-fluorescence and selective plane illumination was combined with a single-photon avalanche diode (SPAD) array camera to enable live-cell fluorescence lifetime imaging (FLIM) using time-correlated single-photon counting (TCSPC). The camera sensor comprised of 192×128\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$\ ext {192}\ imes \ ext {128}$$\\end{document} pixels, each integrating a single SPAD and a time-to-digital converter. Jointly, they produced a stream of single-photon images of photon arrival times with ≈38 ps\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$\\approx \ ext {38 ps}$$\\end{document} accuracy. The photon arrival times were subject to systematic delays and nonlinearities, which were corrected by a Monte-Carlo algorithm. The SPAD camera was then applied to FLIM where histogramming the resulting photon arrival times in each pixel resulted in decays compatible with common data processing pipelines for fluorescence lifetime analysis. The capabilities of the TCSPC camera-based FLIM microscope were demonstrated by imaging living unicellular photosynthetic algae and artificial lipid vesicles. Epi-fluorescence illumination enabled rapid fluorescence lifetime imaging of living cells and selective-plane illumination enabled 3-dimensional FLIM of stationary samples.

Large reconfigurable quantum circuits with SPAD arrays and multimode fibers

Reprogrammable integrated optics provides a natural platform for tunable quantum photonic circuits, but faces challenges when high dimensions and high connectivity are involved. Here, we implement high-dimensional linear transformations on spatial modes of photons using wavefront shaping together with mode mixing in a multimode fiber, and measure photon correlations using a time-tagging single-photon avalanche diode (SPAD) array. Our demonstration of a generalization of a Hong-Ou-Mandel interference to 22 output ports shows the scalability potential of wavefront shaping in complex media in conjunction with SPAD arrays for implementing high-dimensional reconfigurable quantum circuits. Specifically, we achieved (80.5±6.8)% similarity for indistinguishable photon pairs and (84.9±7.0)% similarity for distinguishable photon pairs using 22 detectors and random circuits.

Demonstration of particle tracking with scintillating fibres read out by a SPAD array sensor and application as a neutrino active target

Scintillating fibre detectors combine sub-mm resolution particle tracking, precise measurements of the particle stopping power and sub-ns time resolution. Typically, fibres are read out with silicon photomultipliers (SiPM). Hence, if fibres with a few hundred μ\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$\\upmu $$\\end{document}m diameter are used, either they are grouped together and coupled with a single SiPM, losing spatial resolution, or a very large number of electronic channels is required. In this article we propose and provide a first demonstration of a novel configuration which allows each individual scintillating fibre to be read out regardless of the size of its diameter, by imaging them with Single-Photon Avalanche Diode (SPAD) array sensors. Differently from SiPMs, SPAD array sensors provide single-photon detection with single-pixel spatial resolution. In addition, O(us) or faster coincidence of detected photons allows to obtain noise-free images. Such a concept can be particularly advantageous if adopted as a neutrino active target, where scintillating fibres alternated along orthogonal directions can provide isotropic, high-resolution tracking in a dense material and reconstruct the kinematics of low-momentum protons (down to 150 MeV/c), crucial for an accurate characterisation of the neutrino-nucleus cross section. In this work the tracking capabilities of a bundle of scintillating fibres coupled to SwissSPAD2 is demonstrated. The impact of such detector configuration in GeV-neutrino experiments is studied with simulations and reported. Finally, future plans, including the development of a new SPAD array sensor optimised for neutrino detection, are discussed.

Photon counting fibre optic distributed temperature sensing with a CMOS SPAD array.

Time-resolved fibre optic Raman distributed temperature sensing (DTS) measurements experience long measurement times due to a weak backscattered Raman signal inside optical fibres or limited detector count rates. Here, improvements to previous work based on individual detectors are demonstrated using a 512 pixel complementary-metal-oxide semiconductor (CMOS) single-photon avalanche diode (SPAD) line sensor array with integrated (on-chip) timing electronics. Multiplexed single photon counting increases count rate and decreases measurement time for practical applications. This allows temperature to be measured every 0.5 m with 0.7 °C accuracy and a 10 s measurement time using a 13.0 m optical fibre, performance over longer distance is also investigated.

High crosstalk suppression in InGaAs/InP single-photon avalanche diode arrays by carrier extraction structure

Crosstalk has become an urgent issue for single-photon avalanche diode arrays. In previous work, trenches were introduced between pixels to block the crosstalk optical path in planar InGaAs/InP single-photon avalanche diode arrays, since the optical crosstalk was considered as the main crosstalk mechanism. However, the crosstalk suppression effect of this solution is not satisfactory. Here, we demonstrate a carrier extraction structure to efficiently reduce crosstalk by electrically guiding photogenerated crosstalk holes in the non-pixel region to the surface, since we find that the optical-electrical crosstalk is the dominant crosstalk mechanism. Experimental measurements show that a narrow carrier extraction structure makes a 91.52% (96.22%) crosstalk reduction between the nearest neighbor pixels in arrays with 100 (50) μm pixel pitch, and it does not cause any etching damage. These results reveal the primary source of crosstalk in InGaAs/InP single-photon avalanche diode arrays and provide a practical route to fabricate low-crosstalk, high-pixel-density arrays for use in high-resolution three-dimensional imaging and quantum technologies.

A Gradient-Gated SPAD Array for Non-Line-of-Sight Imaging

Time-resolved non-line-of-sight (NLOS) imaging based on single-photon avalanche diode (SPAD) detectors have demonstrated impressive results in recent years. To acquire adequate number of indirect photons from a hidden scene in the presence of overwhelming amount of early-arrival photons, a single-gated SPAD is widely employed to mitigate pile-up. However, additional prior knowledge of the hidden range and relay surface profile are required to preset the gating position and implement the reconstruction. With this work, we propose a gradient-gated technique to alleviate these shortcomings (pile-up and prior knowledge) in NLOS imaging with the development of a 6 × 6 SPAD array fabricated in a standard 55-nm Bipolar-CMOS-DMOS (BCD) technology. The SPAD sensor includes a delay-locked loop (DLL) block, a gating generator and a pixel array, which can be flexibly configured to free-running, single-gating and gradient-gating modes. The rise time of the gates is less than 450 ps (from 10% to 90%). In gradient-gating mode, the interval time between adjacent gates can be configured from 300 ps to 2 ns. In single-gating mode, the minimum gate window is measured below 5 ns. We demonstrated the sensor in a confocal NLOS imaging system that reconstructs hidden scenes with both retroreflective and diffuse objects. The presented scheme enables the development of calibration-free NLOS imaging modality for practical applications.

Combined fluorescence lifetime and surface topographical imaging of biological tissue.

In this work a combined fluorescence lifetime and surface topographical imaging system is demonstrated. Based around a 126 × 192 time resolved single photon avalanche diode (SPAD) array operating in time correlated single-photon counting (TCSPC) mode, both the fluorescence lifetime and time of flight (ToF) can be calculated on a pixel by pixel basis. Initial tests on fluorescent samples show it is able to provide 4 mm resolution in distance and 0.4 ns resolution in lifetime. This combined modality has potential biomedical applications such as surgical guidance, endoscopy, and diagnostic imaging. The system is demonstrated on both ovine and human pulmonary tissue samples, where it offers excellent fluorescence lifetime contrast whilst also giving a measure of the distance to the sample surface.

Pion Detection Using Single Photon Avalanche Diodes.

We present the first reported use of a CMOS-compatible single photon avalanche diode (SPAD) array for the detection of high-energy charged particles, specifically pions, using the Super Proton Synchrotron at CERN, the European Organization for Nuclear Research. The results confirm the detection of incident high-energy pions at 120 GeV, minimally ionizing, which complements the variety of ionizing radiation that can be detected with CMOS SPADs.

Single-photon avalanche diode (SPAD) array detector for high-throughput fluorescence lifetime flow cytometry

Abstract Time-domain measurement of the fluorescence lifetime in flow cytometry offers a complementary method to traditional flow cytometry, especially for the analysis of cells and biomolecules. Short measurement times due to high throughputs (cells/s) make a suited detector mandatory for a sufficient detection of the fluorescence signal and therefore the application of this method. We summarize the requirements for a suited detector for time resolved flow cytometry (TRFC) and present a new developed SPAD array detector with 100 pixels and 340 ns time between measurement windows, allowing a high-throughput of up to 60,000 cells/s. The functionality of the detector is shown with the measurement of a 22.2 ns laser pulse, making it applicable for an improved TRFC.

Correlated-photon imaging at 10 volumetric images per second

The correlation properties of light provide an outstanding tool to overcome the limitations of traditional imaging techniques. A relevant case is represented by correlation plenoptic imaging (CPI), a quantum-inspired volumetric imaging protocol employing spatio-temporally correlated photons from either entangled or chaotic sources to address the main limitations of conventional light-field imaging, namely, the poor spatial resolution and the reduced change of perspective for 3D imaging. However, the application potential of high-resolution imaging modalities relying on photon correlations is limited, in practice, by the need to collect a large number of frames. This creates a gap, unacceptable for many relevant tasks, between the time performance of correlated-light imaging and that of traditional imaging methods. In this article, we address this issue by exploiting the photon number correlations intrinsic in chaotic light, combined with a cutting-edge ultrafast sensor made of a large array of single-photon avalanche diodes (SPADs). This combination of source and sensor is embedded within a novel single-lens CPI scheme enabling to acquire 10 volumetric images per second. Our results place correlated-photon imaging at a competitive edge and prove its potential in practical applications.

Seeing Photons in Color

Megapixel single-photon avalanche diode (SPAD) arrays have been developed recently, opening up the possibility of deploying SPADs as generalpurpose passive cameras for photography and computer vision. However, most previous work on SPADs has been limited to monochrome imaging. We propose a computational photography technique that reconstructs high-quality color images from mosaicked binary frames captured by a SPAD array, even for high-dyanamic-range (HDR) scenes with complex and rapid motion. Inspired by conventional burst photography approaches, we design algorithms that jointly denoise and demosaick single-photon image sequences. Based on the observation that motion effectively increases the color sample rate, we design a blue-noise pseudorandom RGBW color filter array for SPADs, which is tailored for imaging dark, dynamic scenes. Results on simulated data, as well as real data captured with a fabricated color SPAD hardware prototype shows that the proposed method can reconstruct high-quality images with minimal color artifacts even for challenging low-light, HDR and fast-moving scenes. We hope that this paper, by adding color to computational single-photon imaging, spurs rapid adoption of SPADs for real-world passive imaging applications.

Rapid single-photon color imaging of moving objects.

This paper outlines an experimental demonstration of a Bayesian image reconstruction approach to achieve rapid single-photon color imaging of moving objects. The capacity to extract the color of objects is important in a variety of target identification and computer vision applications. Nonetheless, it remains challenging to achieve high-speed color imaging of moving objects in low-photon flux environments. The low-photon regime presents particular challenges for efficient spectral separation and identification, while unsupervised image reconstruction algorithms are often slow and computationally expensive. In this paper, we address both of these difficulties using a combination of hardware and computational solutions. We demonstrate color imaging using a Single-Photon Avalanche Diode (SPAD) detector array for rapid, low-light-level data acquisition, with an integrated color filter array (CFA) for efficient spectral unmixing. High-speed image reconstruction is achieved using a bespoke Bayesian algorithm to produce high-fidelity color videos. The analysis is conducted first on simulated data allowing different pixel formats and photon flux scenarios to be investigated. Experiments are then performed using a plasmonic metasurface-based CFA, integrated with a 64 × 64 pixel format SPAD array. Passive imaging is conducted using white-light illumination of multi-colored, moving targets. Intensity information is recorded in a series of 2D photon-counting SPAD frames, from which accurate color information is extracted using the fast Bayesian method introduced herein. The per-frame reconstruction rate proves to be hundreds of times faster than the previous computational method. Furthermore, this approach yields additional information in the form of uncertainty measures, which can be used to assist with imaging system optimization and decision-making in real-world applications. The techniques demonstrated point the way towards rapid video-rate single-photon color imaging. The developed Bayesian algorithm, along with more advanced SPAD technology and utilization of time-correlated single-photon counting (TCSPC) will permit live 3D, color videography in extremely low-photon flux environments.

Reconfigurable coaxial single-photon LIDAR based on the SPAD array.

The single-photon avalanche diode (SPAD) array with time-to-digital converter (TDC) circuits on each pixel is an excellent candidate detector for imaging LIDAR systems. However, the low fill-factor of the SPAD array does not allow for efficient use of laser energy when directly adopted in a LIDAR system. Here, we design a reconfigurable coaxial single-photon LIDAR based on the SPAD array and diffractive optical elements (DOEs). We use the DOE and beam expander to shape the laser beam into a laser dot matrix. The total divergence angle of the DOE spot beam is strictly matched to the total field of view (FOV) angle of the SPAD array. Meanwhile, each focused beamlet is individually matched to every active area of the SPAD array detector, which increases the use of output energy about 100 times compared to the diffusion illumination system. Besides, the system uses the active area as the minimum pixel and can support sub-pixel scanning, resulting in higher resolution images. Through this coaxial structure, two different telescope systems after transceiver switching can be reconfigured for imaging targets at different distances. Based on our single-photon LIDAR system, we achieved 3D imaging of targets at 100m and 180m using two different telescope configurations.

Handheld wide-field fluorescence lifetime imaging system based on a distally mounted SPAD array.

In this work a handheld Fluorescent Lifetime IMaging (FLIM) system based on a distally mounted < 2 mm2 128 × 120 single photon avalanche diode (SPAD) array operating over a > 1 m long wired interface is demonstrated. The head of the system is ∼4.5 cm x 4.5 cm x 4.5 cm making it suitable for hand-held ex vivo applications. This is, to the best of the authors' knowledge, the first example of a SPAD array mounted on the distal end of a handheld FLIM system in this manner. All existing systems to date use a fibre to collect and relay fluorescent light to detectors at the proximal end of the system. This has clear potential biological and biomedical applications. To demonstrate this, the system is used to provide contrast between regions of differing tissue composition in ovine kidney samples, and between healthy and stressed or damaged plant leaves. Additionally, FLIM videos are provided showing that frame rates of > 1 Hz are achievable. It is thus an important step in realising an in vivo miniaturized chip-on-tip FLIM endoscopy system.

Light-sheet autofluorescence lifetime imaging with a single-photon avalanche diode array.

Fluorescence lifetime imaging microscopy (FLIM) of the metabolic co-enzyme nicotinamide adenine dinucleotide (phosphate) [NAD(P)H] is a popular method to monitor single-cell metabolism within unperturbed, living 3D systems. However, FLIM of NAD(P)H has not been performed in a light-sheet geometry, which is advantageous for rapid imaging of cells within live 3D samples. We aim to design, validate, and demonstrate a proof-of-concept light-sheet system for NAD(P)H FLIM. A single-photon avalanche diode camera was integrated into a light-sheet microscope to achieve optical sectioning and limit out-of-focus contributions for NAD(P)H FLIM of single cells. An NAD(P)H light-sheet FLIM system was built and validated with fluorescence lifetime standards and with time-course imaging of metabolic perturbations in pancreas cancer cells with 10s integration times. NAD(P)H light-sheet FLIM in vivo was demonstrated with live neutrophil imaging in a larval zebrafish tail wound also with 10s integration times. Finally, the theoretical and practical imaging speeds for NAD(P)H FLIM were compared across laser scanning and light-sheet geometries, indicating a to acquisition speed advantage for the light sheet compared to the laser scanning geometry. FLIM of NAD(P)H is feasible in a light-sheet geometry and is attractive for 3D live cell imaging applications, such as monitoring immune cell metabolism and migration within an organism.

Challenges and prospects for multi-chip microlens imprints on front-side illuminated SPAD imagers.

The overall sensitivity of frontside-illuminated, silicon single-photon avalanche diode (SPAD) arrays has often suffered from fill factor limitations. The fill factor loss can however be recovered by employing microlenses, whereby the challenges specific to SPAD arrays are represented by large pixel pitch (> 10 µm), low native fill factor (as low as ∼10%), and large size (up to 10 mm). In this work we report on the implementation of refractive microlenses by means of photoresist masters, used to fabricate molds for imprints of UV curable hybrid polymers deposited on SPAD arrays. Replications were successfully carried out for the first time, to the best of our knowledge, at wafer reticle level on different designs in the same technology and on single large SPAD arrays with very thin residual layers (∼10 µm), as needed for better efficiency at higher numerical aperture (NA > 0.25). In general, concentration factors within 15-20% of the simulation results were obtained for the smaller arrays (32×32 and 512×1), achieving for example an effective fill factor of 75.6-83.2% for a 28.5 µm pixel pitch with a native fill factor of 28%. A concentration factor up to 4.2 was measured on large 512×512 arrays with a pixel pitch of 16.38 µm and a native fill factor of 10.5%, whereas improved simulation tools could give a better estimate of the actual concentration factor. Spectral measurements were also carried out, resulting in good and uniform transmission in the visible and NIR.

Highly Sensitive SPAD-Based Receiver for Dimming Control in LiFi Networks

Visible light communication (VLC) is an emerging mode of wireless communication that supports both illumination and communication. One essential function of VLC systems is the dimming control, which requires a sensitive receiver for low-light conditions. The use of an array of single-photon avalanche diodes (SPADs) is one promising approach to enhancing receivers’ sensitivity in a VLC system. However, because of the non-linear effects brought on by the SPAD dead time, an increase in the brightness of the light might degrade its performance. In this paper, an adaptive SPAD receiver is proposed for VLC systems to ensure reliable operation under various dimming levels. In the proposed receiver, a variable optical attenuator (VOA) is used to adaptively control the SPAD’s incident photon rate according to the instantaneous received optical power so that SPAD operates in its optimal conditions. The application of the proposed receiver in systems with various modulation schemes is investigated. When binary on–off keying (OOK) modulation is employed due to its good power efficiency, two dimming control methods of the IEEE 802.15.7 standard based on analogue and digital dimming are considered. We also investigate the application of the proposed receiver in the spectral efficient VLC systems with multi-carrier modulation schemes, i.e., direct current (DCO) and asymmetrically clipped optical (ACO) orthogonal frequency division multiplexing (OFDM). Through extensive numerical results, it is demonstrated that the suggested adaptive receiver outperforms the conventional PIN PD and SPAD array receivers in terms of bit error rate (BER) and achievable data rate.

Field programmable gate array compression for large array multispeckle diffuse correlation spectroscopy.

Diffuse correlation spectroscopy (DCS) is an indispensable tool for quantifying cerebral blood flow noninvasively by measuring the autocorrelation function (ACF) of the diffused light. Recently, a multispeckle DCS approach was proposed to scale up the sensitivity with the number of independent speckle measurements, leveraging the rapid development of single-photon avalanche diode (SPAD) cameras. However, the extremely high data rate from advanced SPAD cameras is beyond the data transfer rate commonly available and requires specialized high-performance computation to calculate large number of autocorrelators (ACs) for real-time measurements. We aim to demonstrate a data compression scheme in the readout field-programmable gate array (FPGA) of a large-pixel-count SPAD camera. On-FPGA, data compression should democratize SPAD cameras and streamline system integration for multispeckle DCS. We present a SPAD array with 128 linear ACs embedded on an FPGA to calculate 12,288 ACFs in real time. We achieved a signal-to-noise ratio (SNR) gain of 110 over a single-pixel DCS system and more than threefold increase in SNR with respect to the state-of-the-art multispeckle DCS. The FPGA-embedded autocorrelation algorithm offers a scalable data compression method to large SPAD array, which can improve the sensitivity and usability of multispeckle DCS instruments.

An Integrated-Circuit Node for High-Spatiotemporal Resolution Time-Domain Near-Infrared Diffuse Optical Tomography Imaging Arrays

Next-generation brain–computer interfaces (BCIs) for healthy individuals are expected to largely rely on noninvasive functional imaging methods to record cortex-wide neural activity because of the risk associated with surgically implanted devices. In this work, we present a fully integrated 1.8 × 1.8 mm single chip that can be arrayed on a wearable patch to perform noninvasive, functional brain imaging over large cortical areas. This chip node contains two bonded vertical-cavity surface-emitting lasers (VCSELs), an 8 × 8 single-photon avalanche diode (SPAD) array with event-driven time-to-digital converters (TDCs) per row, and a digital back-end for on-chip histogramming and time-gating. We achieved 70-ps resolution for time-of-flight (ToF) imaging at the record-high 100-MHz laser repetition rate with 80-mW total power. We showed that time-gating improves the imaging contrast by as much as 36% using a brain-skull phantom. The fully integrated and compact node presented here is the key enabler for future high-spatiotemporal-resolution time-domain diffuse optical tomography (TD-DOT) imaging arrays.