Conventional Imaging Systems Research Articles

A Study on Refraction Error Compensation Method for Underwater Spinning Laser Scanning Three-Dimensional Imaging.

Laser scanning 3D imaging technology, because it can obtain accurate three-dimensional surface data, has been widely used in the search for wrecks and rescue operations, underwater resource development, and other fields. At present, the conventional underwater spinning laser scanning imaging system maintains a relatively fixed light window. However, in low-light situations underwater, the rotation of the scanning device causes some degree of water fluctuation, which warps the light strip data that the system sensor receives about the object's surface. To solve this problem, this research studies an underwater 3D scanning and imaging system that makes use of a fixed light window and a spinning laser (FWLS). A refraction error compensation algorithm is investigated that is based on the fundamentals of linear laser scanning imaging, and a dynamic refraction mathematical model is established based on the motion of the imaging device. The results of the experiment on error analysis in an optimal underwater environment indicate that the error in reconstructing the radius is decreased by 60% (from 2.5 mm to around 1 mm) when compensating for the measurement data of a standard sphere with a radius of 20 mm. Moreover, the compensated point cloud data exhibit a higher degree of correspondence with the model of the standard spherical point cloud. Furthermore, we examine the impact of physical noise, measurement distance, and partial occlusion of the object on the imaging system inside an authentic underwater setting. This study is a good starting point for looking at the refractive error of an underwater laser scanning imaging system. It also provides to us some ideas for future research on the refractive error of other scanning imaging methods.

Single-shot deterministic complex amplitude imaging with a single-layer metalens.

Conventional imaging systems can only capture light intensity. Meanwhile, the lost phase information may be critical for a variety of applications such as label-free microscopy and optical metrology. Existing phase retrieval techniques typically require a bulky setup, multiframe measurements, or prior information of the target scene. Here, we proposed an extremely compact system for complex amplitude imaging, leveraging the extreme versatility of a single-layer metalens to generate spatially multiplexed and polarization phase-shifted point spread functions. Combining the metalens with a polarization camera, the system can simultaneously record four polarization shearing interference patterns along both in-plane directions, thus allowing the deterministic reconstruction of the complex amplitude light field in a single shot. Using an incoherent light-emitting diode as the illumination, we experimentally demonstrated speckle-noise-free complex amplitude imaging for both static and moving objects with tailored magnification ratio and field of view. The miniaturized and robust system may open the door for complex amplitude imaging in portable devices for point-of-care applications.

Minimalist and High-Quality Panoramic Imaging With PSF-Aware Transformers.

High-quality panoramic images with a Field of View (FoV) of 360° are essential for contemporary panoramic computer vision tasks. However, conventional imaging systems come with sophisticated lens designs and heavy optical components. This disqualifies their usage in many mobile and wearable applications where thin and portable, minimalist imaging systems are desired. In this paper, we propose a Panoramic Computational Imaging Engine (PCIE) to achieve minimalist and high-quality panoramic imaging. With less than three spherical lenses, a Minimalist Panoramic Imaging Prototype (MPIP) is constructed based on the design of the Panoramic Annular Lens (PAL), but with low-quality imaging results due to aberrations and small image plane size. We propose two pipelines, i.e. Aberration Correction (AC) and Super-Resolution and Aberration Correction (SR&AC), to solve the image quality problems of MPIP, with imaging sensors of small and large pixel size, respectively. To leverage the prior information of the optical system, we propose a Point Spread Function (PSF) representation method to produce a PSF map as an additional modality. A PSF-aware Aberration-image Recovery Transformer (PART) is designed as a universal network for the two pipelines, in which the self-attention calculation and feature extraction are guided by the PSF map. We train PART on synthetic image pairs from simulation and put forward the PALHQ dataset to fill the gap of real-world high-quality PAL images for low-level vision. A comprehensive variety of experiments on synthetic and real-world benchmarks demonstrates the impressive imaging results of PCIE and the effectiveness of the PSF representation. We further deliver heuristic experimental findings for minimalist and high-quality panoramic imaging, in terms of the choices of prototype and pipeline, network architecture, training strategies, and dataset construction. Our dataset and code will be available at https://github.com/zju-jiangqi/PCIE-PART.

Elimination of wraparound artifacts in spatial harmonic imaging using motion blurring

Dark-field X-ray imaging (DFXI), which is based on spatial harmonic imaging (SHI), is an imaging modality that can rapidly and easily acquire microstructural information on macroscopic samples that cannot be detected by conventional X-ray imaging systems. It has potential in various fields. However, it cannot obtain accurate information concerning microstructures, owing to image distortion caused by wraparound artifacts. In this study, we examined the use of motion-blurring technique to eliminate these artifacts and devised a modified motion condition for a tilted grid system designed to prevent moiré artifacts in SHI-based DFXI. Experimental results indicated that the technique successfully eliminated the artifacts in dark-field images and increased the contrast-to-noise ratio for small-angle X-ray scattering signals, which are the measures of microstructural information of the sample. Furthermore, the technique increased the accuracy of detection of low-density foreign bodies in SHI-based DFXI-particularly when the sample had sharp edges. The results indicate the applicability of motion-blurring technique to SHI-based DFXI.

Neural network for full-Stokes image reconstruction with wavelength and modulation independence

In this paper, we propose a full-Stokes image reconstruction (FIR) network to reconstruct polarization images from a snapshot of random modulated image. The Stokes-Mueller matrix theory demonstrates that a image captured by conventional polarization imaging system is a linear superposition of the four Stokes vectors, thus image decomposition methods can be used for full-Stokes image reconstruction. The network is constructed based on a cycled conditional adversarial network, which is trained utilizing the physical mapping relationships between the Stokes vectors and the modulated images. Simulations and experiments are conducted to demonstrate the network’s wavelength independence and modulation independence, proving the effectiveness of proposed FIRnet. To some extent, our method alleviates the contradiction between measurement time and accuracy of polarization, promoting the application of compact snapshot full-Stokes imaging.

Transparent Dual-Frequency CMUT Arrays for Photoacoustic Imaging.

The opaque ultrasound transducers used in conventional photoacoustic imaging systems necessitate oblique light delivery, which gives rise to some disadvantages such as inefficient target illumination and bulky system size. This work proposes a transparent capacitive micromachined ultrasound transducer (CMUT) linear array with dual-band operation for through-illumination photoacoustic imaging. Fabricated using an adhesive wafer bonding method, the array consists of optically transparent conductors [indium tin oxide (ITO)] as both top and bottom electrodes, a transparent polymer [bisbenzocyclobutene (BCB)] as the sidewall and adhesive material, and largely transparent silicon nitride as the membrane. The fabricated device had a maximum optical transparency of 76.8% in the visible range. Furthermore, to simultaneously maintain higher spatial resolution and deeper imaging depth, this dual-frequency array consists of low- and high-frequency channels with 4.2- and 9.3-MHz center frequencies, respectively, which are configured in an interlaced architecture to minimize the grating lobes in the receive point spread function (PSF). With a wider bandwidth compared to the single-frequency case, the fabricated transparent dual-frequency CMUT array was used in through-illumination photoacoustic imaging of wire targets demonstrating an improved spatial resolution and imaging depth.

Experimental study on the implementation method of short pulse laser in distance-selective imaging system

Conventional distance-selective imaging systems use lasers that are large in size, high in power consumption, and high in cost. In order to reduce the system size and reduce the system power consumption and cost, The principles and design methods of two drive circuits for generating narrow pulse lasers based on step recovery diodes SRD (combined with shorted transmission lines) and RF bipolar transistors are discussed, physically fabricated and tested, and the characteristics of the two pulse generators and the factors affecting the pulse width amplitude are analyzed. The experimental results show that the SRD-based method can generate a narrow pulse with a rise time of 456.8 ps, a fall time of 458.3 ps, a pulse width of 1.5 ns, and an amplitude of 2.38 V; the transistor-based method can generate a narrow pulse with a rise time of 903.5 ps, a fall time of 946.1 ps, a pulse width of 824 ps, and an amplitude of 2.46 V, both of which can reach a repetition frequency of 50 MHz. Both design methods can be combined with an external laser diode to achieve excellent short pulse laser output.

Dual-Channel Switchable Metasurface Filters for Compact Spectral Imaging with Deep Compressive Reconstruction.

Spectral imaging technology, which aims to capture images across multiple spectral channels and create a spectral data cube, has been widely utilized in various fields. However, conventional spectral imaging systems face challenges, such as slow acquisition speed and large size. The rapid development of optical metasurfaces, capable of manipulating light fields versatilely and miniaturizing optical components into ultrathin planar devices, offers a promising solution for compact hyperspectral imaging (HSI). This study proposes a compact snapshot compressive spectral imaging (SCSI) system by leveraging the spectral modulations of metasurfaces with dual-channel switchable metasurface filters and employing a deep-learning-based reconstruction algorithm. To achieve compactness, the proposed system integrates dual-channel switchable metasurface filters using twisted nematic liquid crystals (TNLCs) and anisotropic titanium dioxide (TiO2) nanostructures. These thin metasurface filters are closely attached to the image sensor, resulting in a compact system. The TNLCs possess a broadband linear polarization conversion ability, enabling the rapid switching of the incidence polarization state between x-polarization and y-polarization by applying different voltages. This polarization conversion facilitates the generation of two groups of transmittance spectra for wavelength-encoding, providing richer information for spectral data cube reconstruction compared to that of other snapshot compressive spectral imaging techniques. In addition, instead of employing classic iterative compressive sensing (CS) algorithms, an end-to-end residual neural network (ResNet) is utilized to reconstruct the spectral data cube. This neural network leverages the 2-frame snapshot measurements of orthogonal polarization channels. The proposed hyperspectral imaging technology demonstrates superior reconstruction quality and speed compared to those of the traditional compressive hyperspectral image recovery methods. As a result, it is expected that this technology will have substantial implications in various domains, including but not limited to object detection, face recognition, food safety, biomedical imaging, agriculture surveillance, and so on.

Preserving polarization maintaining photons for enhanced contrast imaging of the retina.

The purpose of this study is to demonstrate the feasibility of using polarization maintaining photons for enhanced contrast imaging of the retina. Orthogonal-polarization control has been frequently used in conventional fundus imaging systems to minimize reflection artifacts. However, the orthogonal-polarization configuration also rejects the directly reflected photons, which preserve the polarization condition of incident light, from the superficial layer of the fundus, i.e., the retina, and thus reduce the contrast of retinal imaging. We report here a portable fundus camera which can simultaneously perform orthogonal-polarization control to reject back-reflected light from the ophthalmic lens and parallel-polarization control to preserve the backscattered light from the retina which partially maintains the polarization state of the incoming light. This portable device utilizes miniaturized indirect ophthalmoscopy illumination to achieve non-mydriatic imaging, with a snapshot field of view of 101° eye-angle (67° visual-angle). Comparative analysis of retinal images acquired with a traditional orthogonal-polarization fundus camera from both normal and diseased eyes was conducted to validate the usefulness of the proposed design. The parallel-polarization control for enhanced contrast in high dynamic range imaging has also been validated.

Sculpting axial characteristics of incoherent imagers by hybridization methods

Axial resolving power (ARP) is one of the cornerstones of imaging systems. In conventional imaging systems, changing ARP by changing the numerical aperture affects also lateral resolving power (LRP). It is highly desirable to change ARP independent of LRP. Recently, incoherent digital holography (IDH) techniques were developed using sparse ensembles of Bessel, Airy and self-rotating beams that allow tuning ARP independent of LRP. In the above studies, the ARP was tuned by controlling the randomness which resulted in noisy reconstructions. In this study, we proposed and demonstrated two INCoherent Hybrid Imaging Systems (INCHIS) using a Bessel and spherical beam to change the ARP between the limits of Bessel and spherical beam independent of LRP. The first hybridization technique INCHIS-H1 requires pre-engineering of multifunctional phase masks using a recently developed modified Gerchberg-Saxton algorithm and an active device such as a spatial light modulator. The second hybridization technique INCHIS-H2 can be implemented using both active as well as passive optical elements with lens and axicon functions and the ARP is changed digitally after optical recording. While INCHIS-H1 requires pre-engineering of phase masks to change ARP like any conventional imaging system, the capability in INCHIS-H2 to change ARP post-recording opens a new pathway in imaging technology. Simulation results and proof-of-concept experimental results are presented. A recently developed Lucy-Richardson-Rosen algorithm has been used for image reconstruction for the above cases. We believe that the developed hybridization methods will revolutionize the field of IDH, computational imaging, computer vision and microscopy.

Bessel Beams in Ophthalmology: A Review.

The achievable resolution of a conventional imaging system is inevitably limited due to diffraction. Dealing with precise imaging in scattering media, such as in the case of biomedical imaging, is even more difficult owing to the weak signal-to-noise ratios. Recent developments in non-diffractive beams such as Bessel beams, Airy beams, vortex beams, and Mathieu beams have paved the way to tackle some of these challenges. This review specifically focuses on non-diffractive Bessel beams for ophthalmological applications. The theoretical foundation of the non-diffractive Bessel beam is discussed first followed by a review of various ophthalmological applications utilizing Bessel beams. The advantages and disadvantages of these techniques in comparison to those of existing state-of-the-art ophthalmological systems are discussed. The review concludes with an overview of the current developments and the future perspectives of non-diffractive beams in ophthalmology.

Geometric-phase-based axicon lens for computational achromatic imaging.

Conventional optical imaging systems usually utilize several lenses within a precise assembly to eliminate chromatic aberration, which increases the difficulty of system integration. In recent years, with the rapid development of metasurfaces and liquid crystals (LCs), planar optical elements provide feasible solutions to realize flexible light manipulation and lightweight systems. However, there also exists chromatic aberration, which can be corrected but at the cost of a complex device design. Here, a geometric-phase-based axicon lens is utilized to correct chromatic aberration across a broadband wavelength with the assistance of a post-process algorithm. The axicon lens is fabricated through arranging orientations of liquid-crystal molecules with a standard photoalignment technique, and it produces an approximately invariant point spread function (PSF) at several discrete wavelengths, which is used as the prior information to extract the object in the blurred image. In the experiment, the reconstruction quality is significantly improved after the post-process algorithm. We expect our work to provide further development to reduce the dispersion with both the device design and the computational image technique.

Inclusion of a GaAs detector model in the Photon Counting Toolkit software for the study of breast imaging systems.

We present an upgraded version of the Photon Counting Toolkit (PcTK), a freely available by request MATLAB tool for the simulation of semiconductor-based photon counting detectors (PCD), which has been extended and validated to account for gallium arsenide (GaAs)-based PCD(s). The modified PcTK version was validated by performing simulations and acquiring experimental data for three different cases. The LAMBDA 60 K module planar detector (X-Spectrum GmbH, Germany) based on the Medipix3 ASIC technology was used in all cases. This detector has a 500-μm thick GaAs sensor and a 256 × 256-pixel array with 55 μm pixel size. The first validation was a comparison between simulated and measured spectra from a 109Cd radionuclide source. In the second validation study, experimental measurements and simulations of mammography spectra were generated to observe the performance of the GaAs version of the PcTK with polychromatic radiation used in conventional x-ray imaging systems. The third validation study used single event analysis to validate the spatio-energetic model of the extended PcTK version. Overall, the software provided a good agreement between simulated and experimental data, validating the accuracy of the GaAs model. The software could be an attractive tool for accurate simulation of breast imaging modalities relying on photon counting detectors and therefore could assist in their characterization and optimization.

Metasurfaces and metalenses

AbstractLenses are widely used as a basic optical element in daily life. They are used in cameras, eyeglasses, microscopes, and many other devices. The lenses are developed based on classical refractive optics, which leads to unavoidable imaging errors such as chromatic as well as spherical aberration and coma. To minimize these, conventional imaging systems usually use multiple lenses of different powers and materials.

Engram-Driven Videography

Sensing and understanding large-scale dynamic scenes require a high-performance imaging system. Conventional imaging systems pursue higher capability by simply increasing the pixel resolution via stitching cameras at the expense of a bulky system. Moreover, they strictly follow the feedforward pathway: that is, their pixel-level sensing is independent of semantic understanding. Differently, a human visual system owns superiority with both feedforward and feedback pathways: The feedforward pathway extracts object representation (referred to as memory engram) from visual inputs, while, in the feedback pathway, the associated engram is reactivated to generate hypotheses about an object. Inspired by this, we propose a dual-pathway imaging mechanism, called engram-driven videography. We start by abstracting the holistic representation of the scene, which is associated bidirectionally with local details, driven by an instance-level engram. Technically, the entire system works by alternating between the excitation–inhibition and association states. In the former state, pixel-level details become dynamically consolidated or inhibited to strengthen the instance-level engram. In the association state, the spatially and temporally consistent content becomes synthesized driven by its engram for outstanding videography quality of future scenes. The association state serves as the imaging of future scenes by synthesizing spatially and temporally consistent content driven by its engram. Results of extensive simulations and experiments demonstrate that the proposed system revolutionizes the conventional videography paradigm and shows great potential for videography of large-scale scenes with multi-objects.

Spatial- and Fourier-domain ptychography for high-throughput bio-imaging.

First envisioned for determining crystalline structures, ptychography has become a useful imaging tool for microscopists. However, ptychography remains underused by biomedical researchers due to its limited resolution and throughput in the visible light regime. Recent developments of spatial- and Fourier-domain ptychography have successfully addressed these issues and now offer the potential for high-resolution, high-throughput optical imaging with minimal hardware modifications to existing microscopy setups, often providing an excellent trade-off between resolution and field of view inherent to conventional imaging systems, giving biomedical researchers the best of both worlds. Here, we provide extensive information to enable the implementation of ptychography by biomedical researchers in the visible light regime. We first discuss the intrinsic connections between spatial-domain coded ptychography and Fourier ptychography. A step-by-step guide then provides the user instructions for developing both systems with practical examples. In the spatial-domain implementation, we explain how a large-scale, high-performance blood-cell lens can be made at negligible expense. In the Fourier-domain implementation, we explain how adding a low-cost light source to a regular microscope can improve the resolution beyond the limit of the objective lens. The turnkey operation of these setups is suitable for use by professional research laboratories, as well as citizen scientists. Users with basic experience in optics and programming can build the setups within a week. The do-it-yourself nature of the setups also allows these procedures to be implemented in laboratory courses related to Fourier optics, biomedical instrumentation, digital image processing, robotics and capstone projects.

Linac-integrated on-board spectral-CT/CBCT imaging using a photon-counting detector: a Monte Carlo study

Purpose: To investigate the feasibility of dual-modal on-board spectral-CT/CBCT imaging using a CZT photon-counting detector mounted on a Linac by Monte Carlo simulations.Methods: In this proof-of-concept study, the Monte Carlo software platform of Geant4 Application for Tomography Emission (GATE) and a high-performance computing hardware platform were utilized to design and validate the novel on-board spectral-CT and conventional CBCT imaging system using a single CZT detector integrated into a Linac. Through the combined use of the Monte Carlo simulation and the charge transportation model based on a diffusion equation, we simulated x-ray energy spectra of the CZT detector with pixel sizes ranging of 200–1,000 μm, based on which the optimized pixel size of the detector was determined. Spatial resolution of the CBCT imaging of the system was evaluated by oversampling a tilted tungsten wire. A PMMA phantom, containing calcium and contrast elements of iodine, gadolinium, and gold, was simulated to demonstrate the spectral CT imaging capability of the system by using the K-edge spectral imaging method.Results: Considering the trade-off between the photon-peak efficiency and spatial resolution of the detector, the pixel size of the CZT detector was determined to be 400 µm. The spatial resolution of the CBCT imaging of the system was estimated to be 19.2 lp/cm@10% modulation transfer function. The CBCT imaging of the system provided sufficient structural details of the phantom with a high image contrast. Compared to the CBCT image of the phantom, the K-edge spectral CT images differentiated the four elements contained within the phantom very well.Conclusion: The simulation results demonstrated the feasibility of dual-modal on-board spectral-CT/CBCT imaging by using a single CZT photon counting detector in a Linac.

Modulation transfer function (MTF) evaluation for x-ray phase imaging system employing attenuation masks

Objective. Attenuation masks can be used in x-ray imaging systems to increase their inherent spatial resolution and/or make them sensitive to phase effects, a typical example being Edge Illumination x-ray phase contrast imaging (EI-XPCI). This work investigates the performance of a mask-based system such as EI-XPCI in terms of Modulation Transfer Function (MTF), in the absence of phase effects. Approach. Pre-sampled MTF measurements, using an edge, were performed on the same system implemented without masks, with non-skipped masks and finally with skipped masks (i.e. masks in which apertures illuminate every other pixel row/column). Results are compared to simulations and finally images of a resolution bar pattern acquired with all the above setups are presented. Main results. Compared to the detector’s inherent MTF, the non-skipped mask setup provides improved MTF results. In comparison to an ideal case where signal spill-out into neighbouring pixels is negligible, this improvement takes place only at specific frequencies of the MTF, dictated by the spatial repetition of the spill-out signal. This is limited with skipped masks, which indeed provide further MTF improvements over a larger frequency range. Experimental MTF measurements are supported through simulation and resolution bar pattern images. Significance. This work has quantified the improvement in MTF due to the use of attenuation masks and lays the foundation for how acceptance and routine quality control tests will have to be modified when systems using masks are introduced in clinical practice and how MTF results will compare to those of conventional imaging systems.

Imaging the brain in action: a motorized optical rotary joint for wide field fibroscopy in freely moving animals.

The study of neuronal processes governing behavior in awake behaving mice is constantly boosted by the development of technological strategies, such as miniaturized microscopes and closed-loop virtual reality systems. However, the former limits the quality of recorded signals due to constrains in size and weight and the latter suffers from the restriction of the movement repertoire of the animal, therefore, hardly reproducing the complexity of natural multisensory scenes. Another strategy that takes advantage of both approaches consists of the use of a fiber-bundle interface to carry optical signals from a moving animal to a conventional imaging system. However, as the bundle is usually fixed below the optics, its torsion resulting from rotations of the animal inevitably constrains the behavior over long recordings. Our aim was to overcome this major limitation of fibroscopic imaging. We developed a motorized optical rotary joint controlled by an inertial measurement unit at the animal's head. We show its principle of operation, demonstrate its efficacy in a locomotion task, and propose several modes of operation for a wide range of experimental designs. Combined with an optical rotary joint, fibroscopic approaches represent an outstanding tool to link neuronal activity with behavior in mice at the millisecond timescale.

Confocal LiDAR for remote high-resolution imaging of auto-fluorescence in aquatic media

Spatially resolved in situ monitoring of plankton can provide insights on the impacts of climate change on aquatic ecosystems due to their vital role in the biological carbon pump. However, high-resolution underwater imaging is technically complex and restricted to small close-range volumes with current techniques. Here, we report a novel inelastic scanning confocal light detection and ranging (LiDAR) system for remote underwater volumetric imaging of fluorescent objects. A continuous wave excitation beam is combined with a pinhole in a conjugated detection plane to reject out-of-focus scattering and accomplish near-diffraction limited probe volumes. The combination of bi-directional scanning with remote focusing enables the acquisition of three-dimensional data. We experimentally determine the point spread and axial weighting functions, and demonstrate selective volumetric imaging of obstructed layers through spatial filtering. Finally, we spatially resolve in vivo autofluorescence from sub-millimeter Acocyclops royi copepods to demonstrate the applicability of our novel instrument in non-intrusive morphological and spectroscopic studies of aquatic fauna. The proposed system constitutes a unique tool e.g. for profiling chlorophyll distributions and for quantitative studies of zooplankton with reduced interference from intervening scatterers in the water column that degrade the the performance of conventional imaging systems currently in place.