Optical Tomography System Research Articles

Metalens in Improving Imaging Quality: Advancements, Challenges, and Prospects for Future Display

AbstractMetalens, a metasurface with a focusing phase, has been the focus of research due to its immense potential for use in imaging and display technology. Traditional lens and optical imaging systems rely on phase accumulation, however metalens with subwavelength structures provide a disruptive path for miniaturized optical imaging systems by allowing unfettered modulation of incident light's phase and amplitude. Recently, extensive efforts have been devoted to exploring new design strategies, new functionalities, and possible applications. This paper reviews the development, principle, classification, and research status of metalens. In particular, this review focuses on the progress and challenges of improving imaging quality and expanding imaging diversity, including improvements of resolution, enhancement of depth of field, extension of field of view, and achromatism. Lastly, the prospects of metalens in the future display are summarized, and the application potentials of metalens in novel 3D display, intelligent and bionic display, as well as nano‐pixelate light‐emitting display (NLED) are emphasized.

Evaluation and analysis of target interpretation capability for novel rotating synthetic aperture system

The novel rotating synthetic aperture imaging system has the advantages of short processing cycle, light weight, low cost, and convenient transport, which is a potential development direction for future optical satellite payloads with ultra-large aperture. However, influenced by the coupling effects of the rectangular primary mirror, rotating imaging, and link perturbation, images from this system may have unique spatial and temporal variability with resolution anisotropy, resulting in the dynamics and weak features of targets. The insufficient recognition of system characteristics seriously restricts the application ability of corresponding target interpretation methods. To address this problem, we start with the analysis of system imaging characteristics and target interpretation mechanisms. Considering calculating texture, grayscale, and edge feature parameters in evaluation regions of different sizes, we propose a degradation assessment method based on multi-scale feature characterization. Then, combined with the theoretical calculation and practical target detection experiments, the influence of crucial parameters such as the aspect ratio and rotation angle of the primary mirror on the target interpretation capability is analyzed. The results will provide guidance for the integrated design and optimization of optical imaging systems and intelligent image processing methods.

Simplified design method for optical imaging systems based on aberration characteristics of optical-digital joint optimization.

With the continuous improvement of imaging performance requirements, the design of imaging systems has become increasingly complex, making it more difficult and expensive to manufacture and test. To overcome these problems, a simplified design framework for imaging systems based on aberration characteristics of optical-digital joint optimization was built in this paper. Specifically, an improved total variation regularization restoration algorithm was proposed, and the difficulty of correction for different monochromatic aberrations was evaluated. With this evaluation, the proposed algorithm was combined with the traditional optical design method to jointly correct the aberration and simplify the optical system by relaxing the requirements for optical structures and surface shapes under the guarantee of the imaging performance. To demonstrate the feasibility and efficiency of the method, three design examples are provided, where the structure similarity index measure of the simulation imaging results is on the same level as that of the initial system, with a maximum error not exceeding 0.04. The simulation results demonstrate that our design method can effectively simplify the optical structure of imaging systems while maintaining high performance.

A Binocular Stereo-Imaging-Perception System with a Wide Field-of-View and Infrared- and Visible Light-Dual-Band Fusion.

With the continuous evolution of autonomous driving and unmanned driving systems, traditional limitations such as a limited field-of-view, poor ranging accuracy, and real-time display are becoming inadequate to satisfy the requirements of binocular stereo-perception systems. Firstly, we designed a binocular stereo-imaging-perception system with a wide-field-of-view and infrared- and visible light-dual-band fusion. Secondly we proposed a binocular stereo-perception optical imaging system with a wide field-of-view of 120.3°, which solves the small field-of-view of current binocular stereo-perception systems. Thirdly, For image aberration caused by the wide-field-of-view system design, we propose an ellipsoidal-image-aberration algorithm with a low consumption of memory resources and no loss of field-of-view. This algorithm simultaneously solves visible light and infrared images with an aberration rate of 45% and 47%, respectively. Fourthly, a multi-scale infrared- and visible light-image-fusion algorithm is used, which improves the situational-awareness capabilities of a binocular stereo-sensing system in a scene and enhances image details to improve ranging accuracy. Furthermore, this paper is based on the Taylor model-calibration binocular stereo-sensing system of internal and external parameters for limit correction; the implemented algorithms are integrated into an NVIDIA Jetson TX2 + FPGA hardware framework, enabling near-distance ranging experiments. The fusion-ranging accuracy within 20 m achieved an error of 0.02 m, outperforming both visible light- and infrared-ranging methods. It generates the fusion-ranging-image output with a minimal delay of only 22.31 ms at a frame rate of 50 Hz.

Large dynamic range stellar radiation simulation optical system

For the current stellar spectral simulation can not realize the stellar color temperature information with large dynamic range simulation, this paper proposes a broad spectrum high-resolution subdivision and spatial beam zoning modulation combined with a large dynamic range of stellar radiation information simulation method, designed a kind of imaging and non-imaging stellar radiation information simulation optical system, using an optical system to achieve multi-color temperature spectrum and large dynamic range stellar simulation. The experimental results show that the designed system can simultaneously achieve the spectral simulation accuracy (single point evaluation) better than ± 7% in the range of spectral 450–1000 nm and color temperature 3000–11,000 K; on the premise of ensuring the spectral simulation accuracy, the magnitude simulation range reaches 0 to + 12 Mv, and the magnitude simulation accuracy is better than ± 0.05 Mv; Accurate simulation of stellar spectral information and energy large dynamic range tuning is realized, and the system is extended. The system function has been extended to realize the switching of broadband and narrowband modes, The half-peak width of the narrowband output beam is better than 4.1 nm, which extends the application of the spectral simulation technology and provides the theoretical and technical basis for the ground calibration of the development of the high-precision stellar radiation information ground simulation system.

An S-CNN-based phase conjugation method in imaging through random media

Imaging through random media is a pervasive issue in many areas. Recently, deep learning (DL) has shown strong capability in speckle reconstruction, especially in extracting the correlation properties of speckle patterns. However, in practical imaging scenarios, most DL methods need numerous training data to adapt to various imaging condition changes. Here, we develop an S-CNN-based phase conjugation method in imaging through random media. Specifically, we propose the amplitude-phase distortion model to characterize the light scattering process. Then, we further develop a scattering convolutional neural network (S-CNN) based on our model to map speckle patterns to scattered light fields in the changed imaging conditions. Finally, we reconstruct the object through phase conjugation. We quantitatively validated the imaging performance of S-CNN-based phase conjugation imaging, meeting the possible changes of practical imaging conditions, encompassing unseen types of different sparse objects, different diffusers, different detection positions, and different apertures on the imaging path. We found that the Jaccard index (JI), Pearson correlation coefficient (PCC), and structural similarity measure (SSIM) in different physical scenarios were increased by more than 21%, 22%, and 8%, compared with digital CNN. The proposed method provides a new optical imaging system that can be adapted to accommodate various condition changes in practical imaging scenarios and paves the way for an all-optical imaging system in imaging through random media.

Workflow for modeling of generalized mid-spatial frequency errors in optical systems.

We propose a workflow for modeling generalized mid-spatial frequency (MSF) errors in optical imaging systems. This workflow enables the classification of MSF distributions, filtering of bandlimited signatures, propagation of MSF errors to the exit pupil, and performance predictions that differentiate performance impacts due to the MSF distributions. We demonstrate the workflow by modeling the performance impacts of MSF errors for both transmissive and reflective imaging systems with near-diffraction-limited performance.

A dual-modality optical system for single-pixel imaging and transmission through scattering media

It is well recognized that it is difficult to develop an optical system to retrieve effective information when dynamic and turbid water exists in an optical channel. It could be more challenging to incorporate dual or multiple modalities in one optical system. In this Letter, we report a dual-modality optical system for single-pixel imaging (SPI) and transmission through scattering media. A series of mutually-orthogonal random illumination patterns are designed and adopted to realize high-resolution image recovery in SPI. The data to be transmitted are also encoded into random illumination patterns in a differential way, and high-fidelity free-space optical data transmission can be simultaneously realized. Experimental results validate feasibility of the proposed optical system and its high robustness against scattering. The developed dual-modality optical system realizes high-resolution SPI and high-fidelity data transmission in scattering media using only one set of realizations, offering an efficient implementation with reduced power and equipment requirements. The proposed method is promising toward the development of an integrated system with multiple modalities for optical information retrieval, especially in dynamic scattering media.

Short-wave Infrared Photoluminescence Lifetime Mapping of Rare-Earth Doped Nanoparticles Using All-Optical Streak Imaging.

The short-wave infrared (SWIR) photoluminescence lifetimes of rare-earth doped nanoparticles (RENPs) have found diverse applications in fundamental and applied research. Despite dazzling progress in the novel design and synthesis of RENPs with attractive optical properties, existing optical systems for SWIR photoluminescence lifetime imaging are still considerably restricted by inefficient photon detection, limited imaging speed, and low sensitivity. To overcome these challenges, SWIR photoluminescence lifetime imaging microscopy using an all-optical streak camera (PLIMASC) is developed. Synergizing scanning optics and a high-sensitivity InGaAs CMOS camera, SWIR-PLIMASC has a 1D imaging speed of up to 138.9kHz in the spectral range of 900-1700nm, which quantifies the photoluminescence lifetime of RENPs in a single shot. A 2D photoluminescence lifetime map can be acquired by 1D scanning of the sample. To showcase the power of SWIR-PLIMASC, a series of core-shell RENPs with distinct SWIR photoluminescence lifetimes is synthesized. In particular, using Er3+ -doped RENPs, SWIR-PLIMASC enables multiplexed anti-counterfeiting. Leveraging Ho3+ -doped RENPs as temperature indicators, this system is applied to SWIR photoluminescence lifetime-based thermometry. Opening up a new avenue for efficient SWIR photoluminescence lifetime mapping, this work is envisaged to contribute to advanced materials characterization, information science, and biomedicine.

10× continuous optical zoom imaging using Alvarez lenses actuated by dielectric elastomers.

Optical zoom is an essential function for many imaging systems including consumer electronics, biomedical microscopes, telescopes, and projectors. However, most optical zoom imaging systems have discrete zoom rates or narrow zoom ranges. In this work, a continuous optical zoom imaging system with a wide zoom range is proposed. It consists of a solid lens, two Alvarez lenses, and a camera with an objective. Each Alvarez lens is composed of two cubic phase plates, which have inverted freeform surfaces concerning each other. The movement of the cubic phase masks perpendicular to the optical axis is realized by the actuation of the dielectric elastomer. By applying actuation voltages to the dielectric elastomer, cubic phase masks are moved laterally and then the focal lengths of the two Alvarez lenses are changed. By adjusting the focal lengths of these two Alvarez lenses, the optical magnification is tuned. The proposed continuous optical zoom imaging system is built and the validity is verified by the experiments. The experimental results demonstrate that the zoom ratio is up to 10×, i.e., the magnification continuously changes from 1.58× to 15.80× when the lateral displacements of the cubic phase masks are about 1.0 mm. The rise and fall response times are 150 ms and 210 ms, respectively. The imaging resolution can reach 114 lp/mm during the optical zoom process. The proposed continuous optical imaging system is expected to be used in the fields of microscopy, biomedicine, virtual reality, etc.

In-situ surface roughness evaluation of laser powder bed fusion surfaces using optical tomography

Laser powder bed fusion (LPBF) is an additive manufacturing technique that enables significant design freedom and high-complexity part production. However, the process requires unconventional analysis methods for surface characterization due to process-induced variations. One possible technique is to use in-situ optical tomography (OT) technique for quality control of LPBF surfaces during fabrication. In-situ characterization approach would enable better first time yield and inspection possibility of inner channels without the need of destructive testing. In this study, samples with varied angles and process parameters are produced by LPBF. Camera images are collected during the production per every process layer using the optical-tomography system. These OT images are interpreted to obtain roughness estimates of sample overhanging surfaces. OT roughness outputs are analyzed and correlated with optical coherence scanning interferometry (CSI) measurements. The relationship between OT surface roughness estimates and optical measurements for different process parameters are presented. The possibility of using an in-situ surface analysis method for the characterization of LPBF surfaces is discussed.

Design of an Integrated Optical System for Detection and Imaging of Large Aperture and Long Focal Length Based on Continuous Zoom

Design of an Integrated Optical System for Detection and Imaging of Large Aperture and Long Focal Length Based on Continuous Zoom

On-chip two-dimensional material-based waveguide-integrated photodetectors

In optical systems for communication, sensing, and imaging, integrating optoelectronic and electronic components on-chip to develop optoelectronic applications has become the focus of future research.

Imaging Deep Haemorrhage and Ischaemia in Preterm Infants' Heads with Time-Domain Near-Infrared Optical Tomography: Phantom Study.

The occurrence of brain lesions in preterm infants is common and can result in lasting disabilities. To prevent these and to safeguard the brain through therapeutic measures or neuroprotective treatments, it is important to identify cerebral ischaemia/hypoxia and haemorrhage at an early stage. For this purpose, we have successfully developed a cutting-edge time-domain near-infrared optical tomography (TD-NIROT) system, which offers diagnostic imaging for neonatal brain oxygenation. Our objective is to validate the effectiveness of the TD-NIROT in detecting deep ischaemia/hypoxia and haemorrhages through phantom experiments. Spherical silicone phantoms were fabricated to replicate the head of preterm infant. To simulate the lesions, we made two head phantoms and embedded small inclusions mimicking ischaemia and haemorrhage at the depth of 30 mm. Additionally, a spherical interface was constructed to connect the spherical phantom to the imaging system, allowing us to collect time-domain data. Following the data acquisition, we proceeded with image reconstruction. Dice similarity was used as an indicator of the accuracy and similarity between the reconstructed images and the ground truth. The resulting images exhibited an accurate location of haemorrhage and detected the ischaemia with a slightly shifted position with Dice similarity of 0.47 and 0.27. Our experiment validates the capability of our TD-NIROT system in successfully detecting deep haemorrhages and ischaemia within the phantom model. The achieved results suggest a promising level of accuracy in the imaging process. These findings are encouraging to continue this work to ultimately achieve clinical application of the TD-NIROT system in diagnosing and monitoring neonatal brain injuries.

RPIR: A Semiblind Unsupervised Learning Image Restoration Method for Optical Synthetic Aperture Imaging Systems With Co-Phase Errors

RPIR: A Semiblind Unsupervised Learning Image Restoration Method for Optical Synthetic Aperture Imaging Systems With Co-Phase Errors

Transfer Learning and Few-Shot Learning Based Deep Neural Network Models for Underwater Sonar Image Classification With a Few Samples

Acoustic imaging sonar systems are widely used for long-range underwater surveillance in various civilian and military applications. They provide 2-D images of underwater objects, even in turbid water conditions where optical underwater imaging systems fail. Achieving high accuracy in automatic deep learning based underwater image classification remains an open problem due to insufficient data availability, poor image resolution, low signal-to-noise ratio surroundings, etc. In this study, we conduct a comparative analysis of different advanced deep learning approaches, i.e., transfer learning and few-shot learning, to address the problem of automatic object classification in sonar images, using a few samples of data. Specifically, two metric learning-based approaches, i.e., siamese network and triplet network as well as library-based approaches, are studied under the few-shot learning paradigm. Extensive experiments are conducted on a novel custom-made dataset developed in-house, along with the publicly available SeabedObjectsKLSG dataset. In addition, the effectiveness of the sampling technique in handling class imbalance during model training is also investigated in this work. Our experimental results highlight that the few-shot learning based approach is a promising direction for future research on underwater image classification with a few samples.

Review of Methods for Enhancing Measurement and Computation Speeds in Computational Optical Imaging Systems (Invited)

Review of Methods for Enhancing Measurement and Computation Speeds in Computational Optical Imaging Systems (Invited)

Large field optical imaging system based on freeform surface optics

Large field optical imaging system based on freeform surface optics

Strength in numbers: Unleashing the potential of trans-scale scope AMATERAS for massive cell quantification.

Singularity biology is a scientific field that targets drastic state changes in multicellular systems, aiming to discover the key cells that induce the state change and investigate the mechanisms behind them. To achieve this goal, we developed a trans-scale optical imaging system (trans-scale scope), that is capable of capturing both macroscale changes across the entire system and the micro-scale behavior of individual cells, surpassing the cell observation capabilities of traditional microscopes. We developed two units of the trans-scale scope, named AMATERAS-1 and -2, which demonstrated the ability to observe multicellular systems consisting of over one million cells in a single field of view with sub-cellular resolution. This flagship instrument has been used to observe the dynamics of various cell species, with the advantage of being able to observe a large number of cells, allowing the detection and analysis of rare events and cells such as leader cells in multicellular pattern formation and cells that spontaneously initiate calcium waves. In this paper, we present the design concept of AMATERAS, the optical configuration, and several examples of observations, and demonstrate how the strength-in-numbers works in life sciences.

Polarization Characteristics of Sparse Aperture Optical Imaging Systems

Polarization Characteristics of Sparse Aperture Optical Imaging Systems