Large Field Of View Imaging Research Articles

Image restoration for spatially varying degradation based on PSF properties

The single-lens imaging system enhances image quality through restoration algorithm, which has the advantage of miniaturization compared with complex multi-element lens. However, in the design of large field of view (FoV), the single lens faces greater challenges in correcting off-axis aberrations compared to complex multi-element lens. It is more susceptible to spatially varying degradation, and the Point Spread Function (PSF) exhibits significant spatial variation. The previous restoration methods are not accurate in the representation of PSF model with spatial variation, and have limited effect on the blur restoration of large FoV single lens. In this work, we perform more accurate characterization of PSF’s change pattern property as well as shape and energy distribution property. To this end, we first use a PSF changing pattern fitting process to obtain the PSF continuous changing pattern of the whole FoV. This pattern is then used as a prior input into a spatially varying restoration network to achieve the restoration results. The results on the simulation dataset show that our design can improve the PSNR from 20.37 to 28.62, and can achieve a large FoV imaging system of 84°, while we still get better performance than the previous method on the real shot dataset.

Continuous Optical Zoom Compound Eye Imaging Using Alvarez Lenses Actuated by Dielectric Elastomers.

The compound eye is a natural multi-aperture optical imaging system. In this paper, a continuous optical zoom compound eye imaging system based on Alvarez lenses is proposed. The main optical imaging part of the proposed system consists of a curved Alvarez lens array (CALA) and two Alvarez lenses. The movement of the CALA and two Alvarez lenses perpendicular to the optical axis is realized by the actuation of the dielectric elastomers (DEs). By adjusting the focal length of the CALA and the two Alvarez lenses, the proposed system can realize continuous zoom imaging without any mechanical movement vertically to the optical axis. The experimental results show that the paraxial magnification of the target can range from ∼0.30× to ∼0.9×. The overall dimensions of the optical imaging part are 54 mm × 36 mm ×60 mm (L × W × H). The response time is 180 ms. The imaging resolution can reach up to 50 lp/mm during the optical zoom process. The proposed continuous optical zoom compound eye imaging system has potential applications in various fields, including large field of view imaging, medical diagnostics, machine vision, and distance detection.

Metalens array miniaturized microscope for large-field-of-view imaging

Miniaturized microscopes with large field-of-view (FOV) have wide applications in biomedical imaging and automated machine vision. Conventional microscopes with a single objective lens have tradeoffs among FOV, resolution and device thickness. Thanks to the high compactness and design flexibility, metalens has a great potential for building the next generation compact imagers. However, there have been various challenges and performance tradeoffs in the design, fabrication and implementation of metalens that could support a large FOV. Here, we present a metalens array based miniaturized microscope that provides extremely high compactness and large FOV. Each metalens unit can image the object tile immediately below it. By tiling such metalens units, we can scale up the FOV while keeping the same device thickness and imaging quality as the microscope with a single metalens unit. Our metalens array enables a compact microscope that can perform large FOV imaging through arbitrary polarized light. We experimentally demonstrated the miniaturized metalens array microscope in 1310 nm wavelength, which has an FOV of 3 × 4 mm2 and can resolve 6.9 μm lines, with 4 mm distance between the sample surface to the camera sensor. Although this is a proof-of-concept demonstration, our metalens array microscope provides a promising solution for portable and implantable camera for large-FOV high-resolution imaging.

Athermalization of Optical System with Large Field of View for Image Navigation

Image navigation sensor is one of the most important sensing means for human to explore the extraterrestrial space environment, and optical system is a key component of image navigation sensor, directly determines the amount of information perceived. The optical system requirements of image navigation sensors are gradually developing towards large field of view and miniaturization. The fisheye lens is the first choice for large field of view imaging by selecting the appropriate optical structure, without adding other additional components, and has the advantages of small size and strong perception energy. However, as the image surface illuminance of fisheye lens will decrease sharply with the increase of the field of view, the change of temperature will also degrade the imaging quality of the system, and strong stray light sources such as the sun will easily enter the field of view, which will greatly affect the perception ability of the system. Because of this, effective design of these systems is quite difficult. In this paper, a reverse-telephoto structure was used for large-field imaging, and the degradation of imaging quality caused by temperature changes was eliminated by selecting appropriate optical and mechanical materials. Designed with a focal length of 6.7mm, an F number of 3.6, a viewing angle of 130°, a working band of 0.45μm to 0.65μm, an after work distance of 7mm, a total system length≤60mm, we tested our system in a -40°C to +60°C temperature range and measured the image quality. Through simulation analysis, the system in the whole field of view within our spot diagrams was≤5.5μm, optical transfer function was greater than 0.2 at 90lp/mm, and no vignetting occurred. Furthermore, the imaging illumination of the edge field of view was 0.72 times that of the center field of view, the f – tan (θ) relative distortion value of the center field of view was≤2.3%, and the f – θ relative distortion value of the edge field of view was≤2.7%. Compared to normal temperatures, the optical transfer function changes at -20°C and +40°C were 0.02 and 0.01, respectively. Thus, the system displayed the characteristics of excellent image quality, small size, high energy utilization rate and good non-thermal performance.

Convolutional neural networks for tracking coalescing waveforms in supersonic jet noise

High-speed schlieren images of the field surrounding a supersonic jet provide a rich database for testing convolutional neural network (CNN) classification methods due to the presence of many waveform structures of interest. One such structure is waveform coalescence, where waves intersect at small angles, which can lead to increased steepening and nonlinear distortion in the jet near field [Willis et al., AIAA Journal (2023)]. Although waves exhibiting coalescence behavior have been identified in narrow field-of-view (FOV) schlieren images, new methods are needed for large FOV images to improve computational efficiency. This presentation will explore methods to track and classify waves observed in large FOV schlieren images as coalescing or noncoalescing using CNNs. Using transfer learning, pretrained networks can be retrained for this problem, with training data obtained from narrow FOV schlieren or from two-dimensional simulated waveforms using the Khokhlov–Zabolotskaya–Kuznetzov (KZK) equation. The impact of model hyperparameters, choice of pretrained network, image scaling, and other factors on the results of waveform classification by the CNN will be explored. [WAW is supported by the ARL:UT Chester M. McKinney Graduate Fellowship in Acoustics.]

Spectrum-optimized direct image reconstruction of super-resolution structured illumination microscopy

Super-resolution structured illumination microscopy (SR-SIM) has become a widely used nanoscopy technique for rapid, long-term, and multi-color imaging of live cells. Precise but troublesome determination of the illumination pattern parameters is a prerequisite for Wiener-deconvolution-based SR-SIM image reconstruction. Here, we present a direct reconstruction SIM algorithm (direct-SIM) with an initial spatial-domain reconstruction followed by frequency-domain spectrum optimization. Without any prior knowledge of illumination patterns and bypassing the artifact-sensitive Wiener deconvolution procedures, resolution-doubled SR images could be reconstructed by direct-SIM free of common artifacts, even for the raw images with large pattern variance in the field of view (FOV). Direct-SIM can be applied to previously difficult scenarios such as very sparse samples, periodic samples, very small FOV imaging, and stitched large FOV imaging.

High-throughput single-molecule localization microscopy: Potential clinical applications.

High-throughput single-molecule localization microscopy: Potential clinical applications.

The Effect of Fabrication Error on the Performance of Mid-Infrared Metalens with Large Field-of-View.

Mid-infrared large field-of-view (FOV) imaging optics play a vital role in infrared imaging and detection. The metalens, which is composed of subwavelength-arrayed structures, provides a new possibility for the miniaturization of large FOV imaging systems. However, the inaccuracy during fabrication is the main obstacle to developing practical uses for metalenses. Here, we introduce the principle and method of designing a large FOV doublet metalens at the mid-infrared band. Then, the quantitative relationship between the fabrication error and the performance of the doublet metalens with a large FOV from four different fabrication errors is explored by using the finite-difference time-domain method. The simulation results show that the inclined sidewall error has the greatest impact on the focusing performance, and the interlayer alignment error deforms the focusing beam and affects the focusing performance, while the spacer thickness error has almost no impact on the performance. The contents discussed in this paper can help manufacturers determine the allowable processing error range of the large FOV doublet metalens and the priority level for optimizing the process, which is of significance.

Research advances in simple and compact optical imaging techniques

Computational imaging enables optical imaging systems to acquire more information with miniaturized setups. Computational imaging can avoid the object-image conjugate limitation of the imaging system, and introduce encoding and decoding processes based on physical optics to achieve more efficient information transmission. It can simultaneously increase the amount of information and reduce the complexity of the system, thereby paving the way for miniaturizing imaging systems. Based on computational imaging, the simple and compact optical imaging techniques are developed, which is also called simple optics. To develop miniaturized optical imaging elements and integrated systems, simple optics utilizes the joint design of optical system and image processing algorithms, thereby realizing high-quality imaging that is comparable to complex optical systems. The imaging systems are of small-size, low-weight, and low-power consumption. With the development of micro-nano manufacturing, the optical elements have evolved from a single lens or a few lenses, to flat/planar optical elements, such as diffractive optical elements and metasurface optical elements. As a result, various lensless and metalens imaging systems have emerged. Owing to the introduction of encoding process and decoding process, an optical imaging model is developed to represent the relationship between the target object and the acquired signal, from which the computational reconstruction is used to restore the image. In the image restoration part, the algorithms are discussed in three categories, i.e. the classic algorithm, the model-based optimization iterative algorithm, and the deep learning (neural network) algorithm. Besides, the end-to-end optimization is highlighted because it introduces a new frame to minimize the complexity of optical system. In this review, the imaging techniques realized by simple optics are also discussed, such as depth imaging, high-resolution and super-resolution imaging, large field of view imaging, and extended depth of field imaging, as well as their important roles in developing consumer electronics, unmanned driving, machine vision, security monitoring, biomedical devices and metaverse. Last but not least, the challenges and future developments are prospected.

Heterogeneous compound eye camera for dual-scale imaging in a large field of view.

Multi-scale imaging with large field of view is pivotal for fast motion detection and target identification. However, existing single camera systems are difficult to achieve snapshot multi-scale imaging with large field of view. To solve this problem, we propose a design method for heterogeneous compound eye, and fabricate a prototype of heterogeneous compound eye camera (HeCECam). This prototype which consists of a heterogeneous compound eye array, an optical relay system and a CMOS sensor, is capable of dual-scale imaging in large field of view (360°×141°). The heterogeneous compound eye array is composed of 31 wide-angle (WA) subeyes and 226 high-definition (HD) subeyes. An optical relay system is introduced to re-image the curved focal surface formed by the heterogeneous compound eye array on a CMOS sensor, resulting in a heterogeneous compound eye image containing dual-scale subimages. To verify the imaging characteristics of this prototype, a series of experiments, such as large field of view imaging, imaging performance, and real-world scene imaging, were conducted. The experiment results show that this prototype can achieve dual-scale imaging in large field of view and has excellent imaging performance. This makes the HeCECam has great potential for UAV navigation, wide-area surveillance, and location tracking, and paves the way for the practical use of bio-inspired compound eye cameras.

Water excitation with LIBRE pulses in three-dimensional variable flip angle fast spin echo for fat-free and large field of view imaging at 3 tesla

PurposeTo develop and evaluate a sequence in which water excitation with lipid insensitive binomial off-resonant radio frequency excitation (LIBRE) pulses is incorporated into three-dimensional (3D) variable flip angle fast spin echo (LIBRE-vf-FSE) for fat-free and large field of view imaging at 3 Tesla (T). Materials and methodsNumerical simulation was conducted to optimize the parameters of LIBRE pulses, including the flip angle, pulse duration, and frequency offset, for maximizing the fat suppression effect of the proposed LIBRE-vf-FSE sequence. The sequence was then implemented at 3 T and assessed in phantoms, lower extremity imaging of 8 healthy volunteers, and head/neck imaging of 5 healthy volunteers. Conventional water excitation (WE) and fat saturation (FatSat) were also performed for comparison. Signal-to-noise ratio (SNR) of fat and contrast-to-noise ratio (CNR) between fat and water were used to evaluate the level of fat suppression. Standard deviation (SD) of SNR was used to evaluate the uniformity of fat suppression. ResultsThe numerical simulation demonstrated that LIBRE-vf-FSE enables large volume imaging with uniform fat suppression, which was further confirmed by phantom and healthy volunteer experiments. LIBRE provided the lowest fat SNR and offered more uniform fat suppression compared with the WE and FatSat. Specifically, average oil SNRs obtained by LIBRE (1.10 ms, 360 Hz, and 60°), WE, and FatSat were (180.1 vs. 280.2 vs. 811.2) in phantom experiments, and average fat SNRs and SDs in legs obtained by LIBRE (1.10 ms, 360 Hz, and 60°), WE, and FatSat were (85.1 vs. 105.0 vs. 105.1) and (22.4 vs. 27.4 vs. 56.4) in vivo experiments, respectively. ConclusionThe proposed LIBRE-vf-FSE sequence allows for fat suppression and large field of view imaging at 3 T. It could be an alternative approach for fat-free vf-FSE scan.

High-efficiency simplification method of irregular FOV for accelerating the imaging process in the Risley-Prism system.

The Risley-Prism system, which has advantages in large FOV (field of view), high resolution and flexible imaging, faces limitations in image processing speed due to the non-convex characteristics of the FOV. Here, we proposed a simplified FOV model using inscribed rectangle and its property in area size, equivalent resolution and dynamic characteristics are studied, shows high consistency with original FOV. The simulation and experimental results show that the simplified FOV can reduce the calculation time of the total area of multi sub-FOVs from 3500 ms to 7.4 ms, and the image distortion correction time can also be reduced by 88.9%∼96.9%.

Chip-scale metalens microscope for wide-field and depth-of-field imaging

Microscopy is very important in research and industry, yet traditional optical microscopy suffers from the limited field-of-view (FOV) and depth-of-field (DOF) in high-resolution imaging. We demonstrate a simultaneous large FOV and DOF microscope imaging technology based on a chip-scale metalens device that is implemented by a SiNx metalens array with a co- and cross-polarization multiplexed dual-phase design and dispersive spectrum zoom effect. A 4-mm × 4-mm FOV is obtained with a resolution of 1.74 μm and DOF of 200 μm within a wavelength range of 450 to 510 nm, which definitely exceeds the performance of traditional microscopes with the same resolution. Moreover, it is realized in a miniaturized compact prototype, showing an overall advantage for portable and convenient microscope technology.

Bio-inspired spherical compound eye camera for simultaneous wide-band and large field of view imaging.

Natural compound eyes have excellent optical characteristics, namely large field of view, small size, no aberration, and sensitive to motion. Some arthropods have more powerful vision. For example, the Morpho butterfly's compound eyes can perceive the near-infrared and ultraviolet light that the human eye cannot see. This wide-band imaging with a large field of view has great potential in wide-area surveillance, all-weather panoramic imaging, and medical imaging. Hence, a wide-band spherical compound eye camera inspired by the Morpho butterfly's eye was proposed. The wide-band spherical compound eye camera which can achieve a large field of view (360° × 171°) imaging over a wide range of wavelengths from 400nm to 1000nm, mainly consists of three parts: a wide-band spherical compound eye with 234 sub-eyes for light collection, a wide-band optical relay system for light transmission, and a wide-band CMOS image sensor for photoelectric conversion. Our experimental results show that the wide-band spherical compound eye camera not only captures a large field of view without anomalous blurring or aberrations but also perceives near-infrared light that is not recognized by the human eye. These features make it possible for distortion-free panoramic vision and panoramic medical diagnosis.

Utilization of TEM with Automated Tile Scan Technique for Length Determination of CNF

Large field of view (FOV) imaging was introduced and evaluated to characterize length and width of cellulose nanofibril (CNF) by transmission electron microscopy (TEM) with automation capability. New imaging method provided an image area as wide as covering one hole on grid. The large FOV image provided 10×10 of tile image which can cover 2500 μm² of sample area. Large FOV imaging has a great advantage to obtain massive information for average length of CNF. The imaging method enable to overcome the limitation of conventional TEM imaging to elicit average length of CNF. The average length and width of CNF was 375 nm and 7 nm, respectively. Length-weighted average length of CNF was 651 nm. Study to select the kind of support film resulted as carbon film was the best among silicon monoxide and carbon. Carbon film was more durable to high electron beam energy exposure and better to disperse CNF separately than silicon monoxide.

Multicolor light-sheet microscopy for a large field of view imaging: A comparative study between Bessel and Gaussian light-sheets configurations.

Light-sheet fluorescence microscopy (LSFM) is useful for developmental biology studies, which require a simultaneous visualization of dynamic microstructures over large fields of views (FOVs). A comparative study between multicolor Bessel and Gaussian-based LSFM systems is presented. Discussing the chromatic implications to achieve colocalized and large FOVs when both optical arrays are implemented under the same excitation objective is the purpose of this work. The light-sheets FOVs, optical sectioning, and resolution are experimentally characterized and discussed. The advantages of using Bessel beams and the main drawbacks of using Gaussian beams for multicolor imaging are highlighted. Multiple Bessel excitation minimizes the FOV's mismatch's effects due to the beams chromatic defocusing and alleviates the aside object blurring obtained with multiple Gaussian beams. It also offers a fair homogeneous axial resolution and optical sectioning over a larger effective FOV. Imaging over perithecia samples of the fungus Sordaria macrospora demonstrates such advantages. This work complements previous comparative studies that discuss only single wavelengths light-sheets excitations.

Simultaneous label-free autofluorescence-multiharmonic microscopy driven by femtosecond sources based on self-phase modulation enabled spectral selection

Nonlinear optical microscopy technique has unique advantages in tissue imaging, such as enhanced contrast, high resolution, and label-free deep optical sectioning capabilities. Nonlinear optical microscopy also has multiple imaging modalities, corresponding to various components in biological tissues. Unfortunately, its wide applications are hindered due to the lack of broadly tunable femtosecond sources designed for driving multimodalities simultaneously. To solve this challenge, we propose a new wavelength conversion approach—self-phase modulation (SPM) enabled spectral selection, dubbed as SESS. The SESS employs SPM to broaden the input spectrum in a short fiber, and the broadened spectrum features well-isolated spectral lobes. Using the suitable optical filters to select the outermost spectral lobes produces nearly transform-limited femtosecond pulses. In this work, we demonstrate a fiber-optic SESS source for multimodal nonlinear optical microscopy. Based on a 43-MHz Yb-fiber laser, this SESS source can emit 990-nm, 84-fs pulses with >5-nJ energy and ~84-fs pulse duration; it can also produce 1110-nm, 48-fs pulses with 15-nJ energy. The 990-nm pulses are used to drive two-photon excitation fluorescence of many important fluorophores and second-harmonic generation microscopy, which, combined with image splicing technology, enables us to obtain a large field of view image of the gastric tissue. We also employ the 1110-nm pulses to drive simultaneous label-free autofluorescence-multiharmonic microscopy for multimodal imaging of gastric tissue. Two-photon excitation fluorescence, three-photon excitation fluorescence, second-harmonic generation and third-harmonic generation signals of gastric tissue are simultaneously excited efficiently. Such a multimodal nonlinear optical microscopy driven by SESS sources becomes a powerful tool in biomedical imaging.

Evaluation of Cone-beam Computed Tomography Artifacts Produced by Metal Objects Located Within and Outside the Field of View

IntroductionArtifacts created by the presence of metal objects in the jaw negatively affect the cone-beam computed tomographic image quality. This study compares artifacts produced by metal objects outside of the field of view (FOV) in a small FOV CBCT image with those produced in a large FOV image in which the metal object is within the FOV. MethodsWe methodically placed 4 titanium implant–sized rods and 4 zirconium crown–sized disks on 1 side of a human cadaver mandible. Using the Accuitomo 170 CBCT machine (J Morita, Irvine, CA), a total of 18 scans (9 with a small FOV and 9 with a large FOV) were made. Ten axial slices from each scan were transferred to ImageJ software (National Institutes of Health, Bethesda, MD) for analysis. The mean standard deviation of all voxel values of a fixed region of interest (ie, uniform air located lingual to tooth #30) was compared between small and large FOV slices. Two blinded observers subjectively rated the images for diagnostic quality and the presence of artifacts. ResultsThe Wilcoxon signed rank test showed that the standard deviation for both small and large FOV slices increases as the number of metal objects increases. The mean of the standard deviation for small and large FOVs is 3.6 and 2.5, respectively (P = .0000). Fifty-three percent of the small FOV slices had more artifacts in the subjective analysis. One hundred percent of the small FOV slices were rated as higher quality. ConclusionMetal objects outside of the FOV in the contralateral quadrant do affect the quality of small FOV images. However, small FOV images have a higher resolution compared with large FOV images.

A versatile oblique plane microscope for large-scale and high-resolution imaging of subcellular dynamics.

We present an oblique plane microscope (OPM) that uses a bespoke glass-tipped tertiary objective to improve the resolution, field of view, and usability over previous variants. Owing to its high numerical aperture optics, this microscope achieves lateral and axial resolutions that are comparable to the square illumination mode of lattice light-sheet microscopy, but in a user friendly and versatile format. Given this performance, we demonstrate high-resolution imaging of clathrin-mediated endocytosis, vimentin, the endoplasmic reticulum, membrane dynamics, and Natural Killer-mediated cytotoxicity. Furthermore, we image biological phenomena that would be otherwise challenging or impossible to perform in a traditional light-sheet microscope geometry, including cell migration through confined spaces within a microfluidic device, subcellular photoactivation of Rac1, diffusion of cytoplasmic rheological tracers at a volumetric rate of 14 Hz, and large field of view imaging of neurons, developing embryos, and centimeter-scale tissue sections.

Generating large field of view en-face projection images from intra-acquisition motion compensated volumetric optical coherence tomography data.

A technique to generate large field of view projection maps of arbitrary optical coherence tomography (OCT) data is described. The technique is divided into two stages - an image acquisition stage that features a simple to use fast and robust retinal tracker to get motion free retinal OCT volume scans - and a stitching stage where OCT data from different retinal locations is first registered against a reference image using a custom pyramid-based approach and finally stitched together into one seamless large field of view (FOV) image. The method is applied to data recorded with a polarization sensitive OCT instrument in healthy subjects and glaucoma patients. The tracking and stitching accuracies are quantified, and finally, large FOV images of retinal nerve fiber layer retardation that contain the arcuate nerve fiber bundles from the optic nerve head to the raphe are demonstrated.