Lenslet Array Research Articles

Multiband polarimetric imaging of HD 34700 with SCExAO/CHARIS

Abstract We present Subaru/SCExAO + CHARIS broadband (JHK) integral field spectroscopy of HD 34700 A in polarized light. CHARIS has the unique ability to obtain polarized integral field images at 22 wavelength channels in broadband, as the incoming light is first split into different polarization states before passing though the lenslet array. We recover the transition disk around HD 34700 A in multiband polarized light in our data. We combine our polarized intensity data with previous total intensity data to examine the scattering profiles, scattering phase functions and polarized fraction of the disk at multiple wavelengths. We also carry out 3D Monte Carlo radiative transfer simulations of the disk using MCFOST, and make qualitative comparisons between our models and data to constrain dust grain properties. We find that in addition to micron-sized dust grains, a population of sub-micron grains is needed to match the surface brightness in polarized light and polarized fraction. This could indicate the existence of a population of small grains in the disk, or it could be caused by Mie theory simulations using additional small grains to compensate for sub-micron structures of real dust aggregates. We find models that match the polarized fraction of the data but the models do not apply strong constraints on the dust grain type or compositions. We find no models that can match all observed properties of the disk. More detailed modeling using realistic dust aggregates with irregular surfaces and complex structures is required to further constrain the dust properties.

Meta Shack–Hartmann wavefront sensor with large sampling density and large angular field of view: phase imaging of complex objects

Shack–Hartmann wavefront sensors measure the local slopes of an incoming wavefront based on the displacement of focal spots created by a lenslet array, serving as key components for adaptive optics for astronomical and biomedical imaging. Traditionally, the challenges in increasing the density and the curvature of the lenslet have limited the use of such wavefront sensors in characterizing slowly varying wavefront structures. Here, we develop a metasurface-enhanced Shack–Hartmann wavefront sensor (meta SHWFS) to break this limit, considering the interplay between the lenslet parameters and the performance of SHWFS. We experimentally validate the meta SHWFS with a sampling density of 5963 per mm2 and a maximum acceptance angle of 8° which outperforms the traditional SFWFS by an order of magnitude. Furthermore, to the best of our knowledge, we demonstrate the first use of a wavefront sensing scheme in single-shot phase imaging of highly complex patterns, including biological tissue patterns. The proposed approach opens up new opportunities in incorporating exceptional light manipulation capabilities of the metasurface platform in complex wavefront characterization.

Comparison of modal and zonal wavefront measurements of refractive extended depth of focus intraocular lenses.

Extended depth-of-focus (EDoF) intraocular lenses (IOLs) are typically evaluated using commercially available aberrometers. Given the intricate optical design of these IOLs, employing an appropriate wavefront reconstruction method with a sufficient sampling resolution of the aberrometer is crucial. A high-resolution Shack-Hartmann wavefront sensor was developed by magnifying the pupil aperture by a factor of five onto a lenslet array (pitch: 133 µm) and utilizing a full-frame CMOS sensor (24 by 36 mm), resulting in a 26.6 µm sampling resolution. Zonal wavefront reconstruction was used and compared with Zernike-based modal wavefront reconstruction to retain detailed local slope irregularities. Four refractive EDoF IOLs with a power of 20D were examined, and the wavefront difference between the zonal and modal methods, expressed as the root mean squared error (RMSE), remained significant for two of the IOLs up to the 16th-order Zernike spherical aberrations (SAs). Conversely, a negligibly small RMSE was observed for the other two IOLs, as long as the Zernike SAs were higher than the 6th order. The raytracing simulation results from the zonal wavefronts exhibited a stronger correlation with the results of recent optical bench studies than those from the modal wavefronts. The study suggests that certain recent refractive EDoF IOLs possess a complex optical profile that cannot be adequately characterized by limited orders of SAs.

Monolithic silicon microlens arrays for far-infrared astrophysics.

Future far-infrared astrophysics observatories will require focal plane arrays containing thousands of ultrasensitive, superconducting detectors, each of which require efficient optical coupling to the telescope fore-optics. At longer wavelengths, many approaches have been developed, including feedhorn arrays and macroscopic arrays of lenslets. However, with wavelengths as short as 25µm, optical coupling in the far infrared remains challenging. In this paper, we present an approach to fabricate far-infrared monolithic silicon microlens arrays using grayscale lithography and deep reactive ion etching. The fabricated microlens arrays presented here are designed for two different wavebands: 25-40µm and 135-240µm. The microlens arrays have sags as deep as 150µm, are hexagonally packed with a pixel pitch of 900µm, and have an overall size as large as 80 by 15mm. We compare an as-fabricated lens profile to the design profile and calculate that the fabricated lenses would achieve 84% encircled power for the designed detector, which is only 3% less than the designed performance. We also present methods developed for antireflection coating microlens arrays and for a silicon-to-silicon die bonding process to hybridize microlens arrays with detector arrays.

Real-time phase retrieval in division of aperture microscopy with the transport of intensity equation.

The transport of intensity equation (TIE) allows to recover the phase of a microscopy sample from differently focused intensity measures along the axial direction of its optical field. In the present work, we propose a cost-effective technique for snapshot phase retrieval with TIE. The optics of a commercially available camera is replaced with a doublet system consisting of a microscope objective and a lenslet array with an extra lens mask attached to it. The system allows to obtain, in real-time and with no mechanical shift of either the sample or the sensor, the in-focus as well as a defocused image of the sample. From these two sub-aperture images, the intensity derivative term in TIE can then be approximated after image rectification. Phase is then retrieved for static as well as dynamic samples over the common view area. Validation experiments are presented.

Thin On-Sensor Nanophotonic Array Cameras

Today's commodity camera systems rely on compound optics to map light originating from the scene to positions on the sensor where it gets recorded as an image. To record images without optical aberrations, i.e., deviations from Gauss' linear model of optics, typical lens systems introduce increasingly complex stacks of optical elements which are responsible for the height of existing commodity cameras. In this work, we investigate flat nanophotonic computational cameras as an alternative that employs an array of skewed lenslets and a learned reconstruction approach. The optical array is embedded on a metasurface that, at 700 nm height, is flat and sits on the sensor cover glass at 2.5 mm focal distance from the sensor. To tackle the highly chromatic response of a metasurface and design the array over the entire sensor, we propose a differentiable optimization method that continuously samples over the visible spectrum and factorizes the optical modulation for different incident fields into individual lenses. We reconstruct a megapixel image from our flat imager with a learned probabilistic reconstruction method that employs a generative diffusion model to sample an implicit prior. To tackle scene-dependent aberrations in broadband , we propose a method for acquiring paired captured training data in varying illumination conditions. We assess the proposed flat camera design in simulation and with an experimental prototype, validating that the method is capable of recovering images from diverse scenes in broadband with a single nanophotonic layer.

Three-dimensional optical watermarking scheme using compressed sensing in integral imaging system

The elemental image array (EIA) is a special form of the integral imaging three-dimensional (3D) display system for recording, transmitting and displaying 3D image information, which consists of a series of small image units taken from different perspectives. There is an urgent need for protecting the copyright of EIA to improve security and anti-aggressive capability. In this paper, we propose a 3D optical watermarking scheme for integral imaging system based on compressed sensing (CS) theory. The proposed watermarking scheme consists of two subsystems, one is the EIA watermark compression and embedding subsystem, and the other is the EIA watermark extraction and display subsystem. CS theory using by phase coding mask is applied for realizing the EIA encryption and compression simultaneously, which can reduce the total amount of embedded watermark information, expand the space of secret keys and make the system more flexible and compact. The experimental results are presented to demonstrate the feasibility and effectiveness of the proposed method. The parameters of the integral imaging watermark encryption system, including the focal length and aperture of the lenslet array, the object distance, the wavelength, the diffraction distance, and the measurement matrix of CS, can all be used as the secret keys. The method proposed in this paper can effectively broaden the keys space and enhance the security of the integral image 3D display system.

Imaging Analysis of Photonic Integrated Interference Imaging System Based on Compact Sampling Lenslet Array Considering On-Chip Optical Loss

A photonic integrated interference imaging system (PIIIS) is a computational imager based on Michelson interference and photonic integrated circuits (PICs). In this paper, a PIIIS based on a compact sampling lenslet array that can sample the zero spatial frequency through a single lenslet, densely sample the frequency in the azimuth direction through the configuration of a hierarchical multistage lenslet array, and continuously sample the frequency in the radial direction through a Langford sequence is proposed. We introduce the design process of the compact sampling lenslet array in detail and simulate the imaging of the system. The simulation results demonstrate that the lenslet array can effectively improve the imaging quality of a PIIIS. In addition, we design a silicon PIC and a silicon nitride transition PIC that match the compact sampling lenslet array and simulate the imaging of the system under the influence of the on-chip optical loss of PICs (the average interference baseline loss is 15.4 dB at 1550 nm). The results show that on-chip optical loss mainly affects the brightness and contrast of the reconstructed image but has little effect on the structure.

Spatial-spectral resolution tunable snapshot imaging spectrometer: analytical design and implementation.

A snapshot imaging spectrometer is a powerful tool for dynamic target tracking and real-time recognition compared with a scanning imaging spectrometer. However, all the current snapshot spectral imaging techniques suffer from a major trade-off between the spatial and spectral resolutions. In this paper, an integral field snapshot imaging spectrometer (TIF-SIS) with a continuously tunable spatial-spectral resolution and light throughput is proposed and demonstrated. The proposed TIF-SIS is formed by a fore optics, a lenslet array, and a collimated dispersive subsystem. Theoretical analyses indicate that the spatial-spectral resolution and light throughput of the system can be continuously tuned through adjusting the F number of the fore optics, the rotation angle of the lenslet array, or the focal length of the collimating lens. Analytical relationships between the spatial and spectral resolutions and the first-order parameters of the system with different geometric arrangements of the lenslet unit are obtained. An experimental TIF-SIS consisting of a self-fabricated lenslet array with a pixelated scale of 100×100 and a fill factor of 0.716 is built. The experimental results show that the spectral resolution of the system can be steadily improved from 4.17 to 0.82nm with a data cube (N x×N y×N λ) continuously tuned from 35×35×36 to 40×40×183 in the visible wavelength range from 500 to 650nm, which is consistent with the theoretical prediction. The proposed method for real-time tuning of the spatial-spectral resolution and light throughput opens new possibilities for broader applications, especially for recognition of things with weak spectral signature and biomedical investigations where a high light throughput and tunable resolution are needed.

Single-Pixel Imaging for Partially Occluded Objects

In some complex scene, such as military reconnaissance and other fields, the target object may be partially occluded by some opaque obstacles, which increase the difficulty to obtain the complete object image. In traditional optical imaging system, the lenslet array or the reference beam and special algorithms are usually needed to solve this problem, which increase the complexity of the system. As a computational optical imaging technology, the problem of single-pixel imaging (SPI) for an occluded object has not been researched yet as we know. Here we propose an SPI system to recover the occluded object image. Firstly, the images of object and occlusion from different perspectives are obtained by detecting the light field at different positions. Secondly, the limited conditions of the system parameters are derived by using geometric optics theory to ensure complete imaging. Thirdly, the feasibility of the scheme and the correctness of the limited conditions are verified by experiments. The results in this article can promote the application of SPI technology in many complex practices.

36‐3: Design and Analysis of Brightness enhancement Integral Imaging Based 3D Light‐Field Normal Display and Optical See‐Through Light‐Field Display by Discrete Lenslet Array

We want to create a floating projection with integral imaging based 3D light field normal display and with an optical see‐through display. Using the Computer Generated Elemental Image (CGEI) method to create an image with a different depth from a two‐dimensional image and depth map. We create a new weight function instead of using the previous one from the previous paper in the same method. Also, creating an optical see‐through light‐field display by using a discrete lenslet array. Finally, we created naked 3D with brighter information and realize floating projection effect with a see‐through display.

52‐1: Ultracompact Virtual Reality System

We demonstrate an ultracompact virtual reality (VR) system with thickness of about 1‐cm. In this system, the imaging optics consists of a lenslet array, a deflector array, and a Pancharatnam‐Berry deflector (PBD). We have experimentally demonstrated a polarization interpolation configuration to reduce the system thickness by nearly 50%.

Compact lensless convolution processor for an optoelectronic convolutional neural network

To our knowledge, optical 4f systems have been widely used as a convolutional layer to perform convolutional computation in free-space optical neural networks (ONNs), which makes ONNs too bulky to be easily applied to miniaturized smart systems. Hence, we propose a compact lensless optoelectronic convolutional neural network (LOE-CNN) architecture in which a single optimized diffractive phase mask acts as an analog convolution processor to perform convolutional operation without a Fourier lens or lenslet array. We demonstrate that this LOE-CNN can be functionally comparable to existing electronic counterparts in classification performance, achieving a classification accuracy of 98.07% and 95% over the Modified National Institute of Standards and Technology dataset in simulation and experiment, respectively, which not only opens new application prospects for free-space ONNs based on a compact single-chip convolution processor, but also facilitates the development of ONN-based smart devices.

Three-dimensional gradient index microlens arrays for light-field and holographic imaging and displays.

The geometric, intensity, and chromatic distortions that are a result of the limitations of the material and processes used to fabricate micro-optical lens arrays (MLAs) degrade the performance of light-field systems. To address these limitations, inkjet print additive manufacturing is used to fabricate planar gradient index (GRIN) lenslet arrays, in which volumetric refractive index profiles are used to embed optical functions that would otherwise require multiple homogeneous index MLA surfaces. By tailoring the optical ink feedstock refractive index spectra, independent control over dispersion is achieved, and achromatic performance is made possible. Digital manufacturing is shown to be beneficial for optimizing individual micro-optical channels in arrays wherein the shape, size, aspect ratio, focal length, and optical axis orientation of the lenslets vary as a function of the position within the optical field. Print fabrication also allows opaque inter-lens baffling and aperture stops that reduce inter-channel cross talk, improve resolution, and enhance contrast. These benefits are demonstrated in a light-field display testbed.

Reflective Fourier ptychography-based depth-recovery & resolution-enhanced real scene hologram acquisition method

Recording interference holograms using coherent light is a complex process for real-world objects. Alternatively, holography based on integral imaging with natural illumination is considered an option. However, the field of view (FOV) of this technology is limited by the lenslet array of the integral imaging system. This paper proposes an integral imaging-based hologram recording method via a commercial plenoptic camera to increase the FOV for a conventional II system. Meanwhile, to address the problem of depth non-uniform compression caused by the main lens of the plenoptic camera, this paper proposed a depth recovery method combined with the camera’s metadata parameters for depth retargeting. Finally, we introduce a reflective Fourier-ptychography-based algorithm via an optimum overlap rate to acquire high-performance holograms. Compared to stereotypical integral imaging holography, this method produces a higher resolution reconstruction result. In addition, we conduct three sets of experiments on real scenes whose results also prove the proposed method embodies finer reconstruction results, and depth is recovered up to twice as much as the original outcome.

Artifact reduction in lenslet array near-eye displays

Lenslet array near-eye displays are a revolutionary technology that generates a virtual image in the field of view of the observer. Although this technology is advantageous in creating compact near-eye displays, undesirable artifacts occur when the user pupil moves outside of the pupil practical movable region (PPMR). Even with dynamic image updating based on eye-tracking techniques, artifacts can still be perceived when human eyes turn rapidly. To enlarge PPMR, we proposed a new rendering method in previous work. To improve the rendering speed in the eye tracking system, look-up tables are used. The disadvantage of the onboard system is the large memory consumption. In this study, we analyzed the system parameters of the incident pupil and pupil margin light columns, the feasibility of the optimized system, and evaluated the optimized system that can adapt to the maximum velocity of the saccadic pupil movement. We optimized the rendering method to reduce memory consumption in the process of generating microdisplay images. In addition, we provide GPU rendering method to improve system speed and reduce system latency to meet the maximum human eye rotation speed. We conducted user studies to evaluate the effect of the method using the optimized rendering method combined with eye tracking to reduce artifacts for fast eye rotation on different images and videos. Results showed that our method effectively reduced artifacts via the optimized rendering method with eye tracking, which adapted to faster human eye movements.

Optical characterisation of two novel myopia control spectacle lenses.

To quantify the amount of myopic defocus, contrast modulation and other optical characteristics of two novel spectacle lenses (MiYOSMART by Hoya and Stellest by Essilor) with the inclusion of lenslets in their designs were investigated computationally and experimentally. This paper examined the hypothesis that despite the non-coaxial nature of the optics, image degradation will exist due to the fragmented nature of the base optic when imaging through the lens regions populated by lenslets. Optical power was evaluated by computing wavefront vergence and curvature from wavefront slope measured with the Optocraft aberrometer within 1.0 and 6.0 mm apertures across MiYOSMART hexagons and Stellest rings. Point-spread functions (PSFs) were computed using physical (wave) optics and geometrical ray optics principles, and compared with experimental measurements using a 4f optical system. Simulated retinal images and modulation transfer functions (MTFs) were computed from PSF-derived optical transfer functions (OTFs). Mean lenslet power in MiYOSMART was +3.95 ± 0.10 D through the hexagons and +6.00 ± 0.15 D in Stellest in rings 1-5 and decreased by 0.42 D/ring reaching 3.50 D in the final one. Stellest lenslets included up to -0.015 microns of primary spherical aberration. PSFs and retinal images revealed simultaneous contributions of the base optic and lenslets. MTFs showed a decrease in contrast at low (1-10 c/deg) spatial frequencies (SFs) comparable to 0.25 D of defocus, and retention of diminished levels of contrast at higher SFs. Varying sagittal power and consistent curvature power across the lenslets is an identifying signature of the novel non-coaxial lens design included in both spectacle lenses. Lenslet array structure itself plays a significant role in determining image characteristics. For both lenses, the blur created by the fragmented base optic contributes to the image quality. The reduced MTFs over a wide range of spatial frequencies result in lowered image contrast.

Analytical design of a cemented-curved-prism based integral field spectrometer (CIFS) with high numerical aperture and high resolution.

Snapshot hyperspectral imaging is superior to scanning spectrometers due to its advantage in dimensionality, allowing longer pixel dwell time and higher data cube acquisition efficiency. Due to the trade-off between spatial and spectral resolution in snapshot spectral imaging technologies, further improvements in the performance of snapshot imaging spectrometers are limited. Therefore, we propose a cemented-curved-prism-based integral field spectrometer (CIFS), which achieves high spatial and high spectral resolution imaging with a high numerical aperture. It consists of a hemispherical lens, a cemented-curved-prism and a concave spherical mirror. The design idea of aplanatic imaging and sharing-optical-path lays the foundation for CIFS to exhibit high-resolution imaging in a compact structure. The numerical model between the parameters of optical elements and the spectral resolution of the system is established, and we analyze the system resolution influenced by the hemispherical lens and the cemented-curved-prism. Thus, the refractive index requirements of the hemispherical lens and the cemented-curved-prism for the optimal spatial and spectral resolution imaging of the system are obtained, providing guidance for the construction of CIFS. The designed CIFS achieves pupil matching with a 1.8 f-number lenslet array, sampling 268 × 76 spatial points with 403 spectral channels in the wavelength band of 400 to 760 nm. The spectral and spatial resolution are further evaluated through a simulation experiment of spectral imaging based on Zemax. It paves the way for developing integral field spectrometers exhibiting high spatial and high spectral resolution imaging with high numerical aperture.

Implementing a non-4f relay system for Hartmann-Shack wavefront sensing.

Hartmann-Shack wavefront sensors (HSWSs) are used in many disciplines to measure optical aberrations. Conventionally, the wavefront of interest is transferred onto the lenslet array of the HSWS with a telescopic 4f relay system. However, the 4f relay design restricts the choice of focal lengths and distances used for the relay system. In this paper, we describe a non-4f variant and demonstrate both theoretically and experimentally that its wavefront relaying properties equal that of a 4f system. We also present an alignment method for conjugating the wavefront with the lenslet array of the HSWS for both 4f and non-4f systems.

Spectacles with highly aspherical lenslets for myopia control do not change visual sensitivity in automated static perimetry.

Spectacle lenses with arrays of lenslets have gained popularity in myopia control due to their high efficacy, low impact on visual performance, and non-invasiveness. One of the questions regarding their impact on visual performance that still remain is that: do the lenslets impact visual field sensitivity? The current study aims to investigate the impact of wearing spectacle lenses with highly aspherical lenslets (HAL) on the visual field sensitivity. An automated static perimetry test (Goldman perimeter target III) was employed to measure the detection sensitivity in the visual field. Targets were white light dots of various luminance levels and size 0.43°, randomly appearing at 76 locations within 30° eccentricity. Twenty-one adult subjects (age 23-61, spherical equivalent refractive error (SER) -8.75 D to +0.88 D) participated in the study. Sensitivities through two lenses, HAL and a single vision lens (SVL) as the control condition, were measured in random order. The mean sensitivity differences between HAL and SVL across the 76 tested locations ranged between -1.14 decibels (dB) and 1.28 dB. Only one location at 30° in the temporal visual field reached statistical significance (p < 0.00065) whereby the sensitivity increased by 1.1 dB with HAL. No significant correlation was found between the difference in sensitivity and age or SER. Such a difference is unlikely to be clinically relevant. Compared to the SVL, the HAL did not change detection sensitivity to static targets in the whole visual field within 30° eccentricity.