Off-axis Images Research Articles

Poster Session II: Understanding scattering in high-resolution retinal imaging.

In conventional fundus images the contrast relates to scattering and absorption of light. Here, we report on modeling of high-resolution retinal imaging to understand the role of mitochondria light scattering in the ellipsoid of photoreceptors. We evaluate the directionality appearance of the photoreceptors, and its relation to drusen appearance in age-related macular degeneration (AMD). The refractive index contrast of the mitochondria collectively resembles that of micron-sized reflectors. Obliqueness of the scattering results in vignetting by the pupil that impacts on the brightness of the photoreceptors. Our hypothesis is that in early-stage AMD, drusen will perturb the photoreceptor alignment and thus cause oblique scattering and reduced brightness on the slope of the drusen in high-resolution retinal images. We model how this affects the observable photoreceptor mosaic both in the healthy eye and in eyes with AMD. The results confirm that the annular dark ring around drusen is likely caused by oblique scattering. We use a model eye to test the hypothesis with a reflective mask emulating the photoreceptor mosaic An SLM is used for amplitude modulation in the pupil and differential imaging allows for capturing off-axis images with an appearance like that of phase contrast images. Further refinement of the model eye may be a valuable way to test new imaging modalities prior to their implementation in the real eye.

On-chip label-free cell classification based directly on off-axis holograms and spatial-frequency-invariant deep learning

We present a rapid label-free imaging flow cytometry and cell classification approach based directly on raw digital holograms. Off-axis holography enables real-time acquisition of cells during rapid flow. However, classification of the cells typically requires reconstruction of their quantitative phase profiles, which is time-consuming. Here, we present a new approach for label-free classification of individual cells based directly on the raw off-axis holographic images, each of which contains the complete complex wavefront (amplitude and quantitative phase profiles) of the cell. To obtain this, we built a convolutional neural network, which is invariant to the spatial frequencies and directions of the interference fringes of the off-axis holograms. We demonstrate the effectiveness of this approach using four types of cancer cells. This approach has the potential to significantly improve both speed and robustness of imaging flow cytometry, enabling real-time label-free classification of individual cells.

Analytic model for off-axis GRB afterglow images – geometry measurement and implications for measuring H0

ABSTRACT We present an analytic model for measuring the jet core angle (θc) and viewing angle (θobs) of off-axis gamma-ray bursts independently of the jet angular structure outside of the core. We model the images of off-axis jets, and using this model, we show that θobs and θc can be measured using any two of the three following observables: the afterglow light curve, the flux-centroid motion, and the image width. The model is calibrated using 2D relativistic hydrodynamic simulations with a broad range of jet angular structures. We study the systematic errors due to the uncertainty in the jet structure and find that when using the light curve and centroid motion to determine θobs and θc, our formulae can be accurate to a level of 5–10 per cent and 30 per cent, respectively. In light of the Hubble tension, the systematic error in cos θobs in GRBs originating in a binary compact object merger is of special interest. We find that the systematic uncertainty on the measurement of cos θobs due to the unknown jet structure is smaller than 1.5 per cent for well-observed events. A similar error is expected if the microphysical parameters evolve at a level that is not easily detected by the light curve. Our result implies that this type of systematic uncertainty will not prevent measurement of H0 to a level of 2 per cent with a sample of well-observed GW events with resolved afterglow image motion. Applying our model to the light curve and centroid motion observations of GW170817, we find $\theta _{obs}=19.2\pm 2~\deg$ (1σ) and $\theta _c=1.5-4~\deg$.

Quantitative evaluations of vortex vein ampullae by adjusted 3D reverse projection model of ultra-widefield fundus images

The purpose of this study was to determine the number and location of vortex vein ampullae (VVA) in normal eyes. This was an observational retrospective study. Montage images of one on-axis and two off-axis ultra-widefield images of 74 healthy eyes were enhanced, and reverse projected onto a 3D model eye. The number and distance between the optic disc to each VVA in the four sectors were compared. The significance of correlations between these values and age, sex, visual acuity, refractive error, and axial length was determined. The mean number of VVA was 8.10/eye with 1.84, 2.12, 2.19 and 1.95 in upper lateral, lower lateral, upper nasal, and lower nasal sectors, respectively. The mean number of VVA/eye was significantly greater in men at 8.43 than women at 7.76 (P = 0.025). The mean distance between the optic disc and VVA was 14.15 mm, and it was 14.04, 15.55, 13.29 and 13.66 mm in the upper lateral, lower lateral, upper nasal and lower nasal sectors, respectively (all P < 0.05). The number and location of VVA can be obtained non-invasively, and the number was significantly higher in men than women. This technique can be used to determine whether these values are altered in a retinochoroidal disease.

Analytic aplanatic singlet lens: setting and design for three-point objects and images in the meridional plane

We present the setting and design of an aplanatic optical system for three-point objects and images. The system is composed of a singlet aspheric lens and its entrance pupil. The aspheric lens and the entrance pupil are such that the three-point images and objects lay on the same plane. The image at the center is free of spherical aberration, and the other off-axis images are free of coma.

ATTENUATION OUTER RETINAL BANDS ON OPTICAL COHERENCE TOMOGRAPHY FOLLOWING MACULAR EDEMA: A Possible Manifestation of Photoreceptor Misalignment.

Macular edema is a common retinal disease which may leave important anatomical and functional sequelaes. Directional fundus imaging consists of comparing on- and off-axis images to reveal angle-dependent reflectance properties of fundus structures, which may be related to misaligned photoreceptors. Here, we analyzed directional optical coherence tomography (OCT) and flood-illumination adaptive optics ophthalmoscopy images to detect evidence of misaligned photoreceptors following macular edema. Transversal, observational study. Nine patients having recovered a normal macular profile after macular edema due to retinal vein occlusion were included. For each patient, a reference OCT scan (i.e., with the incident beam normal to the fovea) was acquired, and off-axis scans were then acquired by laterally shifting the entry pupil. In addition, in four of these eyes, directional adaptive optics ophthalmoscopy documented the directional variations of cone metrics. Included patients comprised two women and seven men (age range, 19-76 years). Reference OCT scans showed patchy attenuation of the cone outer segment tips and to a lesser extent of the inner segment/outer segment lines in all, but two eyes; these. Increased intensity of the cone outer segment tips and inner segment/outer segment lines could be observed on off-axis scans. Accordingly, fusion images showed 66% average reduction of the length of cone outer segment tips attenuation. In two cases, although reference scans showed continuity of outer bands, focal attenuation was evidenced in off-axis images. Directional adaptive optics ophthalmoscopy imaging showed a strong directional variability of cone counts in these areas, ranging from near absence to roughly two-third of reference values. In each case, directional variations of cone counts paralleled those of the reflectance of outer bands. After macular edema, focal attenuations of the inner segment/outer segment and of the cone outer segment tips lines may be present on OCT. These areas may show a strong directional variability by both OCT and adaptive optics ophthalmoscopy, suggesting that misaligned photoreceptor outer segments contribute to such features. The evaluation of outer retinal damage following macular edema should therefore take into account the optical Stiles-Crawford effect to disambiguate missing from misaligned cones.

Off-axis optical coherence tomography imaging of the crystalline lens to reconstruct the gradient refractive index using optical methods.

Earlier studies have shown that the gradient index of refraction (GRIN) of the crystalline lens can be reconstructed in vitro using Optical Coherence Tomography (OCT) images. However, the methodology cannot be extended in vivo because it requires accurate measurements of the external geometry of the lens. Specifically, the posterior surface is measured by flipping the lens so that the posterior lens surface faces the OCT beam, a method that cannot be implemented in vivo. When the posterior surface is imaged through the lens in its natural position, it appears distorted by the unknown GRIN. In this study, we demonstrate a method to reconstruct both the GRIN and the posterior surface shape without the need to flip the lens by applying optimization routines using both on-axis and off-axis OCT images of cynomolgous monkey crystalline lenses, obtained by rotating the OCT delivery probe from -45 to +45 degrees in 5 degree steps. We found that the GRIN profile parameters can be reconstructed with precisions up to 0.009, 0.004, 1.7 and 1.1 (nucleus and surface refractive indices, and axial and meridional power law, respectively), the radius of curvature within 0.089 mm and the conic constant within 0.3. While the method was applied on isolated crystalline lenses, it paves the way to in vivo lens GRIN and posterior lens surface reconstruction.

In vitro and schematic model eye assessment of glare or positive dysphotopsia-type photic phenomena: Comparison of a new material IOL to other monofocal IOLs

To compare the glare-type photic phenomena for a new intraocular lens (IOL) to other monofocal IOLs, and to investigate how IOL design features might affect these phenomena. Alcon Laboratories, Inc., Fort Worth, Texas; John A Moran Eye Center, University of Utah, Salt Lake City, USA. Schematic model eye evaluation and invitro study. Five monofocal IOL models (Clareon CNA0T0, Tecnis ZCB00, enVista MX60, Eternity W-60, and Vivinex XY1) were used to evaluate glare or positive dysphotopsia-type phenomena. Optical simulations of incoming light were generated using nonsequential ray-tracing software based on a collimated light source for various off-axis angles of illumination. The simulation analyses were verified using a laboratory invitro bench-top glare measurement system. The Clareon and Vivinex IOLs produced focused off-axis images with negligible peripheral glare characteristics. The Tecnis and enVista IOLs produced dispersed images with additional glare characteristics at 45 degrees of off-axis illumination and higher. The Eternity IOL showed the highest edge-reflected glare characteristic, likely because of its straight optic edge geometry. The laboratory bench images and glare intensity profiles were consistent with the simulation data. Invitro and nonsequential ray-tracing evaluations showed that straight optic edges and peripheral nonimaging optic geometry might contribute to positive dysphotopsia. The IOL designs with optic edge curvature and full functional optics demonstrated the lowest level of glare-type photic phenomena. Only clinical studies can confirm whether the differences observed between the IOLs invitro are clinically significant.

Off-axis afterglow light curves and images from 2D hydrodynamic simulations of double-sided GRB jets in a stratified external medium

Gamma-ray burst (GRB) jets are narrow, and thus typically point away from us. They are initially ultra-relativistic, causing their prompt $\gamma$-ray and early afterglow emission to be beamed away from us. However, as the jet gradually decelerates its beaming cone widens and eventually reaches our line of sight and the afterglow emission may be detected. Such orphan afterglows were not clearly detected so far. Nevertheless, they should be detected in upcoming optical or radio surveys, and it would be challenging to clearly distinguish between them and other types of transients. Therefore, we perform detailed, realistic calculations of the expected afterglow emission from GRB jets viewed at different angles from the jet's symmetry axis. The dynamics are calculated using 2D relativistic hydrodynamics simulations of jets propagating into different power-law external density profiles, $\rho_{\rm ext}\propto{}R^{-k}$ for $k=0,\,1,\,1.5,\,2$, ranging from a uniform ISM-like medium ($k=0$) to a stratified steady stellar-wind like profile ($k=2$). We calculate radio, optical and X-ray lightcurves, and the evolution of the radio afterglow image size, shape and flux centroid. This may help identify misaligned relativistic jets, whether initially ultra-relativistic and producing a GRB for observers within their beam, or (possibly intrinsically more common) moderately relativistic, in either (i) nearby supernovae Ib/c (some of which are associated with long duration GRBs), or (ii) in binary neutron star mergers, which may produce short duration GRBs, and may also be detected in gravitational waves (e.g. GW$\,$170827/GRB$\,$170817A with a weak prompt $\gamma$-ray emission may harbor an off-axis jet).

SCORPIO-2 guiding and calibration system in the prime focus of the 6-m telescope

We describe a device (adapter) for off-axis guiding and photometric calibration of wide-angle spectrographs operating in the prime focus of the 6-m telescope of the Special Astrophysical Observatory of the Russian Academy of Sciences. To compensate coma in off-axis star images an achromatic lens corrector is used, which ensures maintaining image quality (FWHM) at a level of about 1'' within 15' from the optical axis. The device has two 54'-diameter movable guiding fields, which can move in 10' x 4'.5 rectangular areas. The device can perform automatic search for guiding stars, use them to control the variations of atmospheric transmittance, and focus the telescope during exposure. The limiting magnitude of potential guiding stars is mR ~17 mag. The calibration path whose optical arrangement meets the telecentrism condition allows the spectrograph to be illuminated both by a source of line spectrum (a He-Ne-Ar filled lamp) and by a source of continuum spectrum. The latter is usually represented either by a halogen lamp or a set of light-emitting diodes, which provide illumination of approximately uniform intensity over the wavelength interval from 350 to 900 nm. The adapter is used for observations with SCORPIO-2 multimode focal reducer.

Geometric Phase Generated Optical Illusion

An optical illusion, such as “Rubin’s vase”, is caused by the information gathered by the eye, which is processed in the brain to give a perception that does not tally with a physical measurement of the stimulus source. Metasurfaces are metamaterials of reduced dimensionality which have opened up new avenues for flat optics. The recent advancement in spin-controlled metasurface holograms has attracted considerate attention, providing a new method to realize optical illusions. We propose and experimentally demonstrate a metasurface device to generate an optical illusion. The metasurface device is designed to display two asymmetrically distributed off-axis images of “Rubin faces” with high fidelity, high efficiency and broadband operation that are interchangeable by controlling the helicity of the incident light. Upon the illumination of a linearly polarized light beam, the optical illusion of a ‘vase’ is perceived. Our result provides an intuitive demonstration of the figure-ground distinction that our brains make during the visual perception. The alliance between geometric metasurface and the optical illusion opens a pathway for new applications related to encryption, optical patterning, and information processing.

Conformable Holographic Metasurfaces

Metasurface holograms are typically fabricated on rigid substrates. Here we experimentally demonstrate broadband, flexible, conformable, helicity multiplexed metasurface holograms operating in the visible range, offering increased potential for real life out-of-the-lab applications. Two symmetrically distributed holographic images are obtained when circularly polarized light impinges on the reflective-type metasurface positioned on non-planar targets. The two off-axis images with high fidelity are interchangeable by controlling the helicity of incident light. Our metasurface features the arrangement of spatially varying gold nanorods on a flexible, conformable epoxy resist membrane to realize a Pancharatnam-Berry phase profile. These results pave the way to practical applications including polarization manipulation, beam steering, novel lenses, and holographic displays.

Optimizing experimental parameters for the projection requirement in HAADF-STEM tomography

Tomographic reconstruction algorithms offer a means by which a tilt-series of transmission images can be combined to yield a three dimensional model of the specimen. Conventional reconstruction algorithms assume that the measured signal is a linear projection of some property, typically the density, of the material. Here we report the use of multislice simulations to investigate the extent to which this assumption is met in HAADF-STEM imaging. The use of simulations allows for a systematic survey of a range of materials and microscope parameters to inform optimal experimental design. Using this approach it is demonstrated that the imaging of amorphous materials is in good agreement with the projection assumption in most cases. Images of crystalline specimens taken along zone-axes are found to be poorly suited for conventional linear reconstruction algorithms due to channelling effects which produce enhanced intensities compared with off-axis images, and poor compliance with the projection requirement. Off-axis images are found to be suitable for reconstruction, though they do not strictly meet the linearity requirement in most cases. It is demonstrated that microscope parameters can be selected to yield improved compliance with the projection requirement.

Alignment of multiple-off-axis-beam imaging/interference systems.

The alignment of components in complex multibeam arrangements is typically prone to errors that limit the performance of the system. A systematic procedure for aligning such systems is presented here. The method facilitates the precision alignment of the optical elements to achieve the accurate projection of multiple on- and off-axis images and the simultaneous interference of the multiple beams. In addition to the multibeam imaging/interference system presented, the procedure can be employed in other multibeam imaging and/or interfering configurations.

Broadband optical mammography instrument for depth-resolved imaging and local dynamic measurements.

We present a continuous-wave instrument for non-invasive diffuse optical imaging of the breast in a parallel-plate transmission geometry. The instrument measures continuous spectra in the wavelength range 650-1000 nm, with an intensity noise level <1.5% and a spatial sampling rate of 5 points/cm in the x- and y-directions. We collect the optical transmission at four locations, one collinear and three offset with respect to the illumination optical fiber, to recover the depth of optical inhomogeneities in the tissue. We imaged a tissue-like, breast shaped, silicone phantom (6 cm thick) with two embedded absorbing structures: a black circle (1.7 cm in diameter) and a black stripe (3 mm wide), designed to mimic a tumor and a blood vessel, respectively. The use of a spatially multiplexed detection scheme allows for the generation of on-axis and off-axis projection images simultaneously, as opposed to requiring multiple scans, thus decreasing scan-time and motion artifacts. This technique localizes detected inhomogeneities in 3D and accurately assigns their depth to within 1 mm in the ideal conditions of otherwise homogeneous tissue-like phantoms. We also measured induced hemodynamic changes in the breast of a healthy human subject at a selected location (no scanning). We applied a cyclic, arterial blood pressure perturbation by alternating inflation (to a pressure of 200 mmHg) and deflation of a pneumatic cuff around the subject's thigh at a frequency of 0.05 Hz, and measured oscillations with amplitudes up to 1 μM and 0.2 μM in the tissue concentrations of oxyhemoglobin and deoxyhemoglobin, respectively. These hemodynamic oscillations provide information about the vascular structure and functional integrity in tissue, and may be used to assess healthy or abnormal perfusion in a clinical setting.

Wolter-I-like X ray telescope structure using one conical mirror and one quadric mirror

Nested multilayer mirrors are commonly used in X-ray telescope structures to increase the collecting area. To balance the difficulty and cost of producing these mirrors, the classical Wolter-I structure has previously been replaced with a conical Wolter-I structure, but it can lead to significantly poorer angular resolution. In this paper, we consider changing one of the mirror shapes (paraboloid or hyperboloid) of the Wolter-I structure to a conical mirror shape, while the other mirror shape remains a quadric surface-type structure, which could thus ensure the imaging quality. Based on a theoretical analysis and the results of simulations, the cone-hyperboloid and paraboloid-cone structures are found to provide the best angular resolutions, and the cone-hyperboloid structure is shorter than the paraboloid-cone structure at the focal length. The cone-hyperboloid structure is then nested to obtain the best on-axis angular resolution and off-axis images.

Helicity multiplexed broadband metasurface holograms.

Metasurfaces are engineered interfaces that contain a thin layer of plasmonic or dielectric nanostructures capable of manipulating light in a desirable manner. Advances in metasurfaces have led to various practical applications ranging from lensing to holography. Metasurface holograms that can be switched by the polarization state of incident light have been demonstrated for achieving polarization multiplexed functionalities. However, practical application of these devices has been limited by their capability for achieving high efficiency and high image quality. Here we experimentally demonstrate a helicity multiplexed metasurface hologram with high efficiency and good image fidelity over a broad range of frequencies. The metasurface hologram features the combination of two sets of hologram patterns operating with opposite incident helicities. Two symmetrically distributed off-axis images are interchangeable by controlling the helicity of the input light. The demonstrated helicity multiplexed metasurface hologram with its high performance opens avenues for future applications with functionality switchable optical devices.

Characterizing the Impact of Off-Axis Scan Acquisition on the Reproducibility of Total Retinal Thickness Measurements in SDOCT Volumes.

Off-axis acquisition of spectral domain optical coherence tomography (SDOCT) images has been shown to increase total retinal thickness (TRT) measurements. We analyzed the reproducibility of TRT measurements obtained using either the retinal pigment epithelium (RPE) or Bruch's membrane as reference surfaces in off-axis scans intentionally acquired through multiple pupil positions. Five volumetric SDOCT scans of the macula were obtained from one eye of 25 normal subjects. One scan was acquired through a central pupil position, while subsequent scans were acquired through four peripheral pupil positions. The internal limiting membrane, the RPE, and Bruch's membrane were segmented using automated approaches. These volumes were registered to each other and the TRT was evaluated in 9 Early Treatment of Diabetic Retinopathy Study (ETDRS) regions. The reproducibility of the TRT obtained using the RPE was computed using the mean difference, coefficient of variation (CV), and the intraclass correlation coefficient (ICC), and compared to those obtained using Bruch's membrane as the reference surface. A secondary set of 1545 SDOCT scans was also analyzed in order to gauge the incidence of off-axis scans in a typical acquisition environment. The photoreceptor tips were dimmer in off-axis images, which affected the RPE segmentation. The overall mean TRT difference and CV obtained using the RPE were 7.04 ± 4.31 μm and 1.46%, respectively, whereas Bruch's membrane was 1.16 ± 1.00 μm and 0.32%, respectively. The ICCs at the subfoveal TRT were 0.982 and 0.999, respectively. Forty-one percent of the scans in the secondary set showed large tilts (> 6%). RPE segmentation is confounded by its proximity to the interdigitation zone, a structure strongly affected by the optical Stiles-Crawford effect. Bruch's membrane, however, is unaffected leading to a more robust segmentation that is less dependent upon pupil position. The way in which OCT images are acquired can independently affect the accuracy of automated retinal thickness measurements. Assessment of scan angle in a clinical dataset demonstrates that off-axis scans are common, which emphasizes the need for caution when relying on automated thickness parameters when this component of scan acquisition is not controlled for.

Focus on software and semiconductors

Focus on software and semiconductors

Iris localization in frontal eye images for less constrained iris recognition systems

Commercial iris recognition systems do not perform well for non-ideal data, because their iris localization algorithms are specifically developed for controlled data. This paper presents a robust iris localization algorithm for less constrained data. It includes: (i) suppressing specular reflections; (ii) localizing the iris inner (pupil circle) and outer (iris circle) boundaries in a two-phase strategy. In the first phase, we use Hough transform, gray level statistics, adaptive thresholding, and a geometrical transform to extract the pupil circle in a sub-image containing a coarse pupil region. After that, we localize iris circle in a sub-image centered at the pupil circle. However, if the first phase fails, the second phase starts, where first we localize a coarse iris region in the eye image. Next, we extract pupil circle within the coarse iris region by reusing procedure of first phase. Following that, we localize iris circle. In either of the two phases, we validate the pupil location by using an effective occlusion transform; and (iii) regularizing the iris circular boundaries by using radial gradients and the active contours. Experimental results show that the proposed technique is tolerant to off-axis eye images, specular reflections, non-uniform illumination; glasses, contact lens, hair, eyelashes, and eyelids occlusions.