Adaptive Optics Optical Coherence Tomography Research Articles

Revealing speckle obscured living human retinal cells with artificial intelligence assisted adaptive optics optical coherence tomography

BackgroundIn vivo imaging of the human retina using adaptive optics optical coherence tomography (AO-OCT) has transformed medical imaging by enabling visualization of 3D retinal structures at cellular-scale resolution, including the retinal pigment epithelial (RPE) cells, which are essential for maintaining visual function. However, because noise inherent to the imaging process (e.g., speckle) makes it difficult to visualize RPE cells from a single volume acquisition, a large number of 3D volumes are typically averaged to improve contrast, substantially increasing the acquisition duration and reducing the overall imaging throughput.MethodsHere, we introduce parallel discriminator generative adversarial network (P-GAN), an artificial intelligence (AI) method designed to recover speckle-obscured cellular features from a single AO-OCT volume, circumventing the need for acquiring a large number of volumes for averaging. The combination of two parallel discriminators in P-GAN provides additional feedback to the generator to more faithfully recover both local and global cellular structures. Imaging data from 8 eyes of 7 participants were used in this study.ResultsWe show that P-GAN not only improves RPE cell contrast by 3.5-fold, but also improves the end-to-end time required to visualize RPE cells by 99-fold, thereby enabling large-scale imaging of cells in the living human eye. RPE cell spacing measured across a large set of AI recovered images from 3 participants were in agreement with expected normative ranges.ConclusionsThe results demonstrate the potential of AI assisted imaging in overcoming a key limitation of RPE imaging and making it more accessible in a routine clinical setting.

Cellular Determinants of Visual Outcomes in Eyes with Epiretinal Membrane: Insights from Adaptive Optics Optical Coherence Tomography

Objective or PurposeIn this study, we aimed to evaluate cellular alterations in the foveal neuroglia of eyes with idiopathic epiretinal membrane (ERM) and examine their correlation with visual function. We also aimed to identify prognostic markers for visual outcomes post-vitrectomy. DesignA prospective longitudinal study. Subjects, Participants, and/or ControlsThe study comprised 84 subjects, including 50 eyes diagnosed with idiopathic ERM and 34 healthy eyes serving as controls. MethodsThe foveal neuroglial changes in eyes with idiopathic ERM were determined using adaptive optics optical coherence tomography (AO-OCT) by comparing them with healthy eyes. For patients with ERM, the ERM and inner limiting membrane were removed during vitrectomy in all eyes. Main Outcome MeasuresFoveal microstructures on AO-OCT images, best-corrected visual acuity (BCVA) and M-CHARTS scores, evaluated preoperatively and at 1, 3, and 6 months postoperatively, and associations between foveal neuroglial changes and these parameters. ResultsAO-OCT revealed discernible differences in the foveal cones of the eyes with ERM and their healthy counterparts. The thickness of the ellipsoid zone (EZ) band was augmented in eyes with ERM. The alignment of the Müller cells was more vertical, and the density of the foveal cone cell nuclei was higher in eyes with ERM than in healthy eyes. Within the AO-OCT parameters, the higher cone nuclei count correlated with worse M-CHARTS scores, both preoperatively and 6 months postoperatively (P = 0.004, 0.010, respectively). Greater EZ thickness was significantly associated with poorer 6-month postoperative BCVA (P = 0.005). ConclusionsAO-OCT can be used to precisely identify cellular alterations in eyes with ERM that are closely related to visual function impairments. These cellular insights enhance our understanding of ERM pathology and offer promising prognostic indicators of visual outcome after vitrectomy.

Cellular-Level Visualization of Retinal Pathology in Multiple Sclerosis With Adaptive Optics.

To apply adaptive optics-optical coherence tomography (AO-OCT) to quantify multiple sclerosis (MS)-induced changes in axonal bundles in the macular nerve fiber layer, ganglion cell somas, and macrophage-like cells at the vitreomacular interface. We used AO-OCT imaging in a pilot study of MS participants (n = 10), including those without and with a history of optic neuritis (ON, n = 4), and healthy volunteers (HV, n = 9) to reveal pathologic changes to inner retinal cells and structures affected by MS. We found that nerve fiber layer axonal bundles had 38% lower volume in MS participants (1.5 × 10-3 mm3) compared to HVs (2.4 × 10-3 mm3; P < 0.001). Retinal ganglion cell (RGC) density was 51% lower in MS participants (12.3 cells/mm2 × 1000) compared to HVs (25.0 cells/mm2 × 1000; P < 0.001). Spatial differences across the macula were observed in RGC density. RGC diameter was 15% higher in MS participants (11.7µm) compared to HVs (10.1µm; P < 0.001). A nonsignificant trend of higher density of macrophage-like cells in MS eyes was also observed. For all AO-OCT measures, outcomes were worse for MS participants with a history of ON compared to MS participants without a history of ON. AO-OCT measures were associated with key visual and physical disabilities in the MS cohort. Our findings demonstrate the utility of AO-OCT for highly sensitive and specific detection of neurodegenerative changes in MS. Moreover, the results shed light on the mechanisms that underpin specific neuronal pathology that occurs when MS attacks the retina. The new findings support the further development of AO-based biomarkers for MS.

Deep learning-enabled volumetric cone photoreceptor segmentation in adaptive optics optical coherence tomography images of normal and diseased eyes.

Objective quantification of photoreceptor cell morphology, such as cell diameter and outer segment length, is crucial for early, accurate, and sensitive diagnosis and prognosis of retinal neurodegenerative diseases. Adaptive optics optical coherence tomography (AO-OCT) provides three-dimensional (3-D) visualization of photoreceptor cells in the living human eye. The current gold standard for extracting cell morphology from AO-OCT images involves the tedious process of 2-D manual marking. To automate this process and extend to 3-D analysis of the volumetric data, we propose a comprehensive deep learning framework to segment individual cone cells in AO-OCT scans. Our automated method achieved human-level performance in assessing cone photoreceptors of healthy and diseased participants captured with three different AO-OCT systems representing two different types of point scanning OCT: spectral domain and swept source.

Retinal imaging using adaptive optics optical coherence tomography with fast and accurate real-time tracking.

One of the main obstacles in high-resolution 3-D retinal imaging is eye motion, which causes blur and distortion artifacts that require extensive post-processing to be corrected. Here, an adaptive optics optical coherence tomography (AOOCT) system with real-time active eye motion correction is presented. Correction of ocular aberrations and of retinal motion is provided by an adaptive optics scanning laser ophthalmoscope (AOSLO) that is optically and electronically combined with the AOOCT system. We describe the system design and quantify its performance. The AOOCT system features an independent focus adjustment that allows focusing on different retinal layers while maintaining the AOSLO focus on the photoreceptor mosaic for high fidelity active motion correction. The use of a high-quality reference frame for eye tracking increases revisitation accuracy between successive imaging sessions, allowing to collect several volumes from the same area. This system enables spatially targeted retinal imaging as well as volume averaging over multiple imaging sessions with minimal correction of motion in post processing.

Advances in Optical Coherence Tomography Imaging Technology and Techniques for Choroidal and Retinal Disorders.

Optical coherence tomography (OCT) imaging has played a pivotal role in the field of retina. This light-based, non-invasive imaging modality provides high-quality, cross-sectional analysis of the retina and has revolutionized the diagnosis and management of retinal and choroidal diseases. Since its introduction in the early 1990s, OCT technology has continued to advance to provide quicker acquisition times and higher resolution. In this manuscript, we discuss some of the most recent advances in OCT technology and techniques for choroidal and retinal diseases. The emerging innovations discussed include wide-field OCT, adaptive optics OCT, polarization sensitive OCT, full-field OCT, hand-held OCT, intraoperative OCT, at-home OCT, and more. The applications of these rising OCT systems and techniques will allow for a closer monitoring of chorioretinal diseases and treatment response, more robust analysis in basic science research, and further insights into surgical management. In addition, these innovations to optimize visualization of the choroid and retina offer a promising future for advancing our understanding of the pathophysiology of chorioretinal diseases.

Application of Adaptive Optics in Ophthalmology

The eye, the photoreceptive organ used to perceive the external environment, is of great importance to humans. It has been proven that some diseases in humans are accompanied by fundus changes; therefore, the health status of people may be interpreted from retinal images. However, the human eye is not a perfect refractive system for the existence of ocular aberrations. These aberrations not only affect the ability of human visual discrimination and recognition, but restrict the observation of the fine structures of human eye and reduce the possibility of exploring the mechanisms of eye disease. Adaptive optics (AO) is a technique that corrects optical wavefront aberrations. Once integrated into ophthalmoscopes, AO enables retinal imaging at the cellular level. This paper illustrates the principle of AO in correcting wavefront aberrations in human eyes, and then reviews the applications and advances of AO in ophthalmology, including the adaptive optics fundus camera (AO-FC), the adaptive optics scanning laser ophthalmoscope (AO-SLO), the adaptive optics optical coherence tomography (AO-OCT), and their combined multimodal imaging technologies. The future development trend of AO in ophthalmology is also prospected.

Long-term assessment of internal limiting membrane peeling for full-thickness macular hole using en face adaptive optics and conventional optical coherence tomography

ObjectiveTo evaluate the long-term structural and microvascular retinal effects of internal limiting membrane peeling for full-thickness macular hole (FTMH) using en face adaptive optics optical coherence tomography (AO-OCT), conventional OCT, and OCT angiography (OCTA). DesignInterventional case series. ParticipantsPatients with FTMH treated with vitrectomy, internal limiting membrane peeling, and gas tamponade. MethodsEleven eyes with FTMH that had at least 12 months of postoperative follow-up were enrolled in the study. En face AO-OCT was used to image the superficial retina in the peeled and nonpeeled areas. En face structural OCT was performed to image the inner retinal dimples (IRDs), macular thickness, and retinal nerve fibre layer (RNFL). En face OCTA was used to examine the integrity of the peripapillary nerve fibre layer (NFL) plexus. ResultsAO-OCT showed RFNL wrapping around the IRDs, and no obvious peripapillary NFL plexus dropout was seen with OCTA. Scattered hyper-reflective dots were observed on the surface of the peeled retina in all patients imaged with AO-OCT. No significant differences were found in IRD number (91.5 ± 24.4 versus 77.2 ± 14.7; P = 2.07), IRD proportionate area (8.36 ± 3.34 versus 7.53 ± 2.60; P = 0.159), or macular thickness between the 6- and 12-month (or greater) postoperative visits. ConclusionIRDs do not to progress beyond 6 months postoperatively, and no obvious damage to RFNL and peripapillary NFL plexus was detected. Hyper-reflective dots on the surface of the retina suggestive of possible Müller cell reactive gliosis were identified with AO-OCT.

Cell - Vessel Mismatch in Glaucoma: Correlation of Ganglion Cell Layer Soma and Capillary Densities.

PurposeThe purpose of this study was to characterize the relationship between retinal ganglion cell layer (GCL) soma density and capillary density in glaucomatous eyes.MethodsSix glaucoma subjects with known hemifield defects and 6 age-matched controls were imaged with adaptive optics – optical coherence tomography (AO-OCT) at 6 locations: 3 degrees, 6 degrees, and 12 degrees temporal to the fovea above and below the midline. GCL soma density and capillary density were measured at each location. Coefficients of determination (pseudo R2) and slopes between GCL soma and capillary density were determined from mixed-effects regressions and were compared between glaucoma and control subjects, between more and less affected hemifield in subjects with glaucoma, and between subjects with early and moderate glaucoma, both in a local, bivariate model and then a global, multivariable model controlling for eccentricity and soma size.ResultsThe global correlation between GCL soma and capillary density was stronger in control versus subjects with glaucoma (R2 = 0.59 vs. 0.22), less versus more affected hemifields (R2 = 0.55 vs. 0.01), and subjects with early versus moderate glaucoma subjects (R2 = 0.44 vs. 0.18). When controlling for eccentricity and soma size, we noted an inverse soma-capillary density local relationship in subjects with glaucoma (−388 ± 190 cells/mm2 per 1% change in capillary density, P = 0.046) and more affected hemifields (−602 ± 257 cells/mm2 per 1% change in capillary density, P = 0.03).ConclusionsAn inverted soma-capillary density local relationship in areas affected by glaucoma potentially explains weaker global correlations observed between GCL soma and capillary density, suggesting cell–vessel mismatch is associated with the disease.

Human Foveal Cone and Müller Cells Examined by Adaptive Optics Optical Coherence Tomography.

PurposeThe purpose of this study was to image and investigate the foveal microstructure of human cone and Müller cells using adaptive optics-optical coherence tomography.MethodsSix healthy subjects underwent the prototype adaptive optics-optical coherence tomography imaging, which allowed an axial resolution of 3.4 µm and a transverse resolution of approximately 3 µm. The morphological features of the individual retinal cells observed in the foveola were qualitatively and quantitatively evaluated.ResultsIn the six healthy subjects, the image B-scans showed hyper-reflective dots that were densely packed in the outer nuclear layer. The mean number, diameter, and density of hyper-reflective dots in the foveola were 250.8 ± 59.6, 12.7 ± 59.6 µm, and 6966 ± 1833/mm2, respectively. These qualitative and quantitative findings regarding the hyper-reflective dots were markedly consistent with the morphological features of the foveal cone cell nuclei. Additionally, the images showed the funnel-shaped hyporeflective bodies running vertically and obliquely between the inner and external limiting membranes, illustrating the cell morphology of the foveal Müller cells.ConclusionsUsing adaptive optics, we succeeded in visualizing cross-sectional images of the individual cone and Müller cells of the human retina in vivo.Translational RelevanceAdaptive optics-optical coherence tomography would help to improve our understanding of the pathogenesis of macular diseases.

Interpretation of anatomic correlates of outer retinal bands in optical coherence tomography.

By providing the sectioning capability to differentiate individual retinal layers, optical coherence tomography (OCT) is revolutionizing eye disease diagnosis and treatment evaluation. A better understanding of the hyper- and hypo-reflective bands in retinal OCT is essential for accurate interpretation of clinical outcomes. In this article, we summarize the interpretations of clinical OCT and adaptive optics (AO) OCT (AO-OCT) of the outer retina in the human eye, and briefly review OCT investigation of the outer retina in animal models. Quantitative analysis of outer retinal OCT bands is compared to established parameters of retinal histology. The literature review and comparative analysis support that both inner/outer segment (IS/OS) junction and IS ellipsoid zone nonexclusively contribute to the second band; and OS, OS tips, and retinal pigment epithelium apical processes contribute to the third band in conventional OCT. In contrast, AO-OCT might predominantly detect the IS/OS junction and OS tip signals at the second and third bands due to its improved sectioning capability and possible AO effect on the sensitivities for recording ballistic and diffusive photons from different regions of the outer retina.

Weakly supervised individual ganglion cell segmentation from adaptive optics OCT images for glaucomatous damage assessment.

Cell-level quantitative features of retinal ganglion cells (GCs) are potentially important biomarkers for improved diagnosis and treatment monitoring of neurodegenerative diseases such as glaucoma, Parkinson's disease, and Alzheimer's disease. Yet, due to limited resolution, individual GCs cannot be visualized by commonly used ophthalmic imaging systems, including optical coherence tomography (OCT), and assessment is limited to gross layer thickness analysis. Adaptive optics OCT (AO-OCT) enables in vivo imaging of individual retinal GCs. We present an automated segmentation of GC layer (GCL) somas from AO-OCT volumes based on weakly supervised deep learning (named WeakGCSeg), which effectively utilizes weak annotations in the training process. Experimental results show that WeakGCSeg is on par with or superior to human experts and is superior to other state-of-the-art networks. The automated quantitative features of individual GCLs show an increase in structure-function correlation in glaucoma subjects compared to using thickness measures from OCT images. Our results suggest that by automatic quantification of GC morphology, WeakGCSeg can potentially alleviate a major bottleneck in using AO-OCT for vision research.

Quantification of Retinal Ganglion Cell Morphology in Human Glaucomatous Eyes.

PurposeTo characterize retinal ganglion cell morphological changes in patients with primary open-angle glaucoma associated with hemifield defect (HD) using adaptive optics–optical coherence tomography (AO-OCT).MethodsSix patients with early to moderate primary open-angle glaucoma with an average age of 58 years associated with HD and six age-matched healthy controls with an average age of 61 years were included. All participants underwent in vivo retinal ganglion cell (RGC) imaging at six primary locations across the macula with AO-OCT. Ganglion cell layer (GCL) somas were manually counted, and morphological parameters of GCL soma density, size, and symmetry were calculated. RGC cellular characteristics were correlated with functional visual field measurements.ResultsGCL soma density was 12,799 ± 7747 cells/mm2, 9370 ± 5572 cells/mm2, and 2134 ± 1494 cells/mm2 at 3°, 6°, and 12°, respectively, in glaucoma patients compared with 25,058 ± 4649 cells/mm2, 15,551 ± 2301 cells/mm2, and 3891 ± 1105 cells/mm2 (P < 0.05 for all locations) at the corresponding retinal locations in healthy participants. Mean soma diameter was significantly larger in glaucoma patients (14.20 ± 2.30 µm) compared with the health controls (12.32 ± 1.94 µm, P < 0.05 for all locations); symmetry was 0.36 ± 0.32 and 0.86 ± 0.13 in glaucoma and control cohorts, respectively.ConclusionsGlaucoma patients had lower GCL soma density and symmetry, greater soma size, and increased variation of GCL soma reflectance compared with age-matched control subjects. The morphological changes corresponded with HD, and the cellular level structural loss correlated with visual function loss in glaucoma. AO-based morphological parameters could be potential sensitive biomarkers for glaucoma.

Three-dimensional composition of the photoreceptor cone layers in healthy eyes using adaptive-optics optical coherence tomography (AO-OCT).

To assess the signal composition of cone photoreceptors three-dimensionally in healthy retinas using adaptive optics optical coherence tomography (AO-OCT). Study population. Twenty healthy eyes of ten subjects (age 23 to 67). Procedures. After routine ophthalmological assessments, eyes were examined using AO-OCT. Three-dimensional volumes were acquired at 2.5° and 6.5° foveal eccentricity in four main meridians (superior, nasal, inferior, temporal). Cone densities and signal compositions were investigated in four different planes: the cone inner segment outer segment junction (IS/OS), the cone outer segment combined with the IS/OS (ISOS+), the cone outer segment tips (COST) and full en-face plane (FEF) combining signals from all mentioned cone layers. Additionally, reliability of a simple semi-automated approach for assessment of cone density was tested. Main outcome measures. Cone density of IS/OS, IS/OS+, COST and FEF. Qualitative depiction and composition of each cone layer. Inter-rater agreement of cone density measurements. Mean overall cone density at all eccentricities was highest at the FEF plane (21.160/mm2), followed by COST (20.450/mm2), IS/OS+ (19.920/mm2) and IS/OS (19.530/mm2). The different meridians and eccentricities had a significant impact on cone density, with lower eccentricity resulting in higher cone densities (p≤.001), which were highest at the nasal, then temporal, then inferior and then superior meridian. Depiction of the cone mosaic differed between all 4 layers regarding signal size and packing density. Therefore, different cone layers showed evident but not complete signal overlap. Using the semi-automated technique for counting of cone signals achieved high inter-rater reliability (ICC > .99). In healthy individuals qualitative and quantitative changes in cone signals are found not only in different eccentricities and meridians, but also within different photoreceptor layers. The variation between cone planes has to be considered when assessing the integrity of cone photoreceptors in healthy and diseased eyes using adaptive optics technology.

Multi-reference global registration of individual A-lines in adaptive optics optical coherence tomography retinal images.

.Significance: Adaptive optics optical coherence tomography (AO-OCT) technology enables non-invasive, high-resolution three-dimensional (3D) imaging of the retina and promises earlier detection of ocular disease. However, AO-OCT data are corrupted by eye-movement artifacts that must be removed in post-processing, a process rendered time-consuming by the immense quantity of data.Aim: To efficiently remove eye-movement artifacts at the level of individual A-lines, including those present in any individual reference volume.Approach: We developed a registration method that cascades (1) a 3D B-scan registration algorithm with (2) a global A-line registration algorithm for correcting torsional eye movements and image scaling and generating global motion-free coordinates. The first algorithm corrects 3D translational eye movements to a single reference volume, accelerated using parallel computing. The second algorithm combines outputs of multiple runs of the first algorithm using different reference volumes followed by an affine transformation, permitting registration of all images to a global coordinate system at the level of individual A-lines.Results: The 3D B-scan algorithm estimates and corrects 3D translational motions with high registration accuracy and robustness, even for volumes containing microsaccades. Averaging registered volumes improves our image quality metrics up to 22 dB. Implementation in CUDA™ on a graphics processing unit registers a volume in only 10.6 s, 150 times faster than MATLAB™ on a central processing unit. The global A-line algorithm minimizes image distortion, improves regularity of the cone photoreceptor mosaic, and supports enhanced visualization of low-contrast retinal cellular features. Averaging registered volumes improves our image quality up to 9.4 dB. It also permits extending the imaging field of view () and depth of focus () beyond what is attainable with single-reference registration.Conclusions: We can efficiently correct eye motion in all 3D at the level of individual A-lines using a global coordinate system.

Three-dimensional assessment of para- and perifoveal photoreceptor densities and the impact of meridians and age in healthy eyes with adaptive-optics optical coherence tomography (AO-OCT).

An adaptive optics optical coherence tomography (AO-OCT) system is used to assess sixty healthy eyes of thirty subjects (age 22 to 75) to evaluate how the outer retinal layers, foveal eccentricity and age effect the mean cone density. The cone mosaics of different retinal planes (the cone inner segment outer segment junction (IS/OS), the cone outer segment combined with the IS/OS (ISOS+), the cone outer segment tips (COST), and the full en-face plane (FEF)) at four main meridians (superior, nasal, inferior, temporal) and para- and perifoveal eccentricities (ecc 2.5° and 6.5°) were analyzed quantitatively. The mean overall cone density was 19,892/mm2 at ecc 2.5° and 13,323/mm2 at ecc 6.5°. A significant impact on cone density was found for eccentricity (up to 6,700/mm2 between ecc 2.5° and 6.5°), meridian (up to 3,700/mm2 between nasal and superior meridian) and layer (up to 1,400/mm2 between FEF and IS/OS). Age showed only a weak negative effect. These factors as well as inter-individual variability have to be taken into account when comparing cone density measurements between healthy and pathologically changed eyes, as their combined effect on density can easily exceed several thousand cones per mm2 even in parafoveal regions.

Label-free adaptive optics imaging of human retinal macrophage distribution and dynamics

Microglia are resident central nervous system macrophages and the first responders to neural injury. Until recently, microglia have been studied only in animal models with exogenous or transgenic labeling. While these studies provided a wealth of information on the delicate balance between neuroprotection and neurotoxicity within which these cells operate, extrapolation to human immune function has remained an open question. Here we examine key characteristics of retinal macrophage cells in live human eyes, both healthy and diseased, with the unique capabilities of our adaptive optics-optical coherence tomography approach and owing to their propitious location above the inner limiting membrane (ILM), allowing direct visualization of cells. Our findings indicate that human ILM macrophage cells may be distributed distinctly, age differently, and have different dynamic characteristics than microglia in other animals. For example, we observed a macular pattern that was sparse centrally and peaked peripherally in healthy human eyes. Moreover, human ILM macrophage density decreased with age (∼2% of cells per year). Our results in glaucomatous eyes also indicate that ILM macrophage cells appear to play an early and regionally specific role of nerve fiber layer phagocytosis in areas of active disease. While we investigate ILM macrophage cells distinct from the larger sample of overall retinal microglia, the ability to visualize macrophage cells without fluorescent labeling in the live human eye represents an important advance for both ophthalmology and neuroscience, which may lead to novel disease biomarkers and new avenues of exploration in disease progression.

Direct laser writing of a titanium dioxide-laden retinal cone phantom for adaptive optics-optical coherence tomography

The spatial resolution of adaptive optics-optical coherence tomography (AO-OCT) enables visualization of retinal components (e.g., photoreceptors), which can advance clinical diagnosis of ocular diseases. Currently, however, variability in AO-OCT system performance suggests a need for standardized physical models, or “phantoms”, that replicate the opto-structural properties of retinal components. Here we employ direct laser writing – a two-photon polymerization-based additive manufacturing technology – using a light scattering titanium (IV) dioxide nanoparticle-laden photomaterial to create novel retinal cone outer segment (OS) phantoms. Fabrication results demonstrate effective mimicry of cone OS diameter and spacing at four retinal eccentricities, while AO-OCT experiments demonstrate cone spacings &gt;4 µm can be resolved. These results suggest a promising methodology for biomimetic photoreceptor phantom development for AO-OCT.

Cellular-Scale Imaging of Transparent Retinal Structures and Processes Using Adaptive Optics Optical Coherence Tomography.

High-resolution retinal imaging is revolutionizing how scientists and clinicians study the retina on the cellular scale. Its exquisite sensitivity enables time-lapse optical biopsies that capture minute changes in the structure and physiological processes of cells in the living eye. This information is increasingly used to detect disease onset and monitor disease progression during early stages, raising the possibility of personalized eye care. Powerful high-resolution imaging tools have been in development for more than two decades; one that has garnered considerable interest in recent years is optical coherence tomography enhanced with adaptive optics. State-of-the-art adaptive optics optical coherence tomography (AO-OCT) makes it possible to visualize even highly transparent cells and measure some of their internal processes at all depths within the retina, permitting reconstruction of a 3D view of the living microscopic retina. In this review, we report current AO-OCT performance and its success in visualizing and quantifying these once-invisible cells in human eyes.

Real-time retinal layer segmentation of OCT volumes with GPU accelerated inferencing using a compressed, low-latency neural network.

Segmentation of retinal layers in optical coherence tomography (OCT) is an essential step in OCT image analysis for screening, diagnosis, and assessment of retinal disease progression. Real-time segmentation together with high-speed OCT volume acquisition allows rendering of en face OCT of arbitrary retinal layers, which can be used to increase the yield rate of high-quality scans, provide real-time feedback during image-guided surgeries, and compensate aberrations in adaptive optics (AO) OCT without using wavefront sensors. We demonstrate here unprecedented real-time OCT segmentation of eight retinal layer boundaries achieved by 3 levels of optimization: 1) a modified, low complexity, neural network structure, 2) an innovative scheme of neural network compression with TensorRT, and 3) specialized GPU hardware to accelerate computation. Inferencing with the compressed network U-NetRT took 3.5 ms, improving by 21 times the speed of conventional U-Net inference without reducing the accuracy. The latency of the entire pipeline from data acquisition to inferencing was only 41 ms, enabled by parallelized batch processing. The system and method allow real-time updating of en face OCT and OCTA visualizations of arbitrary retinal layers and plexuses in continuous mode scanning. To the best our knowledge, our work is the first demonstration of an ophthalmic imager with embedded artificial intelligence (AI) providing real-time feedback.