Nonlinear Imaging Modalities Research Articles

Development of hydrogel-based standards and phantoms for non-linear imaging at depth.

Rapid advances in medical imaging technology, particularly the development of optical systems with non-linear imaging modalities, are boosting deep tissue imaging. The development of reliable standards and phantoms is critical for validation and optimization of these cutting-edge imaging techniques. We aim to design and fabricate flexible, multi-layered hydrogel-based optical standards and evaluate advanced optical imaging techniques at depth. Standards were made using a robust double-network hydrogel matrix consisting of agarose and polyacrylamide. The materials generated ranged from single layers to more complex constructs consisting of up to seven layers, with modality-specific markers embedded between the layers. These standards proved useful in the determination of the axial scaling factor for light microscopy and allowed for depth evaluation for different imaging modalities (conventional one-photon excitation fluorescence imaging, two-photon excitation fluorescence imaging, second harmonic generation imaging, and coherent anti-Stokes Raman scattering) achieving actual depths of 1550, 1550, 1240, and , respectively. Once fabricated, the phantoms were found to be stable for many months. The ability to image at depth, the phantom's robustness and flexible layered structure, and the ready incorporation of "optical markers" make these ideal depth standards for the validation of a variety of imaging modalities.

Age-dependent nuclear lipid droplet deposition is a cellular hallmark of aging in Caenorhabditis elegans.

Aging is the major risk factor for several life-threatening pathologies and impairs the function of multiple cellular compartments and organelles. Age-dependent deterioration of nuclear morphology is a common feature in evolutionarily divergent organisms. Lipid droplets have been shown to localize in most nuclear compartments, where they impinge on genome architecture and integrity. However, the significance of progressive nuclear lipid accumulation and its impact on organismal homeostasis remain obscure. Here, we implement non-linear imaging modalities to monitor and quantify age-dependent nuclear lipid deposition in Caenorhabditis elegans. We find that lipid droplets increasingly accumulate in the nuclear envelope, during aging. Longevity-promoting interventions, such as low insulin signaling and caloric restriction, abolish the rate of nuclear lipid accrual and decrease the size of lipid droplets. Suppression of lipotoxic lipid accumulation in hypodermal and intestinal nuclei is dependent on the transcription factor HLH-30/TFEB and the triglyceride lipase ATGL-1. HLH-30 regulates the expression of ATGL-1 to reduce nuclear lipid droplet abundance in response to lifespan-extending conditions. Notably, ATGL-1 localizes to the nuclear envelope and moderates lipid content in long-lived mutant nematodes during aging. Our findings indicate that the reduced ATGL-1 activity leads to excessive nuclear lipid accumulation, perturbing nuclear homeostasis and undermining organismal physiology, during aging.

Opportunities of optical and spectral technologies in intraoperative histopathology

Modern optical and spectral technologies represent powerful approaches for a molecular characterization of tissues enabling delineating pathological tissues but also a label-free grading and staging of tumors in terms of computer-assisted histopathology. First, currently used tools for intraoperative tumor assessment are described. Next, the requirements for intraoperative tissue visualization from a medical and optical point of view are specified. Then, optical and spectral techniques are introduced that are already approved or close to being used in standard clinical practice for ex vivo and in vivo monitoring, and proof-of concept studies utilizing linear and nonlinear spectroscopy and imaging modalities are presented. Combining several spectroscopic mechanisms in multi-contrast approaches constitutes further advances. Modern artificial intelligence and deep learning concepts have emerged to analyze spectroscopic and imaging datasets and have contributed to the progress of each technique. Finally, an outlook for opportunities and prospects of clinical translation is given.

Development of an image classification pipeline for atherosclerotic plaques assessment using supervised machine learning

BackgroundDuring atherosclerosis, the narrowing of the arterial lumen is observed through the accumulation of bio compounds and the formation of plaque within artery walls. A non-linear optical imaging modality (NLOM), coherent anti-stokes Raman scattering (CARS) microscopy, can be used to image lipid-rich structures commonly found in atherosclerotic plaques. By matching the lipid’s molecular vibrational frequencies (CH bonds), it is possible to map the accumulation of lipid-rich structures without the need for exogenous labelling and/or processing of the samples. CARS allows for the visualization of the morphological features of plaque. In combination with supervised machine learning, CARS imaged morphological features can be used to characterize the progression of atherosclerotic plaques. ResultsBased on a set of label-free CARS images of atherosclerotic plaques (i.e. foam cell clusters) from a Watanabe heritable hyperlipidemic rabbit model, we developed an automated pipeline to classify atherosclerotic lesions based on their major morphological features. Our method uses image preprocessing to first improve the quality of the CARS-imaged plaque, followed by the segmentation of the plaque using Otsu thresholding, marker-controlled watershed, K-means segmentation and a novel independent foam cell thresholding segmentation. To define relevant morphological features, 27 quantitative features were extracted and further refined by a novel coefficient of variation feature refinement method in accordance with filter-type feature selection. Refined morphological features were supplied into three supervised machine learning algorithms; K-nearest neighbour, support vector machine and decision tree classifier. The classification pipeline showcased the ability to exploit relevant plaque morphological features to accurately classify 3 pre-defined stages of atherosclerosis: early fatty streak development (EFS) and advancing atheroma (AA) with a greater than 85% class accuracyConclusionsThrough the combination of CARS microscopy and computational methods, a powerful classification tool was developed to identify the progression of atherosclerotic plaque in an automated manner. Using a curated dataset, the classification pipeline demonstrated the ability to differentiate between EFS, EF and AA. Thus, presenting the opportunity to classify the onset of atherosclerosis at an earlier stage of development

Label-free multimodal imaging of infected Galleria mellonella larvae

Non-linear imaging modalities have enabled us to obtain unique morpho-chemical insights into the tissue architecture of various biological model organisms in a label-free manner. However, these imaging techniques have so far not been applied to analyze the Galleria mellonella infection model. This study utilizes for the first time the strength of multimodal imaging techniques to explore infection-related changes in the Galleria mellonella larvae due to massive E. faecalis bacterial infection. Multimodal imaging techniques such as fluorescent lifetime imaging (FLIM), coherent anti-Stokes Raman scattering (CARS), two-photon excited fluorescence (TPEF), and second harmonic generation (SHG) were implemented in conjunction with histological HE images to analyze infection-associated tissue damage. The changes in the larvae in response to the infection, such as melanization, vacuolization, nodule formation, and hemocyte infiltration as a defense mechanism of insects against microbial pathogens, were visualized after Enterococcus faecalis was administered. Furthermore, multimodal imaging served for the analysis of implant-associated biofilm infections by visualizing biofilm adherence on medical stainless steel and ePTFE implants within the larvae. Our results suggest that infection-related changes as well as the integrity of the tissue of G. mellonella larvae can be studied with high morphological and chemical contrast in a label-free manner.

Bayesian Inversion for Nonlinear Imaging Models Using Deep Generative Priors

Most modern imaging systems incorporate a computational pipeline to infer the image of interest from acquired measurements. The Bayesian approach to solve such ill-posed inverse problems involves the characterization of the posterior distribution of the image. It depends on the model of the imaging system and on prior knowledge on the image of interest. In this work, we present a Bayesian reconstruction framework for nonlinear imaging models where we specify the prior knowledge on the image through a deep generative model. We develop a tractable posterior-sampling scheme based on the Metropolis-adjusted Langevin algorithm for the class of nonlinear inverse problems where the forward model has a neural-network-like structure. This class includes most practical imaging modalities. We introduce the notion of augmented deep generative priors in order to suitably handle the recovery of quantitative images. We illustrate the advantages of our framework by applying it to two nonlinear imaging modalities—phase retrieval and optical diffraction tomography.

Ultrafast amplitude modulation for molecular and hemodynamic ultrasound imaging.

Ultrasound is playing an emerging role in molecular and cellular imaging thanks to new micro- and nanoscale contrast agents and reporter genes. Acoustic methods for the selective in vivo detection of these imaging agents are needed to maximize their impact in biology and medicine. Existing ultrasound pulse sequences use the nonlinearity in contrast agents' response to acoustic pressure to distinguish them from mostly linear tissue scattering. However, such pulse sequences typically scan the sample using focused transmissions, resulting in a limited frame rate and restricted field of view. Meanwhile, existing wide-field scanning techniques based on plane wave transmissions suffer from limited sensitivity or nonlinear artifacts. To overcome these limitations, we introduce an ultrafast nonlinear imaging modality combining amplitude-modulated pulses, multiplane wave transmissions, and selective coherent compounding. This technique achieves contrast imaging sensitivity comparable to much slower gold-standard amplitude modulation sequences and enables the acquisition of larger and deeper fields of view, while providing a much faster imaging framerate of 3.2 kHz. Additionally, it enables simultaneous nonlinear and linear image formation and allows concurrent monitoring of phenomena accessible only at ultrafast framerates, such as blood volume variations. We demonstrate the performance of this ultrafast amplitude modulation technique by imaging gas vesicles, an emerging class of genetically encodable biomolecular contrast agents, in several in vitro and in vivo contexts. These demonstrations include the rapid discrimination of moving contrast agents and the real-time monitoring of phagolysosomal function in the mouse liver.

Multi-modal nonlinear optical and thermal imaging platform for label-free characterization of biological tissue

The ability to characterize the combined structural, functional, and thermal properties of biophysically dynamic samples is needed to address critical questions related to tissue structure, physiological dynamics, and disease progression. Towards this, we have developed an imaging platform that enables multiple nonlinear imaging modalities to be combined with thermal imaging on a common sample. Here we demonstrate label-free multimodal imaging of live cells, excised tissues, and live rodent brain models. While potential applications of this technology are wide-ranging, we expect it to be especially useful in addressing biomedical research questions aimed at the biomolecular and biophysical properties of tissue and their physiology.

Synchronously pumped Raman laser for simultaneous degenerate and nondegenerate two-photon microscopy.

Two-photon fluorescence microscopy is a nonlinear imaging modality frequently used in deep-tissue imaging applications. A tunable-wavelength multicolor short-pulse source is usually required to excite fluorophores with a wide range of excitation wavelengths. This need is most typically met by solid-state lasers, which are bulky, expensive, and complicated systems. Here, we demonstrate a compact, robust fiber system that generates naturally synchronized femtosecond pulses at 1050 nm and 1200 nm by using a combination of gain-managed and Raman amplification. We image the brain of a mouse and view the blood vessels, neurons, and other cell-like structures using simultaneous degenerate and nondegenerate excitation.

Multimodal Nonlinear Optical Imaging for Sensitive Detection of Multiple Pharmaceutical Solid-State Forms and Surface Transformations.

Two nonlinear imaging modalities, coherent anti-Stokes Raman scattering (CARS) and sum-frequency generation (SFG), were successfully combined for sensitive multimodal imaging of multiple solid-state forms and their changes on drug tablet surfaces. Two imaging approaches were used and compared: (i) hyperspectral CARS combined with principal component analysis (PCA) and SFG imaging and (ii) simultaneous narrowband CARS and SFG imaging. Three different solid-state forms of indomethacin-the crystalline gamma and alpha forms, as well as the amorphous form-were clearly distinguished using both approaches. Simultaneous narrowband CARS and SFG imaging was faster, but hyperspectral CARS and SFG imaging has the potential to be applied to a wider variety of more complex samples. These methodologies were further used to follow crystallization of indomethacin on tablet surfaces under two storage conditions: 30 °C/23% RH and 30 °C/75% RH. Imaging with (sub)micron resolution showed that the approach allowed detection of very early stage surface crystallization. The surfaces progressively crystallized to predominantly (but not exclusively) the gamma form at lower humidity and the alpha form at higher humidity. Overall, this study suggests that multimodal nonlinear imaging is a highly sensitive, solid-state (and chemically) specific, rapid, and versatile imaging technique for understanding and hence controlling (surface) solid-state forms and their complex changes in pharmaceuticals.

Endoscopic fiber probe for nonlinear spectroscopic imaging

We present a compact multimodal fiber probe that enables the simultaneous recording of nonlinear imaging modalities like coherent anti-Stokes Raman scattering (CARS), second harmonic generation (SHG), and two-photon excited auto-fluorescence (TPEF) for biomedical applications. The probe is based on a gradient index lens design and a multi-core fiber supplying the excitation laser light. The multi-core fiber preserves the spatial relationship between the entrance and output; therefore, the laser scanning procedure can be shifted from the distal to the proximal end of the probe. No moving parts or electric power are required in situ. The generated sample signals can be collected in the backward (epi) direction and transferred to a detection setup with a multimode fiber integrated in the probe head. The first CARS/SHG/TPEF multimodal tissue images recorded with the introduced fiber probe will be presented.

Ectopic fat deposition contributes to age-associated pathology in Caenorhabditis elegans

Age-dependent collapse of lipid homeostasis results in spillover of lipids and excessive fat deposition in nonadipose tissues. Ectopic fat contributes to lipotoxicity and has been implicated in the development of a metabolic syndrome that increases risk of age-associated diseases. However, the molecular mechanisms coupling ectopic fat accumulation with aging remain obscure. Here, we use nonlinear imaging modalities to visualize and quantify age-dependent ectopic lipid accumulation in Caenorhabditis elegans We find that aging is accompanied by pronounced deposition of lipids in nonadipose tissues, including the nervous system. Importantly, interventions that promote longevity such as low insulin signaling, germ-line loss, and dietary restriction, which effectively delay aging in evolutionary divergent organisms, diminish the rate of ectopic fat accumulation and the size of lipid droplets. Suppression of lipotoxic accumulation of fat in heterologous tissues is dependent on helix-loop-helix (HLH)-30/transcription factor EB (TFEB) and autophagy. Our findings in their totality highlight the pivotal role of HLH-30/TFEB and autophagic processes in the maintenance of lipid homeostasis during aging, in addition to establishing nonlinear imaging as a powerful tool for monitoring ectopic lipid droplet deposition in vivo.

Nonlinear microscopy for quantification of riboflavin diffusion in the cornea

SummaryImaging methods are a central part of diagnostics and therapeutic procedures at the anterior segment of the eye. Due to the good accessibility, even high resolution laser scanning technologies are applicable, delivering cellular resolution images of living cells and tissues of the cornea. Using different nonlinear imaging modalities, even diffusion processes at the cornea can be monitored.Using a scanning laser microscope in combination with a tunable optical parametric oscillator, nonlinear images by two‐photon excitation and second‐harmonic generation can be acquired. Further contrast modalities, such as higher harmonics or four‐wave mixing are investigated.Several tissue layers and cellular structures can be visualized in living tissue (mouse model) and ex vivo tissue (pig eyes). Cellular structures as epithelium, endothelium and keratocytes, as well as the lens capsule and cells were imaged, by using second‐harmonic generation and four‐wave mixing, collagen was imaged within the cornea and the transition from cornea to sclera could be studied.Furthermore, diffusion of molecules through the cornea at different concentrations could be monitored as well, for applications such as corneal crosslinking.Nonlinear laser microscopy is a well‐suited method for non‐invasive, staining free imaging of the anterior segment of the eye.

Nonlinear plasmonic imaging techniques and their biological applications

Abstract Nonlinear optics, when combined with microscopy, is known to provide advantages including novel contrast, deep tissue observation, and minimal invasiveness. In addition, special nonlinearities, such as switch on/off and saturation, can enhance the spatial resolution below the diffraction limit, revolutionizing the field of optical microscopy. These nonlinear imaging techniques are extremely useful for biological studies on various scales from molecules to cells to tissues. Nevertheless, in most cases, nonlinear optical interaction requires strong illumination, typically at least gigawatts per square centimeter intensity. Such strong illumination can cause significant phototoxicity or even photodamage to fragile biological samples. Therefore, it is highly desirable to find mechanisms that allow the reduction of illumination intensity. Surface plasmon, which is the collective oscillation of electrons in metal under light excitation, is capable of significantly enhancing the local field around the metal nanostructures and thus boosting up the efficiency of nonlinear optical interactions of the surrounding materials or of the metal itself. In this mini-review, we discuss the recent progress of plasmonics in nonlinear optical microscopy with a special focus on biological applications. The advancement of nonlinear imaging modalities (including incoherent/coherent Raman scattering, two/three-photon luminescence, and second/third harmonic generations that have been amalgamated with plasmonics), as well as the novel subdiffraction limit imaging techniques based on nonlinear behaviors of plasmonic scattering, is addressed.

Tripling the maximum imaging depth with third-harmonic generation microscopy.

The growing interest in performing high-resolution, deep-tissue imaging has galvanized the use of longer excitation wavelengths and three-photon-based techniques in nonlinear imaging modalities. This study presents a threefold improvement in maximum imaging depth of ex vivo porcine vocal folds using third-harmonic generation (THG) microscopy at 1552-nm excitation wavelength compared to two-photon microscopy (TPM) at 776-nm excitation wavelength. The experimental, analytical, and Monte Carlo simulation results reveal that THG improves the maximum imaging depth observed in TPM significantly from 140 to 420 μm in a highly scattered medium, reaching the expected theoretical imaging depth of seven extinction lengths. This value almost doubles the previously reported normalized imaging depths of 3.5 to 4.5 extinction lengths using three-photon-based imaging modalities. Since tissue absorption is substantial at the excitation wavelength of 1552 nm, this study assesses the tissue thermal damage during imaging by obtaining the depth-resolved temperature distribution through a numerical simulation incorporating an experimentally obtained thermal relaxation time (τ). By shuttering the laser for a period of 2τ, the numerical algorithm estimates a maximum temperature increase of ∼2°C at the maximum imaging depth of 420 μm. The paper demonstrates that THG imaging using 1552 nm as an illumination wavelength with effective thermal management proves to be a powerful deep imaging modality for highly scattering and absorbing tissues, such as scarred vocal folds.

Characterization of tissue-engineered posterior corneas using second- and third-harmonic generation microscopy.

Three-dimensional tissues, such as the cornea, are now being engineered as substitutes for the rehabilitation of vision in patients with blinding corneal diseases. Engineering of tissues for translational purposes requires a non-invasive monitoring to control the quality of the resulting biomaterial. Unfortunately, most current methods still imply invasive steps, such as fixation and staining, to clearly observe the tissue-engineered cornea, a transparent tissue with weak natural contrast. Second- and third-harmonic generation imaging are well known to provide high-contrast, high spatial resolution images of such tissues, by taking advantage of the endogenous contrast agents of the tissue itself. In this article, we imaged tissue-engineered corneal substitutes using both harmonic microscopy and classic histopathology techniques. We demonstrate that second- and third-harmonic imaging can non-invasively provide important information regarding the quality and the integrity of these partial-thickness posterior corneal substitutes (observation of collagen network, fibroblasts and endothelial cells). These two nonlinear imaging modalities offer the new opportunity of monitoring the engineered corneas during the entire process of production.

Expanding Multimodal Microscopy by High Spectral Resolution Coherent Anti-Stokes Raman Scattering Imaging for Clinical Disease Diagnostics

Over the past years fast label-free nonlinear imaging modalities providing molecular contrast of endogenous disease markers with subcellular spatial resolution have been emerged. However, applications of these imaging modalities in clinical settings are still at the very beginning. This is because single nonlinear imaging modalities such as second-harmonic generation (SHG) and two-photon excited fluorescence (TPEF) have only limited value for diagnosing diseases due to the small number of endogenous markers. Coherent anti-Stokes Raman scattering (CARS) microscopy on the other hand can potentially be added to SHG and TPEF to visualize a much broader range of marker molecules. However, CARS requires a second synchronized laser source and the detection of a certain wavenumber range of the vibrational spectrum to differentiate multiple molecules, which results in increased experimental complexity and often inefficient excitation of SHG and TPEF signals. Here we report the application of a novel near-infrared (NIR) fiber laser of 1 MHz repetition rate, 65 ps pulse duration, and 1 cm(-1) spectral resolution to realize an efficient but experimentally simple SGH/TPEF/multiplex CARS multimodal imaging approach for a label-free characterization of composition of complex tissue samples. This is demonstrated for arterial tissue specimens demonstrating differentiation of elastic fibers, triglycerides, collagen, myelin, cellular cytoplasm, and lipid droplets by analyzing the CARS spectra within the C-H stretching region only. A novel image analysis approach for multispectral CARS data based on colocalization allows correlating spectrally distinct pixels to morphologic structures. Transfer of this highly precise but compact and simple to use imaging approach into clinical settings is expected in the near future.

Femtosecond laser nanosurgery of sub‐cellular structures in HeLa cells by employing Third Harmonic Generation imaging modality as diagnostic tool

Femtosecond laser assisted nanosurgery of microscopic biological specimens is a relatively new technique which allows the selective disruption of sub-cellular structures without causing any undesirable damage to the surrounding regions. The targeted structures have to be stained in order to be clearly visualized for the nanosurgery procedure. However, the validation of the final nanosurgery result is difficult, since the targeted structure could be simply photobleached rather than selectively destroyed. This fact comprises a main drawback of this technique. In our study we employed a multimodal system which integrates non-linear imaging modalities with nanosurgery capabilities, for the selective disruption of sub-cellular structures in HeLa cancer cells. Third Harmonic Generation (THG) imaging modality was used as a tool for the identification of structures that were subjected to nanosurgery experiments. No staining of the biological samples was required, since THG is an intrinsic property of matter. Furthermore, cells' viability after nanosurgery processing was verified via Two Photon Excitation Fluorescence (TPEF) measurements.

Observation of spontaneous polarization misalignments in periodically poled crystals using second-harmonic generation microscopy

Periodically poled crystal (PPC) is a key component for nonlinear optical applications. Its poling quality relies largely on successful domain inversion and the alignment of spontaneous polarization (SP) vectors in each domain. Here we report the unexpected observation of bulk second harmonic generation (SHG) in PPC when excitation propagating along its optical axis. Based on its tensorial nature, SHG is highly sensitive to the orientation of SP, and therefore the misalignment of SP in each domain of PPC can be revealed noninvasively by SHG microscopy. This nonlinear imaging modality provides optical sectioning capability with 3D sub-micrometer resolution, so it will be useful for in situ investigation of poling quality in PPC.

Multimodal imaging to study the morphochemistry of basal cell carcinoma

Basal cell carcinoma is the most abundant malignant neoplasm in humans, the pathology of which is characterized by an abnormal proliferation of basal cells. Basal cell carcinoma can show a variety of different morphologies, which are based on different cellular biology. Furthermore, the carcinoma often grows invisibly to the eye imbedded in the surrounding skin. Therefore, in some cases its clinical detection is challenging. Thus, our work aims at establishing an unsupervised tissue classification method based on multimodal imaging and the application of chemometrics to discriminate basal cell carcinoma from non-diseased tissue. A case study applying multimodal imaging to ex-vivo sections of basal cell carcinoma is presented. In doing so, we apply a combination of various linear and non-linear imaging modalities, i.e. fluorescence, Raman and second-harmonic generation microscopy, to study the morphochemistry of basal cell carcinoma. The joint information content obtained by such multimodal approach in studying various aspects of the malignant tissue alterations associated with basal cell carcinoma is discussed.