Nonlinear Imaging Method Research Articles

Feasibility study of nonlinear ultrasonic imaging using a contact pulse-echo method for fatigue damage evaluation

ABSTRACT A contact pulse-echo nonlinear imaging method is proposed for the detection and localisation of fatigue damage in solid materials. A dual element transducer is designed based on nonlinear wave simulations and manufactured to improve the signal-to-noise ratio of harmonic waves. The transducer is clamped on a fixture device for scanning. The proposed method is introduced for scanning and imaging stainless steel specimens with different fatigue damage states. Experimental results for the specimen in the initial state show that both the fundamental and second harmonic waves are well measured and the imaging of nonlinear parameters is very stable over the scanning area. The imaging results for the specimen with an initial fatigue crack show that the fundamental waves remain the same but the second harmonic waves vary significantly in the potential growth area of the fatigue crack. Furthermore, the imaging results for the seriously fatigued specimen show that the amplitudes of fundamental waves decrease near the fatigue crack, while the amplitudes of second harmonic waves increase. These results indicate that the proposed pulse-echo method is effective for nonlinear ultrasonic imaging and early damage evaluation. The factors affecting the nonlinear waves in the lab experiments and possible problems with practical applications are also discussed for the proposed method.

Second harmonic generation microscopy of electromechanical reshaping on corneal collagen

Refractive errors remain a global health concern, as a large proportion of the world's population is myopic. Current ablative approaches are costly, not without risks, and not all patients are candidates for these procedures. Electromechanical reshaping (EMR) has been explored as a viable cost-effective modality to directly shape tissues, including cartilage. In this study, stromal collagen structure and fibril orientation was examined before and after EMR with second-harmonic generation microscopy (SHG), a nonlinear multiphoton imaging method that has previously been used to study native corneal collagen with high spatial resolution. EMR, using a milled metal contact lens and potentiostat, was performed on the corneas of five extracted rabbit globes. SHG was performed using a confocal microscopy system and all images underwent collagen fibril orientation analysis. The collagen SHG signal in controls is uniform and is similarly seen in samples treated with pulsed potential, while continuous EMR specimens have reduced, nonhomogeneous signal. Collagen fibril orientation in native tissue demonstrates a broad distribution with suggestion of another peak evolving, while with EMR treated eyes a bimodal characteristic becomes readily evident. Pulsed EMR may be a means to correct refractive errors, as when comparing its SHG signal to negative control, preservation of collagen structures with little to no damage is observed. From collagen fiber orientation analysis, it can be inferred that simple DC application alters the structure of collagen. Future studies will involve histological assessment of these layers and multi-modal imaging analysis of dosimetry.

Terahertz wave imaging using time domain iterative shrink threshold method

We propose a new linear imaging method that combines the iterative shrinkage thresholding algorithm (ISTA) with the synthetic aperture (SA) method to achieve high resolution. Unlike other ISTA methods that use a single frequency component of signals, we use time domain signals directly as measurement, which allows for simultaneous wide bandwidth calculation and potentially better imaging results. Additionally, we simplify the backward estimation process by using impulse back-projection based on the SA method, which reduces the computing cost compared to the ISTA method. Numerical simulation and experimental measurement results show that the image resolution is similar to that of our previous non-linear imaging method, and two reflectors with different reflectivity are imaged linearly. These comparison results demonstrate the effectiveness of our proposed method in achieving high-resolution and maintaining the linearity of target reflectivity.

Frequency-encoded two-photon excited fluorescence microscopy.

Two-photon excited fluorescence (2PEF) microscopy is the most popular non-linear imaging method of biomedical samples. State-of-the art 2PEF microscopes use multiple detectors and spectral filter sets to discriminate different fluorophores based on their distinct emission behavior (emission discrimination). One drawback of 2PEF is that fluorescence photons outside the filter transmission range are inherently lost, thereby reducing the imaging efficiency and speed. Furthermore, emission discrimination of different fluorophores may fail if their emission profiles are too similar. Here, we present an alternative 2PEF method that discriminates fluorophores based on their excitation spectra (excitation discrimination). For excitation we use two lasers of different wavelengths (ω1, ω2) resulting in excitation energies at 2ω1, 2ω2, and the mixing energy ω1+ω2. Both lasers are frequency encoded (FE) by an intensity modulation at distinct frequencies while all 2PEF emission is collected on a single detector. The signal is fed into a lock-in-amplifier and demodulated at various frequencies simultaneously. A customized nonnegative matrix factorization (NNMF) then generates fluorescence images that are free of cross talk. Combining FE-2PEF with multiple detectors has the potential to enable the simultaneous imaging of an unprecedented number of fluorophores.

Instability-driven image recovery of 180-degree backscattered polarized-light in turbid water.

Although the incoherent modulation instability has been proven to be effective for the recovery of forward-scattering images, the similar attempt of backscatter is still non-ideal. In this paper, considering the preservation properties of polarization and coherence in 180° backscatter, we propose an instability-driven nonlinear imaging method based on polarization modulation. A coupling model is established using Mueller calculus and mutual coherence function, in which the instability generation and image reconstruction are both analyzed. Experimental results clearly show the enhancement of imaging quality. This method is general and has potential for echo detection in various scattering environments.

Seismic Waveform Inversion Capability on Resource-Constrained Edge Devices.

Seismic full wave inversion (FWI) is a widely used non-linear seismic imaging method used to reconstruct subsurface velocity images, however it is time consuming, has high computational cost and depend heavily on human interaction. Recently, deep learning has accelerated it's use in several data-driven techniques, however most deep learning techniques suffer from overfitting and stability issues. In this work, we propose an edge computing-based data-driven inversion technique based on supervised deep convolutional neural network to accurately reconstruct the subsurface velocities. Deep learning based data-driven technique depends mostly on bulk data training. In this work, we train our deep convolutional neural network (DCN) (UNet and InversionNet) on the raw seismic data and their corresponding velocity models during the training phase to learn the non-linear mapping between the seismic data and velocity models. The trained network is then used to estimate the velocity models from new input seismic data during the prediction phase. The prediction phase is performed on a resource-constrained edge device such as Raspberry Pi. Raspberry Pi provides real-time and on-device computational power to execute the inference process. In addition, we demonstrate robustness of our models to perform inversion in the presence on noise by performing both noise-aware and no-noise training and feeding the resulting trained models with noise at different signal-to-noise (SNR) ratio values. We make great efforts to achieve very feasible inference times on the Raspberry Pi for both models. Specifically, the inference times per prediction for UNet and InversionNet models on Raspberry Pi were 22 and 4 s respectively whilst inference times for both models on the GPU were 2 and 18 s which are very comparable. Finally, we have designed a user-friendly interactive graphical user interface (GUI) to automate the model execution and inversion process on the Raspberry Pi.

In Vivo Contrast Imaging of Rat Heart with Carbon Dioxide Foam.

Widely used classical angiography with the use of iodine contrast agents is highly problematic, particularly in patients with diabetes mellitus, cardiac and pulmonary diseases, or degree III or IV renal insufficiency. Some patients may be susceptible to allergic reaction to the iodine contrast substance. The intravenous injection of a bolus of CO2 (negative contrast) is an alternative method, which is, however, currently only used for imaging blood vessels of the lower limbs. The aim of our project was to design and test on an animal model a methodology for injecting the CO2 foam which would minimize the possibility of embolization of the brain tissue and heart infarction, leading to their damage. This is important research for the further promotion of the use of CO2, which is increasingly important for endovascular diagnosis and treatment, because carbon-dioxide-related complications are extremely rare. CO2 foam was prepared by the rapid mixing in a 2:1 ratio of CO2 and fetal bovine serum (FBS)-enriched Dulbecco’s Modified Eagle Medium (DMEM). Freshly prepared CO2 foam was administered into the catheterized rat tail vein or cannulated rat abdominal aorta and inferior vena cava (IVC). CO2 foam was compared with commercially available microbubbles (lipid shell/gas core). The rat heart in its parasternal long axis was imaged in B-Mode and Non-linear Contrast Mode before/during and after the contrast administration. Samples of the brain, heart and lungs were collected and subjected to histological examination. The non-linear contrast imaging method enables the imaging of micron-sized gas microbubbles inside a rat heart. The significantly shorter lifetime of the prepared CO2 foam is a benefit for avoiding the local ischemia of tissues.

Fast denoising and lossless spectrum extraction in stimulated Raman scattering microscopy.

Stimulated Raman scattering (SRS) microscopy is a nonlinear optical imaging method for visualizing chemical content based on molecular vibrational bonds. However, the imaging speed and sensitivity are currently limited by the noise of the light beam probing the Raman process. In this paper, we present a fast non-average denoising and high-precision Raman shift extraction method, based on a self-reinforcing signal-to-noise ratio (SNR) enhancement algorithm, for SRS spectroscopy and microscopy. We compare the results of this method with the filtering methods and the reported experimental methods to demonstrate its high efficiency and high precision in spectral denoising, Raman peak extraction and image quality improvement. We demonstrate a maximum SNR enhancement of 10.3dB in fixed tissue imaging and 11.9dB in vivo imaging. This method reduces the cost and complexity of the SRS system and allows for high-quality SRS imaging without use of special laser, complicated system design and Raman tags.

Teriparatide improves bone quality through augmenting the linearity of bone collagen fibers, revealed by novel analysis of nonlinear optics imaging and AI-based morphometrical recognition method

Teriparatide improves bone quality through augmenting the linearity of bone collagen fibers, revealed by novel analysis of nonlinear optics imaging and AI-based morphometrical recognition method

Review of Stimulated Raman Scattering Microscopy Techniques and Applications in the Biosciences.

Stimulated Raman scattering (SRS) microscopy is a nonlinear optical imaging method for visualizing chemical content based on molecular vibrational bonds. Featuring high speed, high resolution, high sensitivity, high accuracy, and 3D sectioning, SRS microscopy has made tremendous progress toward biochemical information acquisition, cellular function investigation, and label-free medical diagnosis in the biosciences. In this review, the principle of SRS, system design, and data analysis are introduced, and the current innovations of the SRS system are reviewed. In particular, combined with various bio-orthogonal Raman tags, the applications of SRS microscopy in cell metabolism, tumor diagnosis, neuroscience, drug tracking, and microbial detection are briefly examined. The future prospects for SRS microscopy are also shared.

Imaging with surface-related multiples to overcome large acquisition gaps

Abstract To get the best result for seismic imaging using primary reflections, data with densely-spaced sources and receivers are ideally preferred. However, dense acquisition can sometimes be hindered by various obstacles, like platforms or complex topography. Such areas with large data gaps may deter exploration or monitoring, as conventional imaging strategies would either provide poor seismic images or turn out to be very expensive. Surface-related multiples travel along different paths compared to primaries, illuminating a wider subsurface area and hence making them valuable in case of data with large gaps. We propose different strategies of using surface-related multiples to get around the problem of imaging in the case of a large data gap. Conventional least-squares imaging methods that incorporate surface-related multiples do so by re-injecting the measured wavefield in the forward-modelling process, which makes it still sensitive to missing data. We introduce a ‘non-linear’ inversion approach in which the surface multiples are modelled from the original source field. This makes the method less dependent on the receiver geometry, therefore, effectively exploiting the information from surface multiples in cases of limited illumination. However, such an approach is sensitive to the knowledge of the source properties. Therefore, we propose a ‘hybrid’ method that combines the non-linear imaging method with the conventional ‘linear’ multiple imaging method, which further improves our imaging result. We test the methods on numerical as well as field data. The results indicate substantial removal of artefacts in the image derived from linear imaging methods due to incomplete data, by exploiting the surface multiples to a maximum extent.

Nonambiguous Image Formation for Low-Earth-Orbit SAR With Geosynchronous Illumination Based on Multireceiving and CAMP

Low-earth-orbit (LEO) synthetic aperture radar (SAR) can achieve advanced remote sensing applications benefiting from the large beam coverage and long duration time of interested area provided by a geosynchronous (GEO) SAR illuminator. In addition, the receiving LEO SAR system is also cost-effective because the transmitting module can be omitted. In this article, an imaging method for GEO-LEO bistatic SAR (BiSAR) is proposed. First, the propagation delay characteristics of GEO-LEO BiSAR are studied. It is found that the traditional “stop-and-go” propagation delay assumption is not appropriate due to the long transmitting path and high speed of the LEO SAR receiver. Then, an improved propagation delay model and the corresponding range model for GEO-LEO BiSAR are established to lay the foundation of accurate imaging. After analyzing the sampling characteristics of GEO-LEO BiSAR, it is found that only 12.5% sampling data can be acquired in the azimuth direction. To handle the serious sub-Nyquist sampling problem and achieve good focusing results, an imaging method combined with multireceiving technique and compressed sensing is proposed. The multireceiving observation model is first obtained based on the inverse process of a nonlinear chirp-scaling imaging method, which can handle 2-D space-variant echo. Following that, the imaging problem of GEO-LEO BiSAR is converted to an $L_{1}$ regularization problem. Finally, an effective recovery method named complex approximate message passing (CAMP) is applied to obtain the final nonambiguous image. Simulation results show that the proposed method can suppress eight times Doppler ambiguity and obtain the well-focused image with three receiving channels. With the proposed method, the number of required receiving channels can be greatly reduced.

Nonlinear ultrasonic imaging in pulse-echo mode using Westervelt equation: a preliminary research

Acoustic nonlinear parameter β, was of great interest in tissue characterization in recent years. Nonlinear imaging methods have been reported to provide improved spatial and contrast resolution. We introduce a nonlinear imaging method derived from nonlinear wave equation based on Gaussian-form solution assumption, which can be applied in pulse-echo mode on diagnostic ultrasound. Through making the use of two pulse transmission, only nonlinear effects are reserved and other effects like scattering, diffraction and linear attenuation can be eliminated. For validation of this method a set of simulation results are generated with a nonlinear simulator. Simulated images also indicate that our method clearly describes the spatial distribution of B/A in the medium.

Sono-photoacoustic theranostics using phase-changing contrast agents

Phase-change contrast agents are low boiling point liquid perfluorocarbon droplets that can be vaporized to form larger microbubbles. Droplet vaporization can be used for both imaging and therapy. Sono-photoacoutics is a non-linear imaging method that uses simultaneous optical and acoustic pulses to activate phase-change contrast agents. By combining photothermal heating from a laser pulse and the negative pressure from an acoustic pulse, lower droplet activation thresholds are achieved than from either source alone. In this study, we demonstrate in an in vitro model that sono-photoacoutics activation of polypyrrole coated perfluorocarbon droplets can be used to disrupt 2-cm long fibrin clots to restore flow. Polypyrrole coated droplets under 200 nm in diameter were introduced upstream and allowed to diffuse into the clot. A 1.24-MHz single element transducer coaxially aligned with a 1064-nm pulsed laser was used to scan the clot, activating any agents within the clot. Agent activation was quantified using passive cavitation detection, while flow was monitored using a digital balance. Our results show that the droplets can freely diffuse into fibrin clots and SPA activation can restore approximately 25% of the flow.

An Automatic Detection of the ROI Using Otsu Thresholding in Nonlinear Difference EIT Imaging

Inverse problem of electrical impedance tomography is highly ill-posed therefore often prior information is used to have a satisfactory and stable solution. Recently, introduced non-linear differential imaging method estimates the initial and difference in conductivities simultaneously and is efficient in handling modeling errors. The non-linear parameterization of conductivity enables to use different regularization schemes for background and region of interest (ROI). Identifying the ROI without any prior information can be beneficial in improving the reconstruction performance. Therefore, in this paper, automatic detection of ROI is introduced using Otsu thresholding method and is then used with non-linear differential imaging. The proposed non-linear differential imaging with Otsu method (NDIWO) considers different regularization methods, i.e., total variational approach with ROI and smoothness prior with background regions during reconstruction. Numerical and experimental studies are performed to test NDIWO method for two-phase flow and thorax imaging and the performance is compared with absolute and linear difference imaging. The results indicate that the proposed NDIWO method has improved reconstruction performance compared with conventional absolute and linear difference imaging.

Роль структурных изменений внеклеточного матрикса мочевого пузыря в возникновении побочных эффектов лучевой терапии разной степени тяжести

To investigate the role of structural changes of the urinary bladder extracellular matrix in the occurrence of different grades of adverse events after radiation therapy. The connective tissue matrix was studied using 126 images obtained from the histological sections of the bladder biopsy specimens of 12 patients classified according to the clinical presentation and the grades of late bladder toxicity according to RTOG/EORTC Late Radiation Morbidity Scoring Scheme. Control images of the normal bladder (n=23) were collected from the autopsy samples. We used nonlinear microscopy imaging method capturing the second harmonic generation (SHG) signal and two-photon excitation auto-fluorescence (TPEA). The findings of nonlinear microscopy of urinary bladder histological sections showed that the structural changes in the connective tissue differed depending on the grade of adverse events: grade II adverse events were associated with the preservation of the structure of collagen fibers and their compression, grade III adverse events caused pronounced disorganization of collagen fibers, blurring without a definite fiber direction. At the same time, in a normal bladder, the structure of collagen fibers was visualized; they had a spiral shape and in some areas were collected in bundles. Collagen fibers and bundles were loosely arranged and accompanied by elastic fibers. The findings suggest that the grade of urinary bladder radiation injury correlates with the data detected by nonlinear microscopy. The mosaic structure of radiation-induced alterations of the bladder tissue, even in the areas most affected by radiation (posterior bladder wall, bladder trigone, and bladder neck) indicates that patients with radiation-induced high-grade toxicity need comprehensive care designed to preserve the bladder functional reserves and capacity. The prevention of radiation-related adverse events before radiation therapy should be based on urologic care aimed to detect and treat chronic inflammatory diseases of the bladder and preserve its functional reserves. Another way to improve outcomes is to optimize the management of adverse events. The examination of bladder tissue specimens taken from different parts of the bladder carried out using nonlinear microscopy in the SHG and TPEA modes revealed that the degree of structural changes in the connective tissue matrix in the post-radiation period varies and correlates with the grades of the radiation bladder toxicity. The results of this study can be used to substantiate measures to prevent the onset of high-grade toxicity after radiation therapy of pelvic malignancies.

Dynamic multiphoton imaging of acellular dermal matrix scaffolds seeded with mesenchymal stem cells in diabetic wound healing.

Significantly effective therapies need to be developed for chronic nonhealing diabetic wounds. In this work, the topical transplantation of mesenchymal stem cell (MSC) seeded on an acellular dermal matrix (ADM) scaffold is proposed as a novel therapeutic strategy for diabetic cutaneous wound healing. GFP-labeled MSCs were cocultured with an ADM scaffold that was decellularized from normal mouse skin. These cultures were subsequently transplanted as a whole into the full-thickness cutaneous wound site in streptozotocin-induced diabetic mice. Wounds treated with MSC-ADM demonstrated an increased percentage of wound closure. The treatment of MSC-ADM also greatly increased angiogenesis and rapidly completed the reepithelialization of newly formed skin on diabetic mice. More importantly, multiphoton microscopy was used for the intravital and dynamic monitoring of collagen type I (Col-I) fibers synthesis via second harmonic generation imaging. The synthesis of Col-I fibers during diabetic wound healing is of great significance for revealing wound repair mechanisms. In addition, the activity of GFP-labeled MSCs during wound healing was simultaneously traced via two-photon excitation fluorescence imaging. Our research offers a novel advanced nonlinear optical imaging method for monitoring the diabetic wound healing process while the ADM and MSCs interact in situ. Schematic of dynamic imaging of ADM scaffolds seeded with mesenchymal stem cells in diabetic wound healing using multiphoton microscopy. PMT, photo-multiplier tube.

A Nonlinear Method for Imaging with Acoustic Waves Via Reduced Order Model Backprojection

We introduce a novel nonlinear imaging method for the acoustic wave equation based on data-driven model order reduction. The objective is to image the discontinuities of the acoustic velocity, a coefficient of the scalar wave equation from the discretely sampled time domain data measured at an array of transducers that can act as both sources and receivers. We treat the wave equation along with transducer functionals as a dynamical system. A reduced order model (ROM) for the propagator of such system can be computed so that it interpolates exactly the measured time domain data. The resulting ROM is an orthogonal projection of the propagator on the subspace of the snapshots of solutions of the acoustic wave equation. While the wavefield snapshots are unknown, the projection ROM can be computed entirely from the measured data, thus we refer to such ROM as data-driven. The image is obtained by backprojecting the ROM. Since the basis functions for the projection subspace are not known, we replace them with the ones computed for a known smooth kinematic velocity model. A crucial step of ROM construction is an implicit orthogonalization of solution snapshots. It is a nonlinear procedure that differentiates our approach from the conventional linear imaging methods (Kirchhoff migration and reverse time migration - RTM). It resolves all dynamical behavior captured by the data, so the error from the imperfect knowledge of the velocity model is purely kinematic. This allows for almost complete removal of multiple reflection artifacts, while simultaneously improving the resolution in the range direction compared to conventional RTM.

Nonlinear imaging of damage in composite structures using sparse ultrasonic sensor arrays

In different engineering fields, there is a strong demand for diagnostic methods able to provide detailed information on material defects. Low velocity impact damage can considerably degrade the integrity of structural components and, if not detected, can result in catastrophic failures. This paper presents a nonlinear structural health monitoring imaging method, based on nonlinear elastic wave spectroscopy, for the detection and localisation of nonlinear signatures on a damaged composite structure. The proposed technique relies on the bispectral analysis of ultrasonic waveforms originated by a harmonic excitation and it allows for the evaluation of second order material nonlinearities due to the presence of cracks and delaminations. This nonlinear imaging technique was combined with a radial basis function approach in order to achieve an effective visualisation of the damage over the panel using only a limited number of acquisition points. The robustness of bispectral analysis was experimentally demonstrated on a damaged carbon fibre reinforced plastic (CFRP) composite panel, and the nonlinear source's location was obtained with a high level of accuracy. Unlike other ultrasonic imaging methods for damage detection, this methodology does not require any baseline with the undamaged structure for the evaluation of the defect, nor a priori knowledge of the mechanical properties of the specimen. Copyright © 2016 John Wiley & Sons, Ltd.

Multimodal Nonlinear Optical Imaging of MoS₂ and MoS₂-Based van der Waals Heterostructures.

van der Waals layered structures, notably the transitional metal dichalcogenides (TMDs) and TMD-based heterostructures, have recently attracted immense interest due to their unique physical properties and potential applications in electronics, optoelectronics, and energy harvesting. Despite the recent progress, it is still a challenge to perform comprehensive characterizations of critical properties of these layered structures, including crystal structures, chemical dynamics, and interlayer coupling, using a single characterization platform. In this study, we successfully developed a multimodal nonlinear optical imaging method to characterize these critical properties of molybdenum disulfide (MoS2) and MoS2-based heterostructures. Our results demonstrate that MoS2 layers exhibit strong four-wave mixing (FWM), sum-frequency generation (SFG), and second-harmonic generation (SHG) nonlinear optical characteristics. We believe this is the first observation of FWM and SFG from TMD layers. All three kinds of optical nonlinearities are sensitive to layer numbers, crystal orientation, and interlayer coupling. The combined and simultaneous SHG/SFG-FWM imaging not only is capable of rapid evaluation of crystal quality and precise determination of odd-even layers but also provides in situ monitoring of the chemical dynamics of thermal oxidation in MoS2 and interlayer coupling in MoS2-graphene heterostructures. This method has the advantages of versatility, high fidelity, easy operation, and fast imaging, enabling comprehensive characterization of van der Waals layered structures for fundamental research and practical applications.