GLobal Ultrasound Elastography Research Articles

A novel tissue mechanics-based method for improved motion tracking in quasi-static ultrasound elastography.

Most cancers are associated with biological and structural changes that lead to tissue stiffening. Therefore, imaging tissue stiffness using quasi-static ultrasound elastography (USE) can potentially be effective in cancer diagnosis. USE techniques developed for stiffness image reconstruction use noisy displacement data to obtain the stiffness images. In this study, we propose a technique to substantially improve the accuracy of the displacement data computed through ultrasound tissue motion tracking techniques, especially in the lateral direction. The proposed technique uses mathematical constraints derived from fundamental tissue mechanics principles to regularize displacement and strain fields obtained using Global Ultrasound Elastography (GLUE) and Second-Order Ultrasound Elastography (SOUL) methods. The principles include a novel technique to enforce (1) tissue incompressibility using 3D Boussinesq model and (2) deformation compatibility using the compatibility differential equation. The technique was validated thoroughly using metrics pertaining to Signal-to-Noise-Ratio (SNR), Contrast-to-Noise-Ratio (CNR) and Normalized Cross Correlation (NCC) for four tissue-mimicking phantom models and two clinical breast ultrasound elastography cases. The results show substantial improvement in the displacement and strain images generated using the proposed technique. The tissue-mimicking phantom study results indicate that the proposed method is superior in improving image quality compared to the GLUE and SOUL techniques as it shows an average axial strain SNR and CNR improvement of 44% and 63%, and lateral strain SNR and CNR improvement of 130% and 435%, respectively. The results of the phantom study also indicate higher accuracy of displacement images obtained using the proposed technique, including improvement ranges of 7-84% and 26-140% for axial and lateral displacement images, respectively. For the clinical cases, the results indicate average improvement of 48% and 64% in SNR and CNR, respectively, in the axial strain images, and average improvement of 40% and 41% in SNR and CNR, respectively, in the lateral strain images. The proposed method is very effective in producing improved estimate of tissue displacement and strain images, especially with the lateral displacement and strain where the improvement is highly remarkable. While the method shows promise for clinical applications, further investigation is necessary for rigorous assessment of the method's performance in the clinic.

Unsupervised Convolutional Neural Network for Motion Estimation in Ultrasound Elastography.

High-quality motion estimation is essential for ultrasound elastography (USE). Traditional motion estimation algorithms based on speckle tracking such as normalized cross correlation (NCC) or regularization such as global ultrasound elastography (GLUE) are time-consuming. In order to reduce the computational cost and ensure the accuracy of motion estimation, many convolutional neural networks have been introduced into USE. Most of these networks such as radio-frequency modified pyramid, warping and cost volume network (RFMPWC-Net) are supervised and need many ground truths as labels in network training. However, the ground truths are laborious to collect for USE. In this study, we proposed a MaskFlownet-based unsupervised convolutional neural network (MF-UCNN) for fast and high-quality motion estimation in USE. The inputs to MF-UCNN are the concatenation of RF, envelope, and B-mode images before and after deformation, while the outputs are the axial and lateral displacement fields. The similarity between the predeformed image and the warped image (i.e., the postdeformed image compensated by the estimated displacement fields) and the smoothness of the estimated displacement fields were incorporated in the loss function. The network was compared with modified pyramid, warping and cost volume network (MPWC-Net)++, RFMPWC-Net, GLUE, and NCC. Results of simulations, breast phantom, and in vivo experiments show that MF-UCNN obtains higher signal-to-noise ratio (SNR) and higher contrast-to-noise ratio (CNR). MF-UCNN achieves high-quality motion estimation with significantly reduced computation time. It is unsupervised and does not need any ground truths as labels in the training, and, thus, has great potential for motion estimation in USE.

Incorporating Gradient Similarity for Robust Time Delay Estimation in Ultrasound Elastography.

Energy-based ultrasound elastography techniques minimize a regularized cost function consisting of data and continuity terms to obtain local displacement estimates based on the local time-delay estimation (TDE) between radio frequency (RF) frames. The data term associated with the existing techniques takes only the amplitude similarity into account and hence is not sufficiently robust to the outlier samples present in the RF frames under consideration. This drawback creates noticeable artifacts in the strain image. To resolve this issue, we propose to formulate the data function as a linear combination of the amplitude and gradient similarity constraints. We estimate the adaptive weight concerning each similarity term following an iterative scheme. Finally, we optimize the nonlinear cost function in an efficient manner to convert the problem to a sparse system of linear equations which are solved for millions of variables. We call our technique rGLUE: robust data term in GLobal Ultrasound Elastography. rGLUE has been validated using simulation, phantom, in vivo liver, and breast datasets. In all our experiments, rGLUE substantially outperforms the recent elastography methods both visually and quantitatively. For simulated, phantom, and in vivo datasets, respectively, rGLUE achieves 107%, 18%, and 23% improvements of signal-to-noise ratio (SNR) and 61%, 19%, and 25% improvements of contrast-to-noise ratio (CNR) over global ultrasound elastography (GLUE), a recently published elastography algorithm.

Second-Order Ultrasound Elastography With L1-Norm Spatial Regularization.

Time delay estimation (TDE) between two radio-frequency (RF) frames is one of the major steps of quasi-static ultrasound elastography, which detects tissue pathology by estimating its mechanical properties. Regularized optimization-based techniques, a prominent class of TDE algorithms, optimize a nonlinear energy functional consisting of data constancy and spatial continuity constraints to obtain the displacement and strain maps between the time-series frames under consideration. The existing optimization-based TDE methods often consider the L2 -norm of displacement derivatives to construct the regularizer. However, such a formulation over-penalizes the displacement irregularity and poses two major issues to the estimated strain field. First, the boundaries between different tissues are blurred. Second, the visual contrast between the target and the background is suboptimal. To resolve these issues, herein, we propose a novel TDE algorithm where instead of L2 -, L1 -norms of both first- and second-order displacement derivatives are taken into account to devise the continuity functional. We handle the non-differentiability of L1 -norm by smoothing the absolute value function's sharp corner and optimize the resulting cost function in an iterative manner. We call our technique Second-Order Ultrasound eLastography (SOUL) with the L1 -norm spatial regularization ( L1 -SOUL). In terms of both sharpness and visual contrast, L1 -SOUL substantially outperforms GLobal Ultrasound Elastography (GLUE), tOtal Variation rEgulaRization and WINDow-based time delay estimation (OVERWIND), and SOUL, three recently published TDE algorithms in all validation experiments performed in this study. In cases of simulated, phantom, and in vivo datasets, respectively, L1 -SOUL achieves 67.8%, 46.81%, and 117.35% improvements of contrast-to-noise ratio (CNR) over SOUL. The L1 -SOUL code can be downloaded from http://code.sonography.ai.

Fast Strain Estimation and Frame Selection in Ultrasound Elastography Using Machine Learning.

Ultrasound elastography aims to determine the mechanical properties of the tissue by monitoring tissue deformation due to internal or external forces. Tissue deformations are estimated from ultrasound radio frequency (RF) signals and are often referred to as time delay estimation (TDE). Given two RF frames I1 and I2 , we can compute a displacement image, which shows the change in the position of each sample in I1 to a new position in I2 . Two important challenges in TDE include high computational complexity and the difficulty in choosing suitable RF frames. Selecting suitable frames is of high importance because many pairs of RF frames either do not have acceptable deformation for extracting informative strain images or are decorrelated and deformation cannot be reliably estimated. Herein, we introduce a method that learns 12 displacement modes in quasi-static elastography by performing principal component analysis (PCA) on displacement fields of a large training database. In the inference stage, we use dynamic programming (DP) to compute an initial displacement estimate of around 1% of the samples and then decompose this sparse displacement into a linear combination of the 12 displacement modes. Our method assumes that the displacement of the whole image could also be described by this linear combination of principal components. We then use the GLobal Ultrasound Elastography (GLUE) method to fine-tune the result yielding the exact displacement image. Our method, which we call PCA-GLUE, is more than 10× faster than DP in calculating the initial displacement map while giving the same result. This is due to converting the problem of estimating millions of variables in DP into a much simpler problem of only 12 unknown weights of the principal components. Our second contribution in this article is determining the suitability of the frame pair I1 and I2 for strain estimation, which we achieve by using the weight vector that we calculated for PCA-GLUE as an input to a multilayer perceptron (MLP) classifier. We validate PCA-GLUE using simulation, phantom, and in vivo data. Our classifier takes only 1.5 ms during the testing phase and has an F1-measure of more than 92% when tested on 1430 instances collected from both phantom and in vivo data sets.

Denoising RF Data via Robust Principal Component Analysis: Results in Ultrasound Elastography.

Ultrasound data often suffers from an excessive amount of noise especially from deep tissue or in synthetic aperture imaging where the acoustic wave is weak. Such noisy data renders Time Delay Estimation (TDE) inaccurate in the context of ultrasound elastography. Herein, a novel two-step elastography technique is presented to ensure accurate TDE while dealing with noisy ultrasound data. In the first step, instead of one, we acquire several Radio-Frequency (RF) frames from both pre- and post-deformed positions of the tissue. We stack the frames collected from pre- and post-deformed planes in separate data matrices. Since each set is collected from the same level of tissue compression, we assume that the Casorati data matrices exhibit underlying low-rank structures, which are sought by taking the low-rank and sparse decomposition framework into account. This Robust Principal Component Analysis (RPCA) approach removes the random noise from the datasets as sparse error components. In the second step, we select one frame from each denoised ensemble and employ GLobal Ultrasound Elastography (GLUE) to perform the strain elastography. We call the proposed technique RPCA-GLUE. Our preliminary validation of RPCA-GLUE against simulation phantoms containing hard and soft inclusions proves its robustness to large noise. Substantial improvement in Signal-to-Noise Ratio (SNR) and Contrast-to-Noise Ratio (CNR) has also been observed. Simulation results show that in the presence of large noise, the proposed method substantially improves CNR from 5.0 to 22.6 in a soft inclusion and from 2.2 to 21.7 in a hard inclusion phantom.

3D Global Time-Delay Estimation for Shear-Wave Absolute Vibro-Elastography of the Placenta.

The placenta is a vital organ for growth and development of the fetus. Shear Wave Absolute Vibro-Elastography (SWAVE) is a new elastography technique proposed to detect placenta disorders. Elastography involves applying a force on the tissue and measuring the resulting tissue deformation. All types of compression cause the tissue to expand in three directions given the biological tissues are nearly incompressible. Hence, 3D displacement estimation should lead to the most accurate elasticity reconstruction compared to the traditional 1D methods. Previous studies estimated 3D displacements over ultrasound volumes mostly for quasi-static compression to generate strain images. However, accurate displacement tracking of dynamic motion continues to be a challenge. In this work, a novel volumetric regularized algorithm, 3D GLobal Ultrasound Elastography (GLUE3D), is presented to estimate the 3D displacement over a volume of ultrasound data, following by a 3D Young's modulus reconstruction. The proposed method outperforms the previous 2D method over a volume and is compared with a 3D technique using phantom data for which the elasticity are provided by the values from magnetic resonance elastography on the same phantom and also the manufacturer reference numbers. We then present Young's modulus reconstruction results obtained from clinical data of placenta which shows more uniform elasticity maps compared to the traditional 1D displacement measurements over a volume of ultrasound data. Furthermore, the dependency of the elasticity values to the frequency is investigated in this study.

Accurate and Precise Time-Delay Estimation for Ultrasound Elastography With Prebeamformed Channel Data.

Free-hand palpation ultrasound elastography is a noninvasive approach for detecting pathological alteration in tissue. In this method, the tissue is compressed by a handheld probe and displacement of each sample is estimated, a process which is also known as time-delay estimation (TDE). Even with the simplifying assumption that ignores out of plane motion, TDE is an ill-posed problem requiring estimation of axial and lateral displacements for each sample from its intensity. A well-known class of methods for making elastography a well-posed problem is regularized optimization-based methods, which imposes smoothness regularization in the associated cost function. In this article, we propose to utilize channel data that have been compensated for time gain and time delay (introduced by transmission) instead of postbeamformed radio frequency (RF) data in the optimization problem. We name our proposed method Channel data for GLobal Ultrasound Elastography (CGLUE). We analytically derive bias and variances of TDE as functions of data noise for CGLUE and Global Ultrasound Elastography (GLUE) and use the Cauchy-Schwarz inequality to prove that CGLUE provides a TDE with lower bias and variance error. To further illustrate the improved performance of CGLUE, the results of simulation, experimental phantom, and ex-vivo experiments are presented.

Neural-network-based Motion Tracking for Breast Ultrasound Strain Elastography: An Initial Assessment of Performance and Feasibility.

Accurate tracking of tissue motion is critically important for several ultrasound elastography methods. In this study, we investigate the feasibility of using three published convolution neural network (CNN) models built for optical flow (hereafter referred to as CNN-based tracking) by the computer vision community for breast ultrasound strain elastography. Elastographic datasets produced by finite element and ultrasound simulations were used to retrain three published CNN models: FlowNet-CSS, PWC-Net, and LiteFlowNet. After retraining, the three improved CNN models were evaluated using computer-simulated and tissue-mimicking phantoms, and in vivo breast ultrasound data. CNN-based tracking results were compared with two published two-dimensional (2D) speckle tracking methods: coupled tracking and GLobal Ultrasound Elastography (GLUE) methods. Our preliminary data showed that, based on the Wilcoxon rank-sum tests, the improvements due to retraining were statistically significant (p < 0.05) for all three CNN models. We also found that the PWC-Net model was the best neural network model for data investigated, and its overall performance was on par with the coupled tracking method. CNR values estimated from in vivo axial and lateral strain elastograms showed that the GLUE algorithm outperformed both the retrained PWC-Net model and the coupled tracking method, though the GLUE algorithm exhibited some biases. The PWC-Net model was also able to achieve approximately 45 frames/second for 2D speckle tracking data investigated.

Fast Approximate Time-Delay Estimation in Ultrasound Elastography Using Principal Component Analysis.

Time delay estimation (TDE) is a critical and challenging step in all ultrasound elastography methods. A growing number of TDE techniques require an approximate but robust and fast method to initialize solving for TDE. Herein, we present a fast method for calculating an approximate TDE between two radio frequency (RF) frames of ultrasound. Although this approximate TDE can be useful for several algorithms, we focus on GLobal Ultrasound Elastography (GLUE), which currently relies on Dynamic Programming (DP) to provide this approximate TDE. We exploit Principal Component Analysis (PCA) to find the general modes of deformation in quasi-static elastography, and therefore call our method PCA-GLUE. PCA-GLUE is a data-driven approach that learns a set of TDE principal components from a training database in real experiments. In the test phase, TDE is approximated as a weighted sum of these principal components. Our algorithm robustly estimates the weights from sparse feature matches, then passes the resulting displacement field to GLUE as initial estimates to perform a more accurate displacement estimation. PCA-GLUE is more than ten times faster than DP in estimation of the initial displacement field and yields similar results.

Combining Total Variation Regularization with Window-Based Time Delay Estimation in Ultrasound Elastography

A major challenge of free-hand palpation ultrasound elastography (USE) is estimating the displacement of RF samples between pre- and post-compressed RF data. The problem of displacement estimation is ill-posed since the displacement of one sample by itself cannot be uniquely calculated. To resolve this problem, two categories of methods have emerged. The first category assumes that the displacement of samples within a small window surrounding the reference sample is constant. The second class imposes smoothness regularization and optimizes an energy function. Herein, we propose a novel method that combines both approaches, and as such, is more robust to noise. The second contribution of this work is the introduction of the L1 norm as the regularization term in our cost function, which is often referred to as the total variation (TV) regularization. Compared to previous work that used the L2 norm regularization, optimization of the new cost function is more challenging. However, the advantages of using the L1 norm are twofold. First, it leads to substantial improvement in the sharpness of displacement estimates. Second, to optimize the cost function with the L1 norm regularization, we use an iterative method that further increases the robustness. We name our proposed method tOtal Variation Regularization and WINDow-based time delay estimation (OVERWIND) and show that it is robust to signal decorrelation and generates sharp displacement and strain maps for simulated, experimental phantom and in-vivo data. In particular, OVERWIND improves strain contrast-to-noise ratio (CNR) by 27.26%, 144.05%, and 49.90% on average in simulation, phantom, and in-vivo data, respectively, compared to our recent Global Ultrasound Elastography (GLUE) method.

Global Ultrasound Elastography in Spatial and Temporal Domains.

In this paper, a novel computationally efficient quasi-static ultrasound elastography technique is introduced by optimizing an energy function. Unlike conventional elastography techniques, three radio frequency (RF) frames are considered to devise a nonlinear cost function consisting of data intensity similarity term, spatial regularization terms and, most importantly, temporal continuity terms. We optimize the aforesaid cost function efficiently to obtain the time-delay estimation (TDE) of all samples between the first two and last two frames of ultrasound images simultaneously, and spatially differentiate the TDE to generate axial strain map. A novelty in our spatial and temporal regularizations is that they adaptively change based on the data, which leads to substantial improvements in TDE. We handle the computational complexity resulting from incorporation of all samples from all three frames by converting our optimization problem to a sparse linear system of equations. Consideration of both spatial and temporal continuity makes the algorithm more robust to signal decorrelation than the previous algorithms. We name the proposed method GUEST: Global Ultrasound Elastography in Spatial and Temporal directions. We validated our technique with simulation, experimental phantom, and in vivo liver data and compared the results with two recently proposed TDE methods. In all the experiments, GUEST substantially outperforms other techniques in terms of signal-to-noise ratio (SNR), contrast-to-noise ratio (CNR), and strain ratio (SR) of the strain images.

Nonlocal Coherent Denoising of RF Data for Ultrasound Elastography.

Ultrasound elastography infers mechanical properties of living tissues from ultrasound radiofrequency (RF) data recorded while the tissues are undergoing deformation. A challenging yet critical step in ultrasound elastography is to estimate the tissue displacement (or, equivalently the time delay estimate) fields from pairs of RF data. The RF data are often corrupted with noise, which causes the displacement estimator to fail in many in vivo experiments. To address this problem, we present a nonlocal, coherent denoising approach based on Bayesian estimation to reduce the impact of noise. Despite incoherent denoising algorithms that smooth the B-mode images, the proposed denoising algorithm is used to suppress noise while maintaining useful information such as speckle patterns. We refer to the proposed approach as COherent Denoising for Elastography (CODE) and evaluate its performance when CODE is used in conjunction with the two state-of-art elastography algorithms, namely: (i) GLobal Ultrasound Elastography (GLUE) and (ii) Dynamic Programming Analytic Minimization elastography (DPAM). Our results show that CODE substantially improves the strain result of both GLUE and DPAM.

Global Time-Delay Estimation in Ultrasound Elastography.

A critical step in quasi-static ultrasound elastography is the estimation of time delay between two frames of radio-frequency (RF) data that are obtained while the tissue is undergoing deformation. This paper presents a novel technique for time-delay estimation (TDE) of all samples of RF data simultaneously, thereby exploiting all the information in RF data for TDE. A nonlinear cost function that incorporates similarity of RF data intensity and prior information of displacement continuity is formulated. Optimization of this function involves searching for TDE of all samples of the RF data, rendering the optimization intractable with conventional techniques given that the number of variables can be approximately one million. Therefore, the optimization problem is converted to a sparse linear system of equations, and is solved in real time using a computationally efficient optimization technique. We call our method GLobal Ultrasound Elastography (GLUE), and compare it to dynamic programming analytic minimization (DPAM) and normalized cross correlation (NCC) techniques. Our simulation results show that the contrast-to-noise ratio (CNR) values of the axial strain maps are 4.94 for NCC, 14.62 for DPAM, and 26.31 for GLUE. Our results on experimental data from tissue mimicking phantoms show that the CNR values of the axial strain maps are 1.07 for NCC, 16.01 for DPAM, and 18.21 for GLUE. Finally, our results on in vivo data show that the CNR values of the axial strain maps are 3.56 for DPAM and 13.20 for GLUE.