Non-rigid Motion Compensation Research Articles

Rigid and Non-Rigid Motion Compensation in Weight-Bearing CBCT of the Knee Using Simulated Inertial Measurements.

Involuntary subject motion is the main source of artifacts in weight-bearing cone-beam CT of the knee. To achieve image quality for clinical diagnosis, the motion needs to be compensated. We propose to use inertial measurement units (IMUs) attached to the leg for motion estimation. We perform a simulation study using real motion recorded with an optical tracking system. Three IMU-based correction approaches are evaluated, namely rigid motion correction, non-rigid 2D projection deformation and non-rigid 3D dynamic reconstruction. We present an initialization process based on the system geometry. With an IMU noise simulation, we investigate the applicability of the proposed methods in real applications. All proposed IMU-based approaches correct motion at least as good as a state-of-the-art marker-based approach. The structural similarity index and the root mean squared error between motion-free and motion corrected volumes are improved by 24-35% and 78-85%, respectively, compared with the uncorrected case. The noise analysis shows that the noise levels of commercially available IMUs need to be improved by a factor of 105 which is currently only achieved by specialized hardware not robust enough for the application. Our simulation study confirms the feasibility of this novel approach and defines improvements necessary for a real application. The presented work lays the foundation for IMU-based motion compensation in cone-beam CT of the knee and creates valuable insights for future developments.

Deep-learning based super-resolution for 3D isotropic coronary MR angiography in less than a minute.

To develop and evaluate a novel and generalizable super-resolution (SR) deep-learning framework for motion-compensated isotropic 3D coronary MR angiography (CMRA), which allows free-breathing acquisitions in less than a minute. Undersampled motion-corrected reconstructions have enabled free-breathing isotropic 3D CMRA in ~5-10 min acquisition times. In this work, we propose a deep-learning-based SR framework, combined with non-rigid respiratory motion compensation, to shorten the acquisition time to less than 1 min. A generative adversarial network (GAN) is proposed consisting of two cascaded Enhanced Deep Residual Network generator, a trainable discriminator, and a perceptual loss network. A 16-fold increase in spatial resolution is achieved by reconstructing a high-resolution (HR) isotropic CMRA (0.9 mm3 or 1.2 mm3 ) from a low-resolution (LR) anisotropic CMRA (0.9 × 3.6 × 3.6 mm3 or 1.2 × 4.8 × 4.8 mm3 ). The impact and generalization of the proposed SRGAN approach to different input resolutions and operation on image and patch-level is investigated. SRGAN was evaluated on a retrospective downsampled cohort of 50 patients and on 16 prospective patients that were scanned with LR-CMRA in ~50 s under free-breathing. Vessel sharpness and length of the coronary arteries from the SR-CMRA is compared against the HR-CMRA. SR-CMRA showed statistically significant (P < .001) improved vessel sharpness 34.1% ± 12.3% and length 41.5% ± 8.1% compared with LR-CMRA. Good generalization to input resolution and image/patch-level processing was found. SR-CMRA enabled recovery of coronary stenosis similar to HR-CMRA with comparable qualitative performance. The proposed SR-CMRA provides a 16-fold increase in spatial resolution with comparable image quality to HR-CMRA while reducing the predictable scan time to <1 min.

Impact of temporal resolution and motion correction for dynamic contrast-enhanced MRI of the liver using an accelerated golden-angle radial sequence

This paper presents a prospective study evaluating the impact on image quality and quantitative dynamic contrast-enhanced (DCE)-MRI perfusion parameters when varying the number of respiratory motion states when using an eXtra-Dimensional Golden-Angle Radial Sparse Parallel (XD-GRASP) MRI sequence. DCE acquisition was performed using a 3D stack-of-stars gradient-echo golden-angle radial acquisition in free-breathing with 100 spokes per motion state and temporal resolution of 6 s/volume, and using a non-rigid motion compensation to align different motion states. Parametric analysis was conducted using a dual-input single-compartment model. Nonparametric analysis was performed on the time-intensity curves. A total of 22 hepatocellular carcinomas (size: 11–52 mm) were evaluated. XD-GRASP reconstructed with increasing number of spokes for each motion state increased the signal-to-noise ratio (SNR) (p < 0.05) but decreased temporal resolution (0.04 volume/s vs 0.17 volume/s for one motion state) (p < 0.05). A visual scoring by an experienced radiologist show no change between increasing number of motion states with same number of spokes using the Likert score. The normalized maximum intensity time ratio, peak enhancement ratio and tumor arterial fraction increased with decreasing number of motion states (p < 0.05) while the transfer constant from the portal venous plasma to the surrounding tissue significantly decreased (p < 0.05). These same perfusion parameters show a significant difference in case of tumor displacement more than 1 cm (p < 0.05) whereas in the opposite case there was no significant variation. While a higher number of motion states and higher number of spokes improves SNR, the resulting lower temporal resolution can influence quantitative parameters that capture rapid signal changes. Finally, fewer displacement compensation is advantageous with lower number of motion state due to the higher temporal resolution. XD-GRASP can be used to perform quantitative perfusion measures in the liver, but the number of motion states may significantly alter some quantitative parameters.

Iterative motion-compensation reconstruction ultra-short TE (iMoCo UTE) for high-resolution free-breathing pulmonary MRI.

To develop a high-scanning efficiency, motion-corrected imaging strategy for free-breathing pulmonary MRI by combining an iterative motion-compensation reconstruction with a ultrashort echo time (UTE) acquisition called iMoCo UTE. An optimized golden-angle ordering radial UTE sequence was used to continuously acquire data for 5 minutes. All readouts were grouped to different respiratory motion states based on self-navigator signals, and then motion-resolved data was reconstructed by XD golden-angle radial sparse parallel reconstruction. One state from the motion-resolved images was selected as a reference, and then motion fields from the other states to the reference were derived via nonrigid registration. Finally, all motion-resolved data and motion fields were reconstructed by using an iterative motion-compensation (MoCo) reconstruction with a total generalized variation sparse constraint. The iMoCo UTE strategy was evaluated in volunteers and nonsedated pediatric patient (4-6 years old) studies. Images reconstructed with iMoCo UTE provided sharper anatomical lung structures and higher apparent SNR and contrast-to-noise ratio compared to using other motion-correction strategies, such as soft-gating, motion-resolved reconstruction, and nonrigid MoCo. iMoCo UTE also showed promising results in an infant study. The proposed iMoCo UTE combines self-navigation, motion modeling, and a compressed sensing reconstruction to increase scan efficiency and SNR and to reduce respiratory motion in lung MRI. This proposed strategy shows improvements in free-breathing lung MRI scans, especially in very challenging application situations such as pediatric MRI studies.

Feasibility study on 3D image reconstruction from 2D orthogonal cine-MRI for MRI-guided radiotherapy.

In-room MRI is a promising image guidance strategy in external beam radiotherapy to acquire volumetric information for moving targets. However, limitations in spatio-temporal resolution led several authors to use 2D orthogonal images for guidance. The aim of this work is to present a method to concurrently compensate for non-rigid tumour motion and provide an approach for 3D reconstruction from 2D orthogonal cine-MRI slices for MRI-guided treatments. Free-breathing sagittal/coronal interleaved 2D cine-MRI were acquired in addition to a pre-treatment 3D volume in two patients. We performed deformable image registration (DIR) between cine-MRI slices and corresponding slices in the pre-treatment 3D volume. Based on an extrapolation of the interleaved 2D motion fields, the 3D motion field was estimated and used to warp the pre-treatment volume. Due to the lack of a ground truth for patients, the method was validated on a digital 4D lung phantom. On the phantom, the 3D reconstruction method was able to compensate for tumour motion and compared favourably to the results of previously adopted strategies. The difference in the 3D motion fields between the phantom and the extrapolated motion was 0.4±0.3mm for tumour and 0.8±1.5mm for whole anatomy, demonstrating feasibility of performing a 3D volumetric reconstruction directly from 2D orthogonal cine-MRI slices. Application of the method to patient data confirmed the feasibility of utilizing this method in real world scenarios. Preliminary results on phantom and patient cases confirm the feasibility of the proposed approach in an MRI-guided scenario, especially for non-rigid tumour motion compensation.

Respiratory Motion Compensation for PET/CT with Motion Information Derived from Matched Attenuation-Corrected Gated PET Data.

Respiratory motion degrades the detection and quantification capabilities of PET/CT imaging. Moreover, mismatch between a fast helical CT image and a time-averaged PET image due to respiratory motion results in additional attenuation correction artifacts and inaccurate localization. Current motion compensation approaches typically have 3 limitations: the mismatch among respiration-gated PET images and the CT attenuation correction (CTAC) map can introduce artifacts in the gated PET reconstructions that can subsequently affect the accuracy of the motion estimation; sinogram-based correction approaches do not correct for intragate motion due to intracycle and intercycle breathing variations; and the mismatch between the PET motion compensation reference gate and the CT image can cause an additional CT-mismatch artifact. In this study, we established a motion correction framework to address these limitations. Methods: In the proposed framework, the combined emission-transmission reconstruction algorithm was used for phase-matched gated PET reconstructions to facilitate the motion model building. An event-by-event nonrigid respiratory motion compensation method with correlations between internal organ motion and external respiratory signals was used to correct both intracycle and intercycle breathing variations. The PET reference gate was automatically determined by a newly proposed CT-matching algorithm. We applied the new framework to 13 human datasets with 3 different radiotracers and 323 lesions and compared its performance with CTAC and non-attenuation correction (NAC) approaches. Validation using 4-dimensional CT was performed for one lung cancer dataset. Results: For the 10 18F-FDG studies, the proposed method outperformed (P < 0.006) both the CTAC and the NAC methods in terms of region-of-interest-based SUVmean, SUVmax, and SUV ratio improvements over no motion correction (SUVmean: 19.9% vs. 14.0% vs. 13.2%; SUVmax: 15.5% vs. 10.8% vs. 10.6%; SUV ratio: 24.1% vs. 17.6% vs. 16.2%, for the proposed, CTAC, and NAC methods, respectively). The proposed method increased SUV ratios over no motion correction for 94.4% of lesions, compared with 84.8% and 86.4% using the CTAC and NAC methods, respectively. For the 2 18F-fluoropropyl-(+)-dihydrotetrabenazine studies, the proposed method reduced the CT-mismatch artifacts in the lower lung where the CTAC approach failed and maintained the quantification accuracy of bone marrow where the NAC approach failed. For the 18F-FMISO study, the proposed method outperformed both the CTAC and the NAC methods in terms of motion estimation accuracy at 2 lung lesion locations. Conclusion: The proposed PET/CT respiratory event-by-event motion-correction framework with motion information derived from matched attenuation-corrected PET data provides image quality superior to that of the CTAC and NAC methods for multiple tracers.

Technical note: Accelerated nonrigid motion-compensated isotropic 3D coronary MR angiography.

PurposeTo develop an accelerated and nonrigid motion‐compensated technique for efficient isotropic 3D whole‐heart coronary magnetic resonance angiography (CMRA) with Cartesian acquisition.MethodsHighly efficient whole‐heart 3D CMRA was achieved by combining image reconstruction from undersampled data using compressed sensing (CS) with a nonrigid motion compensation framework. Undersampled acquisition was performed using a variable‐density Cartesian trajectory with radial order (VD‐CAPR). Motion correction was performed in two steps: beat‐to‐beat 2D translational correction with motion estimated from interleaved image navigators, and bin‐to‐bin 3D nonrigid correction with motion estimated from respiratory‐resolved images reconstructed from undersampled 3D CMRA data using CS. Nonrigid motion fields were incorporated into an undersampled motion‐compensated reconstruction, which combines CS with the general matrix description formalism. The proposed approach was tested on 10 healthy subjects and compared against a conventional twofold accelerated 5‐mm navigator‐gated and tracked acquisition.ResultsThe proposed method achieves isotropic 1.2‐mm Cartesian whole‐heart CMRA in 5 min ± 1 min (~8× acceleration). The proposed approach provides good‐quality images of the left and right coronary arteries, comparable to those of a twofold accelerated navigator‐gated and tracked acquisition, but scan time was up to about four times faster. For both coronaries, no significant differences (P > 0.05) in vessel sharpness and length were found between the proposed method and reference scan.ConclusionThe feasibility of a highly efficient motion‐compensated reconstruction framework for accelerated 3D CMRA has been demonstrated in healthy subjects. Further investigation is required to assess the clinical value of the method.

Nonrigid motion compensation in compressed sensing reconstruction of cardiac cine MRI

In this work, a robust nonrigid motion compensation approach, is applied to the compressed sensing reconstruction of dynamic cardiac cine MRI sequences. Respiratory and cardiac motion separation coupled with a registration algorithm is used to provide accurate reconstruction of dynamic cardiac images. The proposed scheme employs a variable splitting based optimization strategy to enable joint motion estimation along with reconstruction. We define the recovery as an energy minimization scheme utilizing an objective function that combines data consistency, spatial smoothness, and motion penalties. The validation of the proposed algorithm using numerical phantom and in-vivo cine MRI data demonstrates reconstruction of cardiac MRI data with less spatio-temporal blurring and motion artifacts from extensively under-sampled data. The proposed method is observed to provide improved reconstructions over state-of-the-art motion compensation schemes.

List-mode image reconstruction for positron emission tomography using tetrahedral voxels

Image space decomposition based on tetrahedral voxels are interesting candidates for use in emission tomography. Tetrahedral voxels provide many of the advantages of point clouds with irregular spacing, such as being intrinsically multi-resolution, yet they also serve as a volumetric partition of the image space and so are comparable to more standard cubic voxels. Additionally, non-rigid displacement fields can be applied to the tetrahedral mesh in a straight-forward manner. So far studies incorporating tetrahedral decomposition of the image space have concentrated on pre-calculated, node-based, system matrix elements which reduces the flexibility of the tetrahedral approach and the capacity to accurately define regions of interest. Here, a list-mode on-the-fly calculation of the system matrix elements is described using a tetrahedral decomposition of the image space and volumetric elements—voxels. The algorithm is demonstrated in the context of awake animal PET which may require both rigid and non-rigid motion compensation, as well as quantification within small regions of the brain. This approach allows accurate, event based, motion compensation including non-rigid deformations.

Semi-automatic motion compensation of contrast-enhanced ultrasound images from abdominal organs for perfusion analysis

This paper presents a system for correcting motion influences in time-dependent 2D contrast-enhanced ultrasound (CEUS) images to assess tissue perfusion characteristics. The system consists of a semi-automatic frame selection method to find images with out-of-plane motion as well as a method for automatic motion compensation. Translational and non-rigid motion compensation is applied by introducing a temporal continuity assumption. A study consisting of 40 clinical datasets was conducted to compare the perfusion with simulated perfusion using pharmacokinetic modeling. Overall, the proposed approach decreased the mean average difference between the measured perfusion and the pharmacokinetic model estimation. It was non-inferior for three out of four patient cohorts to a manual approach and reduced the analysis time by 41% compared to manual processing.

Automated analysis of non-mass-enhancing lesions in breast MRI based on morphological, kinetic, and spatio-temporal moments and joint segmentation-motion compensation technique

Abstract Dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) represents an established method for the detection and diagnosis of breast lesions. While mass-like enhancing lesions can be easily categorized according to the Breast Imaging Reporting and Data System (BI-RADS) MRI lexicon, a majority of diagnostically challenging lesions, the so called non-mass-like enhancing lesions, remain both qualitatively as well as quantitatively difficult to analyze. Thus, the evaluation of kinetic and/or morphological characteristics of non-masses represents a challenging task for an automated analysis and is of crucial importance for advancing current computer-aided diagnosis (CAD) systems. Compared to the well-characterized mass-enhancing lesions, non-masses have no well-defined and blurred tumor borders and a kinetic behavior that is not easily generalizable and thus discriminative for malignant and benign non-masses. To overcome these difficulties and pave the way for novel CAD systems for non-masses, we will evaluate several kinetic and morphological descriptors separately and a novel technique, the Zernike velocity moments, to capture the joint spatio-temporal behavior of these lesions, and additionally consider the impact of non-rigid motion compensation on a correct diagnosis.

Evaluation of a Nonrigid Motion Compensation Technique Based on Spatiotemporal Features for Small Lesion Detection in Breast MRI

Motion-induced artifacts represent a major problem in detection and diagnosis of breast cancer in dynamic contrast-enhanced magnetic resonance imaging. The goal of this paper is to evaluate the performance of a new nonrigid motion correction algorithm based on the optical flow method. For each of the small lesions, we extracted morphological and dynamical features describing both global and local shape, and kinetics behavior. In this paper, we compare the performance of each extracted feature set under consideration of several 2D or 3D motion compensation parameters for the differential diagnosis of enhancing lesions in breast MRI. Based on several simulation results, we determined the optimal motion compensation parameters. Our results have shown that motion compensation can improve the classification results. The results suggest that the computerized analysis system based on the non-rigid motion compensation technique and spatiotemporal features has the potential to increase the diagnostic accuracy of MRI mammography for small lesions and can be used as a basis for computer-aided diagnosis of breast cancer with MR mammography.