In-vivo Datasets Research Articles

Improving resolution of MR images with an adversarial network incorporating images with different contrast.

The routine MRI scan protocol consists of multiple pulse sequences that acquire images of varying contrast. Since high frequency contents such as edges are not significantly affected by image contrast, down-sampled images in one contrast may be improved by high resolution (HR) images acquired in another contrast, reducing the total scan time. In this study, we propose a new deep learning framework that uses HR MR images in one contrast to generate HR MR images from highly down-sampled MR images in another contrast. The proposed convolutional neural network (CNN) framework consists of two CNNs: (a) a reconstruction CNN for generating HR images from the down-sampled images using HR images acquired with a different MRI sequence and (b) a discriminator CNN for improving the perceptual quality of the generated HR images. The proposed method was evaluated using a public brain tumor database and invivo datasets. The performance of the proposed method was assessed in tumor and no-tumor cases separately, with perceptual image quality being judged by a radiologist. To overcome the challenge of training the network with a small number of available invivo datasets, the network was pretrained using the public database and then fine-tuned using the small number of invivo datasets. The performance of the proposed method was also compared to that of several compressed sensing (CS) algorithms. Incorporating HR images of another contrast improved the quantitative assessments of the generated HR image in reference to ground truth. Also, incorporating a discriminator CNN yielded perceptually higher image quality. These results were verified in regions of normal tissue as well as tumors for various MRI sequences from pseudo k-space data generated from the public database. The combination of pretraining with the public database and fine-tuning with the small number of real k-space datasets enhanced the performance of CNNs in invivo application compared to training CNNs from scratch. The proposed method outperformed the compressed sensing methods. The proposed method can be a good strategy for accelerating routine MRI scanning.

MLS: Joint Manifold-Learning and Sparsity-Aware Framework for Highly Accelerated Dynamic Magnetic Resonance Imaging.

Manifold-based models have been recently exploited for accelerating dynamic magnetic resonance imaging (dMRI). While manifold-based models have shown to be more efficient than conventional low-rank approaches, joint low-rank and sparsity-aware modeling still appears to be very efficient due to the inherent sparsity within dMR images. In this paper, we propose a joint manifold-learning and sparsity-aware framework for dMRI. The proposed method establishes a link between the recently developed manifold models and conventional sparsity-aware models. Dynamic MR images are modeled as points located on or close to a smooth manifold, and a novel data-driven manifold-learning approach, which preserves affine relation among images, is used to learn the low-dimensional embedding of the dynamic images. The temporal basis learnt from such an approach efficiently captures the inherent periodicity of dynamic images and hence sparsity along temporal direction is enforced during reconstruction. The proposed framework is validated by extensive numerical tests on phantom and in-vivo data sets.

Real-Time FEM-Based Registration of 3-D to 2.5-D Transrectal Ultrasound Images.

We present a novel technique for real-time deformable registration of 3-D to 2.5-D transrectal ultrasound (TRUS) images for image-guided, robot-assisted laparoscopic radical prostatectomy (RALRP). For RALRP, a pre-operatively acquired 3-D TRUS image is registered to thin-volumes comprised of consecutive intra-operative 2-D TRUS images, where the optimal transformation is found using a gradient descent method based on analytical first and second order derivatives. Our method relies on an efficient algorithm for real-time extraction of arbitrary slices from a 3-D image deformed given a discrete mesh representation. We also propose and demonstrate an evaluation method that generates simulated models and images for RALRP by modeling tissue deformation through patient-specific finite-element models (FEM). We evaluated our method on in-vivo data from 11 patients collected during RALRP and focal therapy interventions. In the presence of an average landmark deformation of 3.89 and 4.62 mm, we achieved accuracies of 1.15 and 0.72 mm, respectively, on the synthetic and in-vivo data sets, with an average registration computation time of 264 ms, using MATLAB on a conventional PC. The results show that the real-time tracking of the prostate motion and deformation is feasible, enabling a real-time augmented reality-based guidance system for RALRP.].

Spatio-temporal TGV denoising for ASL perfusion imaging

In arterial spin labeling (ASL) a perfusion weighted image is achieved by subtracting a label image from a control image. This perfusion weighted image has an intrinsically low signal to noise ratio and numerous measurements are required to achieve reliable image quality, especially at higher spatial resolutions. To overcome this limitation various denoising approaches have been published using the perfusion weighted image as input for denoising. In this study we propose a new spatio-temporal filtering approach based on total generalized variation (TGV) regularization which exploits the inherent information of control and label pairs simultaneously. In this way, the temporal and spatial similarities of all images are used to jointly denoise the control and label images. To assess the effect of denoising, virtual ground truth data were produced at different SNR levels. Furthermore, high-resolution in-vivo pulsed ASL data sets were acquired and processed. The results show improved image quality, quantitative accuracy and robustness against outliers compared to seven state of the art denoising approaches.

Motion-robust parameter estimation in abdominal diffusion-weighted MRI by simultaneous image registration and model estimation.

Quantitative body DW-MRI can detect abdominal abnormalities as well as monitor response-to-therapy for applications including cancer and inflammatory bowel disease with increased accuracy. Parameter estimates are obtained by fitting a forward model of DW-MRI signal decay to the observed data acquired with several b-values. The DW-MRI signal decay models typically used do not account for respiratory, cardiac and peristaltic motion, however, which may deteriorate the accuracy and robustness of parameter estimates. In this work, we introduce a new model of DW-MRI signal decay that explicitly accounts for motion. Specifically, we estimated motion-compensated model parameters by simultaneously solving image registration and model estimation (SIR-ME) problems utilizing the interdependence of acquired volumes along the diffusion-weighting dimension. To accomplish this, we applied the SIR-ME model to the in-vivo DW-MRI data sets of 26 Crohn's disease (CD) patients and achieved improved precision of the estimated parameters by reducing the coefficient of variation by 8%, 24% and 8% for slow diffusion (D), fast diffusion (D*) and fast diffusion fraction (f) parameters respectively, compared to parameters estimated with independent registration in normal-appearing bowel regions. Moreover, the parameters estimated with the SIR-ME model reduced the error rate in classifying normal and abnormal bowel loops to 12% for D and 10% for f parameter with a reduction in error rate by 13% and 11% for D and f parameters, respectively, compared to the error rate in classifying parameter estimates obtained with independent registration. The experiments in DW-MRI of liver in 20 subjects also showed that the SIR-ME model improved the precision of parameter estimation by reducing the coefficient of variation to 7% for D, 23% for D*, and 8% for the f parameter. Using the SIR-ME model, the coefficient of variation was reduced by 4%, 14% and 6% for D, D* and f parameters, respectively, compared to parameters estimated with independent registration. These results demonstrate that the proposed SIR-ME model improves the accuracy and robustness of quantitative body DW-MRI in characterizing tissue microstructure.

M-MRI: A Manifold-based Framework to Highly Accelerated Dynamic Magnetic Resonance Imaging.

High-dimensional signals, including dynamic magnetic resonance (dMR) images, often lie on low dimensional manifold. While many current dynamic magnetic resonance imaging (dMRI) reconstruction methods rely on priors which promote low-rank and sparsity, this paper proposes a novel manifold-based framework, we term M-MRI, for dMRI reconstruction from highly undersampled k-space data. Images in dMRI are modeled as points on or close to a smooth manifold, and the underlying manifold geometry is learned through training data, called "navigator" signals. Moreover, low-dimensional embeddings which preserve the learned manifold geometry and effect concise data representations are computed. Capitalizing on the learned manifold geometry, two regularization loss functions are proposed to reconstruct dMR images from highly undersampled k-space data. The advocated framework is validated using extensive numerical tests on phantom and in-vivo data sets.

A Segmentation Editing Framework Based on Shape Change Statistics.

Segmentation is a key task in medical image analysis because its accuracy significantly affects successive steps. Automatic segmentation methods often produce inadequate segmentations, which require the user to manually edit the produced segmentation slice by slice. Because editing is time-consuming, an editing tool that enables the user to produce accurate segmentations by only drawing a sparse set of contours would be needed. This paper describes such a framework as applied to a single object. Constrained by the additional information enabled by the manually segmented contours, the proposed framework utilizes object shape statistics to transform the failed automatic segmentation to a more accurate version. Instead of modeling the object shape, the proposed framework utilizes shape change statistics that were generated to capture the object deformation from the failed automatic segmentation to its corresponding correct segmentation. An optimization procedure was used to minimize an energy function that consists of two terms, an external contour match term and an internal shape change regularity term. The high accuracy of the proposed segmentation editing approach was confirmed by testing it on a simulated data set based on 10 in-vivo infant magnetic resonance brain data sets using four similarity metrics. Segmentation results indicated that our method can provide efficient and adequately accurate segmentations (Dice segmentation accuracy increase of 10%), with very sparse contours (only 10%), which is promising in greatly decreasing the work expected from the user.

DNA Shape Features Improve Transcription Factor Binding Site Predictions In Vivo

Interactions of transcription factors (TFs) with DNA comprise a complex interplay between base-specific amino acid contacts and readout of DNA structure. Recent studies have highlighted the complementarity of DNA sequence and shape in modeling TF binding invitro. Here, we have provided a comprehensive evaluation of invivo datasets to assess the predictive power obtained by augmenting various DNA sequence-based models of TF binding sites (TFBSs) with DNA shape features (helix twist, minor groove width, propeller twist, and roll). Results from 400 human ChIP-seq datasets for 76 TFs show that combining DNA shape features with position-specific scoring matrix (PSSM) scores improves TFBS predictions. Improvement has also been observed using TF flexible models and a machine-learning approach using a binary encoding of nucleotides inlieu of PSSMs. Incorporating DNA shape information is most beneficial for E2F and MADS-domain TF families. Our findings indicate that incorporating DNA sequence and shape information benefits the modeling of TF binding under complex invivo conditions.

A graph theoretic approach for computing 3D+time biventricular cardiac strain from tagged MRI data

Tagged magnetic resonance imaging (tMRI) is a well-established method for evaluating regional mechanical function of the heart. Many techniques have been developed to compute 2D or 3D cardiac deformation and strain from tMRI images. In this paper, we present a new method for measuring 3D plus time biventricular myocardial strain from tMRI data. The method is composed of two parts. First, we use a Gabor filter bank to extract tag points along tag lines. Second, each tag point is classified to one of a set of indexed reference tag lines using a point classification with graph cuts (PCGC) algorithm and a motion compensation technique. 3D biventricular deformation and strain is computed at each image time frame from the classified tag points using a previously published finite difference method. The strain computation is fully automatic after myocardial contours are defined near end-diastole and end-systole. An in-vivo dataset composed of 30 human imaging studies with a range of pathologies was used for validation. Strains computed with the PCGC method with no manual corrections were compared to strains computed from both manually placed tag points and a manually-corrected unwrapped phase method. A typical cardiac imaging study with 10 short-axis slices and 6 long-axis slices required 30 min for contouring followed by 44 min of automated processing. The results demonstrate that the proposed method can reconstruct accurate 3D plus time cardiac strain maps with minimal user intervention.

Joint Multi-Fiber NODDI Parameter Estimation and Tractography Using the Unscented Information Filter.

Tracing white matter fiber bundles is an integral part of analyzing brain connectivity. An accurate estimate of the underlying tissue parameters is also paramount in several neuroscience applications. In this work, we propose to use a joint fiber model estimation and tractography algorithm that uses the NODDI (neurite orientation dispersion diffusion imaging) model to estimate fiber orientation dispersion consistently and smoothly along the fiber tracts along with estimating the intracellular and extracellular volume fractions from the diffusion signal. While the NODDI model has been used in earlier works to estimate the microstructural parameters at each voxel independently, for the first time, we propose to integrate it into a tractography framework. We extend this framework to estimate the NODDI parameters for two crossing fibers, which is imperative to trace fiber bundles through crossings as well as to estimate the microstructural parameters for each fiber bundle separately. We propose to use the unscented information filter (UIF) to accurately estimate the model parameters and perform tractography. The proposed approach has significant computational performance improvements as well as numerical robustness over the unscented Kalman filter (UKF). Our method not only estimates the confidence in the estimated parameters via the covariance matrix, but also provides the Fisher-information matrix of the state variables (model parameters), which can be quite useful to measure model complexity. Results from in-vivo human brain data sets demonstrate the ability of our algorithm to trace through crossing fiber regions, while estimating orientation dispersion and other biophysical model parameters in a consistent manner along the tracts.

An Adaptive Directional Haar Framelet-Based Reconstruction Algorithm for Parallel Magnetic Resonance Imaging

Parallel magnetic resonance imaging (pMRI) is a technique to accelerate the magnetic resonance imaging process. The problem of reconstructing an image from the collected pMRI data is ill-posed. Regularization is needed to make the problem well-posed. In this paper, we first construct a two-dimensional tight framelet system whose filters have the same support as the orthogonal Haar filters and are able to detect edges of an image in the horizontal, vertical, and $\pm 45^o$ directions. This system is referred to as directional Haar framelet (DHF). We then propose a pMRI reconstruction model whose regularization term is formed by the DHF. This model is solved by a fast proximal algorithm with low computational complexity. The regularization parameters are updated adaptively and determined automatically during the iteration of the algorithm. Numerical experiments for in-silico and in-vivo data sets are provided to demonstrate the superiority of the DHF-based model and the efficiency of our proposed algorithm ...

A joint compressed-sensing and super-resolution approach for very high-resolution diffusion imaging

Diffusion MRI (dMRI) can provide invaluable information about the structure of different tissue types in the brain. Standard dMRI acquisitions facilitate a proper analysis (e.g. tracing) of medium-to-large white matter bundles. However, smaller fiber bundles connecting very small cortical or sub-cortical regions cannot be traced accurately in images with large voxel sizes. Yet, the ability to trace such fiber bundles is critical for several applications such as deep brain stimulation and neurosurgery. In this work, we propose a novel acquisition and reconstruction scheme for obtaining high spatial resolution dMRI images using multiple low resolution (LR) images, which is effective in reducing acquisition time while improving the signal-to-noise ratio (SNR). The proposed method called compressed-sensing super resolution reconstruction (CS-SRR), uses multiple overlapping thick-slice dMRI volumes that are under-sampled in q-space to reconstruct diffusion signal with complex orientations. The proposed method combines the twin concepts of compressed sensing and super-resolution to model the diffusion signal (at a given b-value) in a basis of spherical ridgelets with total-variation (TV) regularization to account for signal correlation in neighboring voxels. A computationally efficient algorithm based on the alternating direction method of multipliers (ADMM) is introduced for solving the CS-SRR problem. The performance of the proposed method is quantitatively evaluated on several in-vivo human data sets including a true SRR scenario. Our experimental results demonstrate that the proposed method can be used for reconstructing sub-millimeter super resolution dMRI data with very good data fidelity in clinically feasible acquisition time.

A Compressed-Sensing Approach for Super-Resolution Reconstruction of Diffusion MRI.

We present an innovative framework for reconstructing high-spatial-resolution diffusion magnetic resonance imaging (dMRI) from multiple low-resolution (LR) images. Our approach combines the twin concepts of compressed sensing (CS) and classical super-resolution to reduce acquisition time while increasing spatial resolution. We use subpixel-shifted LR images with down-sampled and non-overlapping diffusion directions to reduce acquisition time. The diffusion signal in the high resolution (HR) image is represented in a sparsifying basis of spherical ridgelets to model complex fiber orientations with reduced number of measurements. The HR image is obtained as the solution of a convex optimization problem which can be solved using the proposed algorithm based on the alternating direction method of multipliers (ADMM). We qualitatively and quantitatively evaluate the performance of our method on two sets of in-vivo human brain data and show its effectiveness in accurately recovering very high resolution diffusion images.

Motion Compensated Abdominal Diffusion Weighted MRI by Simultaneous Image Registration and Model Estimation (SIR-ME).

Non-invasive characterization of water molecule's mobility variations by quantitative analysis of diffusion-weighted MRI (DW-MRI) signal decay in the abdomen has the potential to serve as a biomarker in gastrointestinal and oncological applications. Accurate and reproducible estimation of the signal decay model parameters is challenging due to the presence of respiratory, cardiac, and peristalsis motion. Independent registration of each b-value image to the b-value=0 s/mm(2) image prior to parameter estimation might be sub-optimal because of the low SNR and contrast difference between images of varying b-value. In this work, we introduce a motion-compensated parameter estimation framework that simultaneously solves image registration and model estimation (SIR-ME) problems by utilizing the interdependence of acquired volumes along the diffusion weighting dimension. We evaluated the improvement in model parameters estimation accuracy using 16 in-vivo DW-MRI data sets of Crohn's disease patients by comparing parameter estimates obtained using the SIR-ME model to the parameter estimates obtained by fitting the signal decay model to the acquired DW-MRI images. The proposed SIR-ME model reduced the average root-mean-square error between the observed signal and the fitted model by more than 50%. Moreover, the SIR-ME model estimates discriminate between normal and abnormal bowel loops better than the standard parameter estimates.

Deducing the Kinetics of Protein Synthesis In Vivo from the Transition Rates Measured In Vitro

The molecular machinery of life relies on complex multistep processes that involve numerous individual transitions, such as molecular association and dissociation steps, chemical reactions, and mechanical movements. The corresponding transition rates can be typically measured in vitro but not in vivo. Here, we develop a general method to deduce the in-vivo rates from their in-vitro values. The method has two basic components. First, we introduce the kinetic distance, a new concept by which we can quantitatively compare the kinetics of a multistep process in different environments. The kinetic distance depends logarithmically on the transition rates and can be interpreted in terms of the underlying free energy barriers. Second, we minimize the kinetic distance between the in-vitro and the in-vivo process, imposing the constraint that the deduced rates reproduce a known global property such as the overall in-vivo speed. In order to demonstrate the predictive power of our method, we apply it to protein synthesis by ribosomes, a key process of gene expression. We describe the latter process by a codon-specific Markov model with three reaction pathways, corresponding to the initial binding of cognate, near-cognate, and non-cognate tRNA, for which we determine all individual transition rates in vitro. We then predict the in-vivo rates by the constrained minimization procedure and validate these rates by three independent sets of in-vivo data, obtained for codon-dependent translation speeds, codon-specific translation dynamics, and missense error frequencies. In all cases, we find good agreement between theory and experiment without adjusting any fit parameter. The deduced in-vivo rates lead to smaller error frequencies than the known in-vitro rates, primarily by an improved initial selection of tRNA. The method introduced here is relatively simple from a computational point of view and can be applied to any biomolecular process, for which we have detailed information about the in-vitro kinetics.

An augmented Lagrangian based compressed sensing reconstruction for non-Cartesian magnetic resonance imaging without gridding and regridding at every iteration.

BackgroundNon-Cartesian trajectories are used in a variety of fast imaging applications, due to the incoherent image domain artifacts they create when undersampled. While the gridding technique is commonly utilized for reconstruction, the incoherent artifacts may be further removed using compressed sensing (CS). CS reconstruction is typically done using conjugate-gradient (CG) type algorithms, which require gridding and regridding to be performed at every iteration. This leads to a large computational overhead that hinders its applicability.MethodsWe sought to develop an alternative method for CS reconstruction that only requires two gridding and one regridding operation in total, irrespective of the number of iterations. This proposed technique is evaluated on phantom images and whole-heart coronary MRI acquired using 3D radial trajectories, and compared to conventional CS reconstruction using CG algorithms in terms of quantitative vessel sharpness, vessel length, computation time, and convergence rate.ResultsBoth CS reconstructions result in similar vessel length (P = 0.30) and vessel sharpness (P = 0.62). The per-iteration complexity of the proposed technique is approximately 3-fold lower than the conventional CS reconstruction (17.55 vs. 52.48 seconds in C++). Furthermore, for in-vivo datasets, the convergence rate of the proposed technique is faster (60±13 vs. 455±320 iterations) leading to a ∼23-fold reduction in reconstruction time.ConclusionsThe proposed reconstruction provides images of similar quality to the conventional CS technique in terms of removing artifacts, but at a much lower computational complexity.

Fully automated side branch detection in intravascular optical coherence tomography pullback runs.

Side branches in the atherosclerotic lesion region are important as they highly influence the treatment strategy selection and optimization. Moreover, they are reliable landmarks for image registration. By providing high resolution delineation of coronary morphology, intravascular optical coherence tomography (IVOCT) has been increasingly used for side branch analysis. This paper presents a fully automated method to detect side branches in IVOCT images, which relies on precise segmentation of the imaging catheter, the protective sheath, the guide wire and the lumen. 25 in-vivo data sets were used for validation. The intraclass correlation coefficient between the algorithmic results and manual delineations for the imaging catheter, the protective sheath and the lumen contour positions was 0.997, 0.949 and 0.974, respectively. All the guide wires were detected correctly and the Dice's coefficient of the shadow regions behind the guide wire was 0.97. 94.0% of 82 side branches were detected with 5.0% false positives and the Dice's coefficient of the side branch size was 0.85. In conclusion, the presented method has been demonstrated to be accurate and robust for side branch analysis.

Real time dynamic MRI with dynamic total variation.

In this study, we propose a novel scheme for real time dynamic magnetic resonance imaging (dMRI) reconstruction. Different from previous methods, the reconstructions of the second frame to the last frame are independent in our scheme, which only require the first frame as the reference. Therefore, this scheme can be naturally implemented in parallel. After the first frame is reconstructed, all the later frames can be processed as soon as the k-space data is acquired. As an extension of the convention total variation, a new online model called dynamic total variation is used to exploit the sparsity on both spatial and temporal domains. In addition, we design an accelerated reweighted least squares algorithm to solve the challenging reconstruction problem. This algorithm is motivated by the special structure of partial Fourier transform in sparse MRI. The proposed method is compared with 4 state-of-the-art online and offline methods on in-vivo cardiac dMRI datasets. The results show that our method significantly outperforms previous online methods, and is comparable to the offline methods in terms of reconstruction accuracy.

Effect of Data Acquisition and Analysis Method on Fiber Orientation Estimation in Diffusion MRI.

In this paper we investigate the effect of single-shell q-space diffusion sampling strategies and applicable multiple-fiber analysis methods on fiber orientation estimation in Diffusion MRI. Specifically, we develop a simulation based on an in-vivo data set and compare a two-compartment "ball-and-stick" model, a constrained spherical deconvolution approach, a generalized Fourier transform approach, and three related methods based on transforms of Fourier data on the sphere. We evaluate each method for N = 20, 30, 40, 60, 90 and 120 angular diffusion-weighted samples, at SNR = 18 and diffusion-weighting b = 1000s/mm2, common to clinical studies. Our results quantitatively show the methods' are most distinguished from each other by their fiber detection ability. Overall, the "ball-and-stick" model and spherical deconvolution approach were found to perform best, yielding the least orientation error, and greatest detection rate of fibers.

Evaluation of automated statistical shape model based knee kinematics from biplane fluoroscopy

State-of-the-art fluoroscopic knee kinematic analysis methods require the patient-specific bone shapes segmented from CT or MRI. Substituting the patient-specific bone shapes with personalizable models, such as statistical shape models (SSM), could eliminate the CT/MRI acquisitions, and thereby decrease costs and radiation dose (when eliminating CT). SSM based kinematics, however, have not yet been evaluated on clinically relevant joint motion parameters.Therefore, in this work the applicability of SSMs for computing knee kinematics from biplane fluoroscopic sequences was explored. Kinematic precision with an edge based automated bone tracking method using SSMs was evaluated on 6 cadaveric and 10 in-vivo fluoroscopic sequences. The SSMs of the femur and the tibia–fibula were created using 61 training datasets. Kinematic precision was determined for medial–lateral tibial shift, anterior–posterior tibial drawer, joint distraction–contraction, flexion, tibial rotation and adduction. The relationship between kinematic precision and bone shape accuracy was also investigated.The SSM based kinematics resulted in sub-millimeter (0.48–0.81mm) and approximately 1° (0.69–0.99°) median precision on the cadaveric knees compared to bone-marker-based kinematics. The precision on the in-vivo datasets was comparable to that of the cadaveric sequences when evaluated with a semi-automatic reference method. These results are promising, though further work is necessary to reach the accuracy of CT-based kinematics. We also demonstrated that a better shape reconstruction accuracy does not automatically imply a better kinematic precision. This result suggests that the ability of accurately fitting the edges in the fluoroscopic sequences has a larger role in determining the kinematic precision than that of the overall 3D shape accuracy.