Accelerating Volumetric CT and MRI Imaging by Reference-Free Deep Learning Transformation from Low-Resolution to High-Resolution

Abstract

High-resolution (HR) images are important in precision radiation oncology. However, acquiring HR volumetric CT and MRI images is often time consuming; also, the resolution in some direction(s) (e.g., z-direction in the case of CT) is often limited by imaging hardware or fundamental imaging principle. Super-resolution (SR) imaging, i.e., the low-resolution (LR) to HR image transformation, is widely used to improve image resolution. Data-driven deep learning (DL) methods have achieved great success in SR imaging, yet they can hardly be applied to medical imaging as they require large amount of LR-HR image pairs to train the model. We therefore propose a reference-free DL method to increase resolutions of volumetric medical images in an efficient way. We propose a maximum likelihood estimation (MLE)-based implicit neural representation (INR) network for SR imaging. The INR network aims to represent an image as a continuous function parameterized by a coordinate-based multi-layer perceptron. The INR network takes image coordinates as input and outputs corresponding pixel intensities. To train the network without using any HR images, we use a MLE framework to model LR observations' statistics and their relation to the latent HR image. The predicted HR image from the INR's output is transformed to LR images based on the MLE, and the network parameters are then optimized by minimizing the distance between the transformed LR images and actual LR observations. We demonstrate the efficacy of the proposed method on CT and MRI images for 2x, 4x, and 8x SR using only one or two LR image(s). The performance is compared with a conventional SR method named plain MLE, in terms of visual quality and numerical qualities of PSNR and SSIM. Our method outperformed the plain MLE method in the experiment. Table 1 reports the numerical improvements of our method over the compared plain MLE method. For 2x SR with a single LR image, our method achieved significant improvements in both PSNR and SSIM. When using two LR images, the better structural restoration capability of our method became more obvious with higher SR magnifications, as indicated by the increased SSIM differences. Better noise suppression capability of our method is observed in all our studies, as indicated by the PSNR values. In visual quality evaluation, we observed sharper image details with less noise in SR images generated by the proposed method, compared with the plain MLE method. The proposed novel reference-free DL method can efficiently provide high-quality HR images with only one or two LR images for CT and MRI imaging. This method can be easily generalized to many other radiation therapy related applications without the requirement for HR reference images.