Deep learning CT image restoration using system blur and noise models.

Abstract

Listen

Translate article

The restoration of images affected by blur and noise has been widely studied and has broad potential for applications including in medical imaging modalities such as computed tomography. Recently, deep learning approaches have demonstrated the potential to enhance image quality beyond classic limits; however, most deep learning models attempt a blind restoration problem and base their restoration on image inputs alone without direct knowledge of the image noise and blur properties. We present a method that leverages both degraded image inputs and a characterization of the system's blur and noise to combine modeling and deep learning approaches. Different methods to integrate these auxiliary inputs are presented, namely, an input-variant and a weight-variant approach wherein the auxiliary inputs are incorporated as a parameter vector before and after the convolutional block, respectively, allowing easy integration into any convolutional neural network architecture. The proposed model shows superior performance compared with baseline models lacking auxiliary inputs. Evaluations are based on the average peak signal-to-noise ratio and structural similarity index measure, selected examples of top and bottom 10% performance for varying approaches, and an input space analysis to assess the effect of different noise and blur on performance. In addition, the proposed model exhibits a degree of robustness when the blur and noise parameters deviate from their true values. Results demonstrate the efficacy of providing a deep learning model with auxiliary inputs, representing system blur and noise characteristics, to enhance the performance of the model in image restoration tasks.