No-Reference Image Quality Assessment of Magnetic Resonance images with multi-level and multi-model representations based on fusion of deep architectures

Abstract

Accurate quality assessment of Magnetic Resonance (MR) images is essential for effective medical diagnostics, as it impacts the time spent on image acquisition and image interpretation by radiologists. Therefore, this study aims to provide a novel deep learning-based No-Reference (NR) MR Image Quality Assessment (IQA) method for the quality prediction of MR images. Therefore, in this work, an internal fusion of two complementary deep learning architectures is introduced that offers MR-specific quality-aware features. Apart from obtaining multi-level image representations of joint networks, to further enhance the quality prediction performance, features from re-trained single deep learning architectures are also used. Finally, as one of the main findings of this study, the quality assessment is performed by a high-level quality model trained on scores of quality models obtained for layers of the networks. The superiority of the method against the state-of-the-art techniques is verified by using two publicly available MRIQA benchmarks containing MR images and subjective scores provided by a large number of radiologists. As reported, the method offers superior IQA of MR images as the obtained scores are highly correlated with subjective opinions of medical specialists. It is characterized by the weighted average values of the Spearman Rank-order Correlation Coefficient, Kendall Rank-order Correlation Coefficient, and Pearson Linear Correlation Coefficient of 0.8754, 0.7185, and 0.9062, respectively.