A novel fuzzy hierarchical fusion attention convolution neural network for medical image super-resolution reconstruction

Abstract

The clarity of medical images is crucial for doctors to identify and diagnose different diseases. High-resolution images have more detailed information and clearer content than low-resolution images. It is well known that medical images can frequently have some blurred object boundaries, and that traditional deep learning models cannot adequately describe the uncertainty of these blurred boundaries. This paper proposes a new fuzzy metric to characterize the uncertainty of pixels and designs a fuzzy hierarchical fusion attention neural network based on multiscale guided learning. Specifically, a fuzzy neural information-processing block is proposed, which converts an input image into a fuzzy domain using fuzzy membership functions. The uncertainty of the pixels is processed using the proposed fuzzy rules, and then the output of the fuzzy rule layer is fused with the result of the convolution in the neural network. Simultaneously, a multiscale guided-learning dense residual block and pyramidal hierarchical attention module are designed to extract more effective hierarchical image information. Finally, a recurrent memory module with a residual structure is used to process the output features of the hierarchical attention modules. A recursive sub-pixel reconstruction module is used at the tail of the network to reconstruct the images. Compared with existing super-resolution methods using the public COVID-CT dataset, the proposed method demonstrated superior performance in high-resolution medical image reconstruction and reduced the number of parameters and analysis time of the models.