CMM: A CNN-MLP Model for COVID-19 Lesion Segmentation and Severity Grading.

Abstract

In this paper, a CNN-MLP model (CMM) is proposed for COVID-19 lesion segmentation and severity grading in CT images. The CMM starts by lung segmentation using UNet, and then segmenting the lesion from the lung region using a multi-scale deep supervised UNet (MDS-UNet), finally implementing the severity grading by a multi-layer preceptor (MLP). In MDS-UNet, shape prior information is fused with the input CT image to reduce the searching space of the potential segmentation outputs. The multi-scale input compensates for the loss of edge contour information in convolution operations. In order to enhance the learning of multiscale features, the multi-scale deep supervision extracts supervision signals from different upsampling points on the network. In addition, it is empirical that the lesion which has a whiter and denser appearance tends to be more severe in the COVID-19 CT image. So, the weighted mean gray-scale value (WMG) is proposed to depict this appearance, and together with the lung and lesion area to serve as input features for the severity grading in MLP. To improve the precision of lesion segmentation, a label refinement method based on the Frangi vessel filter is also proposed. Comparative experiments on COVID-19 public datasets show that our proposed CMM achieves high accuracy on COVID-19 lesion segmentation and severity grading. Source codes and datasets are available at our GitHub repository (https://github.com/RobotvisionLab/COVID-19-severity-grading.git).