A Generalized Deep Learning Method for Synthetic CT Generation.

Abstract

The application of deep learning to generate synthetic CT (sCT) has been widely studied in radiotherapy. Existing methods generally involve data from two different image modalities, such as CBCT-CT or MRI-CT, the quality of sCT is adversely affected by source image quality. We propose a unique method of synthesizing MRI and CBCT into sCT based on single-modal CT for training, and call it SmGAN. We used planning CT of a group of 35 head and neck cases to as training data. We then applied two different spatial transformations to the planning CT image to produce the transformed CT1 and CT2. And We used a random style enhancement technique (Shuffle Remap) to modify the image distribution of CT1 which we termed CT1+E. CT1+E was used to simulate the patient's "image of the day" while CT2 to simulate the "planning image". After feeding both CT1+E and CT2 into the generator, we obtained the sCT predicted by the generator. The generator was trained using the Mean Absolute Error (MAE) loss between sCT and CT1. In the actual clinical process, we use the patient's CBCT or MRI instead of CT1+E and the patient's planning CT instead of CT2 as the input of the generator. After processing, we get an sCT that can maintain the spatial position of the image taken on the day, while presenting features similar to the planning CT. The evaluation data we have includes 10 pairs of MRI-Def_CT and 10 pairs of CBCT-Def_CT Head and Neck patients. Def_CT is obtained from the planning CT based on the spatial position deformation of MRI and CBCT. To evaluate the accuracy of sCT based on MRI and CBCT with Def CT, we use a range of metrics, including Hounsfield Unit (HU) difference, peak signal-to-noise ratio (PSNR), structural similarity (SSIM) and gamma pass rate. All results will be benchmarks against the advanced method RegGAN for comparison. Compared to RegGAN, the results of SmGAN were significantly better. The mean absolute errors within the body were (44.7±216.2 HU vs. 36.7±131.4 HU) and (64.9±123.7 HU vs. 58.2±152.8 HU) for the CBCT-SCT and MRI-SCT, respectively (Table 1). In addition, experimental results show that SmGAN also outperforms RegGAN in dose calculation accuracy. For example, under the 10% threshold, SmGAN's gamma pass rate of 1mm and 1% is 0.926±0.02, compared with gamma rate of 0.896±0.02 for RegGAN. We proposed a generalized deep learning model for synthetic CT generation, based on CBCT or MRI images. The proposed algorithm achieved high accuracy of dosimetric metrics, as well as excellent IMRT QA verification results. Compared to other existing synthetic CT generation methods, the proposed SmGAN required a single-modal image for training, which is considered as a major breakthrough in the industry, and is expected to have wide spread of clinical applications.