Synthetic Computed Tomography Images Research Articles

Clinical implementation of a commercial synthetic computed tomography solution for radiotherapy treatment of glioblastoma

Background and PurposeMagnetic resonance (MR)-only radiotherapy (RT) workflow eliminates uncertainties due to computed tomography (CT)-MR image registration, by using synthetic CT (sCT) images generated from MR. This study describes the clinical implementation process, from retrospective commissioning to prospective validation stage of a commercial artificial intelligence (AI)-based sCT product. Evaluation of the dosimetric performance of the sCT is presented, with emphasis on the impact of voxel size differences between image modalities. Materials and methodssCT performance was assessed in glioblastoma RT planning. Dose differences for 30 patients in both commissioning and validation cohorts were calculated at various dose-volume-histogram (DVH) points for target and organs-at-risk (OAR). A gamma analysis was conducted on regridded image plans. Quality assurance (QA) guidelines were established based on commissioning phase results. ResultsMean dose difference to target structures was found to be within ± 0.7 % regardless of image resolution and cohort. OARs’ mean dose differences were within ± 1.3 % for plans calculated on regridded images for both cohorts, while differences were higher for plans with original voxel size, reaching up to −4.2 % for chiasma D2% in the commissioning cohort. Gamma passing rates for the brain structure using the criteria 1 %/1mm, 2 %/2mm and 3 %/3mm were 93.6 %/99.8 %/100 % and 96.6 %/99.9 %/100 % for commissioning and validation cohorts, respectively. ConclusionsDosimetric outcomes in both commissioning and validation stages confirmed sCT’s equivalence to CT. The large patient cohort in this study aided in establishing a robust QA program for the MR-only workflow, now applied in glioblastoma RT at our center.

Generation and applications of synthetic computed tomography images for neurosurgical planning.

CT and MRI are synergistic in the information provided for neurosurgical planning. While obtaining both types of images lends unique data from each, doing so adds to cost and exposes patients to additional ionizing radiation after MRI has been performed. Cross-modal synthesis of high-resolution CT images from MRI sequences offers an appealing solution. The authors therefore sought to develop a deep learning conditional generative adversarial network (cGAN) which performs this synthesis. Preoperative paired CT and contrast-enhanced MR images were collected for patients with meningioma, pituitary tumor, vestibular schwannoma, and cerebrovascular disease. CT and MR images were denoised, field corrected, and coregistered. MR images were fed to a cGAN that exported a "synthetic" CT scan. The accuracy of synthetic CT images was assessed objectively using the quantitative similarity metrics as well as by clinical features such as sella and internal auditory canal (IAC) dimensions and mastoid/clinoid/sphenoid aeration. A total of 92,981 paired CT/MR images obtained in 80 patients were used for training/testing, and 10,068 paired images from 10 patients were used for external validation. Synthetic CT images reconstructed the bony skull base and convexity with relatively high accuracy. Measurements of the sella and IAC showed a median relative error between synthetic CT scans and ground truth images of 6%, with greater variability in IAC reconstruction compared with the sella. Aerations in the mastoid, clinoid, and sphenoid regions were generally captured, although there was heterogeneity in finer air cell septations. Performance varied based on pathology studied, with the highest limitation observed in evaluating meningiomas with intratumoral calcifications or calvarial invasion. The generation of high-resolution CT scans from MR images through cGAN offers promise for a wide range of applications in cranial and spinal neurosurgery, especially as an adjunct for preoperative evaluation. Optimizing cGAN performance on specific anatomical regions may increase its clinical viability.

Synthesis of virtual monoenergetic images from kilovoltage peak images using wavelet loss enhanced CycleGAN for improving radiomics features reproducibility.

Dual-energy computed tomography (CT) can provide a range of image information beyond conventional CT through virtual monoenergetic images (VMIs). The purpose of this study was to investigate the impact of material decomposition in detector-based spectral CT on radiomics features and effectiveness of using deep learning-based image synthesis to improve the reproducibility of radiomics features. In this paper, spectral CT image data from 45 esophageal cancer patients were collected for investigation retrospectively. First, we computed the correlation coefficient of radiomics features between conventional kilovoltage peak (kVp) CT images and VMI. Then, a wavelet loss-enhanced CycleGAN (WLL-CycleGAN) with paired loss terms was developed to synthesize virtual monoenergetic CT images from the corresponding conventional single-energy CT (SECT) images for improving radiomics reproducibility. Finally, the radiomic features in 6 different categories, including gray-level co-occurrence matrix (GLCM), gray-level difference matrix (GLDM), gray-level run-length matrix (GLRLM), gray-level size-zone matrix (GLSZM), neighborhood gray-tone difference matrix (NGTDM), and wavelet, were extracted from the gross tumor volumes from conventional single energy CT, synthetic virtual monoenergetic CT images, and virtual monoenergetic CT images. Comparison between errors in the VMI and synthetic VMI (sVMI) suggested that the performance of our proposed deep learning method improved the radiomic feature accuracy. Material decomposition of dual-layer dual-energy CT (DECT) can substantially influence the reproducibility of the radiomic features, and the degree of impact is feature dependent. The average reduction of radiomics errors for 15 patients in testing sets was 96.9% for first-order, 12.1% for GLCM, 12.9% for GLDM, 15.7% for GLRLM, 50.3% for GLSZM, 53.4% for NGTDM, and 6% for wavelet features. The work revealed that material decomposition has a significant effect on the radiomic feature values. The deep learning-based method reduced the influence of material decomposition in VMIs and might improve the robustness and reproducibility of radiomic features in esophageal cancer. Quantitative results demonstrated that our proposed wavelet loss-enhanced paired CycleGAN outperforms the original CycleGAN.

Contouring practices and artefact management within a synthetic CT-based radiotherapy workflow for the central nervous system

BackgroundThe incorporation of magnetic resonance (MR) imaging in radiotherapy (RT) workflows improves contouring precision, yet it introduces geometrical uncertainties when registered with computed tomography (CT) scans. Synthetic CT (sCT) images could minimize these uncertainties and streamline the RT workflow. This study aims to compare the contouring capabilities of sCT images with conventional CT-based/MR-assisted RT workflows, with an emphasis on managing artefacts caused by surgical fixation devices (SFDs).MethodsThe study comprised a commissioning cohort of 100 patients with cranial tumors treated using a conventional CT-based/MR-assisted RT workflow and a validation cohort of 30 patients with grade IV glioblastomas treated using an MR-only workflow. A CE-marked artificial-intelligence-based sCT product was utilized. The delineation accuracy comparison was performed using dice similarity coefficient (DSC) and average Hausdorff distance (AHD). Artefacts within the commissioning cohort were visually inspected, classified and an estimation of thickness was derived using Hausdorff distance (HD). For the validation cohort, boolean operators were used to extract artefact volumes adjacent to the target and contrasted to the planning treatment volume.ResultsThe combination of high DSC (0.94) and low AHD (0.04 mm) indicates equal target delineation capacity between sCT images and conventional CT scans. However, the results for organs at risk delineation were less consistent, likely because of voxel size differences between sCT images and CT scans and absence of standardized delineation routines. Artefacts observed in sCT images appeared as enhancements of cranial bone. When close to the target, they could affect its definition. Therefore, in the validation cohort the clinical target volume (CTV) was expanded towards the bone by 3.5 mm, as estimated by HD analysis. Subsequent analysis on cone-beam CT scans showed that the CTV adjustment was enough to provide acceptable target coverage.ConclusionThe tested sCT product performed on par with conventional CT in terms of contouring capability. Additionally, this study provides both the first comprehensive classification of metal artefacts on a sCT product and a novel method to assess the clinical impact of artefacts caused by SFDs on target delineation. This methodology encourages similar analysis for other sCT products.

TomoRay: Generating Synthetic Computed Tomography of the Spine From Biplanar Radiographs.

Computed tomography (CT) imaging is a cornerstone in the assessment of patients with spinal trauma and in the planning of spinal interventions. However, CT studies are associated with logistical problems, acquisition costs, and radiation exposure. In this proof-of-concept study, the feasibility of generating synthetic spinal CT images using biplanar radiographs was explored. This could expand the potential applications of x-ray machines pre-, post-, and even intraoperatively. A cohort of 209 patients who underwent spinal CT imaging from the VerSe2020 dataset was used to train the algorithm. The model was subsequently evaluated using an internal and external validation set containing 55 from the VerSe2020 dataset and a subset of 56 images from the CTSpine1K dataset, respectively. Digitally reconstructed radiographs served as input for training and evaluation of the 2-dimensional (2D)-to-3-dimentional (3D) generative adversarial model. Model performance was assessed using peak signal to noise ratio (PSNR), structural similarity index (SSIM), and cosine similarity (CS). At external validation, the developed model achieved a PSNR of 21.139 ± 1.018 dB (mean ± standard deviation). The SSIM and CS amounted to 0.947 ± 0.010 and 0.671 ± 0.691, respectively. Generating an artificial 3D output from 2D imaging is challenging, especially for spinal imaging, where x-rays are known to deliver insufficient information frequently. Although the synthetic CT scans derived from our model do not perfectly match their ground truth CT, our proof-of-concept study warrants further exploration of the potential of this technology.

VOARiability: Interobserver and intermodality variability analysis in OAR contouring from head and neck CT and MR images.

Accurate and consistent contouring of organs-at-risk (OARs) from medical images is a key step of radiotherapy (RT) cancer treatment planning. Most contouring approaches rely on computed tomography (CT) images, but the integration of complementary magnetic resonance (MR) modality is highly recommended, especially from the perspective of OAR contouring, synthetic CT and MR image generation for MR-only RT, and MR-guided RT. Although MR has been recognized as valuable for contouring OARs in the head and neck (HaN) region, the accuracy and consistency of the resulting contours have not been yet objectively evaluated. To analyze the interobserver and intermodality variability in contouring OARs in the HaN region, performed by observers with different level of experience from CT and MR images of the samepatients. In the final cohort of 27 CT and MR images of the same patients, contours of up to 31 OARs were obtained by a radiation oncology resident (junior observer, JO) and a board-certified radiation oncologist (senior observer, SO). The resulting contours were then evaluated in terms of interobserver variability, characterized as the agreement among different observers (JO and SO) when contouring OARs in a selected modality (CT or MR), and intermodality variability, characterized as the agreement among different modalities (CT and MR) when OARs were contoured by a selected observer (JO or SO), both by the Dice coefficient (DC) and 95-percentile Hausdorff distance (HD ). The mean (±standard deviation) interobserver variability was 69.0 ± 20.2% and 5.1 ± 4.1mm, while the mean intermodality variability was 61.6 ± 19.0% and 6.1 ± 4.3mm in terms of DC and HD , respectively, across all OARs. Statistically significant differences were only found for specific OARs. The performed MR to CT image registration resulted in a mean target registration error of 1.7 ± 0.5mm, which was considered as valid for the analysis of intermodalityvariability. The contouring variability was, in general, similar for both image modalities, and experience did not considerably affect the contouring performance. However, the results indicate that an OAR is difficult to contour regardless of whether it is contoured in the CT or MR image, and that observer experience may be an important factor for OARs that are deemed difficult to contour. Several of the differences in the resulting variability can be also attributed to adherence to guidelines, especially for OARs with poor visibility or without distinctive boundaries in either CT or MR images. Although considerable contouring differences were observed for specific OARs, it can be concluded that almost all OARs can be contoured with a similar degree of variability in either the CT or MR modality, which works in favor of MR images from the perspective of MR-only and MR-guidedRT.

Evaluation of a deep learning magnetic resonance imaging reconstruction method for synthetic computed tomography generation in prostate radiotherapy

Background and PurposeIn magnetic resonance imaging (MRI) only radiotherapy computed tomography (CT) is excluded. The method relies entirely on synthetic CT images generated from MRI. This study evaluates the compatibility of a commercial synthetic CT (sCT) with an accelerated commercial deep learning reconstruction (DLR) in MRI-only prostate radiotherapy. Materials and MethodsFor a group of 24 patients (cohort 1) the effects of DLR were studied in isolation. MRI data were reconstructed conventionally and with DLR from identical k-space data, and sCTs were generated for both reconstructions. The sCT quality, Hounsfield Unit (HU) and dosimetric impact were investigated. In another group of 15 patients (cohort 2) effects on sCT generation using accelerated MRI acquisition (40 % time reduction) reconstructed with DLR were investigated. ResultssCT images from both cohorts, generated from DLR MRI data, were of clinically expected image quality. The mean dose differences for targets and organs at risks in cohort 1 were <0.06 Gy, corresponding to a 0.1 % prescribed dose difference. Similar dose differences were observed in cohort 2. Gamma pass rates for cohort 1 were 100 % for criteria 3 %/3mm, 2 %/2mm and 1 %/1mm for all dose levels. Mean error and mean absolute error inside the body, between sCTs, averaged over all cohort 1 subjects, were −1.1 ± 0.6 [−2.4 0.2] and 2.9 ± 0.4 [2.3 3.9] HU, respectively. ConclusionsDLR was suitable for sCT generation with clinically negligible differences in HU and calculated dose compared to the conventional MRI reconstruction method. For sCT generation DLR enables scan time reduction, without compromised sCT quality.

Pseudo-Computed Tomography Generation from Noisy Magnetic Resonance Imaging with Deep Learning Algorithm

Purpose: Magnetic Resonance Imaging (MRI) applications offer superior soft tissue contrast compared with Computed Tomography (CT) for accurate radiotherapy planning although MRI images suffer from poor image quality and lack electron density for radiation dose calculation. The present study aims to use the Deep Learning (DL) approach to 1) enhance the quality of MRI images and 2) generate synthetic CT images using MRI images for more accurate radiotherapy planning.&#x0D; Materials and Methods: In this paper, the pix2pix Generative Adversarial Network was utilized to synthesize CT images from noisy MRI images of 20 arbitrarily patients with brain disease. The standard statistical measurements investigated the accuracy comparison of the modeled Hounsfield Unit (HU) value from MRI images and referenced CT of each patient. The famous quality metrics that were used to compare synthetic CTs and referenced CTs were the Mean Absolute eError (MAE), the structural similarity index (SSIM), and the Peak Signal-to-Noise Ratio (PSNR).&#x0D; Results: The higher quality measurements between the synthetic pseudo-CT and the referenced CT images as PSNR and SSIM should correlate with the lower MAE value. For the overall brain among blind test data, the measured peak signal-to-noise ratio, mean absolute error, and structural similarity index values were about 16.5, 28.13, and 93.46, respectively.&#x0D; Conclusion: The proposed method provides an acceptable level of statistical measurements computed on the Pseudo-CT and referenced CT, and it could be concluded that the p-CT can be implemented in radiotherapy treatment planning with acceptable accuracy.

End-to-end validation of fiducial tracking accuracy in robotic radiosurgery using MRI-only simulation imaging.

Image-guided radiation-therapy (IGRT)-based robotic radiosurgery using magnetic resonance imaging (MRI)-only simulation could allow for improved target definition with highly conformal radiotherapy treatments. Fiducial marker (FM)-based alignment is used with robotic radiosurgery treatments of sites such as the prostate because it aids in accurate target localization. Synthetic CT (sCT) images are generated in the MRI-only workflow but FMs used for IGRT appear as signal voids in MRIs and do not appear in MR-generated sCTs, hindering the ability to use sCTs for fiducial-based IGRT. In this study we evaluate the fiducial tracking accuracy for a novel artificial fiducial insertion method in sCT images that allows for fiducial marker tracking in robotic radiosurgery, using MRI-only simulation imaging (MRI-only workflow). Artificial fiducial markers were inserted into sCT images at the site of the real marker implantation as visible in MRI. Two phantoms were used in this study. A custom anthropomorphic pelvis phantom was designed to validate the tracking accuracy for a variety of artificial fiducials in an MRI-only workflow. A head phantom containing a hidden target and orthogonal film pair inserts was used to perform end-to-end tests of artificial fiducial configurations inserted in sCT images. The setup and end-to-end targeting accuracy of the MRI-only workflow were compared to the computed tomography (CT)-based standard. Each phantom had six FMs implanted with a minimum spacing of 2cm. For each phantom a bulk-density sCT was generated, and artificial FMs were inserted at the implantation location. Several methods of FM insertion were tested including: (1) replacing HU with a fixed value (10000HU) (voxel-burned); (2) using a representative fiducial image derived from a linear combination of fiducial templates (composite-fiducial); (3) computationally simulating FM signal voids using a digital phantom containing FMs and inserting the corresponding signal void into sCT images (simulated-fiducial). All tests were performed on a CyberKnife system (Accuray, Sunnyvale, CA). Treatment plans and digital-reconstructed-radiographs were generated from the original CT and sCTs with embedded fiducials and used to align the phantom on the treatment couch. Differences in the initial phantom alignment (3D translations/rotations) and tracking parameters between CT-based plans and sCT-based plans were analyzed. End-to-end plans for both scenarios were generated and analyzed following our clinical protocol. For all plans, the fiducial tracking algorithm was able to identify the fiducial locations. The mean FM-extraction uncertainty for the composite and simulated FMs was below 48% for fiducials in both the anthropomorphic pelvis and end-to-end phantoms, which is below the 70% treatment uncertainty threshold. The total targeting error was within tolerance (<0.95mm) for end-to-end tests of sCT images with the composite and head-on simulated FMs (0.26, 0.44, and 0.35mm for the composite fiducial in sCT, head-on simulated fiducial in sCT, and fiducials in original CT, respectively. MRI-only simulation for robotic radiosurgery could potentially improve treatment accuracy and reduce planning margins. Our study has shown that using a composite-derived or simulated FM in conjunction with sCT images, MRI-only workflow can provide clinically acceptable setup accuracy in line with CT-based standards for FM-based robotic radiosurgery.

Deep-learning-based methods of attenuation correction for SPECT and PET

Attenuation correction (AC) is essential for quantitative analysis and clinical diagnosis of single-photon emission computed tomography (SPECT) and positron emission tomography (PET). In clinical practice, computed tomography (CT) is utilized to generate attenuation maps (μ-maps) for AC of hybrid SPECT/CT and PET/CT scanners. However, CT-based AC methods frequently produce artifacts due to CT artifacts and misregistration of SPECT-CT and PET-CT scans. Segmentation-based AC methods using magnetic resonance imaging (MRI) for PET/MRI scanners are inaccurate and complicated since MRI does not contain direct information of photon attenuation. Computational AC methods for SPECT and PET estimate attenuation coefficients directly from raw emission data, but suffer from low accuracy, cross-talk artifacts, high computational complexity, and high noise level. The recently evolving deep-learning-based methods have shown promising results in AC of SPECT and PET, which can be generally divided into two categories: indirect and direct strategies. Indirect AC strategies apply neural networks to transform emission, transmission, or MR images into synthetic μ-maps or CT images which are then incorporated into AC reconstruction. Direct AC strategies skip the intermediate steps of generating μ-maps or CT images and predict AC SPECT or PET images from non-attenuation-correction (NAC) SPECT or PET images directly. These deep-learning-based AC methods show comparable and even superior performance to non-deep-learning methods. In this article, we first discussed the principles and limitations of non-deep-learning AC methods, and then reviewed the status and prospects of deep-learning-based methods for AC of SPECT and PET.

Automatic generation of subject-specific finite element models of the spine from magnetic resonance images.

The generation of subject-specific finite element models of the spine is generally a time-consuming process based on computed tomography (CT) images, where scanning exposes subjects to harmful radiation. In this study, a method is presented for the automatic generation of spine finite element models using images from a single magnetic resonance (MR) sequence. The thoracic and lumbar spine of eight adult volunteers was imaged using a 3D multi-echo-gradient-echo sagittal MR sequence. A deep-learning method was used to generate synthetic CT images from the MR images. A pre-trained deep-learning network was used for the automatic segmentation of vertebrae from the synthetic CT images. Another deep-learning network was trained for the automatic segmentation of intervertebral discs from the MR images. The automatic segmentations were validated against manual segmentations for two subjects, one with scoliosis, and another with a spine implant. A template mesh of the spine was registered to the segmentations in three steps using a Bayesian coherent point drift algorithm. First, rigid registration was applied on the complete spine. Second, non-rigid registration was used for the individual discs and vertebrae. Third, the complete spine was non-rigidly registered to the individually registered discs and vertebrae. Comparison of the automatic and manual segmentations led to dice-scores of 0.93-0.96 for all vertebrae and discs. The lowest dice-score was in the disc at the height of the implant where artifacts led to under-segmentation. The mean distance between the morphed meshes and the segmentations was below 1mm. In conclusion, the presented method can be used to automatically generate accurate subject-specific spine models.

A study of Bayesian deep network uncertainty and its application to synthetic CT generation for MR-only radiotherapy treatment planning.

The use of synthetic computed tomography (CT) for radiotherapy treatment planning has received considerable attention because of the absence of ionizing radiation and close spatial correspondence to source magnetic resonance (MR) images, which have excellent tissue contrast. However,in an MR-only environment, little effort has been made to examine the quality of synthetic CT images without using the original CT images. To estimate synthetic CT quality without referring to original CT images, this study established the relationship between synthetic CT uncertainty and Bayesian uncertainty, and proposed a new Bayesian deep network for generating synthetic CT images and estimating synthetic CT uncertainty for MR-only radiotherapy treatment planning. A novel deep Bayesian network was formulated using probabilistic network weights. Two mathematical expressions were proposed to quantify the Bayesian uncertainty of the network and synthetic CT uncertainty, which was closely related to the mean absolute error (MAE) in Hounsfield Unit (HU) of synthetic CT. These uncertainties were examined to demonstrate the accuracy of representing the synthetic CT uncertainty using a Bayesian counterpart. We developed a hybrid Bayesian architecture and a new data normalization scheme, enabling the Bayesian network to generate both accurate synthetic CT and reliable uncertainty information when probabilistic weights were applied. The proposed method was evaluated in 59 patients (13/12/32/2 for training/validation/testing/uncertainty visualization) diagnosed with prostate cancer, who underwent same-day pelvic CT- and MR-acquisitions. To assess the relationship between Bayesian and synthetic CT uncertainties, linear and non-linear correlation coefficients were calculated on per-voxel, per-tissue, and per-patient bases. For accessing the accuracy of the CT number and dosimetric accuracy, the proposed method was compared with a commercially available atlas-based method (MRCAT) and a U-Net conditional-generative adversarial network (UcGAN). The proposed model exhibited 44.33 MAE, outperforming UcGAN 52.51 and MRCAT 54.87. The gamma rate (2%/2mm dose difference/distance to agreement) of the proposed model was 98.68%, comparable to that of UcGAN (98.60%) and MRCAT (98.56%). The per-patient and per-tissue linear correlation coefficients between the Bayesian and synthetic CT uncertainties ranged from 0.53 to 0.83, implying a moderate to strong linear correlation. Per-voxel correlation coefficients varied from -0.13 to 0.67 depending on the regions-of-interest evaluated, indicating tissue-dependent correlation. The R2 value for estimating MAE solely using Bayesian uncertainty was 0.98, suggesting that the uncertainty of the proposed model was an ideal candidate for predicting synthetic CT error, without referring to the original CT. This study established a relationship between the Bayesian model uncertainty and synthetic CT uncertainty. A novel Bayesian deep network was proposed to generate a synthetic CT and estimate its uncertainty. Various metrics were used to thoroughly examine the relationship between the uncertainties of the proposed Bayesian model and the generated synthetic CT. Compared with existing approaches, the proposed model showed comparable CT number and dosimetric accuracies. The experiments showed that the proposed Bayesian model was capable of producing accurate synthetic CT, and was an effective indicator of the uncertainty and error associated with synthetic CT in MR-only workflows.

Breath-Hold CBCT-Guided CBCT-to-CT Synthesis via Multimodal Unsupervised Representation Disentanglement Learning.

Adaptive radiation therapy (ART) aims to deliver radiotherapy accurately and precisely in the presence of anatomical changes, in which the synthesis of computed tomography (CT) from cone-beam CT (CBCT) is an important step. However, because of serious motion artifacts, CBCT-to-CT synthesis remains a challenging task for breast-cancer ART. Existing synthesis methods usually ignore motion artifacts, thereby limiting their performance on chest CBCT images. In this paper, we decompose CBCT-to-CT synthesis into artifact reduction and intensity correction, and we introduce breath-hold CBCT images to guide them. To achieve superior synthesis performance, we propose a multimodal unsupervised representation disentanglement (MURD) learning framework that disentangles the content, style, and artifact representations from CBCT and CT images in the latent space. MURD can synthesize different forms of images using the recombination of disentangled representations. Also, we propose a multipath consistency loss to improve structural consistency in synthesis and a multidomain generator to improve synthesis performance. Experiments on our breast-cancer dataset show that MURD achieves impressive performance with a mean absolute error of 55.23±9.94 HU, a structural similarity index measurement of 0.721±0.042, and a peak signal-to-noise ratio of 28.26±1.93 dB in synthetic CT. The results show that compared to state-of-the-art unsupervised synthesis methods, our method produces better synthetic CT images in terms of both accuracy and visual quality.

Evaluating synthetic computed tomography images for adaptive radiotherapy decision making in head and neck cancer.

Adaptive radiotherapy (ART) decision-making benefits from dosimetric information to supplement image inspection when assessing the significance of anatomical changes. This study evaluated a dosimetry-based clinical decision workflow for ART utilizing deformable registration of the original planning computed tomography (CT) image to the daily Cone Beam CT (CBCT) to replace the need for a replan CT for dose estimation. We used 12 retrospective Head & Neck patient cases having a ground truth - a replan CT (rCT) in response to anatomical changes apparent in the daily CBCT - to evaluate the accuracy of dosimetric assessment conducted on synthetic CTs (sCT) generated by deforming the original planning CT Hounsfield Units to the daily CBCT anatomy.The original plan was applied to the sCT and dosimetric accuracy of the sCT was assessed by analyzing plan objectives for targets and organs-at-risk compared to calculations on the ground-truth rCT. Three commercial DIR algorithms were compared. For the best-performing algorithms, the majority of dose metrics calculated on the sCTs differed by less than 4Gy (5.7% of 70Gy prescription dose). An uncertainty of ±2.5Gy (3.6% of 70Gy prescription) is recommended as a conservative tolerance when evaluating dose metrics on sCTs for head and neck. Synthetic CTs present a valuable addition to the adaptive radiotherapy workflow, and synthetic CT dose estimates can be effectively used in addition to the current practice of visually inspecting the overlay of the planning CT and CBCT to assess the significance of anatomical change.

Multimodality MRI synchronous construction based deep learning framework for MRI-guided radiotherapy synthetic CT generation

Synthesizing computed tomography (CT) images from magnetic resonance imaging (MRI) data can provide the necessary electron density information for accurate dose calculation in the treatment planning of MRI-guided radiation therapy (MRIgRT). Inputting multimodality MRI data can provide sufficient information for accurate CT synthesis: however, obtaining the necessary number of MRI modalities is clinically expensive and time-consuming. In this study, we propose a multimodality MRI synchronous construction based deep learning framework from a single T1-weight (T1) image for MRIgRT synthetic CT (sCT) image generation. The network is mainly based on a generative adversarial network with sequential subtasks of intermediately generating synthetic MRIs and jointly generating the sCT image from the single T1 MRI. It contains a multitask generator and a multibranch discriminator, where the generator consists of a shared encoder and a splitted multibranch decoder. Specific attention modules are designed within the generator for feasible high-dimensional feature representation and fusion. Fifty patients with nasopharyngeal carcinoma who had undergone radiotherapy and had CT and sufficient MRI modalities scanned (5550 image slices for each modality) were used in the experiment. Results showed that our proposed network outperforms state-of-the-art sCT generation methods well with the least MAE, NRMSE, and comparable PSNR and SSIM index measure. Our proposed network exhibits comparable or even superior performance than the multimodality MRI-based generation method although it only takes a single T1 MRI image as input, thereby providing a more effective and economic solution for the laborious and high-cost generation of sCT images in clinical applications.

Cross-modality image translation: CT image synthesis of MR brain images using multi generative network with perceptual supervision

Background: Computed tomography (CT) and magnetic resonance imaging (MRI) are the mainstream imaging technologies for clinical practice. CT imaging can reveal high-quality anatomical and physiopathological structures, especially bone tissue, for clinical diagnosis. MRI provides high resolution in soft tissue and is sensitive to lesions. CT combined with MRI diagnosis has become a regular image-guided radiation treatment plan.Methods: In this paper, to reduce the dose of radiation exposure in CT examinations and ameliorate the limitations of traditional virtual imaging technologies, we propose a Generative MRI-to-CT transformation method with structural perceptual supervision. Even though structural reconstruction is structurally misaligned in the MRI-CT dataset registration, our proposed method can better align structural information of synthetic CT (sCT) images to input MRI images while simulating the modality of CT in the MRI-to-CT cross-modality transformation.Results: We retrieved a total of 3416 brain MRI-CT paired images as the train/test dataset, including 1366 train images of 10 patients and 2050 test images of 15 patients. Several methods (the baseline methods and the proposed method) were evaluated by the HU difference map, HU distribution, and various similarity metrics, including the mean absolute error (MAE), structural similarity index (SSIM), peak signal-to-noise ratio (PSNR), and normalized cross-correlation (NCC). In our quantitative experimental results, the proposed method achieves the lowest MAE mean of 0.147, highest PSNR mean of 19.27, and NCC mean of 0.431 in the overall CT test dataset.Conclusions: In conclusion, both qualitative and quantitative results of synthetic CT validate that the proposed method can preserve higher similarity of structural information of the bone tissue of target CT than the baseline methods. Furthermore, the proposed method provides better HU intensity reconstruction for simulating the distribution of the CT modality. The experimental estimation indicates that the proposed method is worth further investigation.

Clinical feasibility of MRI-based synthetic CT imaging in the diagnosis of lumbar disc herniation: a comparative study.

Computed tomography (CT) and magnetic resonance imaging (MRI) are indicated for use in preoperative planning and may complicate diagnosis and place a burden on patients with lumbar disc herniation. To investigate the diagnostic potential of MRI-based synthetic CT with conventional CT in the diagnosis of lumbar disc herniation. After obtaining prior institutional review board approval, 19 patients who underwent conventional and synthetic CT imaging were enrolled in this prospective study. Synthetic CT images were generated from the MRI data using U-net. The two sets of images were compared and analyzed qualitatively by two musculoskeletal radiologists. The images were rated on a 4-point scale to determine their subjective quality. The agreement between the conventional and synthetic images for a diagnosis of lumbar disc herniation was determined independently using the kappa statistic. The diagnostic performances of conventional and synthetic CT images were evaluated for sensitivity, specificity, and accuracy, and the consensual results based on T2-weighted imaging were employed as the reference standard. The inter-reader and intra-reader agreement were almost moderate for all evaluated modalities (κ = 0.57-0.79 and 0.47-0.75, respectively). The sensitivity, specificity, and accuracy for detecting lumbar disc herniation were similar for synthetic and conventional CT images (synthetic vs. conventional, reader 1: sensitivity = 91% vs. 81%, specificity = 83% vs. 100%, accuracy = 87% vs. 91%; P < 0.001; reader 2: sensitivity = 84% vs. 81%, specificity = 85% vs. 98%, accuracy = 84% vs. 90%; P < 0.001). Synthetic CT images can be used in the diagnostics of lumbar disc herniation.

CT synthesis from multi-sequence MRI using adaptive fusion network

ObjectiveTo investigate a method using multi-sequence magnetic resonance imaging (MRI) to synthesize computed tomography (CT) for MRI-only radiation therapy. ApproachWe proposed an adaptive multi-sequence fusion network (AMSF-Net) to exploit both voxel- and context-wise cross-sequence correlations from multiple MRI sequences to synthesize CT using element- and patch-wise fusions, respectively. The element- and patch-wise fusion feature spaces were combined, and the most representative features were selected for modeling. Finally, a densely connected convolutional decoder was applied to utilize the selected features to produce synthetic CT images. Main resultsThis study includes a total number of 90 patients’ T1-weighted MRI, T2-weighted MRI and CT data. The AMSF-Net reduced the average mean absolute error (MAE) from 52.88-57.23 to 49.15 HU, increased the peak signal-to-noise ratio (PSNR) from 24.82-25.32 to 25.63 dB, increased the structural similarity index measure (SSIM) from 0.857-0.869 to 0.878, and increased the dice coefficient of bone from 0.886-0.896 to 0.903 compared to the other three existing multi-sequence learning models. The improvements were statistically significant according to two-tailed paired t-test. In addition, AMSF-Net reduced the intensity difference with real CT in five organs at risk, four types of normal tissue and tumor compared with the baseline models. The MAE decreases in parotid and spinal cord were over 8% and 16% with reference to the mean intensity value of the corresponding organ, respectively. Further, the qualitative evaluations confirmed that AMSF-Net exhibited superior structural image quality of synthesized bone and small organs such as the eye lens. SignificanceThe proposed method can improve the intensity and structural image quality of synthetic CT and has potential for use in clinical applications.

Compensation cycle consistent generative adversarial networks (Comp-GAN) for synthetic CT generation from MR scans with truncated anatomy.

MR scans used in radiotherapy can be partially truncated due to the limited field of view (FOV), affecting dose calculation accuracy in MR-based radiation treatment planning. We proposed a novel Compensation-cycleGAN (Comp-cycleGAN) by modifying the cycle-consistent generative adversarial network (cycleGAN), to simultaneously create synthetic CT (sCT) images and compensate the missing anatomy from the truncated MR images. Computed tomography (CT) and T1 MR images with complete anatomy of 79 head-and-neck patients were used for this study. The original MR images were manually cropped 10-25mm off at the posterior head to simulate clinically truncated MR images. Fifteen patients were randomly chosen for testing and the rest of the patients were used for model training and validation. Both the truncated and original MR images were used in the Comp-cycleGAN training stage, which enables the model to compensate for the missing anatomy by learning the relationship between the truncation and known structures. After the model was trained, sCT images with complete anatomy can be generated by feeding only the truncated MR images into the model. In addition, the external body contours acquired from the CT images with full anatomy could be an optional input for the proposed method to leverage the additional information of the actual body shape for each test patient. The mean absolute error (MAE) of Hounsfield units (HU), peak signal-to-noise ratio (PSNR), and structural similarity index (SSIM) were calculated between sCT and real CT images to quantify the overall sCT performance. To further evaluate the shape accuracy, we generated the external body contours for sCT and original MR images with full anatomy. The Dice similarity coefficient (DSC) and mean surface distance (MSD) were calculated between the body contours of sCT and original MR images for the truncation region to assess the anatomy compensation accuracy. The average MAE, PSNR, and SSIM calculated over test patients were 93.1 HU/91.3 HU, 26.5dB/27.4dB, and 0.94/0.94 for the proposed Comp-cycleGAN models trained without/with body-contour information, respectively. These results were comparable with those obtained from the cycleGAN model which is trained and tested on full-anatomy MR images, indicating the high quality of the sCT generated from truncated MR images by the proposed method. Within the truncated region, the mean DSC and MSD were 0.85/0.89 and 1.3/0.7mm for the proposed Comp-cycleGAN models trained without/with body contour information, demonstrating good performance in compensating the truncated anatomy. We developed a novel Comp-cycleGAN model that can effectively create sCT with complete anatomy compensation from truncated MR images, which could potentially benefit the MRI-based treatment planning.

Frequency-Domain-Based Structure Losses for CycleGAN-Based Cone-Beam Computed Tomography Translation.

Research exploring CycleGAN-based synthetic image generation has recently accelerated in the medical community due to its ability to leverage unpaired images effectively. However, a commonly established drawback of the CycleGAN, the introduction of artifacts in generated images, makes it unreliable for medical imaging use cases. In an attempt to address this, we explore the effect of structure losses on the CycleGAN and propose a generalized frequency-based loss that aims at preserving the content in the frequency domain. We apply this loss to the use-case of cone-beam computed tomography (CBCT) translation to computed tomography (CT)-like quality. Synthetic CT (sCT) images generated from our methods are compared against baseline CycleGAN along with other existing structure losses proposed in the literature. Our methods (MAE: 85.5, MSE: 20433, NMSE: 0.026, PSNR: 30.02, SSIM: 0.935) quantitatively and qualitatively improve over the baseline CycleGAN (MAE: 88.8, MSE: 24244, NMSE: 0.03, PSNR: 29.37, SSIM: 0.935) across all investigated metrics and are more robust than existing methods. Furthermore, no observable artifacts or loss in image quality were observed. Finally, we demonstrated that sCTs generated using our methods have superior performance compared to the original CBCT images on selected downstream tasks.