Hybrid-Supervised Deep Learning for Proton-Acoustic Reconstruction for 3D In Vivo Proton Dose Verification

Abstract

Proton-acoustic (PA) image has shown great potential to provide real-time 3D dose verification of proton therapy. However, the PA image quality suffers from severe limited view artifacts, which significantly impairs its accuracy for dose verification. In this study, we developed a hybrid-supervised deep learning method for PA reconstruction to address the limited-view issues. Our method consists of two stages. In the first stage, a transformer-based network was proposed to reconstruct initial pressure maps from protoacoustic signals. The network was first trained using supervision by the iteratively reconstructed pressure map and then fine-tuned using transfer learning and self-supervision based on the data fidelity constraint. In the second stage, the PA image was further enhanced by a 3D U-net. The final PA images were converted to dose maps using conversion coefficients derived from CT images. Data from 126 prostate cancer patients treated by proton therapy were collected under an IRB protocol and were split into 86 and 40 patients for model training and testing, respectively. Data of each patient contains the planning CT scan, the corresponding clinical treatment plan, and the dose map calculated by commercial software. The radiofrequency signals were generated by performing proton acoustic simulation based on CT images and the ground truth pressure map derived from the treatment plan. An ultrasound detector matrix with 64 × 64 size and 500kHz central frequency was simulated under the perineum to acquire the signals in the prostate area. In the testing results, the method's accuracy was evaluated using Root-mean-squared-error (RMSE) and structural-similarity-index-measure (SSIM) between the reconstructed and ground truth pressure map and dose distribution. Testing results showed that the reconstructed pressure map achieved an average RMSE/SSIM of 0.0292/0.96, demonstrating excellent 3D information with details. Dose maps derived from the pressure map achieved an average RMSE/SSIM of 0.018/0.99 with a gamma index of 94.7% and 95.7% for 1%/3 mm and 1%/5 mm criteria compared to the ground truth dose maps. The reconstruction time was 6s, which can be further reduced using GPU. Our study achieves start-of-the-art performance in the challenging task of direct reconstruction from limited-view radiofrequency signals, demonstrating the great promise of PA imaging as a highly efficient and accurate tool for in-vivo 3D proton dose verification. Such high-precision 3D online dose verification can substantially reduce the range uncertainties of proton therapy to significantly improve its precision and outcomes.