Deformable Registration Research Articles

Deformable Mapping of Rectal Cancer Whole-Mount Histology with Restaging MRI at Voxel Scale: A Feasibility Study.

Purpose To develop a radiology-pathology coregistration method for 1:1 automated spatial mapping between preoperative rectal MRI and ex vivo rectal whole-mount histology (WMH). Materials and Methods This retrospective study included consecutive patients with rectal adenocarcinoma who underwent total neoadjuvant therapy followed by total mesorectal excision with preoperative rectal MRI and WMH from January 2019 to January 2022. A gastrointestinal pathologist and a radiologist established three corresponding levels for each patient at rectal MRI and WMH, subsequently delineating external and internal rectal wall contours and the tumor bed at each level and defining eight point-based landmarks. An advanced deformable image coregistration model based on the linearized iterative boundary reconstruction (LIBR) approach was compared with rigid point-based registration (PBR) and state-of-the-art deformable intensity-based multiscale spectral embedding registration (MSERg). Dice similarity coefficient (DSC), modified Hausdorff distance (MHD), and target registration error (TRE) across patients were calculated to assess the coregistration accuracy of each method. Results Eighteen patients (mean age, 54 years ± 13 [SD]; nine female) were included. LIBR demonstrated higher DSC versus PBR for external and internal rectal wall contours and tumor bed (external: 0.95 ± 0.03 vs 0.86 ± 0.04, respectively, P < .001; internal: 0.71 ± 0.21 vs 0.61 ± 0.21, P < .001; tumor bed: 0.61 ± 0.17 vs 0.52 ± 0.17, P = .001) and versus MSERg for internal rectal wall contours (0.71 ± 0.21 vs 0.63 ± 0.18, respectively; P < .001). LIBR demonstrated lower MHD versus PBR for external and internal rectal wall contours and tumor bed (external: 0.56 ± 0.25 vs 1.68 ± 0.56, respectively, P < .001; internal: 1.00 ± 0.35 vs 1.62 ± 0.59, P < .001; tumor bed: 2.45 ± 0.99 vs 2.69 ± 1.05, P = .03) and versus MSERg for internal rectal wall contours (1.00 ± 0.35 vs 1.62 ± 0.59, respectively; P < .001). LIBR demonstrated lower TRE (1.54 ± 0.39) versus PBR (2.35 ± 1.19, P = .003) and MSERg (2.36 ± 1.43, P = .03). Computation time per WMH slice for LIBR was 35.1 seconds ± 12.1. Conclusion This study demonstrates feasibility of accurate MRI-WMH coregistration using the advanced LIBR method. Keywords: MR Imaging, Abdomen/GI, Rectum, Oncology Supplemental material is available for this article. © RSNA, 2024.

Semi-automatic robotic puncture system based on deformable soft tissue point cloud registration.

Traditional surgical puncture robot systems based on computed tomography (CT) and infrared camera guidance have natural disadvantages for puncture of deformable soft tissues such as the liver. Liver movement and deformation caused by breathing are difficult to accurately assess and compensate by current technical solutions. We propose a semi-automatic robotic puncture system based on real-time ultrasound images to solve this problem. Real-time ultrasound images and their spatial position information can be obtained by robot in this system. By recognizing target tissue in these ultrasound images and using reconstruction algorithm, 3D real-time ultrasound tissue point cloud can be constructed. Point cloud of the target tissue in the CT image can be obtained by using developed software. Through the point cloud registration method based on feature points, two point clouds above are registered. The puncture target will be automatically positioned, then robot quickly carries the puncture guide mechanism to the puncture site and guides the puncture. It takes about just tens of seconds from the start of image acquisition to completion of needle insertion. Patient can be controlled by a ventilator to temporarily stop breathing, and patient's breathing state does not need to be the same as taking CT scan. The average operation time of 24 phantom experiments is 64.5 s, and the average error between the needle tip and the target point after puncture is 0.8mm. Two animal puncture surgeries were performed, and the results indicated that the puncture errors of these two experiments are 1.76mm and 1.81mm, respectively. Robot system can effectively carry out and implement liver tissue puncture surgery, and the success rate of phantom experiments and experiments is 100%. It also shows that the puncture robot system has high puncture accuracy, short operation time, and great clinical value.

Super-resolution reconstruction of time-resolved four-dimensional computed tomography (TR-4DCT) with multiple breathing cycles based on TR-4DMRI.

Respiratory motion irregularities in lung cancer patients are common and can be severe during multi-fractional (∼20 mins/fraction) radiotherapy. However, the current clinical standard of motion management is to use a single-breath respiratory-correlated four-dimension computed tomography (RC-4DCT or 4DCT) to estimate tumor motion to delineate the internal tumor volume (ITV), covering the trajectory of tumor motion, as a treatment target. To develop a novel multi-breath time-resolved (TR) 4DCT using the super-resolution reconstruction framework with TR 4D magnetic resonance imaging (TR-4DMRI) as guidance for patient-specific breathing irregularity assessment, overcoming the shortcomings of RC-4DCT, including binning artifacts and single-breath limitations. Six lung cancer patients participated in the IRB-approved protocol study to receive multiple T1w MRI scans, besides an RC-4DCT scan on the simulation day, including 80 low-resolution (lowR: 5×5×5mm3) free-breathing (FB) 3D cine MRFB images in 40s (2Hz) and a high-resolution (highR: 2×2×2mm3) 3D breath-hold (BH) MRBH image for each patient. A CT (1×1×3mm3) image was selected from 10-bin RC-4DCT with minimal binning artifacts and a close diaphragm match (<1cm) to the MRBH image. A mutual-information-based Freeform deformable image registration (DIR) was used to register the CT and MRBH via the opposite directions (namely F1: and F2: ) to establish CT-MR voxel correspondences. An intensity-based enhanced Demons DIR was then applied for , in which the original MRBH was used in D1: , while the deformed MRBH was used in D2: . The deformation vector fields (DVFs) obtained from each DIR were composed to apply to the deformed CT (D1) and original CT (D2) to reconstruct TR-4DCT images. A digital 4D-XCAT phantom at the end of inhalation (EOI) and end of exhalation (EOE) with 2.5cm diaphragmatic motion and three spherical targets (ϕ=2, 3, 4cm) were first tested to reconstruct TR-4DCT. For each of the six patients, TR-4DCT images at the EOI, middle (MID), and EOE were reconstructed with both D1 and D2 approaches. TR-4DCT image quality was evaluated with mean distance-to-agreement (MDA) at the diaphragm compared with MRFB, tumor volume ratio (TVR) referenced to MRBH, and tumor shape difference (DICE index) compared with the selected input CT. Additionally, differences in the tumor center of mass (|∆COMD1-D2|), together with TVR and DICE comparison, was assessed in the D1 and D2 reconstructed TR-4DCT images. In the phantom, TR-4DCT quality is assessed by MDA=2.0±0.8mm at the diaphragm, TVR=0.8±0.0 for all tumors, and DICE=0.83±0.01, 0.85±0.02, 0.88±0.01 for ϕ=2, 3, 4cm tumors, respectively. In six patients, the MDA in diaphragm match is -1.6±3.1mm (D1) and 1.0±3.9mm (D2) between the reconstructed TR-4DCT and lowR MRFB among 18 images (3 phases/patient). The tumor similarity is TVR=1.2±0.2 and DICE=0.70±0.07 for D1 and TVR=1.4±0.3 (D2) and DICE=0.73±0.07 for D2. The tumor position difference is |∆COMD1-D2|=1.2±0.8mm between D1 and D2 reconstructions. The feasibility of super-resolution reconstruction of multi-breathing-cycle TR-4DCT is demonstrated and image quality at the diaphragm and tumor is assessed in both the 4D-XCAT phantom and six lung cancer patients. The similarity of D1 and D2 reconstruction suggests consistent and reliable DIR results. Clinically, TR-4DCT has the potential for breathing irregularity assessment and dosimetry evaluation in radiotherapy.

PHSOR12 Presentation Time: 9:55 AM: A Novel Method for Validation of MR/TRUS Deformable Registration for Real-Time Needle Guidance in Gynecological HDR Brachytherapy

PHSOR12 Presentation Time: 9:55 AM: A Novel Method for Validation of MR/TRUS Deformable Registration for Real-Time Needle Guidance in Gynecological HDR Brachytherapy

Triple-UNet with attention-based technique for deformable medical image registration

Triple-UNet with attention-based technique for deformable medical image registration

A novel framework for elucidating the effect of mechanical loading on the geometry of ovariectomized mouse tibiae using principal component analysis

IntroductionMurine models are used to test the effect of anti-osteoporosis treatments as they replicate some of the bone phenotypes observed in osteoporotic (OP) patients. The effect of disease and treatment is typically described as changes in bone geometry and microstructure over time. Conventional assessment of geometric changes relies on morphometric scalar parameters. However, being correlated with each other, these parameters do not describe separate fractions of variations and offer only a moderate insight into temporal changes.MethodsThe current study proposes a novel image-based framework that employs deformable image registration on in vivo longitudinal images of bones and Principal Component Analysis (PCA) for improved quantification of geometric effects of OP treatments. This PCA-based model and a novel post-processing of score changes provide orthogonal modes of shape variations temporally induced by a course of treatment (specifically in vivo mechanical loading).Results and DiscussionErrors associated with the proposed framework are rigorously quantified and it is shown that the accuracy of deformable image registration in capturing the bone shapes (∼1 voxel = 10.4 μm) is of the same order of magnitude as the relevant state-of-the-art evaluation studies. Applying the framework to longitudinal image data from the midshaft section of ovariectomized mouse tibia, two mutually orthogonal mode shapes are reliably identified to be an effect of treatment. The mode shapes captured changes of the tibia geometry due to the treatment at the anterior crest (maximum of 0.103 mm) and across the tibia midshaft section and the posterior (0.030 mm) and medial (0.024 mm) aspects. These changes agree with those reported previously but are now described in a compact fashion, as a vector field of displacements on the bone surface. The proposed framework enables a more detailed investigation of the effect of disease and treatment on bones in preclinical studies and boosts the precision of such assessments.

Monte Carlo dose calculation for photon and electron radiotherapy on dynamically deforming anatomy.

Dose calculation in radiotherapy aims to accurately estimate and assess the dose distribution of a treatment plan. Monte Carlo (MC) dose calculation is considered the gold standard owing to its ability to accurately simulate particle transport in inhomogeneous media. However, uncertainties such as the patient's dynamically deforming anatomy can still lead to differences between the delivered and planned dose distribution. Development and validation of a deformable voxel geometry for MC dose calculations (DefVoxMC) to account for dynamic deformation in the dose calculation process of photon- and electron-based radiotherapy treatment plans for clinically motivated cases. DefVoxMC relies on the subdivision of a regular voxel geometry into dodecahedrons. It allows shifting the dodecahedrons' corner points according to the deformation in the patient's anatomy using deformation vector fields (DVF). DefVoxMC is integrated into the Swiss Monte Carlo Plan (SMCP) to allow the MC dose calculation of photon- and electron-based treatment plans on the deformable voxel geometry. DefVoxMC is validated in two steps. A compression test and a Fano test are performed in silico. Delta4 (for photon beams) and EBT4 film measurements in a cubic PMMA phantom (for electron beams) are performed on a TrueBeam in Developer Mode for clinically motivated treatment plans. During these measurements, table motion is used to mimic rigid dynamic patient motion. The measured and calculated dose distributions are compared using gamma passing rate (GPR) (3% / 2mm (global), 10% threshold). DefVoxMC is used to study the impact of patient-recorded breathing motion on the dose distribution for clinically motivated lung and breast cases, each prescribed 50Gy to 50% of the target volume. A volumetric modulated arc therapy (VMAT) and an arc mixed-beam radiotherapy (Arc-MBRT) plan are created for the lung and breast case, respectively. For the dose calculation, the dynamic deformation of the patient's anatomy is described by DVFs obtained from deformable image registration of the different phases of 4DCTs. The resulting dose distributions are compared to the ones of the static situation using dose-volume histograms and dose differences. DefVoxMC is successfully integrated into the SMCP to enable the MC dose calculation of photon- and electron-based treatments on a dynamically deforming patient anatomy. The compression and the Fano test agree within 1.0% and 0.1% with the expected result, respectively. Delta4 and EBT4 film measurements agree with the calculated dose by a GPR>95%. For the clinically motivated cases, breathing motion resulted in areas with a dose increase of up to 26.9Gy (lung) and up to 7.6Gy (breast) compared to the static situation. The largest dose differences are observed in high-dose-gradient regions perpendicular to the beam plane, consequently decreasing the planning target volume coverage (V95%) by 4.2% for the lung case and 2.0% for the breast case. A novel method for MC dose calculation for photon- and electron-based treatments on dynamically deforming anatomy is successfully developed and validated. Applying DefVoxMC to clinically motivated cases, we found that breathing motion has non-negligible impact on the dosimetric plan quality.

Three-dimensional characterization of sex differences in abdominal aortic aneurysm progression via vascular deformation mapping

Although abdominal aortic aneurysms (AAA) are more common in men, women are at greater risk for AAA growth/rupture. Vascular deformation mapping (VDM) utilizes deformable image registration to qualify and quantify 3D-AAA growth using computed tomography angiograms (CTA). In this study we leveraged VDM to investigate sex differences in AAA growth patterns. Patients with infra-renal AAA and ≥ 2 CTA were identified. Males and females were matched for age, hypertension, and smoking history. Patient characteristics, maximum diameter (Dmax), and AAA volume were obtained. CTA images were segmented, and VDM was conducted to quantify 3D AAA growth rate per year (GR, cm/year). Statistical shape modeling was utilized to compute mean aneurysm shapes and 3D GR. Average GR was evaluated at specific regions of the aortic surface for males and females. Seventeen males and 17 females were matched. At the individual level, there were no sex differences in changes in Dmax or AAA volume. However, females had larger GR across the anterior and right lateral AAA (1.33 vs 0.89 and 1.56 vs 0.74 cm/year, respectively), despite no difference in posterior or left lateral AAA GR. Despite comparable changes in Dmax, AAA volume, and GR magnitude, women demonstrated a more eccentric, anterior-predominant, AAA growth pattern.

A comparative study on automatic treatment planning for online adaptive proton therapy of esophageal cancer: which combination of deformable registration and deep learning planning tools performs the best?

Objective.To demonstrate the feasibility of integrating fully-automated online adaptive proton therapy strategies (OAPT) within a commercially available treatment planning system and underscore what limits their clinical implementation. These strategies leverage existing deformable image registration (DIR) algorithms and state-of-the-art deep learning (DL) networks for organ segmentation and proton dose prediction.Approach.Four OAPT strategies featuring automatic segmentation and robust optimization were evaluated on a cohort of 17 patients, each undergoing a repeat CT scan. (1) DEF-INIT combines deformably registered contours with template-based optimization. (2) DL-INIT, (3) DL-DEF, and (4) DL-DL employ a nnU-Net DL network for organ segmentation and a controlling ROIs-guided DIR algorithm for internal clinical target volume (iCTV) segmentation. DL-INIT uses this segmentation alongside template-based optimization, DL-DEF integrates it with a dose-mimicking (DM) step using a reference deformed dose, and DL-DL merges it with DM on a reference DL-predicted dose. All strategies were evaluated on manual contours and contours used for optimization and compared with manually adapted plans. Key dose volume metrics like iCTV D98% are reported.Main results.iCTV D98% was comparable in manually adapted plans and for all strategies in nominal cases but dropped to 20 Gy in worst-case scenarios for a few patients per strategy, highlighting the need to correct segmentation errors in the target volume. Evaluations on optimization contours showed minimal relative error, with some outliers, particularly in template-based strategies (DEF-INIT and DL-INIT). DL-DEF achieves a good trade-off between speed and dosimetric quality, showing a passing rate (iCTV D98% > 94%) of 90% when evaluated against 2, 4 and 5 mm setup error and of 88% when evaluated against 7 mm setup error. While template-based methods are more rigid, DL-DEF and DL-DL have potential for further enhancements with proper DM algorithm tuning.Significance.Among investigated strategies, DL-DEF and DL-DL demonstrated promising within 10 min OAPT implementation results and significant potential for improvements.

Evaluation of cumulative dose distributions from external beam radiation therapy using CT-to-CBCT deformable image registration (DIR) for cervical cancer patients.

To investigate dose differences between the planning CT (pCT) and dose calculated on pre-treatment verification CBCTs using DIR and dose summation for cervical cancer patients. Cervical cancer patients treated at our institution with 45Gy EBRT undergo a pCT and 5 CBCTs, once every five fractions of treatment. A free-form intensity-based DIR in MIM was performed between the pCT and each CBCT using the "Merged CBCT" feature to generate an extended FOV-CBCT (mCBCT). DIR-generated bladder and rectum contours were adjusted by a physician, and dice similarity coefficients (DSC) were calculated. After deformation, the investigated doses were (1) recalculated in Eclipse using original plan parameters (ecD), and (2) deformed from planning dose (pD) using the deformation matrix in MIM (mdD). Dose summation was performed to the first week's mCBCT. Dose distributions were compared for the bladder, rectum, and PTV in terms of percent dose difference, dose volume histograms (DVHs), and gamma analysis between the calculated doses. For the 20 patients, the mean DSC was 0.68±0.17 for bladder and 0.79±0.09 for rectum. Most patients were within 5% of pD for D2cc (19/20), Dmax (17/20), and Dmean (16/20). All patients demonstrated a percent difference>5% for bladder V45 due to variations in bladder volume from the pCT. D90 showed fewer differences with 19/20 patients within 2% of pD. Gamma rates between pD and ecD averaged 94% for bladder and 94% for rectum, while pD and mdD exhibited slightly better performance for bladder (93%) and lower for rectum (85%). Using DIR with weekly CBCT images, the MIM deformed dose (mdD) was found to be in close agreement with the Eclipse calculated dose (ecD). The proposed workflow should be used on a case-by-case basis when the weekly CBCT shows marked difference in organs-at-risk from the planning CT.

Evaluation of the impact of cardiac implantable electronic devices on cine MRI for real-time adaptive cardiac radioablation on a 1.5 T MR-linac.

Stereotactic arrhythmia radioablation (STAR) is a novel treatment approach for refractory ventricular tachycardia (VT). The risk of treatment-induced toxicity and geographic miss can be reduced with online MRI-guidance on an MR-linac. However, most VT patients carry cardiac implantable electronic devices (CIED), which compromise MRimages. Robust MR-linac imaging sequences are required for cardiac visualization and accurate motion monitoring in presence of a CIED during MRI-guided STAR. We optimized two clinically available cine sequences for cardiorespiratory motion estimation in presence of a CIED on a 1.5 T MR-linac. The image quality, motion estimation accuracy, and geometric fidelity using these cine sequences wereevaluated. Clinically available 2D balanced steady-state free precession (bSSFP, voxel size = 3.0 3.0 10 mm3, Tscan = 96 ms, bandwidth (BW) = 1884 Hz/px) and -spoiled gradient echo ( -GRE, voxel size = 4.0 4.0 10 mm3, Tscan = 97 ms, BW = 500 Hz/px) sequences were adjusted for real-time cardiac visualization and cardiorespiratory motion estimation on a 1.5 T Unity MR-linac (Elekta AB, Stockholm, Sweden), while complying with safety guidelines for MRI in presence of CIEDs (specific absorption rate 2 W/kg and 80 mT/s). Cine acquisitions were performed in five healthy volunteers, with and without an implantable cardioverter- defibrillator (ICD) placed on the clavicle, and a VT patient. Generalized divergence-curl (GDC) deformable image registration (DIR) was used for automated landmark motion estimation in the left ventricle (LV). Gaussian processes (GP), a machine-learning technique, was trained using GDC landmarks and deployed for real-time cardiorespiratory motion prediction. -mapping was performed to assess geometric image fidelity in the presence ofCIEDs. CIEDs introduced banding artifacts partially obscuring cardiac structures in bSSFP acquisitions. In contrast, the -GRE was more robust to CIED-induced artifacts at the expense of a lower signal-to-noise ratio. In presence of an ICD, image-based cardiorespiratory motion estimation was possible for 85% (100%) of the volunteers using the bSSFP ( -GRE) sequence. The in-plane 2D root-mean-squared deviation (RMSD) range between GDC-derived landmarks and manual annotations using the bSSFP (T1-GRE) sequence was 3.1-3.3 (3.3-4.1) mm without ICD and 4.6-4.6 (3.2-3.3) mm with ICD. Without ICD, the RMSD between the GP-predictions and GDC-derived landmarks ranged between 0.9 and 2.2 mm (1.3-3.0 mm) for the bSSFP (T1-GRE) sequence. With ICD, the RMSD between the GP-predictions and GDC-derived landmarks ranged between 1.3 and 2.2 mm (1.2-3.2 mm) using the bSSFP (T1-GRE) sequence resulting in an RMSD-increase of 42%-143% (bSSFP) and -61%-142% (T1-GRE). Lead-induced spatial distortions ranged between -0.2 and 0.2 mm (-0.7-1.2 mm) using the bSSFP ( -GRE) sequence. The 98th percentile range of the spatial distortions in the gross target volume of the patient was between 0.0 and 0.4 mm (0.0-1.8 mm) when using bSSFP ( -GRE). Tailored bSSFP and -GRE sequences can facilitate real-time cardiorespiratory estimation using GP trained with GDC-derived landmarks in the majority of landmark locations in the LV despite the presence of CIEDs. The need for high temporal resolution noticeably reduced achievable spatial resolution of the cine MRIs. However, the effect of the CIED-induced artifacts is device, patient and sequence dependent and requires specific assessment percase.

Comparison of translation algorithms in determining maximum allowable CTV shifts for Real-Time Gated Proton Therapy (RGPT) robustness evaluation in prostate cancers.

Real-Time Gated Proton Therapy (RGPT) is an active motion management technique that utilizes treatment gating and tumor tracking via fiducial markers. When performing RGPT treatment for prostate cancer, it is essential to account for the CTV displacement relative to the body in the clinical workflow. The workflow at the National Cancer Centre Singapore (NCCS) includes bone matching via CT-CBCT images, followed by fiducial matching via pulsed fluoroscopy (soft tissue matching), and finally, a robustness evaluation procedure to determine if the difference is within an allowable tolerance. In this study, we compare two CTV translation methods for robustness evaluation: (1) an in-house translation algorithm and (2) the RayStation "simulate organ motion" Deformable image registration (DIR) algorithm. Nine RGPT prostate patient plans with CTV volumes ranging from 17.1 to 96.72 cm2 were included in this study. An in-house translation algorithm and "simulate organ motion" DIR RayStation algorithm were used to generate CTV shifts along R-L, I-S, and P-A axes between 10mm at 2mm steps. At each step, dose metrics, which include CTV Dmax, CTV D95%, and CTV D98%, were extracted and used as comparative metrics for CTV target coverage and hot spot evaluation. Across all axes, there were no statistically significant differences between the two algorithms for all three dose metrics: CTV Dmax (P=0.92, P=0.91, and P=0.47), CTV D95% (P=0.97, P=0.22, and P=0.33), and CTV D98% (P=0.85, P=0.33, and P=0.36). Further, the in-house translation algorithm evaluation time was less than 10s, two orders of magnitude faster than the DIR algorithm. Our results demonstrate that the simpler in-house algorithm performs equivalently to the realistic DIR algorithm when simulating CTV motion in prostate cancers. Furthermore, the in-house algorithm completes the robustness evaluation two orders of magnitude faster than the DIR algorithm. This significant reduction in evaluation time is crucial especially when preparatory time efficiency is of paramount importance in a busy clinic.

Integrated framework for quantitative T2-weighted MRI analysis following prostate cancer radiotherapy

PurposeThe aim of this study is to develop a framework for quantitative analysis of longitudinal T2-weighted MRIs (T2w) following radiotherapy (RT) for prostate cancer. Materials and methodsThe developed methodology includes: (i) deformable image registration of longitudinal series to pre-RT T2w for automated detection of prostate, peripheral zone (PZ), and gross tumor volume (GTV); and (ii) T2w signal-intensity harmonization based on three reference tissues. The REgistration and HARMonization (REHARM) framework was applied on T2w acquired in a clinical trial consisting of two pre-RT and three post-RT MRI exams. Image registration was assessed by the DICE coefficient between automatic and manual contours, and intensity normalization via inter-patient histogram intersection. Longitudinal consistency was evaluated by the repeatability coefficient and Pearson correlation (r) between the two T2w exams before RT. ResultsT2w from 107 MRI exams (23 patients) were utilized. Following REHARM, the histogram intersections for prostate, PZ and GTV increased from median = 0.43/0.16/0.13 to 0.66/0.44/0.46. The repeatability in T2w intensity estimation was better for the automatic than the manual contours for all three ROIs (r = 0.9, p < 0.0001, for GTV). The changes in the tissues’ T2w values pre- and post-RT became significant, indicating the measurable quantitative signal related to radiation. ConclusionsThe developed methodology allows to automate longitudinal analysis reducing data acquisition-related variation and improving consistency. The quantitative characterization of RT-induced changes in T2w will lead to new understanding of radiation effects enabling prediction modeling of RT response.

Adaptive assessment based on fractional CBCT images for cervical cancer.

Anatomical and other changes during radiotherapy will cause inaccuracy of dose distributions, therefore the expectation for online adaptive radiation therapy (ART) is high in effectively reducing uncertainties due to intra-variation. However, ART requires extensive time and effort. This study investigated an adaptive assessment workflow based on fractional cone-beam computed tomography (CBCT) images. Image registration, synthetic CT (sCT) generation, auto-segmentation, and dose calculation were implemented and integrated into ArcherQA Adaptive Check. The rigid registration was based on ITK open source. The deformable image registration (DIR) method was based on a 3D multistage registration network, and the sCT generation method was performed based on a 2D cycle-consistent adversarial network (CycleGAN). The auto-segmentation of organs at risk (OARs) on sCT images was finished by a deep learning-based auto-segmentation software, DeepViewer. The contours of targets were obtained by the structure-guided registration. Finally, the dose calculation was based on a GPU-based Monte Carlo (MC) dose code, ArcherQA. The dice similarity coefficient (DSCs) were over 0.86 for target volumes and over 0.79 for OARs. The gamma pass rate of ArcherQA versus Eclipse treatment planning system was more than 99% at the 2%/2mm criterion with a low-dose threshold of 10%. The time for the whole process was less than 3 min. The dosimetric results of ArcherQA Adaptive Check were consistent with the Ethos scheduled plan, which can effectively identify the fractions that need the implementation of the Ethos adaptive plan. This study integrated AI-based technologies and GPU-based MC technology to evaluate the dose distributions using fractional CBCT images, demonstrating remarkably high efficiency and precision to support future ART processes.

SparseMorph: A weakly-supervised lightweight sparse transformer for mono- and multi-modal deformable image registration

PurposeDeformable image registration (DIR) is crucial for improving the precision of clinical diagnosis. Recent Transformer-based DIR methods have shown promising performance by capturing long-range dependencies. Nevertheless, these methods still grapple with high computational complexity. This work aims to enhance the performance of DIR in both computational efficiency and registration accuracy. MethodsWe proposed a weakly-supervised lightweight Transformer model, named SparseMorph. To reduce computational complexity without compromising the representative feature capture ability, we designed a sparse multi-head self-attention (SMHA) mechanism. To accumulate representative features while preserving high computational efficiency, we constructed a multi-branch multi-layer perception (MMLP) module. Additionally, we developed an anatomically-constrained weakly-supervised strategy to guide the alignment of regions-of-interest in mono- and multi-modal images. ResultsWe assessed SparseMorph in terms of registration accuracy and computational complexity.Within the mono-modal brain datasets IXI and OASIS, our SparseMorph outperforms the state-of-the-art method TransMatch with improvements of 3.2 % and 2.9 % in DSC scores for MRI-to-CT registration tasks, respectively. Moreover, in the multi-modal cardiac dataset MMWHS, our SparseMorph shows DSC score improvements of 9.7 % and 11.4 % compared to TransMatch in MRI-to-CT and CT-to-MRI registration tasks, respectively. Notably, SparseMorph attains these performance advantages while utilizing 33.33 % of the parameters of TransMatch. ConclusionsThe proposed weakly-supervised deformable image registration model, SparseMorph, demonstrates efficiency in both mono- and multi-modal registration tasks, exhibiting superior performance compared to state-of-the-art algorithms, and establishing an effective DIR method for clinical applications.

DELR-Net: a network for 3D multimodal medical image registration in more lightweight application scenarios.

3D multimodal medical image deformable registration plays a significant role in medical image analysis and diagnosis. However, due to the substantial differences between images of different modalities, registration is challenging and requires high computational costs. Deep learning-based registration methods face these challenges. The primary aim of this paper is to design a 3D multimodal registration network that ensures high-quality registration results while reducing the number of parameters. This study designed a Dual-Encoder More Lightweight Registration Network (DELR-Net). DELR-Net is a low-complexity network that integrates Mamba and ConvNet. The State Space Sequence Module and the Dynamic Large Kernel block are used as the main components of the dual encoders, while the Dynamic Feature Fusion block is used as the main component of the decoder. This study conducted experiments on 3D brain MR images and abdominal MR and CT images. Compared to existing registration methods, DELR-Net achieved better registration results while maintaining a lower number of parameters. Additionally, generalization experiments on other modalities showed that DELR-Net has superior generalization capabilities. DELR-Net significantly improves the limitations of 3D multimodal medical image deformable registration, achieving better registration performance with fewer parameters.

MA-VoxelMorph: Multi-scale attention-based VoxelMorph for nonrigid registration of thoracoabdominal CT images

This paper aims to develop a nonrigid registration method of preoperative and intraoperative thoracoabdominal CT images in computer-assisted interventional surgeries for accurate tumor localization and tissue visualization enhancement. However, fine structure registration of complex thoracoabdominal organs and large deformation registration caused by respiratory motion is challenging. To deal with this problem, we propose a 3D multi-scale attention VoxelMorph (MA-VoxelMorph) registration network. To alleviate the large deformation problem, a multi-scale axial attention mechanism is utilized by using a residual dilated pyramid pooling for multi-scale feature extraction, and position-aware axial attention for long-distance dependencies between pixels capture. To further improve the large deformation and fine structure registration results, a multi-scale context channel attention mechanism is employed utilizing content information via adjacent encoding layers. Our method was evaluated on four public lung datasets (DIR-Lab dataset, Creatis dataset, Learn2Reg dataset, OASIS dataset) and a local dataset. Results proved that the proposed method achieved better registration performance than current state-of-the-art methods, especially in handling the registration of large deformations and fine structures. It also proved to be fast in 3D image registration, using about 1.5 s, and faster than most methods. Qualitative and quantitative assessments proved that the proposed MA-VoxelMorph has the potential to realize precise and fast tumor localization in clinical interventional surgeries.

Gaussianmorph: deformable medical image registration with Gaussian noise constraints

Gaussianmorph: deformable medical image registration with Gaussian noise constraints

MUsculo-Skeleton-Aware (MUSA) deep learning for anatomically guided head-and-neck CT deformable registration

Deep-learning-based deformable image registration (DL-DIR) has demonstrated improved accuracy compared to time-consuming non-DL methods across various anatomical sites. However, DL-DIR is still challenging in heterogeneous tissue regions with large deformation. In fact, several state-of-the-art DL-DIR methods fail to capture the large, anatomically plausible deformation when tested on head-and-neck computed tomography (CT) images. These results allude to the possibility that such complex head-and-neck deformation may be beyond the capacity of a single network structure or a homogeneous smoothness regularization. To address the challenge of combined multi-scale musculoskeletal motion and soft tissue deformation in the head-and-neck region, we propose a MUsculo-Skeleton-Aware (MUSA) framework to anatomically guide DL-DIR by leveraging the explicit multiresolution strategy and the inhomogeneous deformation constraints between the bony structures and soft tissue. The proposed method decomposes the complex deformation into a bulk posture change and residual fine deformation. It can accommodate both inter- and intra- subject registration. Our results show that the MUSA framework can consistently improve registration accuracy and, more importantly, the plausibility of deformation for various network architectures. The code will be publicly available at https://github.com/HengjieLiu/DIR-MUSA.

Regional deep atrophy: Using temporal information to automatically identify regions associated with Alzheimer’s disease progression from longitudinal MRI

Abstract Longitudinal assessment of brain atrophy, particularly in the hippocampus, is a well-studied biomarker for neurodegenerative diseases, such as Alzheimer’s disease (AD). Estimating brain progression patterns can be applied to understanding the therapeutic effects of amyloid-clearing drugs in research and detecting the earliest sign of accelerated atrophy in clinical settings. However, most state-of-the-art measurements calculate changes directly by segmentation and/or deformable registration of MRI images, and may misreport head motion or MRI artifacts as neurodegeneration, impacting their accuracy. In our previous study, we developed a deep learning method DeepAtrophy that uses a convolutional neural network to quantify differences between longitudinal MRI scan pairs that are associated with time. DeepAtrophy has high accuracy in inferring temporal information from longitudinal MRI scans, such as temporal order or relative interscan interval. DeepAtrophy also provides an overall atrophy score that was shown to perform well as a potential biomarker of disease progression and treatment efficacy. However, DeepAtrophy is not interpretable, and it is unclear what changes in the MRI contribute to progression measurements. In this paper, we propose Regional Deep Atrophy (RDA), which combines the temporal inference approach from DeepAtrophy with a deformable registration neural network and attention mechanism that highlights regions in the MRI image where longitudinal changes are contributing to temporal inference. RDA has similar prediction accuracy as DeepAtrophy, but its additional interpretability makes it more acceptable for use in clinical settings, and may lead to more sensitive biomarkers for disease monitoring and progression understanding in preclinical AD.