Channelized Hotelling Observer Research Articles

Automated Web-based Software for CT Quality Control Testing of Low-contrast Detectability using Model Observers.

The Channelized Hotelling observer (CHO) is well correlated with human observer performance in many CT detection/classification tasks but has not been widely adopted in routine CT quality control and performance evaluation, mainly because of the lack of an easily available, efficient, and validated software tool. We developed a highly automated solution - CT image quality evaluation and Protocol Optimization (CTPro), a web-based software platform that includes CHO and other traditional image quality assessment tools such as modulation transfer function and noise power spectrum. This tool can allow easy access to the CHO for both the research and clinical community and enable efficient, accurate image quality evaluation without the need of installing additional software. Its application was demonstrated by comparing the low-contrast detectability on a clinical photon-counting-detector (PCD)-CT with a traditional energy-integrating-detector (EID)-CT, which showed UHR-T3D had 6.2% higher d' than EID-CT with IR (p = 0.047) and 4.1% lower d' without IR (p = 0.122).

DEMIST: A Deep-Learning-Based Detection-Task-Specific Denoising Approach for Myocardial Perfusion SPECT.

There is an important need for methods to process myocardial perfusion imaging (MPI) single-photon emission computed tomography (SPECT) images acquired at lower-radiation dose and/or acquisition time such that the processed images improve observer performance on the clinical task of detecting perfusion defects compared to low-dose images. To address this need, we build upon concepts from model-observer theory and our understanding of the human visual system to propose a detection task-specific deep-learning-based approach for denoising MPI SPECT images (DEMIST). The approach, while performing denoising, is designed to preserve features that influence observer performance on detection tasks. We objectively evaluated DEMIST on the task of detecting perfusion defects using a retrospective study with anonymized clinical data in patients who underwent MPI studies across two scanners (N = 338). The evaluation was performed at low-dose levels of 6.25%, 12.5%, and 25% and using an anthropomorphic channelized Hotelling observer. Performance was quantified using area under the receiver operating characteristics curve (AUC). Images denoised with DEMIST yielded significantly higher AUC compared to corresponding low-dose images and images denoised with a commonly used task-agnostic deep learning-based denoising method. Similar results were observed with stratified analysis based on patient sex and defect type. Additionally, DEMIST improved visual fidelity of the low-dose images as quantified using root mean squared error and structural similarity index metric. A mathematical analysis revealed that DEMIST preserved features that assist in detection tasks while improving the noise properties, resulting in improved observer performance. The results provide strong evidence for further clinical evaluation of DEMIST to denoise low-count images in MPI SPECT.

Channelized hotelling observer-based low-contrast detectability on the ACR CT accreditation phantom: Part II. Repeatability study.

Objective and quantitative evaluation for low-contrast detectability that correlates with human observer performance is lacking for routine CT quality control testing. Channelized Hotelling observer (CHO) is considered a strong candidate to fill the need but has long been deemed impractical to implement due to its requirement of a large number of repeated scans in order to provide accurate and precise estimates of index of detectability (d'). In our previous work, we optimized a CHO model observer on the American College of Radiology (ACR) CT accreditation phantom and achieved accurate measurement of d' with only 1-3 repeat scans. In this work, we aim to validate the repeatability of the proposed CHO-based low-contrast evaluation on four scanner models using the ACR CT accreditation phantom. The repeatability test was performed on four different scanners from two major CT manufacturers: Siemens Force and Alpha; Canon Prism and Prime SP. An ACR CT phantom was scanned 10 times, each time after repositioning of the phantom. For each repositioning, 3 repeated scans were acquired at 24, 12, and 6 mGy on all four scanner models. CHO was applied at the measured dose levels for different low-contrast object sizes (4-6mm). The CHO was also applied to images created using deep learning-based reconstructions on Canon Prism and to four different scan/reconstruction modes on the Siemens Alpha, a photon-counting-detector (PCD)-CT. The repeatability was evaluated by the probability that a measurement would fall within the±15% tolerance (P<15% ). With the CHO setting optimized for the ACR phantom and the use of 3 repeated scans and 9 non-overlapping slices per scan, the CHO measurement could provide high repeatability with P<15% of 98.8%-99.9% at 12 mGy with IR reconstruction on all four scanners. On scanner A, P<15% were 91.5%-99.9% at the three dose levels and for all three object sizes while the numbers were 93.6%-99.998% on scanner B. P<15% were 96.5%-97.2% for the two deep learning reconstructions and 97.0%-99.97% for the four scan/reconstruction modes on the PCD-CT. The CHO provided highly repeatable measurements with over 95% probability that a CHO measurement would lie within the±15% tolerance for most of the dose levels and object sizes on the ACR phantom. The repeatability was maintained when the CHO was applied to images created with a commercial deep learning-based reconstruction and various scan/reconstruction modes on a PCD-CT. This study demonstrates that practical implementation of CHO for routine quality control and performance evaluation is feasible.

Spatio-Temporal Positron Emission Tomography Reconstruction with Attenuation and Motion Correction.

The detection of cancer lesions of a comparable size to that of the typical system resolution of modern scanners is a long-standing problem in Positron Emission Tomography. In this paper, the effect of composing an image-registering convolutional neural network with the modeling of the static data acquisition (i.e., the forward model) is investigated. Two algorithms for Positron Emission Tomography reconstruction with motion and attenuation correction are proposed and their performance is evaluated in the detectability of small pulmonary lesions. The evaluation is performed on synthetic data with respect to chosen figures of merit, visual inspection, and an ideal observer. The commonly used figures of merit-Peak Signal-to-Noise Ratio, Recovery Coefficient, and Signal Difference-to-Noise Ration-give inconclusive responses, whereas visual inspection and the Channelised Hotelling Observer suggest that the proposed algorithms outperform current clinical practice.

Adaptation of a channelized Hotelling observer model to accommodate anthropomorphic backgrounds and moving test objects in X-ray angiography.

Prior implementations of the channelized Hotelling observer (CHO) model have succeeded in assessing the performance of X-ray angiography systems under a variety of imaging conditions. However, often times these conditions do not resemble those present in routine clinical imaging scenarios, such as having complex anthropomorphic backgrounds in conjunction with moving test objects. This work builds up on prior established CHO methods and introduces a new approach to switch from the already established "multiple-sample" CHO implementation to a "single-sample" technique. The proposed implementation enables the inclusion of moving test objects upon nonuniform backgrounds by allowing only a single sample to represent the test object present condition that is to be used within the statistical test to estimate the detectability index. To assess the proposed method, two image data sets were acquired with a clinical X-ray angiography system. The first set consisted of a uniform background in combination with static test objects while the second consisted of an anthropomorphic chest phantom in conjunction with moving test objects. The first set was used to validate the proposed approach against the multiple-sample method while the second was used to assess the feasibility of the proposed method under a variety of imaging conditions, including seven object sizes and seven detector target dose (DTD)levels. For the uniform background data set, considering all detectability indices greater or equal than 1, the ratio between the detectability indices of the proposed single-sample approach versus the multiple-sample method was 0.997 ± 0.056 (range 0.884-1.159). The average single-direction width of the 95% confidence intervals (CIs) of the detectability index estimates for the multiple-sample method was 0.38 ± 0.43 (range 0.03-2.20). For the single-sample approach, the average width was 2.52 ± 0.63 (range 1.11-5.44). For the anthropomorphic background image set, the results were consistent with classical quantum-limited signal-to-noise ratio (SNR) theory. The magnitude of the detectability indices varied predictably with changes in both object size and DTD, with the highest value associated with the highest dose and the largest object size. Additionally, the proposed method was able to capture differences in the imaging performance for a given test object across the field of view, which was associated with the attenuation levels provided by different features of the anthropomorphicbackground. A new single-sample variant of the CHO model to assess the performance of X-ray angiography imaging systems is proposed. The new approach is consistent with quantum-limited image quality theory and with a standard implementation of the CHO model. The proposed method enables the assessment of moving test objects in combination with complex, nonuniform image backgrounds, thereby opening the possibility to assess imaging conditions which more closely resemble those used in clinicalcare.

Strategy to implement a convolutional neural network based ideal model observer via transfer learning for multi-slice simulated breast CT images

Objective. In this work, we propose a convolutional neural network (CNN)-based multi-slice ideal model observer using transfer learning (TL-CNN) to reduce the required number of training samples. Approach. To train model observers, we generate simulated breast CT image volumes that are reconstructed using the FeldkampDavisKress algorithm with a ramp and Hanning-weighted ramp filter. The observer performance is evaluated on the background-known-statistically (BKS)/signal-known-exactly task with a spherical signal, and the BKS/signal-known-statistically task with random signal generated by the stochastic grown method. We compare the detectability of the CNN-based model observer with that of conventional linear model observers for multi-slice images (i.e. a multi-slice channelized Hotelling observer (CHO) and volumetric CHO). We also analyze the detectability of the TL-CNN for different numbers of training samples to examine its performance robustness to a limited number of training samples. To further analyze the effectiveness of transfer learning, we calculate the correlation coefficients of filter weights in the CNN-based multi-slice model observer. Main results. When using transfer learning for the CNN-based multi-slice ideal model observer, the TL-CNN provides the same performance with a 91.7% reduction in the number of training samples compared to that when transfer learning is not used. Moreover, compared to the conventional linear model observer, the proposed CNN-based multi-slice model observers achieve 45% higher detectability in the signal-known-statistically detection tasks and 13% higher detectability in the SKE detection tasks. In correlation coefficient analysis, it is observed that the filters in most of the layers are highly correlated, demonstrating the effectiveness of the transfer learning for multi-slice model observer training. Significance. Deep learning-based model observers require large numbers of training samples, and the required number of training samples increases as the dimensions of the image (i.e. the number of slices) increase. With applying transfer learning, the required number of training samples is significantly reduced without performance drop.

Dose-efficiency quantification of computed tomography systems using a model-observer.

Recent advances in computed tomography (CT) technology have considerably improved the quality of CT images and reduced radiation exposure in patients. At present, however, there is no generally accepted figure of merit (FOM) for comparing the dose efficiencies of CT systems. (i) To establish an FOM that characterizes the quality of CT images in relation to the radiation dose by means of a mathematical model observer and (ii) to evaluate the new FOM on different CT systems and image reconstruction algorithms. Images of a homogeneous phantom with four low-contrast inserts were acquired using three different CT systems at three dose levels and a representative protocol for CT imaging of low-contrast objects in the abdomen. The images were reconstructed using filtered-back projection and iterative algorithms. A channelized hotelling observer with difference-of-Gaussian channels was applied to compute the detectability ( ). This was done for each insert and each of the considered imaging conditions from square regions of interest (ROIs) that were (semi-)automatically centered on the inserts. The estimated detectabilities ( ) were averaged in the first step over the three dose levels ( ), and subsequently over the four contrast inserts ( ). All calculation steps included a dedicated assessment of the related uncertainties following accepted metrological guidelines. The determined detectabilities ( ) varied considerably with the contrast and diameter of the four inserts, as well as with the radiation doses and reconstruction algorithms used for image generation ( =1.3-5.5). Thus, the specification of a single detectability as an FOM is not well suited for comprehensively characterizing the dose efficiency of a CT system. A more comprehensive and robust characterization was provided by the averaged detectabilities and, in particular, . Our analysis reveals that the model observer analysis is very sensitive to the exact position of the ROIs. The presented automatable software approach yielded with the weighted detectability an objective FOM to benchmark different CT systems and reconstruction algorithms in a robust and reliable manner. An essential advantage of the proposed model-observer approach is that uncertainties in the FOM can be provided, which is an indispensable prerequisite for type testing.

Evaluation of Low-contrast Detectability of Photon-Counting-Detector CT Using Channelized Hotelling Observer and an ACR Accreditation Phantom.

The purpose of this work is to evaluate the low-contrast detectability on a clinical whole-body photon-counting-detector (PCD)-CT scanner and compare it with an energy-integrating-detector (EID) CT scanner, using an efficient Channelized Hotelling observer (CHO)-based method previously developed and optimized on the American College of Radiology (ACR) CT accreditation phantom for routine quality control (QC) purpose. The low-contrast module of an ACR CT phantom was scanned on both the PCD-CT and EID-CT scanners, each with 10 different positionings. For PCD-CT, data were acquired at 120 kV with two major scan modes, standard resolution (SR) (collimation: 144×0.4 mm) and ultra-high-resolution (UHR) (120×0.2 mm). Images were reconstructed with two major modes: virtual monochromatic energy at 70 keV and low-energy threshold (T3D), each with filtered-backprojection (Br44) and iterative reconstruction (Br44-3) kernels. For each positioning, 3 repeated scans were acquired for each scan mode at a fixed radiation dose setting (CTDIvol = 12 mGy). For EID-CT, scans (10 positionings × 3 repeated scans) were performed at a matched CTDIvol, and images were reconstructed using the same kernels with FBP and IR. A recently developed CHO-based method dedicated for QC of low-contrast performance on the ACR phantom was applied to calculate the low-contrast detectability (d') for each scan and reconstruction condition. Results showed that there was no significant difference in low-contrast detectability (d') between the UHR mode and SR mode (p = 0.360-0.942), and the T3D reconstruction resulted in 7.7%-14.6% higher d' than 70keV (p < 0.0016). Similar detectability levels were observed on PCD-CT and EID-CT. The PCD-CT: UHR-T3D had 6.2% higher d' than EID-CT with IR (p = 0.047) and 4.1% lower d' without IR (p = 0.122).

Spatio-temporal generalized Model Observers methods for Low Contrast Detectability assessment in digital angiography: Application to moving targets

The purpose of this work is to investigate the feasibility of spatio-temporal generalized Model Observer methods for protocol optimization programs in the field of interventional radiography.Two Model Observers were taken under examination: a Channelized Hotelling Observer with 24 spatio-temporal Gabor channels and a Non Pre-Whitening Model Observer with two different implementations of the spatio-temporal contrast sensitivity function. The images of targets, both stationary and in motion, were acquired in fluoroscopic mode using a CDRAD phantom for signal-present images and an homogenous slab of PMMA for signal-absent ones.After the processing, these images were used to build three series of two alternative forced choice experiments, designed to simulate tasks of clinical interest, and submitted to three human observers in order to set a goal on detectability. A first set of images was used for model tuning and subsequently the verified models were validated throughout a second set of images.Results from the validation phase, for both models, show good agreement with the human observer performances (Root Mean Square Error RMSE ≤ 12%).The tuning phase emerges as a crucial step in building models for angiographic dynamic images; the final agreement underlines the good capability of these spatio-temporal models in simulating human performances, allowing to consider them as a useful and worthwhile tool in protocol optimization when dynamic images are involved.

Dual-Tracer Parathyroid Imaging Using Joint SPECT Reconstruction.

We assessed the lesion detection performance of the dual-tracer parathyroid SPECT imaging using the joint reconstruction method. Thirty-six noise realizations were created from SPECT projections collected from an in-house neck phantom to emulate 99mTc-pertechnetate/99mTc-sestamibi parathyroid SPECT datasets. Difference images representing parathyroid lesions were reconstructed using the subtraction and the joint methods whose corresponding optimal iteration was defined as the iteration which maximized the channelized Hotelling observer signal-to-noise ratio (CHO-SNR). The joint method whose initial estimate was derived from the subtraction method at optimal iteration (the joint-AltInt method) was also assessed. In a study of 36 patients, a human-observer lesion-detection study was performed using difference images from the three methods at optimal iteration and the subtraction method with four iterations. The area under the receiver operating characteristic curve (AUC) was calculated for each method. In the phantom study, both the joint-AltInt method and the joint method improved SNR compared to the subtraction method at their optimal iteration by 444% and 81%, respectively. In the patient study, the joint-AltInt method yielded the highest AUC of 0.73 as compared with 0.72, 0.71, and 0.64 from the joint method, the subtraction method at optimal iteration, and the subtraction method at four iterations. At a specificity of at least 0.70, the joint-AltInt method yielded significantly higher sensitivity than the other methods (0.60 vs 0.46, 042, and 0.42; p < 0.05). The joint reconstruction method yielded higher lesion detectability than the conventional method and holds promise for dual-tracer parathyroid SPECT imaging.

CT Image Quality Assessment by a Channelized Hotelling Observer: Optimization of Adaptive Statistical Iterative Reconstruction for Radiation Dose Reduction and Improving Image Quality of Pediatric Abdominal CT Scan

Background: Iterative reconstruction (IR) techniques have tried to reduce the radiation dose of computed tomography (CT) scans while maintaining the image quality. One of the IR techniques is the adaptive statistical iterative reconstruction (ASIR). Increasing the amount of ASIR in image reconstruction can lead to the emergence of artifacts and reduce the ability to detect objects with low contrast. Objective: This study aimed to optimize the ASIR technique to reduce the radiation dose and increase image quality in pediatric abdominal CT. Methods: This is a phantom study performed using variable tube current (40,100,140 and 200mA) and ASIR level (ASIR 10% to ASIR 100%). Various criteria including noise, high-contrast spatial resolution, and Channelized Hotelling observer’s model were used to compare image quality at different captured levels. In this study CHO model was used for low contrast detectability. Results: The result was quit promising in the term of CHO’s used for mentioned purposes. The noise of reconstructed images with 30% ASIR and higher levels had a significant difference compared to the reconstructed images by the Filter Back Projection (FBP) method (P &lt; 0.05). The spatial resolution of the images with tube currents of 140, 100, and 40 mA reconstructed with 30, 50, and 80% levels of ASIR technique was equal to 0.8 ± 0.144 pairs of lines per millimeter. The amount of the spatial resolution of images obtained with standard radiation dose and reconstructed by FBP method was 1 pair of lines per mm (p&gt; 0.05). Conclusion: Based on the results of this study, using 50% ASIR for the pediatric population can reduce the radiation dose on abdominal and pelvic CT scans by 50% while maintaining image quality. Furthermore using ASIR 50% only for the reconstruction of abdominal and pelvic images in children at standard radiation dose leads to optimal image quality.

Accurate and efficient measurement of channelized Hotelling observer-based low-contrast detectability on the ACR CT accreditation phantom.

Current CT quality control (QC) for low-contrast detectability relies on visual inspection and measurement of contrast-to-noise ratio (CNR). However, CNR numbers become unreliable when it comes to nonlinear methods, such as iterative reconstruction (IR) and deep-learning-based techniques. Image quality metrics using channelized Hotelling observer (CHO) have been validated to be well correlated with human observer performance on phantom-based and patient-based tasks, but it has not been widely used in routine CT QC mainly because the CHO calculation typically requires a large number of repeated scans in order to provide accurate and precise estimate of index of detectability (d'). The main goal of this work is to optimize channel filters and other CHO parameters and accurately estimate the low-contrast detectability with minimum number of repeated scans for the widely used American College of Radiology (ACR) CT accreditation phantom so that it can become practically feasible for routine CT QC tests. To provide a converged d' value, an ACR phantom was repeatedly scanned 100 times at three dose levels (24, 12, and 6 mGy). Images were reconstructed with two kernels (FBP Br44 and IR Br44-3). d' as a function of number of repeated scans was determined for different number of background regions of interest (ROIs), different number of low-contrast objects, different number of slices per each object, and different channel filter options. A reference d' was established using the optimized CHO setting, and the bias of d' was quantified using the d' calculated from all 100 repeated scans. The variation of d' at each condition was estimated using a resampling method combining random subsampling among 100 repeated scans and bootstrapping of the ensembles of signal and background ROIs. Optimized parameters in CHO calculation were determined: two background ROIs per object, four objects per low-contrast object size, nine non-overlapping slices per object, and a 4-channel Gabor filter. The bias and uncertainty were estimated at different numbers of repeated scans using these parameters. When only one single scan was used in the CHO calculation, the bias of d' was below 6.2% and the uncertainty 15.6-19.6% for the 6, 5, and 4 mm objects, while with three repeated scans the bias was below 2.0% and uncertainty 8.7-10.9% for the three object sizes. With optimized parameter settings in CHO, efficient and accurate measurement of low-contrast detectability on the commonly used ACR phantom becomes feasible, which could potentially lead to adoption of CHO-based low-contrast evaluation in routine QC tests.

Evaluation of the quantitative performance of non-enhanced dual-energy CT X-map in detecting acute ischemic brain stroke: A model observer study using computer simulation

PurposeA simulation study was performed to evaluate the quantitative performance of X-map images—derived from non-enhanced (NE) dual-energy computed tomography (DECT)—in detecting acute ischemic stroke (AIS) compared with that of NE-DECT mixed images. MethodsA virtual phantom, 150 mm in diameter, filled with tissues comprising various gray- and white-matter proportions was used to generate pairs of NE-head images at 80 kV and Sn150 kV at three dose levels (20, 40, and 60 mGy). The phantom included an inserted low-contrast object, 15 mm in diameter, with four densities (0%, 5%, 10%, and 15%) mimicking ischemic edema. Mixed and X-map images were generated from these sets of images and compared in terms of detectability of ischemic edema using a channelized Hotelling observer (CHO). The area under the curve (AUC) of the receiver operating characteristic that generated CHO for each condition was used as a figure of merit. ResultsThe AUCs of X-map images were always significantly higher than those of mixed images (P < 0.001). The improvement in AUC for X-map images compared with that for mixed images at edema densities was 9.2%-12.6% at 20 mGy, 10.1%-17.7% at 40 mGy, and 14.0%-19.4% at 60 mGy. At any edema density, X-map images at 20 mGy resulted in higher AUCs than mixed images acquired at any other dose level (P < 0.001), which corresponded to a 66% dose reduction on X-map images. ConclusionsThe simulation study confirmed that NE-DECT X-map images have superior capability of detecting AIS than NE-DECT mixed images.

Iterative reconstruction with multifrequency signal recognition technology to improve low-contrast detectability: A phantom study.

BackgroundBrain CT needs more attention to improve the extremely low image contrast and image texture.PurposeTo evaluate the performance of iterative progressive reconstruction with visual modeling (IPV) for the improvement of low-contrast detectability (IPV-LCD) compared with filtered backprojection (FBP) and conventional IPV.Materials and methodsLow-contrast and water phantoms were used. Helical scans were conducted with the use of a CT scanner with 64 detectors. The tube voltage was set at 120 kVp; the tube current was adjusted from 60 to 300 mA with a slice thickness of 0.625 mm and from 20 to 150 mA with a slice thickness of 5.0 mm. Images were reconstructed with the FBP, conventional IPV, and IPV-LCD algorithms. The channelized Hotelling observer (CHO) model was applied in conjunction with the use of low-contrast modules in the low-contrast phantom. The noise power spectrum (NPS) and normalized NPS were calculated.ResultsAt the same standard and strong levels, the IPV-LCD method improved low-contrast detectability compared with the conventional IPV, regardless of contrast-rod diameters. The mean CHO values at a slice thickness of 0.625 mm were 1.83, 3.28, 4.40, 4.53, and 5.27 for FBP, IPV STD, IPV-LCD STD, IPV STR, and IPV-LCD STR, respectively. The normalized NPS for the IPV-LCD STD and STR images were slightly shifted to the higher frequency compared with that for the FBP image.ConclusionIPV-LCD images further improve the low-contrast detectability compared with FBP and conventional IPV images while maintaining similar FBP image appearances.

Effect of optical blurring of X-ray source on breast tomosynthesis image quality: Modulation transfer function, anatomical noise power spectrum, and signal detectability perspectives

We investigated the effect of the optical blurring of X-ray source on digital breast tomosynthesis (DBT) image quality using well-designed DBT simulator and table-top experimental systems. To measure the in-plane modulation transfer function (MTF), we used simulated sphere phantom and Teflon sphere phantom and generated their projection data using two acquisition modes (i.e., step-and-shoot mode and continuous mode). After reconstruction, we measured the in-plane MTF using reconstructed sphere phantom images. In addition, we measured the anatomical noise power spectrum (aNPS) and signal detectability. We constructed simulated breast phantoms with a 50% volume glandular fraction (VGF) of breast anatomy using the power law spectrum and inserted spherical objects with 1 mm, 2 mm, and 5 mm diameters as breast masses. Projection data were acquired using two acquisition modes, and in-plane breast images were reconstructed using the Feldkamp-Davis-Kress (FDK) algorithm. For the experimental study, we used BR3D breast phantom with 50% VGF and obtained projection data using a table-top experimental system. To compare the detection performance of the two acquisition modes, we calculated the signal detectability using the channelized Hotelling observer (CHO) with Laguerre-Gauss (LG) channels. Our results show that spatial resolution of in-plane image in continuous mode was degraded due to the optical blurring of X-ray source. This blurring effect was reflected in aNPS, resulting in large β values. From a signal detectability perspective, the signal detectability in step-and-shoot mode is higher than that in continuous mode for small spherical signals but not large spherical signals. Although the step-and-shoot mode has disadvantage in terms of scan time compared to the continuous mode, scanning in step-and-shoot mode is better for detecting small signals, indicating that there is a tradeoff between scan time and image quality.

Efficient Evaluation of Low-contrast Detectability of Deep-CNN-based CT Reconstruction Using Channelized Hotelling Observer on the ACR Accreditation Phantom.

As deep-learning-based denoising and reconstruction methods are gaining more popularity in clinical CT, it is of vital importance that these new algorithms undergo rigorous and objective image quality assessment beyond traditional metrics to ensure diagnostic information is not sacrificed. Channelized Hotelling observer (CHO), which has been shown to be well correlated with human observer performance in many clinical CT tasks, has a great potential to become the method of choice for objective image quality assessment for these non-linear methods. However, practical use of CHO beyond research labs have been quite limited, mostly due to the strict requirement on a large number of repeated scans to ensure sufficient accuracy and precision in CHO computation and the lack of efficient and widely acceptable phantom-based method. In our previous work, we developed an efficient CHO model observer for accurate and precise measurement of low-contrast detectability with only 1-3 repeated scans on the most widely used ACR accreditation phantom. In this work, we applied this optimized CHO model observer to evaluating the low-contrast detectability of a deep learning-based reconstruction (DLIR) equipped on a GE Revolution scanner. The commercially available DLIR reconstruction method showed consistent increase in low-contrast detectability over the FBP and the IR method at routine dose levels, which suggests potential dose reduction to the FBP reconstruction by up to 27.5%.

Investigating the limited performance of a deep-learning-based SPECT denoising approach: An observer-study-based characterization.

Multiple objective assessment of image-quality (OAIQ)-based studies have reported that several deep-learning (DL)-based denoising methods show limited performance on signal-detection tasks. Our goal was to investigate the reasons for this limited performance. To achieve this goal, we conducted a task-based characterization of a DL-based denoising approach for individual signal properties. We conducted this study in the context of evaluating a DL-based approach for denoising single photon-emission computed tomography (SPECT) images. The training data consisted of signals of different sizes and shapes within a clustered-lumpy background, imaged with a 2D parallel-hole-collimator SPECT system. The projections were generated at normal and 20% low-count level, both of which were reconstructed using an ordered-subset-expectation-maximization (OSEM) algorithm. A convolutional neural network (CNN)-based denoiser was trained to process the low-count images. The performance of this CNN was characterized for five different signal sizes and four different signal-to-background ratio (SBRs) by designing each evaluation as a signal-known-exactly/background-known-statistically (SKE/BKS) signal-detection task. Performance on this task was evaluated using an anthropomorphic channelized Hotelling observer (CHO). As in previous studies, we observed that the DL-based denoising method did not improve performance on signal-detection tasks. Evaluation using the idea of observer-study-based characterization demonstrated that the DL-based denoising approach did not improve performance on the signal-detection task for any of the signal types. Overall, these results provide new insights on the performance of the DL-based denoising approach as a function of signal size and contrast. More generally, the observer study-based characterization provides a mechanism to evaluate the sensitivity of the method to specific object properties, and may be explored as analogous to characterizations such as modulation transfer function for linear systems. Finally, this work underscores the need for objective task-based evaluation of DL-based denoising approaches.

Computer simulations of case difficulty in digital breast tomosynthesis using virtual clinical trials.

Virtual clinical trials (VCTs) require computer simulations of representative patients and images to evaluate and compare changes in performance of imaging technologies. The simulated images are usually interpreted by model observers whose performance depends upon the selection of imaging cases used in training evaluation models. This work proposes an efficient method to simulate and calibrate soft tissue lesions, which matches the detectability threshold of virtual and human readings. Anthropomorphic breast phantoms were used to evaluate the simulation of four mass models (I-IV) that vary in shape and composition of soft tissue. Ellipsoidal (I) and spiculated (II-IV) masses were simulated using composite voxels with partial volumes. Digital breast tomosynthesis projections and reconstructions of a clinical system were simulated. Channelized Hotelling observers (CHOs) were evaluated using reconstructed slices of masses that varied in shape, composition, and density of surrounded tissue. The detectability threshold of each mass model was evaluated using receiver operating characteristic (ROC) curves calculated with the CHO's scores. The area under the curve (AUC) of each calibrated mass model were within the 95% confidence interval (mean AUC [95% CI]) reported in a previous reader study (0.93 [0.89, 0.97]). The mean AUC [95% CI] obtained were 0.94 [0.93, 0.96], 0.92 [0.90, 0.93], 0.92 [0.90, 0.94], 0.93 [0.92, 0.95] for models I to IV, respectively. The mean AUC results varied substantially as a function of shape, composition, and density of surrounded tissue. For successful VCTs, lesions composed of soft tissue should be calibrated to simulate imaging cases that match the case difficulty predicted by human readers. Lesion composition, shape, and size are parameters that should be carefully selected to calibrate VCTs.

P164 - Characterization of two CT systems using a channelized hotelling observer and NPS metric

P164 - Characterization of two CT systems using a channelized hotelling observer and NPS metric

OD118 - Radiation dose reduction and static image quality assessment using a channelized hotelling observer on an angiography system upgraded with clarity IQ

OD118 - Radiation dose reduction and static image quality assessment using a channelized hotelling observer on an angiography system upgraded with clarity IQ