Channelized Hotelling Observer Model Research Articles

Channelized hotelling observer-based low-contrast detectability on the ACR CT accreditation phantom: Part II. Repeatability study.

Objective and quantitative evaluation for low-contrast detectability that correlates with human observer performance is lacking for routine CT quality control testing. Channelized Hotelling observer (CHO) is considered a strong candidate to fill the need but has long been deemed impractical to implement due to its requirement of a large number of repeated scans in order to provide accurate and precise estimates of index of detectability (d'). In our previous work, we optimized a CHO model observer on the American College of Radiology (ACR) CT accreditation phantom and achieved accurate measurement of d' with only 1-3 repeat scans. In this work, we aim to validate the repeatability of the proposed CHO-based low-contrast evaluation on four scanner models using the ACR CT accreditation phantom. The repeatability test was performed on four different scanners from two major CT manufacturers: Siemens Force and Alpha; Canon Prism and Prime SP. An ACR CT phantom was scanned 10 times, each time after repositioning of the phantom. For each repositioning, 3 repeated scans were acquired at 24, 12, and 6 mGy on all four scanner models. CHO was applied at the measured dose levels for different low-contrast object sizes (4-6mm). The CHO was also applied to images created using deep learning-based reconstructions on Canon Prism and to four different scan/reconstruction modes on the Siemens Alpha, a photon-counting-detector (PCD)-CT. The repeatability was evaluated by the probability that a measurement would fall within the±15% tolerance (P<15% ). With the CHO setting optimized for the ACR phantom and the use of 3 repeated scans and 9 non-overlapping slices per scan, the CHO measurement could provide high repeatability with P<15% of 98.8%-99.9% at 12 mGy with IR reconstruction on all four scanners. On scanner A, P<15% were 91.5%-99.9% at the three dose levels and for all three object sizes while the numbers were 93.6%-99.998% on scanner B. P<15% were 96.5%-97.2% for the two deep learning reconstructions and 97.0%-99.97% for the four scan/reconstruction modes on the PCD-CT. The CHO provided highly repeatable measurements with over 95% probability that a CHO measurement would lie within the±15% tolerance for most of the dose levels and object sizes on the ACR phantom. The repeatability was maintained when the CHO was applied to images created with a commercial deep learning-based reconstruction and various scan/reconstruction modes on a PCD-CT. This study demonstrates that practical implementation of CHO for routine quality control and performance evaluation is feasible.

Photon-Counting Detector CT for Liver Lesion Detection-Optimal Virtual Monoenergetic Energy for Different Simulated Patient Sizes and Radiation Doses.

The aim of this study was to evaluate the optimal energy level of virtual monoenergetic images (VMIs) from photon-counting detector computed tomography (CT) for the detection of liver lesions as a function of phantom size and radiation dose. An anthropomorphic abdominal phantom with liver parenchyma and lesions was imaged on a dual-source photon-counting detector CT at 120 kVp. Five hypoattenuating lesions with a lesion-to-background contrast difference of -30 HU and -45 HU and 3 hyperattenuating lesions with +30 HU and +90 HU were used. The lesion diameter was 5-10 mm. Rings of fat-equivalent material were added to emulate medium- or large-sized patients. The medium size was imaged at a volume CT dose index of 5, 2.5, and 1.25 mGy and the large size at 5 and 2.5 mGy, respectively. Each setup was imaged 10 times. For each setup, VMIs from 40 to 80 keV at 5 keV increments were reconstructed with quantum iterative reconstruction at a strength level of 4 (QIR-4). Lesion detectability was measured as area under the receiver operating curve (AUC) using a channelized Hotelling model observer with 10 dense differences of Gaussian channels. Overall, highest detectability was found at 65 and 70 keV for both hypoattenuating and hyperattenuating lesions in the medium and large phantom independent of radiation dose (AUC range, 0.91-1.0 for the medium and 0.94-0.99 for the large phantom, respectively). The lowest detectability was found at 40 keV irrespective of the radiation dose and phantom size (AUC range, 0.78-0.99). A more pronounced reduction in detectability was apparent at 40-50 keV as compared with 65-75 keV when radiation dose was decreased. At equal radiation dose, detection as a function of VMI energy differed stronger for the large size as compared with the medium-sized phantom (12% vs 6%). Detectability of hypoattenuating and hyperattenuating liver lesions differed between VMI energies for different phantom sizes and radiation doses. Virtual monoenergetic images at 65 and 70 keV yielded highest detectability independent of phantom size and radiation dose.

Adaptation of a channelized Hotelling observer model to accommodate anthropomorphic backgrounds and moving test objects in X-ray angiography.

Prior implementations of the channelized Hotelling observer (CHO) model have succeeded in assessing the performance of X-ray angiography systems under a variety of imaging conditions. However, often times these conditions do not resemble those present in routine clinical imaging scenarios, such as having complex anthropomorphic backgrounds in conjunction with moving test objects. This work builds up on prior established CHO methods and introduces a new approach to switch from the already established "multiple-sample" CHO implementation to a "single-sample" technique. The proposed implementation enables the inclusion of moving test objects upon nonuniform backgrounds by allowing only a single sample to represent the test object present condition that is to be used within the statistical test to estimate the detectability index. To assess the proposed method, two image data sets were acquired with a clinical X-ray angiography system. The first set consisted of a uniform background in combination with static test objects while the second consisted of an anthropomorphic chest phantom in conjunction with moving test objects. The first set was used to validate the proposed approach against the multiple-sample method while the second was used to assess the feasibility of the proposed method under a variety of imaging conditions, including seven object sizes and seven detector target dose (DTD)levels. For the uniform background data set, considering all detectability indices greater or equal than 1, the ratio between the detectability indices of the proposed single-sample approach versus the multiple-sample method was 0.997 ± 0.056 (range 0.884-1.159). The average single-direction width of the 95% confidence intervals (CIs) of the detectability index estimates for the multiple-sample method was 0.38 ± 0.43 (range 0.03-2.20). For the single-sample approach, the average width was 2.52 ± 0.63 (range 1.11-5.44). For the anthropomorphic background image set, the results were consistent with classical quantum-limited signal-to-noise ratio (SNR) theory. The magnitude of the detectability indices varied predictably with changes in both object size and DTD, with the highest value associated with the highest dose and the largest object size. Additionally, the proposed method was able to capture differences in the imaging performance for a given test object across the field of view, which was associated with the attenuation levels provided by different features of the anthropomorphicbackground. A new single-sample variant of the CHO model to assess the performance of X-ray angiography imaging systems is proposed. The new approach is consistent with quantum-limited image quality theory and with a standard implementation of the CHO model. The proposed method enables the assessment of moving test objects in combination with complex, nonuniform image backgrounds, thereby opening the possibility to assess imaging conditions which more closely resemble those used in clinicalcare.

Photon-Counting Detector CT With Quantum Iterative Reconstruction: Impact on Liver Lesion Detection and Radiation Dose Reduction.

To assess image noise, diagnostic performance, and potential for radiation dose reduction of photon-counting detector (PCD) computed tomography (CT) with quantum iterative reconstruction (QIR) in the detection of hypoattenuating and hyperattenuating focal liver lesions compared with energy-integrating detector (EID) CT. A medium-sized anthropomorphic abdominal phantom with liver parenchyma and lesions (diameter, 5-10 mm; hypoattenuating and hyperattenuating from -30 HU to +90 HU at 120 kVp) was used. The phantom was imaged on ( a ) a third-generation dual-source EID-CT (SOMATOM Force, Siemens Healthineers) in the dual-energy mode at 100 and 150 kVp with tin filtration and ( b ) a clinical dual-source PCD-CT at 120 kVp (NAEOTOM Alpha, Siemens). Scans were repeated 10 times for each of 3 different radiation doses of 5, 2.5, and 1.25 mGy. Datasets were reconstructed as virtual monoenergetic images (VMIs) at 60 keV for both scanners and as linear-blended images (LBIs) for EID-CT. For PCD-CT, VMIs were reconstructed with different strength levels of QIR (QIR 1-4) and without QIR (QIR-off). For EID-CT, VMIs and LBIs were reconstructed using advanced modeled iterative reconstruction at a strength level of 3. Noise power spectrum was measured to compare image noise magnitude and texture. A channelized Hotelling model observer was used to assess diagnostic accuracy for lesion detection. The potential for radiation dose reduction using PCD-CT was estimated for the QIR strength level with the highest area under the curve compared with EID-CT for each radiation dose. Image noise decreased with increasing QIR level at all radiation doses. Using QIR-4, noise reduction was 41%, 45%, and 59% compared with EID-CT VMIs and 12%, 18%, and 33% compared with EID-CT LBIs at 5, 2.5, and 1.25 mGy, respectively. The peak spatial frequency shifted slightly to lower frequencies at higher QIR levels. Lesion detection accuracy increased at higher QIR levels and was higher for PCD-CT compared with EID-CT VMIs. The improvement in detection with PCD-CT was strongest at the lowest radiation dose, with an area under the receiver operating curve of 0.917 for QIR-4 versus 0.677 for EID-CT VMIs for hyperattenuating lesions, and 0.900 for QIR-4 versus 0.726 for EID-CT VMIs for hypoattenuating lesions. Compared with EID-CT LBIs, detection was higher for QIR 1-4 at 2.5 mGy and for QIR 2-4 at 1.25 mGy (eg, 0.900 for QIR-4 compared with 0.854 for EID-CT LBIs at 1.25 mGy). Radiation dose reduction potential of PCD-CT with QIR-4 was 54% at 5 mGy compared with VMIs and 39% at 2.5 mGy compared with LBIs. Compared with EID-CT, PCD-CT with QIR substantially improved focal liver lesion detection, especially at low radiation dose. This enables substantial radiation dose reduction while maintaining diagnostic accuracy.

Efficient Evaluation of Low-contrast Detectability of Deep-CNN-based CT Reconstruction Using Channelized Hotelling Observer on the ACR Accreditation Phantom.

As deep-learning-based denoising and reconstruction methods are gaining more popularity in clinical CT, it is of vital importance that these new algorithms undergo rigorous and objective image quality assessment beyond traditional metrics to ensure diagnostic information is not sacrificed. Channelized Hotelling observer (CHO), which has been shown to be well correlated with human observer performance in many clinical CT tasks, has a great potential to become the method of choice for objective image quality assessment for these non-linear methods. However, practical use of CHO beyond research labs have been quite limited, mostly due to the strict requirement on a large number of repeated scans to ensure sufficient accuracy and precision in CHO computation and the lack of efficient and widely acceptable phantom-based method. In our previous work, we developed an efficient CHO model observer for accurate and precise measurement of low-contrast detectability with only 1-3 repeated scans on the most widely used ACR accreditation phantom. In this work, we applied this optimized CHO model observer to evaluating the low-contrast detectability of a deep learning-based reconstruction (DLIR) equipped on a GE Revolution scanner. The commercially available DLIR reconstruction method showed consistent increase in low-contrast detectability over the FBP and the IR method at routine dose levels, which suggests potential dose reduction to the FBP reconstruction by up to 27.5%.

Task-specific efficient channel selection and bias management for Gabor function channelized Hotelling observer model for the assessment of x-ray angiography system performance.

Channelized Hotelling observer (CHO) models have been implemented to assess imaging performance in x-ray angiography systems. While current methods are appropriate for assessing unprocessed images of moving test objects upon uniform-exposure backgrounds, they are inadequate for assessing conditions which more appropriately mimic clinical imaging conditions including the combination of moving test objects, complex anthropomorphic backgrounds, and image processing. In support of this broad goal, the purpose of this work was to develop theory and methods to automatically select a subset of task-specific efficient Gabor channels from a task-generic Gabor channel base set. Also, previously described theory and methods to manage detectability index (d') bias due to nonrandom temporal variations in image electronic noise will be revisited herein. Starting with a base set of 96 Gabor channels, backward elimination of channels was used to automatically identify an "efficient" channel subset which reduced the number of channels retained in the subset while maintaining the magnitude of the d' estimate. The concept of a pixelwise Hotelling observer (PHO) model was introduced and similarly implemented to assess the performance of the efficient-channel CHO model. Bias in d' estimates arising from temporally variable nonstationary noise was modeled as a bivariate probability density function for normal distributions, where one variable corresponds to the signal from the test object and the other variable corresponds to the signal from temporally variable nonstationary noise. Theory and methods were tested on uniform-exposure unprocessed angiography images with detector target dose (DTD) of 6, 18, and 120nGy containing static disk-shaped test objects with diameter in the range of 0.5 to 4mm. Considering all DTD levels and test object sizes, the proposed method reduced the number of Gabor channels in the final subset by 63-82% compared to the original 96 Gabor channel base set, while maintaining a mean relative performance ( ) of 95% 4% with respect to the reference PHO model. Experimental results demonstrated that the bivariate approach to account for bias due to temporally variable nonstationary noise resulted in improved correlation between the CHO and PHO models as compared to a previously proposed univariate approach. Computationally efficient backward elimination can be used to select an efficient subset of Gabor channels from an initial channel base set without substantially compromising the magnitude of the d' estimate. Bias due to temporally variable nonstationary noise can be modeled through a bivariate approach leading to an improved unbiased estimate of d'.

Radiation dose reduction and static image quality assessment using a channelized hotelling observer on an angiography system upgraded with clarity IQ

The goal of this paper was the comparison of radiation dose and imaging quality before and after the Clarity IQ technology installation in a Philips AlluraXper FD20/20 angiography system using a Channelized Hotelling Observer model (CHO). The core characteristics of the Allura Clarity IQ technology are its real-time noise reduction algorithms (NRT) combined with state-of-the-art hardware; this technology allows to implement acquisition protocols able to significantly reduce patient entrance dose. To measure the system performances in terms of image quality we used a contrast detail phantom in a clinical scatter condition. A Leeds TO10 phantom has been imaged between two 10 cm thick homogeneous solid water slabs. Fluoroscopy images were acquired using a cerebral protocol at 3 dose levels (low, medium and high) with a field- of view (FOV) of 31 cm. Cineangiography images were acquired using a cerebral protocol at 2 fps. Thus, 4 acquisitions were obtained for the conventional technology and 4 acquisitions were taken after the Clarity IQ upgrade, for a total of 8 different image sets. A validated 40 Gabor channels CHO with an internal noise model compared the image sets. Human observers’ studies were carried out to tune the internal noise parameter. We showed that the CHO did not detect any significant difference between any of the image sets acquired using the two technologies. Consequently, this x–ray imaging technology provides a non-inferior image quality with an average patient dose reduction of 57% and 28% respectively in cineangiography and fluoroscopy. The Clarity IQ installation has certainly allowed a considerable improvement in patient and staff safety, while maintaining the same image quality.

Improving Low-contrast Detectability and Noise Texture Pattern for Computed Tomography Using Iterative Reconstruction Accelerated with Machine Learning Method: A Phantom Study

To evaluate the performance of iterative reconstruction (IR) and filtered back projection (FBP) images in terms of low-contrast detectability at different radiation doses, IR levels, and slice thickness using the mathematical model observer with a focus on low-contrast detectability. The CCT189 MITA CT IQ Low-Contrast Phantom was used and helical scans were performed using a 64-detector CT scanner. Tube voltage was set at 120 kVp and tube current was adjusted from 45 to 600 mA. Images were reconstructed at slice thicknesses of 0.625 and 5.0 mm with FBP and five types of iterative progressive reconstruction with visual modeling (IPV) algorithms. The noise power spectrum (NPS) and normalized NPS were calculated. To evaluate low-contrast detectability, the model observer with the channelized Hotelling observer model was applied using low-contrast modules in the phantom. The NPS and normalized NPS for IPV images had similar curves as that for FBP images. At a slice thickness of 0.625 mm and equivalent radiation dose level, the mean improvement of low-contrast detectability for IPV images was 1.19-2.15-fold greater than FBP images with corresponding noise reduction levels. At equivalent noise levels of 5.0-8.0 HU, low-contrast detectability of the IPVstd2 to IPVstr2 images as almost the same or better than that of the FBP images. However, the detectability of the IPVstr4 image was lower than that of the FBP image (p = 0.02). Low-contrast detectability of the IPV images was improved with a similar normalized NPS as with FBP images. Furthermore, a radiation reduction of >50% was achieved for the IPV images, while maintaining similar low-contrast detectability.

Integration of high velocity test object motion into a channelized Hotelling observer for the assessment of x-ray angiography systems

Assessment of x-ray angiography system performance is typically performed using stationary test objects with simple geometries such as a disk on a uniform background. However, these methods do not represent realistic imaging conditions in interventional cardiology as anatomy and devices are inherently non-stationary due to cardiac motion. In this work, a novel implementation of the channelized Hotelling observer (CHO) was used to assess the influence of motion blur on object detectability. A standard CHO model assumes imaging system stationarity whereby the detectability index of a test object is independent of location. However, real angiography systems are inherently non-stationary. While vendor correction gain factors and offset maps are used to compensate for visual non-uniformities, these corrections do not restore stationarity to the images. Methods to accommodate non-stationarity and allow assessment of the influence of motion blur on test object detectability will be presented. The effect of motion blur was quantified with the relative detectability index (), where the for an object when moving with constant linear velocity was compared to a low velocity ‘pseudo-stationary’ condition to account for system non-stationarity. The pseudo-stationary condition was used to isolate the influences of spatial non-stationarity and motion blur. Three different test object shapes (disks, spheres and capsules) with linear velocity in the range 0–30 cm · s−1 were tested. For 1 mm diameter objects and linear velocity 30 cm · s−1, was degraded by 37%, 33% and 42% for the disk, sphere and capsule respectively, relative to the pseudo-stationary condition. Considering all test objects with diameter greater than 2 mm and linear velocity 30 cm · s−1, was degraded by less than 10% due to motion. In summary, this work describes a new approach to assess performance of x-ray angiography systems using the CHO model and moving test objects.

Characterization of GE discovery IGS 740 angiography system by means of channelized Hotelling observer (CHO)

The aim of the study is to use the well-known channelized Hotelling observer model (CHO) to characterize a recently installed angiography system (GE Discovery IGS 740) using sets of images of a contrast-detail phantom acquired with clinical protocols. A Leeds TO10 phantom was used. The phantom has 108 details: 12 diameters (size range: 0.25 mm–11 mm), each with nine contrasts (declared range: 0.012–0.930 at 70 kVp 1.00 with 1 mm Cu filtration). TO10 has been imaged between two 10 cm thick homogeneous solid water slabs. Two FOVs (32 cm and 20 cm) were used. Fluoroscopy images were taken using an abdominal protocol at two different frame rates (15 fps and 7.5 fps) and at two dose levels (low and normal); cineangiography images were acquired using an abdominal protocol at 15 fps at two dose levels (low and normal). A 40 Gabor channels CHO with internal noise was used. Human observers’ studies were carried out to tune the internal noise parameter and to validate the model observer. Contrast-detail curves were obtained from the CHO output using a visibility threshold of 75% and fitted with Rose’s model theory in order to characterize the angiography system. Wilcoxon rank-sum tests were performed to investigate possible differences among the different sets of images.The CHO can distinguish between the two dose levels (p -values < 0.002), while FOV and frame rate do not affect the contrast-detail curves significantly. It is important to note that the CHO does not find statistically significant differences between a fluoroscopy with FOV = 20 cm at normal dose level (17.6 mGy min−1) and a cineangiography with FOV = 32 cm low dose level (42.1 mGy min−1). This result can lead to a dose reduction of about 70% for our specific task (i.e. a static, disc shaped object at known location in homogeneous field). Given their stability in comparison to human observers, model observers provide an effective tool for image quality evaluation.

Systematic approach to a channelized Hotelling model observer implementation for a physical phantom containing mass-like lesions: Application to digital breast tomosynthesis

Purposeto develop a channelized model observer (CHO) that matches human reader (HR) scoring of a physical phantom containing breast simulating structure and mass lesion-like targets for use in quality control of digital breast tomosynthesis (DBT) imaging systems. MethodsA total of 108 DBT scans of the phantom was acquired using a Siemens Inspiration DBT system. The detectability of mass-like targets was evaluated by human readers using a 4-alternative forced choice (4-AFC) method. The percentage correct (PC) values were then used as the benchmark for CHO tuning, again using a 4-AFC method. Three different channel functions were considered: Gabor, Laguerre-Gauss and Difference of Gaussian. With regard to the observer template, various methods for generating the expected signal were studied along with the influence of the number of training images used to form the covariance matrix for the observer template. Impact of bias in the training process on the observer template was evaluated next, as well as HR and CHO reproducibility. ResultsHR performance was most closely matched by 8 Gabor channels with tuned phase, orientation and frequency, using an observer template generated from training image data. Just 24 DBT image stacks were required to give robust CHO performance with 0% bias, although a bias of up to 33% in the training images also gave acceptable performance. CHO and HR reproducibility were similar (on average 3.2 PC versus 3.4 PC). ConclusionsThe CHO algorithm developed matches human reader performance and is therefore a promising candidate for automated readout of phantom studies.

I121] Model observers applied to quality control in computed tomography

Model observers are mathematical algorithms that can include different aspects of the human visual system and aim to reproduce human performance for simple detection tasks. Their use has extended in different medical imaging modalities, such as mammography, computed tomography (CT) and nuclear medicine among others, in the past few years. Several model observers have shown good correlation with human observers for simple detection and discrimination tasks in image quality phantoms with uniform backgrounds. Some model observers have been used by CT manufacturers to obtain clearance for their image quality claims, in particular for low contrast detectability (LCD), in the USA. LCD is frequently assessed in CT by human observers scoring the visibility of simple objects (such as disks) of different contrast and size in phantom images. These studies might be biased as, in general, the observer knows the distribution of the objects in the phantom beforehand. A great inter- and intra-observer variability might also appear. The models that will be studied in the course are: the non-prewhitening matched filter with an eye filter (NPWE) and the channelized Hotelling observer (CHO). The NPWE model includes a mathematical implementation of the contrast sensitivity function (CSF) of the human eye. There exist different published functions for the CSF based on human observer studies. The CHO model includes channels that can have different shapes (Gabor, Laguerre-Gauss, difference of gaussians…) depending on the target object; the channels aim to mimic the neurons triggering in the human visual cortex. Different aspects the implementation of model observers in image quality assessment, in particular in CT will be explored in this refresher course. Among them, how to choose the task, how to implement a model observer and its limitations, and also a short introduction on how to validate the model results with human observer studies. Practical examples about the use of these models in routine quality control, for example for low contrast detectability assessment, will be shown. Tips about how to start implementing model observers, in particular with freeware (imageJ), will be shared.

Establishment and validation of the Channelized Hotelling Model Observer for image assessment in industrial radiography

A new method for industrial radiography is presented to assess image quality objectively. The assessment is performed by a modelled observer developed to interpret radiographic images in order to rate the detectability of structural defects. For the purpose of qualifying radiographic NDE procedures, computational tools simulate the image, but should additionally automatically assess the associated image quality instead of relying on human interpretation. The Channelized Hotelling Model Observer (CHO) approach, originally developed for medical imaging, is here developed for industrial NDE applications to measure objectively the defect's detectability. A validation study based on a comparison of the model's efficiency of observing circular and elongated flaws shows that the CHO outperforms other detectability models used by industry. Furthermore, the model's reliability was verified by comparing it to psychophysical data.

Objective comparison of high-contrast spatial resolution and low-contrast detectability for various clinical protocols on multiple CT scanners.

We sought to compare objectively computed tomography (CT) scanner performance for three clinically relevant protocols using a task-based image quality assessment method in order to assess the potential for radiation dose reduction. Four CT scanners released between 2003 and 2007 by different manufacturers were compared with four CT scanners released between 2012 and 2014 by the same manufacturers using ideal linear model observers (MO): prewhitening (PW) MO and channelized Hotelling (CHO) MO with Laguerre-Gauss channels for high-contrast spatial resolution and low-contrast detectability (LCD) performance, respectively. High-contrast spatial resolution was assessed using a custom-made phantom that enabled the computation of the target transfer function (TTF) and noise power spectrum (NPS). Low-contrast detectability was assessed using a commercially available anthropomorphic abdominal phantom providing equivalent diameters of 24, 29.6, and 34.6cm. Three protocols were reviewed: a head (trauma) and an abdominal (urinary stones) protocol were applied to assess high-contrast spatial resolution performance; and another abdominal (focal liver lesions) protocol was applied for LCD. The liver protocol was tested using fixed and modulated tube currents. The PW MO was proposed for assessing high-contrast detectability performance of the various CT scanners. Compared with older generation CT scanners, three newer systems displayed significant improvements in high-contrast detectability over that of their predecessors. A fourth, newer system had lower performance. The CHO MO was appropriate for assessing LCD performance and revealed that an excellent level of image quality could be obtained with newer scanners at significantly lower dose levels. This study shows that MO can objectively benchmark CT scanners using a task-based image quality method, thus helping to estimate the potential for further dose reductions offered by the latest systems. Such an approach may be useful for adequately and quantitatively comparing clinically relevant image quality among various scanners.

Practical implementation of Channelized Hotelling Observers: Effect of ROI size.

Fundamental to the development and application of channelized Hotelling observer (CHO) models is the selection of the region of interest (ROI) to evaluate. For assessment of medical imaging systems, reducing the ROI size can be advantageous. Smaller ROIs enable a greater concentration of interrogable objects in a single phantom image, thereby providing more information from a set of images and reducing the overall image acquisition burden. Additionally, smaller ROIs may promote better assessment of clinical patient images as different patient anatomies present different ROI constraints. To this end, we investigated the minimum ROI size that does not compromise the performance of the CHO model. In this study, we evaluated both simulated images and phantom CT images to identify the minimum ROI size that resulted in an accurate figure of merit (FOM) of the CHO's performance. More specifically, the minimum ROI size was evaluated as a function of the following: number of channels, spatial frequency and number of rotations of the Gabor filters, size and contrast of the object, and magnitude of the image noise. Results demonstrate that a minimum ROI size exists below which the CHO's performance is grossly inaccurate. The minimum ROI size is shown to increase with number of channels and be dictated by truncation of lower frequency filters. We developed a model to estimate the minimum ROI size as a parameterized function of the number of orientations and spatial frequencies of the Gabor filters, providing a guide for investigators to appropriately select parameters for model observer studies.

CT image quality assessment by a Channelized Hotelling Observer (CHO): Application to protocol optimization

In this work we investigate the feasibility of employing a Channelized Hotelling model Observer (CHO) in a CT protocol optimization program with the aim at assuring that the scanners are working at their own best with regard to the quality of images and patient exposure.Although the benefit of using model observers in the clinical protocol optimization is evident, in the practice it is still to be investigated what are the pitfalls associated with this method. With this concern we focused on a clinical protocol for oncology of the abdomen. For the implementation of CHO, we designed a new phantom with the aim of minimizing the number of acquired images. After tuning the model according to a restricted data set, we applied it to the evaluation of a large data set of images obtained with different reconstruction algorithms and acquired on different scanners.Results were very encouraging about the usefulness of CHO for the mentioned purposes. For the first time, at our knowledge, the applicability of CHO was demonstrated for images reconstructed with both filtered back projection (FBP) and iterative (IR) algorithms on the same scanner as well as for images from different scanners, though produced by the same manufacturer. Instead it turned out that CHO was not applicable for the same purposes over images from another manufacturer.

Evaluation of lesion detectability in positron emission tomography when using a convergent penalized likelihood image reconstruction method.

We have previously developed a convergent penalized likelihood (PL) image reconstruction algorithm using the relative difference prior (RDP) and showed that it achieves more accurate lesion quantitation compared to ordered subsets expectation maximization (OSEM). We evaluated the detectability of low-contrast liver and lung lesions using the PL-RDP algorithm compared to OSEM. We performed a two-alternative forced choice study using a channelized Hotelling observer model that was previously validated against human observers. Lesion detectability showed a stronger dependence on lesion size for PL-RDP than OSEM. Lesion detectability was improved using time-of-flight (TOF) reconstruction, with greater benefit for the liver compared to the lung and with increasing benefit for decreasing lesion size and contrast. PL detectability was statistically significantly higher than OSEM for 20mm liver lesions when contrast was [Formula: see text] ([Formula: see text]), and TOF PL detectability was statistically significantly higher than TOF OSEM for 15 and 20mm liver lesions with contrast [Formula: see text] and [Formula: see text], respectively. For all other cases, there was no statistically significant difference between PL and OSEM ([Formula: see text]). For the range of studied lesion properties, lesion detectability using PL-RDP was equivalent or improved compared to using OSEM.

Direct estimation and correction of bias from temporally variable non-stationary noise in a channelized Hotelling model observer

Channelized Hotelling model observer (CHO) methods were developed to assess performance of an x-ray angiography system. The analytical methods included correction for known bias error due to finite sampling. Detectability indices () corresponding to disk-shaped objects with diameters in the range 0.5–4 mm were calculated. Application of the CHO for variable detector target dose (DTD) in the range 6–240 nGy frame−1 resulted in estimates which were as much as 2.9× greater than expected of a quantum limited system. Over-estimation of was presumed to be a result of bias error due to temporally variable non-stationary noise. Statistical theory which allows for independent contributions of ‘signal’ from a test object (o) and temporally variable non-stationary noise (ns) was developed. The theory demonstrates that the biased is the sum of the detectability indices associated with the test object and non-stationary noise (). Given the nature of the imaging system and the experimental methods, cannot be directly determined independent of . However, methods to estimate independent of were developed. In accordance with the theory, was subtracted from experimental estimates of , providing an unbiased estimate of . Estimates of exhibited trends consistent with expectations of an angiography system that is quantum limited for high DTD and compromised by detector electronic readout noise for low DTD conditions. Results suggest that these methods provide estimates which are accurate and precise for . Further, results demonstrated that the source of bias was detector electronic readout noise. In summary, this work presents theory and methods to test for the presence of bias in Hotelling model observers due to temporally variable non-stationary noise and correct this bias when the temporally variable non-stationary noise is independent and additive with respect to the test object signal.

SU‐F‐I‐80: Correction for Bias in a Channelized Hotelling Model Observer Caused by Temporally Variable Non‐Stationary Noise

Purpose:Application of a channelized Hotelling model observer (CHO) over a wide range of x‐ray angiography detector target dose (DTD) levels demonstrated substantial bias for conditions yielding low detectability indices (d’), including low DTD and small test objects. The purpose of this work was to develop theory and methods to correct this bias.Methods:A hypothesis was developed wherein the measured detectability index (d'b) for a known test object is positively biased by temporally variable non‐stationary noise in the images. Hotelling's T2 test statistic provided the foundation for a mathematical theory which accounts for independent contributions to the measured d'b value from both the test object (d'o) and non‐stationary noise (d'ns). Experimental methods were developed to directly estimate d'o by determining d'ns and subtracting it from d'b, in accordance with the theory. Specifically, d'ns was determined from two sets of images from which the traditional test object was withheld. This method was applied to angiography images with DTD levels in the range 0 to 240 nGy and for disk‐shaped iodine‐based contrast targets with diameters 0.5 to 4.0 mm.Results:Bias in d’ was evidenced by d'b values which exceeded values expected from a quantum limited imaging system and decreasing object size and DTD. d'ns increased with decreasing DTD, reaching a maximum of 2.6 for DTD = 0. Bias‐corrected d'o estimates demonstrated sub‐quantum limited performance of the x‐ray angiography for low DTD. Findings demonstrated that the source of non‐stationary noise was detector electronic readout noise.Conclusion:Theory and methods to estimate and correct bias in CHO measurements from temporally variable non‐stationary noise were presented. The temporal non‐stationary noise was shown to be due to electronic readout noise. This method facilitates accurate estimates of d’ values over a large range of object size and detector target dose.

Impact of number of repeated scans on model observer performance for a low-contrast detection task in computed tomography.

Channelized Hotelling observer (CHO) models have been shown to correlate well with human observers for several phantom-based detection/classification tasks in clinical computed tomography (CT). A large number of repeated scans were used to achieve an accurate estimate of the model's template. The purpose of this study is to investigate how the experimental and CHO model parameters affect the minimum required number of repeated scans. A phantom containing 21 low-contrast objects was scanned on a 128-slice CT scanner at three dose levels. Each scan was repeated 100 times. For each experimental configuration, the low-contrast detectability, quantified as the area under receiver operating characteristic curve, [Formula: see text], was calculated using a previously validated CHO with randomly selected subsets of scans, ranging from 10 to 100. Using [Formula: see text] from the 100 scans as the reference, the accuracy from a smaller number of scans was determined. Our results demonstrated that the minimum number of repeated scans increased when the radiation dose level decreased, object size and contrast level decreased, and the number of channels increased. As a general trend, it increased as the low-contrast detectability decreased. This study provides a basis for the experimental design of task-based image quality assessment in clinical CT using CHO.