Observer Performance In Detection Research Articles

Applying Self-Supervised Learning to Image Quality Assessment in Chest CT Imaging.

Many new reconstruction techniques have been deployed to allow low-dose CT examinations. Such reconstruction techniques exhibit nonlinear properties, which strengthen the need for a task-based measure of image quality. The Hotelling observer (HO) is the optimal linear observer and provides a lower bound of the Bayesian ideal observer detection performance. However, its computational complexity impedes its widespread practical usage. To address this issue, we proposed a self-supervised learning (SSL)-based model observer to provide accurate estimates of HO performance in very low-dose chest CT images. Our approach involved a two-stage model combining a convolutional denoising auto-encoder (CDAE) for feature extraction and dimensionality reduction and a support vector machine for classification. To evaluate this approach, we conducted signal detection tasks employing chest CT images with different noise structures generated by computer-based simulations. We compared this approach with two supervised learning-based methods: a single-layer neural network (SLNN) and a convolutional neural network (CNN). The results showed that the CDAE-based model was able to achieve similar detection performance to the HO. In addition, it outperformed both SLNN and CNN when a reduced number of training images was considered. The proposed approach holds promise for optimizing low-dose CT protocols across scanner platforms.

Objective Image Quality Optimization in Augmented Reality Using Spatial Frequency Domain Models.

Augmented reality (AR) blends the digital and physical worlds by overlapping a virtual image onto the see-through physical environment. However, contrast reduction and noise superposition in an AR head-mounted display (HMD) can substantially limit image quality and human perceptual performance in both the digital and physical spaces. To assess image quality in AR, we performed human and model observer studies for various imaging tasks with targets placed in the digital and physical worlds. A target detection model was developed for the complete AR system including the optical see-through. Target detection performance using different observer models developed in the spatial frequency domain was compared with the human observer results. The non-prewhitening model with eye filter and internal noise results closely track human perception performance as measured by the area under the receiver operating characteristic curve (AUC), especially for tasks with high image noise. The AR HMD non-uniformity limits the low-contrast target (less than 0.02) observer performance for low image noise. In augmented reality conditions, the detectability of a target in the physical world is reduced due to the contrast reduction by the overlaid AR display image (AUC less than 0.87 for all the contrast levels evaluated). We propose an image quality optimization scheme to optimize the AR display configurations to match observer detection performance for targets in both the digital and physical worlds. The image quality optimization procedure is validated using both simulation and bench measurements of a chest radiography image with digital and physical targets for various imaging configurations.

The diagnostic performance and clinical value of deep learning-based nodule detection system concerning influence of location of pulmonary nodule

BackgroundThe deep learning-based nodule detection (DLD) system improves nodule detection performance of observers on chest radiographs (CXRs). However, its performance in different pulmonary nodule (PN) locations remains unknown.MethodsWe divided the CXR intrathoracic region into non-danger zone (NDZ) and danger zone (DZ). The DZ included the lung apices, paramediastinal areas, and retrodiaphragmatic areas, where nodules could be missed. We used a dataset of 300 CXRs (100 normal and 200 abnormal images with 216 PNs [107 NDZ and 109 DZ nodules]). Eight observers (two thoracic radiologists [TRs], two non-thoracic radiologists [NTRs], and four radiology residents [RRs]) interpreted each radiograph with and without the DLD system. The metric of lesion localization fraction (LLF; the number of correctly localized lesions divided by the total number of true lesions) was used to evaluate the diagnostic performance according to the nodule location.ResultsThe DLD system demonstrated a lower LLF for the detection of DZ nodules (64.2) than that of NDZ nodules (83.2, p = 0.008). For DZ nodule detection, the LLF of the DLD system (64.2) was lower than that of TRs (81.7, p < 0.001), which was comparable to that of NTRs (56.4, p = 0.531) and RRs (56.7, p = 0.459). Nonetheless, the LLF of RRs significantly improved from 56.7 to 65.6 using the DLD system (p = 0.021) for DZ nodule detection.ConclusionThe performance of the DLD system was lower in the detection of DZ nodules compared to that of NDZ nodules. Nonetheless, RR performance in detecting DZ nodules improved upon using the DLD system.Critical relevance statementDespite the deep learning-based nodule detection system’s limitations in detecting danger zone nodules, it proves beneficial for less-experienced observers by providing valuable assistance in identifying these nodules, thereby advancing nodule detection in clinical practice.Key points• The deep learning-based nodule detection (DLD) system can improve the diagnostic performance of observers in nodule detection.• The DLD system shows poor diagnostic performance in detecting danger zone nodules.• For less-experienced observers, the DLD system is helpful in detecting danger zone nodules.Graphical

Modeling human observer detection in undersampled magnetic resonance imaging reconstruction with total variation and wavelet sparsity regularization.

Task-based assessment of image quality in undersampled magnetic resonance imaging provides a way of evaluating the impact of regularization on task performance. In this work, we evaluated the effect of total variation (TV) and wavelet regularization on human detection of signals with a varying background and validated a model observer in predicting human performance. Human observer studies used two-alternative forced choice (2-AFC) trials with a small signal known exactly task but with varying backgrounds for fluid-attenuated inversion recovery images reconstructed from undersampled multi-coil data. We used a 3.48 undersampling factor with TV and a wavelet sparsity constraints. The sparse difference-of-Gaussians (S-DOG) observer with internal noise was used to model human observer detection. The internal noise for the S-DOG was chosen to match the average percent correct (PC) in 2-AFC studies for four observers using no regularization. That S-DOG model was used to predict the PC of human observers for a range of regularization parameters. We observed a trend that the human observer detection performance remained fairly constant for a broad range of values in the regularization parameter before decreasing at large values. A similar result was found for the normalized ensemble root mean squared error. Without changing the internal noise, the model observer tracked the performance of the human observers as the regularization was increased but overestimated the PC for large amounts of regularization for TV and wavelet sparsity, as well as the combination of both parameters. For the task we studied, the S-DOG observer was able to reasonably predict human performance with both TV and wavelet sparsity regularizers over a broad range of regularization parameters. We observed a trend that task performance remained fairly constant for a range of regularization parameters before decreasing for large amounts of regularization.

Relationship between image information content and observer performance in digital intraoral radiography.

This study conducted a receiver operating characteristic (ROC) analysis by applying improved cluster signal-to-noise (CSN) analysis to digital intraoral radiographs and develop an observer-free method of analyzing image quality related to the observer performance in the detection task. Two aluminum step phantoms with a thickness interval of 1.0mm were used for this study. One phantom had holes of increasing depth (from 0.05 to 0.35mm) and the other had no holes. Phantom images were obtained under various exposure dose and image capture modes using a dental X-ray unit, a photostimulable phosphor imaging plate, and scanner system. These phantom images were analyzed using the FindFoci plugin in ImageJ software. Subsequently, true positive rates (TPRs) and false positive rates (FPRs) were calculated by analyzing phantom images with and without holes. We constructed ROC curves by plotting the TPRs against the FPRs and calculated the area under the ROC curve (AUC). Using the same phantom images with holes, eight observers assessed the number of detectable holes. Correlations between observer detection performance and AUC values were evaluated. AUC values increased as the exposure dose increased and showed different tendencies depending on the image capture mode. The AUC values showed a high correlation with observer detection performance (r = 0.76). AUC values obtained from CSN analysis reflect image quality and replace the observer detection performance test of image quality.

Modeling human observer detection in undersampled magnetic resonance imaging (MRI).

Task-based assessment of image quality in undersampled magnetic resonance imaging (MRI) using constraints is important because of the need to quantify the effect of the artifacts on task performance. Fluid-attenuated inversion recovery (FLAIR) images are used in detection of small metastases in the brain. In this work we carry out two-alternative forced choice (2-AFC) studies with a small signal known exactly (SKE) but with varying background for reconstructed FLAIR images from undersampled multi-coil data. Using a 4x undersampling and a total variation (TV) constraint we found that the human observer detection performance remained fairly constant for a broad range of values in the regularization parameter before decreasing at large values. Using the TV constraint did not improve task performance. The non- prewhitening eye (NPWE) observer and sparse difference-of-Gaussians (S-DOG) observer with internal noise were used to model human observer detection. The parameters for the NPWE and the internal noise for the S-DOG were chosen to match the average percent correct (PC) in 2-AFC studies for three observers using no regularization. The NPWE model observer tracked the performance of the human observers as the regularization was increased but slightly over-estimated the PC for large amounts of regularization. The S-DOG model observer with internal noise tracked human performace for all levels of regularization studied. To our knowledge this is the first time that model observers have been used to track human observer detection for undersampled MRI.

On the correlation between second order texture features and human observer detection performance in digital images

Image texture, the relative spatial arrangement of intensity values in an image, encodes valuable information about the scene. As it stands, much of this potential information remains untapped. Understanding how to decipher textural details would afford another method of extracting knowledge of the physical world from images. In this work, we attempt to bridge the gap in research between quantitative texture analysis and the visual perception of textures. The impact of changes in image texture on human observer’s ability to perform signal detection and localization tasks in complex digital images is not understood. We examine this critical question by studying task-based human observer performance in detecting and localizing signals in tomographic breast images. We have also investigated how these changes impact the formation of second-order image texture. We used digital breast tomosynthesis (DBT) an FDA approved tomographic X-ray breast imaging method as the modality of choice to show our preliminary results. Our human observer studies involve localization ROC (LROC) studies for low contrast mass detection in DBT. Simulated images are used as they offer the benefit of known ground truth. Our results prove that changes in system geometry or processing leads to changes in image texture magnitudes. We show that the variations in several well-known texture features estimated in digital images correlate with human observer detection–localization performance for signals embedded in them. This insight can allow efficient and practical techniques to identify the best imaging system design and algorithms or filtering tools by examining the changes in these texture features. This concept linking texture feature estimates and task based image quality assessment can be extended to several other imaging modalities and applications as well. It can also offer feedback in system and algorithm designs with a goal to improve perceptual benefits. Broader impact can be in wide array of areas including imaging system design, image processing, data science, machine learning, computer vision, perceptual and vision science. Our results also point to the caution that must be exercised in using these texture features as image-based radiomic features or as predictive markers for risk assessment as they are sensitive to system or image processing changes.

Objective assessment of task performance: a comparison of two FFDM detectors using an anthropomorphic breast phantom.

Current digital mammography systems primarily employ one of two types of detectors: indirect conversion, typically using a cesium-iodine scintillator integrated with an amorphous silicon photodiode matrix, or direct conversion, using a photoconductive layer of amorphous selenium (a-Se) combined with thin-film transistor array. The goal of this study was to evaluate a methodology for objectively assessing image quality to compare human observer task performance in detecting microcalcification clusters and extended mass-like lesions achieved with different detector types. The proposed assessment methodology uses a novel anthropomorphic breast phantom fabricated with ink-jet printing. In addition to human observer detection performance, standard linear metrics such as modulation transfer function, noise power spectrum, and detective quantum efficiency (DQE) were also measured to assess image quality. An Analogic Anrad AXS-2430 a-Se detector used in a commercial FFDM/DBT system and a Teledyne Dalsa Xineos-2329 with CMOS pixel readout were evaluated and compared. The DQE of each detector was similar over a range of exposures. Similar task performance in detecting microcalcifications and masses was observed between the two detectors over a range of clinically applicable dose levels, with some perplexing differences in the detection of microcalcifications at the lowest dose measurement. The evaluation approach presented seems promising as a new technique for objective assessment of breast imaging technology.

Channelized Hotelling observer correlation with human observers for low-contrast detection in liver CT images.

Task-based image quality procedures in CT that substitute a human observer with a model observer usually use single-slice images with uniform backgrounds from homogeneous phantoms. However, anatomical structures and inhomogeneities in organs generate noise that can affect the detection performance of human observers. The purpose of this work was to assess the impact of background type, uniform or liver, and the viewing modality, single- or multislice, on the detection performance of human and model observers. We collected abdominal CT scans from patients and homogeneous phantom scans in which we digitally inserted low-contrast signals that mimicked a liver lesion. We ran a rating experiment with the two background conditions with three signal sizes and three human observers presenting images in two reading modalities: single- and multislice. In addition, channelized Hotelling observers (CHO) for single- and multislice detection were implemented and evaluated according to their degree of correlation with the human observer performance. For human observers, there was a small but significant improvement in performance with multislice compared to the single-slice viewing mode. Our data did not reveal a significant difference between uniform and anatomical backgrounds. Model observers demonstrated a good correlation with human observers for both viewing modalities. Human observers have very similar performances in both multi- and single-slice viewing mode. It is therefore preferable to use single-slice CHO as this model is computationally more tractable than multislice CHO. However, using images from a homogeneous phantom can result in overestimating image quality as CHO performance tends to be higher in uniform than anatomical backgrounds, while human observers have similar detection performances.

Lesion detectability in 2D-mammography and digital breast tomosynthesis using different targets and observers

This work investigates the detection performance of specialist and non-specialist observers for different targets in 2D-mammography and digital breast tomosynthesis (DBT) using the OPTIMAM virtual clinical trials (VCT) Toolbox and a 4-alternative forced choice (4AFC) assessment paradigm.Using 2D-mammography and DBT images of virtual breast phantoms, we compare the detection limits of simple uniform spherical targets and irregular solid masses. Target diameters of 4 mm and 6 mm have been chosen to represent target sizes close to the minimum detectable size found in breast screening, across a range of controlled contrast levels. The images were viewed by a set of specialist observers (five medical physicists and six experienced clinical readers) and five non-specialists.Combined results from both observer groups indicate that DBT has a significantly lower detectable threshold contrast than 2D-mammography for small masses (4 mm: 2.1% [DBT] versus 6.9% [2D]; 6 mm: 0.7% [DBT] versus 3.9% [2D]) and spheres (4 mm: 2.9% [DBT] versus 5.3% [2D]; 6 mm: 0.3% [DBT] versus 2.2% [2D]) (p < 0.0001). Both observer groups found spheres significantly easier to detect than irregular solid masses for both sizes and modalities (p < 0.0001) (except 4 mm DBT). The detection performances of specialist and non-specialist observers were generally found to be comparable, where each group marginally outperformed the other in particular detection tasks. Within the specialist group, the clinical readers performed better than the medical physicists with irregular masses (p < 0.0001).The results indicate that using spherical targets in such studies may produce over-optimistic detection thresholds compared to more complex masses, and that the superiority of DBT for detecting masses over 2D-mammography has been quantified. The results also suggest specialist observers may be supplemented by non-specialist observers (with training) in some types of 4AFC studies.

Cluster signal-to-noise analysis for evaluation of the information content in an image.

(1) To develop an observer-free method of analysing image quality related to the observer performance in the detection task and (2) to analyse observer behaviour patterns in the detection of small mass changes in cone-beam CT images. 13 observers detected holes in a Teflon phantom in cone-beam CT images. Using the same images, we developed a new method, cluster signal-to-noise analysis, to detect the holes by applying various cut-off values using ImageJ and reconstructing cluster signal-to-noise curves. We then evaluated the correlation between cluster signal-to-noise analysis and the observer performance test. We measured the background noise in each image to evaluate the relationship with false positive rates (FPRs) of the observers. Correlations between mean FPRs and intra- and interobserver variations were also evaluated. Moreover, we calculated true positive rates (TPRs) and accuracies from background noise and evaluated their correlations with TPRs from observers. Cluster signal-to-noise curves were derived in cluster signal-to-noise analysis. They yield the detection of signals (true holes) related to noise (false holes). This method correlated highly with the observer performance test (R2 = 0.9296). In noisy images, increasing background noise resulted in higher FPRs and larger intra- and interobserver variations. TPRs and accuracies calculated from background noise had high correlation with actual TPRs from observers; R2 was 0.9244 and 0.9338, respectively. Cluster signal-to-noise analysis can simulate the detection performance of observers and thus replace the observer performance test in the evaluation of image quality. Erroneous decision-making increased with increasing background noise.

Blurred digital mammography images: an analysis of technical recall and observer detection performance.

Blurred images in full-field digital mammography are a problem in the UK Breast Screening Programme. Technical recalls may be due to blurring not being seen on lower resolution monitors used for review. This study assesses the visual detection of blurring on a 2.3-MP monitor and a 5-MP report grade monitor and proposes an observer standard for the visual detection of blurring on a 5-MP reporting grade monitor. 28 observers assessed 120 images for blurring; 20 images had no blurring present, whereas 100 images had blurring imposed through mathematical simulation at 0.2, 0.4, 0.6, 0.8 and 1.0 mm levels of motion. Technical recall rate for both monitors and angular size at each level of motion were calculated. χ2 tests were used to test whether significant differences in blurring detection existed between 2.3- and 5-MP monitors. The technical recall rate for 2.3- and 5-MP monitors are 20.3% and 9.1%, respectively. The angular size for 0.2- to 1-mm motion varied from 55 to 275 arc s. The minimum amount of motion for visual detection of blurring in this study is 0.4 mm. For 0.2-mm simulated motion, there was no significant difference [χ2 (1, N = 1095) = 1.61, p = 0.20] in blurring detection between the 2.3- and 5-MP monitors. According to this study, monitors ≤2.3 MP are not suitable for technical review of full-field digital mammography images for the detection of blur. Advances in knowledge: This research proposes the first observer standard for the visual detection of blurring.

Investigation on slice direction dependent detectability of volumetric cone beam CT images.

We investigate the detection performance of transverse and longitudinal planes for various signal sizes (i.e., 1 mm to 8 mm diameter spheres) in cone beam computed tomography (CBCT) images. CBCT images are generated by computer simulation and images are reconstructed using an FDK algorithm. For each slice direction and signal size, a human observer study is conducted with a signal-known-exactly/background-known-exactly (SKE/BKE) binary detection task. The detection performance of human observers is compared with that of a channelized Hotelling observer (CHO). The detection performance of an ideal linear observer is also calculated using a CHO with Laguerre-Gauss (LG) channels. The detectability of high contrast small signals (i.e., up to 4-mm-diameter spheres) is higher in the longitudinal plane than the transverse plane. It is also shown that CHO performance correlates well with human observer performance in both transverse and longitudinal plane images.

Evaluation of detection and discrimination ability of peripheral vision on notification information based on large displays

Large displays enable users to perform several tasks simultaneously. Under such circumstances, notification information provided through the concept of ambient displays plays a vital role in assisting users to switch among tasks. This paper presents the experimental results of a notification system design in the peripheral region of large displays. The aim is to provide guidance for notification information design by investigating detection and discrimination performance of human observers when visual notification information is presented away from the foveal region and viewed using peripheral vision. The proposed notification system was designed using an array of glyphs. Each glyph is a small gray square with a fixed size of 60×60 pixels. By changing the gray levels of adjacent glyphs dynamically, a glyph array presents a particular dynamic pattern. The experiments involved testing factors that comprised the visual angle, size and shape of glyph arrays, frequency of temporal modulation, phase shift of each pattern, and number of stimuli. The results show that glyph arrays are detected accurately if they are larger, even at wide viewing angles, and that the number of glyphs in a glyph array affects the performance more than the shapes of glyph arrays do. Furthermore, the discrimination performance is higher when both the frequency and phase are manipulated simultaneously (multidimensional design), compared with the case when each of these dimensions is varied separately (single-dimensional design). When the number of stimuli is set at 8, for example, users can maintain an accuracy rate of 70% for the multidimensional design, whereas the accuracy rate is only approximately 60% for the single-dimensional design.

Task-based evaluation of a 4D MAP-RBI-EM image reconstruction method for gated myocardial perfusion SPECT using a human observer study

We evaluated the performance of a new 4D image reconstruction method for improved 4D gated myocardial perfusion (MP) SPECT using a task-based human observer study. We used a realistic 4D NURBS-based Cardiac-Torso (NCAT) phantom that models cardiac beating motion. Half of the population was normal; the other half had a regional hypokinetic wall motion abnormality. Noise-free and noisy projection data with 16 gates/cardiac cycle were generated using an analytical projector that included the effects of attenuation, collimator-detector response, and scatter (ADS), and were reconstructed using the 3D FBP without and 3D OS-EM with ADS corrections followed by different cut-off frequencies of a 4D linear post-filter. A 4D iterative maximum a posteriori rescaled-block (MAP-RBI)-EM image reconstruction method with ADS corrections was also used to reconstruct the projection data using various values of the weighting factor for its prior. The trade-offs between bias and noise were represented by the normalized mean squared error (NMSE) and averaged normalized standard deviation (NSDav), respectively. They were used to select reasonable ranges of the reconstructed images for use in a human observer study. The observers were trained with the simulated cine images and were instructed to rate their confidence on the absence or presence of a motion defect on a continuous scale. We then applied receiver operating characteristic (ROC) analysis and used the area under the ROC curve (AUC) index. The results showed that significant differences in detection performance among the different NMSE-NSDav combinations were found and the optimal trade-off from optimized reconstruction parameters corresponded to a maximum AUC value. The 4D MAP-RBI-EM with ADS correction, which had the best trade-off among the tested reconstruction methods, also had the highest AUC value, resulting in significantly better human observer detection performance when detecting regional myocardial wall motion abnormality. We concluded that the NMSE-NSDav trade-off was shown to agree with observer performance for the detection task of the regional motion abnormality, and the optimized 4D MAP-RBI-EM method with ADS corrections provides significant improvement compared to 3D FBP and 3D OS-EM with ADS corrections in detecting regional myocardial wall motion abnormali in 4D gated MP SPECT.

Simulated lesion, human observer performance comparison between thin-section dedicated breast CT images versus computed thick-section simulated projection images of the breast

The objective of this study was to compare the lesion detection performance of human observers between thin-section computed tomography images of the breast, with thick-section (>40 mm) simulated projection images of the breast.Three radiologists and six physicists each executed a two alterative force choice (2AFC) study involving simulated spherical lesions placed mathematically into breast images produced on a prototype dedicated breast CT scanner. The breast image data sets from 88 patients were used to create 352 pairs of image data. Spherical lesions with diameters of 1, 2, 3, 5, and 11 mm were simulated and adaptively positioned into 3D breast CT image data sets; the native thin section (0.33 mm) images were averaged to produce images with different slice thicknesses; average section thicknesses of 0.33, 0.71, 1.5 and 2.9 mm were representative of breast CT; the average 43 mm slice thickness served to simulate simulated projection images of the breast.The percent correct of the human observer’s responses were evaluated in the 2AFC experiments. Radiologists lesion detection performance was significantly (p < 0.05) better in the case of thin-section images, compared to thick section images similar to mammography, for all but the 1 mm lesion diameter lesions. For example, the average of three radiologist’s performance for 3 mm diameter lesions was 92% correct for thin section breast CT images while it was 67% for the simulated projection images. A gradual reduction in observer performance was observed as the section thickness increased beyond about 1 mm. While a performance difference based on breast density was seen in both breast CT and the projection image results, the average radiologist performance using breast CT images in dense breasts outperformed the performance using simulated projection images in fatty breasts for all lesion diameters except 11 mm. The average radiologist performance outperformed that of the average physicist observer, however trends in performance were similar.Human observers demonstrate significantly better mass-lesion detection performance on thin-section CT images of the breast, compared to thick-section simulated projection images of the breast.

Numerical Surrogates for Human Observers in Myocardial Motion Evaluation From SPECT Images

In medical imaging, the gold standard for image-quality assessment is a task-based approach in which one evaluates human observer performance for a given diagnostic task (e.g., detection of a myocardial perfusion or motion defect). To facilitate practical task-based image-quality assessment, model observers are needed as approximate surrogates for human observers. In cardiac-gated SPECT imaging, diagnosis relies on evaluation of the myocardial motion as well as perfusion. Model observers for the perfusion-defect detection task have been studied previously, but little effort has been devoted toward development of a model observer for cardiac-motion defect detection. In this work, we describe two model observers for predicting human observer performance in detection of cardiac-motion defects. Both proposed methods rely on motion features extracted using previously reported deformable mesh model for myocardium motion estimation. The first method is based on a Hotelling linear discriminant that is similar in concept to that used commonly for perfusion-defect detection. In the second method, based on relevance vector machines (RVM) for regression, we compute average human observer performance by first directly predicting individual human observer scores, and then using multi reader receiver operating characteristic analysis. Our results suggest that the proposed RVM model observer can predict human observer performance accurately, while the new Hotelling motion-defect detector is somewhat less effective.

Comparison of Liquid Crystal Display Monitors Calibrated With Gray-Scale Standard Display Function and With γ 2.2 and iPad: Observer Performance in Detection of Cerebral Infarction on Brain CT

The purpose of the study was to compare observer performance in the detection of cerebral infarction on a brain CT using medical-grade liquid crystal display (LCD) monitors calibrated with the gray-scale standard display function and with γ 2.2 and using an iPad with a simulated screen setting. We amassed 97 sample sets, from 47 patients with proven cerebral infarction and 50 healthy control subjects. Nine radiologists independently assessed brain CT on a gray-scale standard display function LCD, a γ 2.2 LCD, and an iPad in random order over 4-week intervals. Receiver operating characteristic (ROC) analysis was performed by using the continuous scale, and the area under the ROC curve (A(z)) was calculated for each monitor. The A(z) values for gray-scale standard display function LCD, γ 2.2 LCD, and iPad were 0.875, 0.884, and 0.839, respectively. The difference among the three monitors was very small. There was no significant difference between gray-scale standard display function LCD and γ 2.2 LCD. However, the A(z) value was statistically significantly smaller for the iPad than the γ 2.2 LCD (p < 0.05). Observer performance for detecting cerebral infarction on the LCD with γ 2.2 calibration was found to be similar to the LCD with gray-scale standard display function calibration. Although observer performance using the iPad was poorer than that using the other LCDs, the difference was small. Therefore, the iPad could not substitute for other LCD monitors. However, owing to the promising potential advantages of tablet PCs, such as portability, further examination is needed into the clinical use of tablet PCs.

Observer detection and discrimination performance as a function of clutter: a signal detection approach

In this paper we investigate the use of signal detection theory (SDT) in predicting target detection and discrimination in disorganized clutter. Two normal observers performed monocular visual search experiments at 25 cm, in the dark. They detected Gabor gratings on an achromatic background cluttered with 2000 or 500 random dots. The targets were displayed at pseudorandom locations from 0–20° and 20–47°, by method of constant stimuli. A contrast-based detection and orientation-based discrimination task was completed in a yes/no or 2-alternative-forced-choice (2AFC) task. The hit rate, false alarm rate, detectability, criterion and bias were analysed. The psychometric function indicated low detection and discrimination thresholds in low clutter that increased in high clutter. Increased clutter showed high hit rates and a false alarm rate that increased with low detectability and liberal criterion. In the detection task, low clutter showed high hit rates and low false alarm rates in the central field. Therefore, SDT proves useful to predict observer performance in visual scenes with disorganized clutter.

73.5L: Late‐News Paper: Observer Strategies for Assessment of Temporal Response — Effect of Technology

AbstractWe compare the detection performance of human observers in LCDs and CRTs using artificial complex backgrounds. Our results suggest that the degradation in performance at high browsing speeds observed in LCDs is not seen or much more subtle in CRTs, even at 50 frames per second.