Summary Estimates Of Diagnostic Accuracy Research Articles

Diagnostic accuracy of NI-RADS for prediction of head and neck squamous cell carcinoma: a systematic review and meta-analysis.

This study aimed to assess the diagnostic performance of NI-RADS for the prediction of recurrence in patients treated for Head and Neck Squamous Cell Carcinoma (HNSCC). A literature search was conducted using various databases to identify relevant articles published from June 2016 onwards. We included studies reporting the diagnostic accuracy of NI-RADS in distinguishing recurrence in patients undergoing imaging surveillance, with pathologic results and/or follow-up as the reference standard. Summary estimates of diagnostic accuracy in terms of sensitivity, specificity, positive likelihood ratio (LR +), negative likelihood ratio (LR -), and diagnostic odds ratio (DOR) were calculated with the hierarchical summary receiver operating characteristic (HSROC) model. Meta-regression and subgroup analyses were conducted to investigate different clinical settings. Study quality was evaluated using the Quality Assessment of Diagnostic Accuracy Studies-2 tool. A total of 12 studies were included in the current meta-analysis. The pooled sensitivity and specificity were 0.69 (95% CI 0.59-0.79) and 0.94 (95% CI 0.89-0.97), respectively. For the primary site, the pooled summary estimates were 0.67 (95% CI 0.53-0.78) and 0.95 (95% CI 0.90-0.97), for the nodal sites were 0.64 (95% CI 0.44-0.80) and 0.99 (95% CI 0.98-0.99), respectively. The recurrence rate for NI-RADS categories 1-3 was 0.03 (95% CI 0.02-0.05), 0.13 (95% CI 0.10-0.15), and 0.77 (95% CI 0.73-0.81). Meta-regression revealed that the type of analysis (per person vs. per site) and number of sites (≤ 200 vs. > 200) were significant factors associated with heterogeneity. NI-RADS demonstrated high specificity but moderate sensitivity in patients after treatment for HNSCC. Summary estimates showed a significantly higher malignancy rate for NI-RADS category 3 compared to category 2.

Diagnostic performance of VEGF-D for lymphangioleiomyomatosis: a meta-analysis.

ABSTRACTObjective:VEGF-D is a potential biomarker for lymphangioleiomyomatosis (LAM); however, its diagnostic performance has yet to be systematically studied. Methods:We searched PubMed, EMBASE, Scopus, Web of Science, and Cochrane Library to identify primary studies on VEGF-D in relation to the diagnosis of LAM. The quality of the studies was evaluated using the Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2). Summary estimates of diagnostic accuracy were pooled using a bivariate random effects model. Subgroup and sensitivity analyses were performed to explore possible heterogeneity. The Grading of Recommendations Assessment, Development, and Evaluation (GRADE) was applied to rate the quality of evidence and indicate the strength of recommendations. Results:Ten studies involving 945 patients were of high risk in quality, as assessed using the QUADAS-2. The pooled diagnostic parameters were indicated as follows: sensitivity = 0.82 (95% CI, 0.71-0.90); specificity = 0.98 (95% CI, 0.94-0.99); and diagnostic OR = 197 (95% CI, 66-587). The AUC of summary ROC analysis was 0.98. The subgroup and sensitivity analyses revealed that the overall performance was not substantially affected by the composition of the control group, prespecified cutoff value, the country of origin, or different cutoff values (p > 0.05 for all). A strong recommendation for serum VEGF-D determination to aid in the diagnosis of LAM was made according to the GRADE. Conclusions:VEGF-D seems to have great potential implications for the diagnosis of LAM in clinical practice due to its excellent specificity and suboptimal sensitivity.

Systematic review and meta-analysis of the diagnostic accuracy of prostate-specific antigen (PSA) for the detection of prostate cancer in symptomatic patients

BackgroundProstate-specific antigen (PSA) is a commonly used test to detect prostate cancer. Attention has mostly focused on the use of PSA in screening asymptomatic patients, but the diagnostic accuracy of PSA for prostate cancer in patients with symptoms is less well understood.MethodsA systematic database search was conducted of Medline, EMBASE, Web of Science, and the Cochrane library. Studies reporting the diagnostic accuracy of PSA for prostate cancer in patients with symptoms were included. Two investigators independently assessed the titles and abstracts of all database search hits and full texts of potentially relevant studies against the inclusion criteria, and data extracted into a proforma. Study quality was assessed using the QUADAS-2 tool by two investigators independently. Summary estimates of diagnostic accuracy were calculated with meta-analysis using bivariate mixed effects regression.ResultsFive hundred sixty-three search hits were assessed by title and abstract after de-duplication, with 75 full text papers reviewed. Nineteen studies met the inclusion criteria, 18 of which were conducted in secondary care settings with one from a screening study cohort. All studies used histology obtained by transrectal ultrasound-guided biopsy (TRUS) as a reference test; usually only for patients with elevated PSA or abnormal prostate examination. Pooled data from 14,489 patients found estimated sensitivity of PSA for prostate cancer was 0.93 (95% CI 0.88, 0.96) and specificity was 0.20 (95% CI 0.12, 0.33). The area under the hierarchical summary receiver operator characteristic curve was 0.72 (95% CI 0.68, 0.76). All studies were assessed as having a high risk of bias in at least one QUADAS-2 domain.ConclusionsCurrently available evidence suggests PSA is highly sensitive but poorly specific for prostate cancer detection in symptomatic patients. However, significant limitations in study design and reference test reduces the certainty of this estimate. There is very limited evidence for the performance of PSA in primary care, the healthcare setting where most PSA testing is performed.

Diagnostic Accuracy of Imaging Findings in Pleural Empyema: Systematic Review and Meta-Analysis.

Computed tomography (CT) diagnosis of empyema is challenging because current literature features multiple overlapping pleural findings. We aimed to identify informative findings for structured reporting. The screening according to inclusion criteria (P: Pleural empyema, I: CT C: culture/gram-stain/pathology/pus, O: Diagnostic accuracy measures), data extraction, and risk of bias assessment of studies published between 01-1980 and 10-2021 on Pubmed, Embase, and Web of Science (WOS) were performed independently by two reviewers. CT findings with pooled diagnostic odds ratios (DOR) with 95% confidence intervals, not including 1, were considered as informative. Summary estimates of diagnostic accuracy for CT findings were calculated by using a bivariate random-effects model and heterogeneity sources were evaluated. Ten studies with a total of 252 patients with and 846 without empyema were included. From 119 overlapping descriptors, five informative CT findings were identified: Pleural enhancement, thickening, loculation, fat thickening, and fat stranding with an AUC of 0.80 (hierarchical summary receiver operating characteristic, HSROC). Potential sources of heterogeneity were different thresholds, empyema prevalence, and study year.

Early detection treatment response for head and neck carcinomas using intravoxel incoherent motion-magnetic resonance imaging: a meta-analysis.

To evaluate the diagnostic accuracy of intravoxel incoherent motion-MRI (IVIM-MRI) for predicting the treatment response in head and neck squamous cell carcinomas (HNSCC) patients. A comprehensive literature search was performed to identify original articles on diagnostic performance of IVIM in predicting treatment response in HNSCC patients receiving chemoradiotherapy. The IVIM parameters studied were diffusion coefficient (D), pseudodiffusion coefficient (D*), perfusion fraction (f), and apparent diffusion coefficient. Summary estimates of diagnostic accuracy were obtained by using a random-effects model. Of 65 studies screened, 8 studies with 347 patients were finally included. The pooled sensitivities and specificities were 76% [95% confidence interval (CI) 69-82%] and 81% (95% CI 70-89%) for pre-treatment D, and 70% (95% CI 58-80%) and 82% (95% CI 66-92%) for △D, respectively. In addition, the sensitivities and specificities ranged from 41.7 to 94% and 67 to 100% for pre-treatment f, and from 55.7 to 76.5% and 72.2 to 93.3% for pre-treatment apparent diffusion coefficient, respectively. The diffusion-related coefficients pre-treatment D and △D demonstrated good accuracy in predicting early treatment response in HNSCC patients. However, because of the variability in reference test and other limitations of included literature, further investigation is needed before implementing any IVIM strategy into clinical practice.

Diagnostic performance of whole-lesion apparent diffusion coefficient histogram analysis metrics for differentiating benign and malignant breast lesions: a systematic review and diagnostic meta-analysis.

Although whole-lesion apparent diffusion coefficient (ADC) histogram has been increasingly used for breast lesions, it has not been routinely used in clinical practice as an emergent promising imaging tool. To evaluate the performance of whole-lesion ADC histogram analysis metrics for differentiating benign and malignant breast lesions. A systematic PubMed/EMBASE/Cochrane electronic database search was performed for original diagnostic studies from 1 January 1970 to 2 January 2019. Summary estimates of diagnostic accuracy were generated and meta-regression was performed to explore sources of heterogeneity according to study and magnetic resonance imaging characteristics. Five original articles involving 493 patients were included in the meta-analysis. The pooled sensitivity and specificity of whole-lesion ADC histogram analysis were 0.85 (95% confidence interval [CI] = 0.81-0.89) and 0.79 (95% CI = 0.72-0.84) for distinguishing benign and malignant breast lesions, respectively. The area under the curve (AUC) was 0.9178. No publication bias was detected (P = 0.51). In subgroup analysis, the summary sensitivity and specificity of 50th percentile ADC value were 0.81 (95% CI = 0.71-0.88) and 0.86 (95% CI = 0.74-0.94), respectively. Meta-regression analysis indicated no covariates were sources of heterogeneity (P > 0.05). Whole-lesion ADC histogram analysis demonstrated good diagnostic performance for differentiating between benign and malignant breast lesions, with 50th percentile ADC value showing higher diagnostic accuracy than other histogram parameters. Given the limited number of studies included in the analysis, the findings from our meta-analysis will need further confirmation in future research.

Lead-I ECG for detecting atrial fibrillation in patients attending primary care with an irregular pulse using single-time point testing: A systematic review and economic evaluation.

BackgroundAtrial fibrillation (AF) is the most common type of cardiac arrhythmia and is associated with increased risk of stroke and congestive heart failure. Lead-I electrocardiogram (ECG) devices are handheld instruments that can detect AF at a single-time point.PurposeTo assess the diagnostic test accuracy, clinical impact and cost effectiveness of single-time point lead-I ECG devices compared with manual pulse palpation (MPP) followed by a 12-lead ECG for the detection of AF in symptomatic primary care patients with an irregular pulse.MethodsElectronic databases (MEDLINE, MEDLINE Epub Ahead of Print and MEDLINE In-Process, EMBASE, PubMed and Cochrane Databases of Systematic Reviews, Cochrane Central Database of Controlled Trials, Database of s of Reviews of Effects, Health Technology Assessment Database) were searched to March 2018. Two reviewers screened the search results, extracted data and assessed study quality. Summary estimates of diagnostic accuracy were calculated using bivariate models. Cost-effectiveness was evaluated using an economic model consisting of a decision tree and two cohort Markov models.ResultsDiagnostic accuracyThe diagnostic accuracy (13 publications reporting on nine studies) and clinical impact (24 publications reporting on 19 studies) results are derived from an asymptomatic population (used as a proxy for people with signs or symptoms of AF). The summary sensitivity of lead-I ECG devices was 93.9% (95% confidence interval [CI]: 86.2% to 97.4%) and summary specificity was 96.5% (95% CI: 90.4% to 98.8%).Cost effectivenessThe de novo economic model yielded incremental cost effectiveness ratios (ICERs) per quality adjusted life year (QALY) gained. The results of the pairwise analysis show that all lead-I ECG devices generate ICERs per QALY gained below the £20,000-£30,000 threshold. Kardia Mobile is the most cost effective option in a full incremental analysis. Lead-I ECG tests may identify more AF cases than the standard diagnostic pathway. This comes at a higher cost but with greater patient benefit in terms of mortality and quality of life.LimitationsNo published data evaluating the diagnostic accuracy, clinical impact or cost effectiveness of lead-I ECG devices for the target population are available.ConclusionsThe use of single-time point lead-I ECG devices in primary care for the detection of AF in people with signs or symptoms of AF and an irregular pulse appears to be a cost effective use of NHS resources compared with MPP followed by a 12-lead ECG, given the assumptions used in the base case model.RegistrationThe protocol for this review is registered on PROSPERO as CRD42018090375.

Comparing amide proton transfer imaging with dynamic susceptibility contrast-enhanced perfusion in predicting histological grades of gliomas: a meta-analysis.

Background As a subtype of chemical exchange saturation transfer imaging without contrast agent administration, amide proton transfer (APT) imaging has demonstrated the potential for differentiating the histologic grades of gliomas. Dynamic susceptibility contrast-enhanced perfusion, a perfusion-weighted imaging technique, is a well-established technique in grading gliomas. Purpose To compare the ability of amide proton transfer and dynamic susceptibility contrast-enhanced imaging for predicting the grades of gliomas. Material and Methods A comprehensive literature search was performed independently by two observers to identify articles about the diagnostic performance of amide proton transfer and dynamic susceptibility contrast-enhanced perfusion in predicting the grade of gliomas. Summary estimates of diagnostic accuracy were obtained by using a random-effects model. Results Of 179 studies identified, 23 studies were included the analysis. Eight studies evaluated amide proton transfer and 16 studies evaluated dynamic susceptibility contrast-enhanced perfusion with the parameter rCBV. The pooled sensitivities and specificities of each study’s best performing parameter were 88% (95% confidence interval [CI] 74–95) and 89% (95% CI 78–95) for amide proton transfer, and 95% (95% CI 87–98), 88% (95% CI 81–93) for perfusion-weighted imaging–dynamic susceptibility contrast-enhanced perfusion, respectively. The pooled sensitivities and specificities for grading gliomas using the two most commonly evaluated parameters, were 92% (95% CI 80–97) and 90% (95% CI 75–96) for APTmax, and 97% (95% CI 91–99) and 87% (95% CI 80–92) for rCBVmax, respectively. Conclusion Considering the similar performance of APT and dynamic susceptibility contrast-enhanced (DSC) in predicting glioma grade, the former method appears preferable since it needs no contrast agent.

Adjunctive colposcopy technologies for assessing suspected cervical abnormalities: systematic reviews and economic evaluation.

Dynamic Spectral Imaging System (DySIS)map (DySIS Medical Ltd, Edinburgh, UK) and ZedScan (Zilico Limited, Manchester, UK) can be used adjunctively with conventional colposcopy, which may improve the detection of cervical intraepithelial neoplasia (CIN) and cancer. To systematically review the evidence on the diagnostic accuracy, clinical effectiveness and implementation of DySISmap and ZedScan as adjuncts to standard colposcopy, and to develop a cost-effectiveness model. Four parallel systematic reviews were performed on diagnostic accuracy, clinical effectiveness issues, implementation and economic analyses. In January 2017 we searched databases (including MEDLINE and EMBASE) for studies in which DySISmap or ZedScan was used adjunctively with standard colposcopy to detect CIN or cancer in women referred to colposcopy. Risk of bias was assessed with the Quality Assessment of Diagnostic Accuracy Studies (QUADAS)-2 tool. Summary estimates of diagnostic accuracy were calculated using bivariate and other regression models when appropriate. Other outcomes were synthesised narratively. A patient-level state-transition model was developed to evaluate the cost-effectiveness of DySISmap and ZedScan under either human papillomavirus (HPV) triage or the HPV primary screening algorithm. The model included two types of clinics ['see and treat' and 'watchful waiting' (i.e. treat later after confirmatory biopsy)], as well as the reason for referral (low-grade or high-grade cytological smear). Sensitivity and scenario analyses were undertaken. Eleven studies were included in the diagnostic review (nine of DySISmap and two of ZedScan), three were included in the clinical effectiveness review (two of DySISmap and one of ZedScan) and five were included in the implementation review (four of DySISmap and one of ZedScan). Adjunctive DySISmap use was found to have a higher sensitivity for detecting CIN grade 2+ (CIN 2+) lesions [81.25%, 95% confidence interval (CI) 72.2% to 87.9%] than standard colposcopy alone (57.91%, 95% CI 47.2% to 67.9%), but with a lower specificity (70.40%, 95% CI 59.4% to 79.5%) than colposcopy (87.41%, 95% CI 81.7% to 91.5%). (Confidential information has been removed.) The base-case cost-effectiveness results showed that adjunctive DySISmap routinely dominated standard colposcopy (it was less costly and more effective). The only exception was for high-grade referrals in a watchful-waiting clinic setting. The incremental cost-effectiveness ratio for ZedScan varied between £272 and £4922 per quality-adjusted life-year. ZedScan also dominated colposcopy alone for high-grade referrals in see-and-treat clinics. These findings appeared to be robust to a wide range of sensitivity and scenario analyses. All but one study was rated as being at a high risk of bias. There was no evidence directly comparing ZedScan with standard colposcopy. No studies directly compared DySIS and ZedScan. The use of adjunctive DySIS increases the sensitivity for detecting CIN 2+, so it increases the number of high-grade CIN cases that are detected. However, it also reduces specificity, so that more women with no or low-grade CIN will be incorrectly judged as possibly having high-grade CIN. The evidence for ZedScan was limited, but it appears to increase sensitivity and decrease specificity compared with colposcopy alone. The cost-effectiveness of both adjunctive technologies compared with standard colposcopy, under both the HPV triage and primary screening algorithms, appears to be favourable when compared with the conventional thresholds used to determine value in the NHS. More diagnostic accuracy studies of ZedScan are needed, as are studies assessing the diagnostic accuracy for women referred to colposcopy as part of the HPV primary screening programme. This study is registered as PROSPERO CRD42017054515. The National Institute for Health Research Health Technology Assessment programme.

Diagnostic accuracy of virtual non-contrast enhanced dual-energy CT for diagnosis of adrenal adenoma: A systematic review and meta-analysis.

To compare the diagnostic accuracy of dual-energy (DE) virtual non-contrast computed tomography (vNCT) to non-contrast CT (NCT) for the diagnosis of adrenal adenomas. Search of multiple databases and grey literature was performed. Two reviewers independently applied inclusion criteria and extracted data. Risk of bias was assessed using QUADAS-2. Summary estimates of diagnostic accuracy were generated and sources of heterogeneity were assessed. Five studies (170 patients; 192 adrenal masses) were included for diagnostic accuracy assessment; all used dual-source dual-energy CT. Pooled sensitivity for adrenal adenoma on vNCT was 54% (95% CI: 47-62%). Pooled sensitivity for NCT was 57% (95% CI: 45-69%). Pooling of specificity was not performed since no false positives were reported. There was a trend for overestimation of HU density on vNCT as compared to NCT which appeared related to contrast timing. Potential sources of bias were seen regarding the index test and reference standard for the included studies. Potential sources of heterogeneity between studies were seen in adenoma prevalence and intravenous contrast timing. vNCT images generated from dual-energy CT demonstrated comparable sensitivity to NCT for the diagnosis of adenomas; however the included studies are heterogeneous and at high risk for some types of bias. • Similar sensitivity of vNCT to NCT for diagnosis of adenoma • Heterogeneity could be related to vNCT from early (<=60sec) CECT studies • Could not pool specificity as there were no false positives • Small number of heterogeneous studies at high risk of bias.

Diagnostic accuracy of fractional exhaled nitric oxide measurement in predicting cough-variant asthma and eosinophilic bronchitis in adults with chronic cough: A systematic review and meta-analysis

Individual studies have suggested the utility of fractional exhaled nitric oxide (Feno) measurement in detecting cough-variant asthma (CVA) and eosinophilic bronchitis (EB) in patients with chronic cough. We sought to obtain summary estimates of diagnostic test accuracy of Feno measurement in predicting CVA, EB, or both in adults with chronic cough. Electronic databases were searched for studies published until January 2016, without language restriction. Cross-sectional studies that reported the diagnostic accuracy of Feno measurement for detecting CVA or EB were included. Risk of bias was assessed with Quality Assessment of Diagnostic Accuracy Studies 2. Random effects meta-analyses were performed to obtain summary estimates of the diagnostic accuracy of Feno measurement. A total of 15 studies involving 2187 adults with chronic cough were identified. Feno measurement had a moderate diagnostic accuracy in predicting CVA in patients with chronic cough, showing the summary area under the curve to be 0.87 (95% CI, 0.83-0.89). Specificity was higher and more consistent than sensitivity (0.85 [95% CI, 0.81-0.88] and 0.72 [95% CI, 0.61-0.81], respectively). However, in the nonasthmatic population with chronic cough, the diagnostic accuracy to predict EB was found to be relatively lower (summary area under the curve, 0.81 [95% CI, 0.77-0.84]), and specificity was inconsistent. The present meta-analyses indicated the diagnostic potential of Feno measurement as a rule-in test for detecting CVA in adult patients with chronic cough. However, Feno measurement may not be useful to predict EB in nonasthmatic subjects with chronic cough. These findings warrant further studies to validate the roles of Feno measurement in clinical practice of patients with chronic cough.

Spontaneous Subarachnoid Hemorrhage: A Systematic Review and Meta-analysis Describing the Diagnostic Accuracy of History, Physical Examination, Imaging, and Lumbar Puncture With an Exploration of Test Thresholds.

Spontaneous subarachnoid hemorrhage (SAH) is a rare, but serious etiology of headache. The diagnosis of SAH is especially challenging in alert, neurologically intact patients, as missed or delayed diagnosis can be catastrophic. The objective was to perform a diagnostic accuracy systematic review and meta-analysis of history, physical examination, cerebrospinal fluid (CSF) tests, computed tomography (CT), and clinical decision rules for spontaneous SAH. A secondary objective was to delineate probability of disease thresholds for imaging and lumbar puncture (LP). PubMed, Embase, Scopus, and research meeting abstracts were searched up to June 2015 for studies of emergency department patients with acute headache clinically concerning for spontaneous SAH. QUADAS-2 was used to assess study quality and, when appropriate, meta-analysis was conducted using random effects models. Outcomes were sensitivity, specificity, and positive (LR+) and negative (LR-) likelihood ratios. To identify test and treatment thresholds, we employed the Pauker-Kassirer method with Bernstein test indication curves using the summary estimates of diagnostic accuracy. A total of 5,022 publications were identified, of which 122 underwent full-text review; 22 studies were included (average SAH prevalence = 7.5%). Diagnostic studies differed in assessment of history and physical examination findings, CT technology, analytical techniques used to identify xanthochromia, and criterion standards for SAH. Study quality by QUADAS-2 was variable; however, most had a relatively low risk of biases. A history of neck pain (LR+ = 4.1; 95% confidence interval [CI] = 2.2 to 7.6) and neck stiffness on physical examination (LR+ = 6.6; 95% CI = 4.0 to 11.0) were the individual findings most strongly associated with SAH. Combinations of findings may rule out SAH, yet promising clinical decision rules await external validation. Noncontrast cranial CT within 6 hours of headache onset accurately ruled in (LR+ = 230; 95% CI = 6 to 8,700) and ruled out SAH (LR- = 0.01; 95% CI = 0 to 0.04); CT beyond 6 hours had a LR- of 0.07 (95% CI = 0.01 to 0.61). CSF analyses had lower diagnostic accuracy, whether using red blood cell (RBC) count or xanthochromia. At a threshold RBC count of 1,000 × 10(6) /L, the LR+ was 5.7 (95% CI = 1.4 to 23) and LR- was 0.21 (95% CI = 0.03 to 1.7). Using the pooled estimates of diagnostic accuracy and testing risks and benefits, we estimate that LP only benefits CT-negative patients when the pre-LP probability of SAH is on the order of 5%, which corresponds to a pre-CT probability greater than 20%. Less than one in 10 headache patients concerning for SAH are ultimately diagnosed with SAH in recent studies. While certain symptoms and signs increase or decrease the likelihood of SAH, no single characteristic is sufficient to rule in or rule out SAH. Within 6 hours of symptom onset, noncontrast cranial CT is highly accurate, while a negative CT beyond 6 hours substantially reduces the likelihood of SAH. LP appears to benefit relatively few patients within a narrow pretest probability range. With improvements in CT technology and an expanding body of evidence, test thresholds for LP may become more precise, obviating the need for a post-CT LP in more acute headache patients. Existing SAH clinical decision rules await external validation, but offer the potential to identify subsets most likely to benefit from post-CT LP, angiography, or no further testing.

MR perfusion-weighted imaging in the evaluation of high-grade gliomas after treatment: a systematic review and meta-analysis.

Distinction between tumor and treatment related changes is crucial for clinical management of patients with high-grade gliomas. Our purpose was to evaluate whether dynamic susceptibility contrast-enhanced (DSC) and dynamic contrast enhanced (DCE) perfusion-weighted imaging (PWI) metrics can effectively differentiate between recurrent tumor and posttreatment changes within the enhancing signal abnormality on conventional MRI. A comprehensive literature search was performed for studies evaluating PWI-based differentiation of recurrent tumor and posttreatment changes in patients with high-grade gliomas (World Health Organization grades III and IV). Only studies published in the "temozolomide era" beginning in 2005 were included. Summary estimates of diagnostic accuracy were obtained by using a random-effects model. Of 1581 abstracts screened, 28 articles were included. The pooled sensitivities and specificities of each study's best performing parameter were 90% and 88% (95% CI: 0.85-0.94; 0.83-0.92) and 89% and 85% (95% CI: 0.78-0.96; 0.77-0.91) for DSC and DCE, respectively. The pooled sensitivities and specificities for detecting tumor recurrence using the 2 most commonly evaluated parameters, mean relative cerebral blood volume (rCBV) (threshold range, 0.9-2.15) and maximum rCBV (threshold range, 1.49-3.1), were 88% and 88% (95% CI: 0.81-0.94; 0.78-0.95) and 93% and 76% (95% CI: 0.86-0.98; 0.66-0.85), respectively. PWI-derived thresholds separating viable tumor from treatment changes demonstrate relatively good accuracy in individual studies. However, because of significant variability in optimal reported thresholds and other limitations in the existing body of literature, further investigation and standardization is needed before implementing any particular quantitative PWI strategy across institutions.

Meta-Analyses of Diagnostic Accuracy in Imaging Journals: Analysis of Pooling Techniques and Their Effect on Summary Estimates of Diagnostic Accuracy.

Purpose To determine whether authors of systematic reviews of diagnostic accuracy studies published in imaging journals used recommended methods for meta-analysis, and to evaluate the effect of traditional methods on summary estimates of sensitivity and specificity. Materials and Methods Medline was searched for published systematic reviews that included meta-analysis of test accuracy data limited to imaging journals published from January 2005 to May 2015. Two reviewers independently extracted study data and classified methods for meta-analysis as traditional (univariate fixed- or random-effects pooling or summary receiver operating characteristic curve) or recommended (bivariate model or hierarchic summary receiver operating characteristic curve). Use of methods was analyzed for variation with time, geographical location, subspecialty, and journal. Results from reviews in which study authors used traditional univariate pooling methods were recalculated with a bivariate model. Results Three hundred reviews met the inclusion criteria, and in 118 (39%) of those, authors used recommended meta-analysis methods. No change in the method used was observed with time (r = 0.54, P = .09); however, there was geographic (χ(2) = 15.7, P = .001), subspecialty (χ(2) = 46.7, P < .001), and journal (χ(2) = 27.6, P < .001) heterogeneity. Fifty-one univariate random-effects meta-analyses were reanalyzed with the bivariate model; the average change in the summary estimate was -1.4% (P < .001) for sensitivity and -2.5% (P < .001) for specificity. The average change in width of the confidence interval was 7.7% (P < .001) for sensitivity and 9.9% (P ≤ .001) for specificity. Conclusion Recommended methods for meta-analysis of diagnostic accuracy in imaging journals are used in a minority of reviews; this has not changed significantly with time. Traditional (univariate) methods allow overestimation of diagnostic accuracy and provide narrower confidence intervals than do recommended (bivariate) methods. (©) RSNA, 2016 Online supplemental material is available for this article.

Hepatocellular carcinoma: diagnostic performance of multidetector CT and MR imaging-a systematic review and meta-analysis.

To perform a systematic review and meta-analysis of the diagnostic performance of computed tomography (CT) and magnetic resonance (MR) imaging as noninvasive modalities for evaluating hepatocellular carcinoma (HCC) in patients with chronic liver disease. A search of the MEDLINE, EMBASE, and Cochrane Library databases was performed to identify studies providing per-patient or per-lesion diagnostic accuracies of multidetector CT and MR imaging for HCCs in patients with chronic liver disease. Studies published from January 2000 to December 2012 that used a reference standard based on histopathologic findings and/or findings at follow-up were included. Summary estimates of diagnostic accuracy were obtained by using a random-effects model with further exploration with meta-regression and subgroup analyses. Forty studies (six on multidetector CT, 22 on MR imaging, and 12 on both CT and MR imaging) were included. The studies evaluated a total of 1135 patients with multidetector CT and 2489 patients with MR imaging. The overall per-patient sensitivity of MR imaging was 88% (95% confidence interval [CI]: 83%, 92%), with a specificity of 94% (95% CI: 85%, 98%). The overall per-lesion sensitivity of MR imaging was higher than that of multidetector CT when the paired data of the 11 available studies were pooled (80% vs 68%, P = .0023). Gadoxetic acid-enhanced MR imaging showed significantly higher per-lesion sensitivity than MR imaging performed with other contrast agents (87% vs 74%, P = .03). Per-lesion sensitivity was significantly lower for HCCs smaller than 1 cm than that for HCCs 1 cm or larger (P < .001 for CT, P = .02 for MR imaging) and for those in explanted livers (P = .04 for CT, P < .001 for MR imaging). MR imaging showed higher per-lesion sensitivity than multidetector CT and should be the preferred imaging modality for the diagnosis of HCCs in patients with chronic liver disease.

Computed tomography angiography in the diagnosis of brain death: a systematic review and meta-analysis.

Physiological instability and confounding factors may interfere with the clinical diagnosis of brain death. Computed tomography angiography (CTA) has been suggested as a potential ancillary test for confirmation of brain death, but its diagnostic accuracy remains unclear. We searched MEDLINE, EMBASE, and CENTRAL for studies comparing CTA with other accepted methods of diagnosing brain death (clinical or radiographic). Summary estimates of diagnostic accuracy were computed using random effects models. Subgroup analyses and meta-regression were performed to assess associations between CTA sensitivity and study or patient characteristics. Twelve studies, involving 541 patients, were included. If the CTA criterion for brain death was complete lack of opacification of intracranial vessels, then the pooled sensitivity was 62% (50-74%) for venous phase and 84% (75-94%) for arterial phase imaging. The sensitivity of CTA was higher when the criterion for brain death involved absence of opacification of internal cerebral veins, either alone (99%, 97-100%) or in combination with lack of flow to the distal middle cerebral artery branches (85%, 77-93%). CTA sensitivity was not influenced by different reference standards (clinical vs. radiographic) or predominant diagnostic category (stroke vs. brain trauma). Specificity of CTA could not be adequately determined from the existing data. Many patients who progress to brain death by accepted clinical or radiographic criteria have persistent opacification of proximal intracranial vessels when CTA is performed. The specificity of CTA in the diagnosis of brain death has not been adequately assessed. Routine use of CTA as an ancillary test in the diagnosis of brain death is therefore not recommended until diagnostic criteria have undergone further refinement and prospective validation. Absence of opacification of the internal cerebral veins appears to be the most promising angiographic criterion.

Unattended sleep studies in pediatric OSA: A systematic review and meta‐analysis

The objective of this study was to systematically assess the evidence for the diagnostic accuracy of unattended type 2 or type 3 multichannel studies for predicting and monitoring pediatric obstructive sleep apnea (OSA). Four medical databases were searched for eligible studies. Only studies that evaluated the ability of unattended multichannel devices to accurately diagnose or monitor OSA in children were included. Those with appropriate data were selected for meta-analysis. Study quality was assessed by using the Quality Assessment Tool for Diagnostic Accuracy Studies tool. Summary estimates of diagnostic accuracy were determined by using sensitivity, specificity, positive and negative likelihood ratios, diagnostic odds ratio, summary receiver operating characteristics, and the area under the curve (AUC). Ten diagnostic studies with 724 patients were included in the systematic review, which was followed by a meta-analysis using studies that provided sufficient information for the calculation of diagnostic parameters. The overall analysis revealed a moderate sensitivity of 76% (95% confidence interval [CI]: 64%-85%), a moderate specificity of 76% (95% CI: 60%-88%), and a pooled diagnostic odds ratio of 15.18 (95% CI: 3.52-65.43). The AUC (0.88) indicated that unattended multichannel devices showed good diagnostic performance for predicting pediatric OSA. Using a cutoff of AHI > 1 for the diagnosis of OSA, the results appeared to be more useful, with a higher sensitivity (88%) while maintaining a moderate specificity (71%). These findings suggest that unattended sleep studies are a good tool for predicting both the presence and severity of OSA in children, especially in those with mild-to-moderate disease.

The Diagnosis of Acute Mesenteric Ischemia: A Systematic Review and Meta-analysis

Acute mesenteric ischemia is an infrequent cause of abdominal pain in emergency department (ED) patients; however, mortality for this condition is high. Rapid diagnosis and surgery are key to survival, but presenting signs are often vague or variable, and there is no pathognomonic laboratory screening test. A systematic review and meta-analysis of the available literature was performed to determine diagnostic test characteristics of patient symptoms, objective signs, laboratory studies, and diagnostic modalities to help rule in or out the diagnosis of acute mesenteric ischemia in the ED. In concordance with published guidelines for systematic reviews, the medical literature was searched for relevant articles. The Quality Assessment Tool for Diagnostic Accuracy Studies-2 (QUADAS-2) for systematic reviews was used to evaluate the overall quality of the trials included. Summary estimates of diagnostic accuracy were computed by using a random-effects model to combine studies. Those studies without data to fully complete a two-by-two table were not included in the meta-analysis portion of the project. The literature search identified 1,149 potentially relevant studies, of which 23 were included in the final analysis. The quality of the diagnostic studies was highly variable. A total of 1,970 patients were included in the combined population of all included studies. The prevalence of acute mesenteric ischemia ranged from 8% to 60%. There was a pooled sensitivity for l-lactate of 86% (95% confidence interval [CI] = 73% to 94%) and a pooled specificity of 44% (95% CI = 32% to 55%). There was a pooled sensitivity for D-dimer of 96% (95% CI = 89% to 99%) and a pooled specificity of 40% (95% CI = 33% to 47%). For computed tomography (CT), we found a pooled sensitivity of 94% (95% CI = 90% to 97%) and specificity of 95% (95% CI = 93% to 97%). The positive likelihood ratio (+LR) for a positive CT was 17.5 (95% CI = 5.99 to 51.29), and the negative likelihood ratio (-LR) was 0.09 (95% CI = 0.05 to 0.17). The pooled operative mortality rate for mesenteric ischemia was 47% (95% CI = 40% to 54%). Given these findings, the test threshold of 2.1% (below this pretest probability, do not test further) and a treatment threshold of 74% (above this pretest probability, proceed to surgical management) were calculated. The quality of the overall literature base for mesenteric ischemia is varied. Signs, symptoms, and laboratory testing are insufficiently diagnostic for the condition. Only CT angiography had adequate accuracy to establish the diagnosis of acute mesenteric ischemia in lieu of laparotomy.

Clinical assessment of pediatric obstructive sleep apnea: A systematic review and meta‐analysis

Clinical symptoms and signs are routinely used to investigate pediatric obstructive sleep apnea (OSA). This study aimed to systematically assess the evidence for the diagnostic accuracy of individual or combined clinical symptoms and signs in predicting pediatric OSA. A systematic review of the literature and diagnostic meta-analysis. Four medical databases were searched (from inception to August 2011). Studies were included that compared the clinical assessment with the current gold standard (full polysomnography). The study quality was assessed using the quality assessment tool for diagnostic accuracy studies. Summary estimates of diagnostic accuracy were determined using the sensitivity, specificity, positive and negative likelihood ratios, diagnostic odds ratio, and hierarchical summary receiver operating characteristic (HSROC) model for meta-analyses. Ten diagnostic studies with 1,525 patients were included in the review. There was substantial variation in the sensitivity and specificity among different symptoms and signs, as well as across studies. Tonsillar size and snoring reported by parents or caregivers had high sensitivity but low specificity. In contrast, excessive daytime somnolence, observed apnea, and difficulty in breathing during sleep had high specificity but low sensitivity. Seven models of a combination of symptoms and signs presented moderate sensitivity (range, 0.04-0.94) and specificity (range, 0.28-0.99). The HSROC indicates poor diagnostic performance of the symptoms and signs in predicting pediatric OSA. Neither single nor combined symptoms and signs have satisfactory performance in predicting pediatric OSA. Alternative diagnostic models are necessary to improve the accuracy.

'Cross hairs' plots for diagnostic meta-analysis.

Understanding diagnostic test accuracy (DTA) data, especially meta-analysis of this information, can be challenging for researchers and clinicians. The use of plots of receiver-operator curve (ROC) space showing individual studies and summary estimates of diagnostic accuracy has become common but can be difficult to interpret. The assessment of heterogeneity in sensitivity and specificity across studies can be particularly difficult. In this paper, we review the key concepts of assessing DTA, starting at the level of individual studies and progressing to the setting of research synthesis. We explore the standard displays of this information and then propose and explain an alternative approach to summarizing key data. These 'cross-hairs' plots display the individual studies in ROC space with paired confidence intervals representing sensitivity and specificity, and allow for the results of meta-analysis to be overlaid on the plot. We suggest that these plots are more easily interpreted, and are a more informative graphical form than common approaches. Copyright © 2011 John Wiley & Sons, Ltd.