Meta-analysis Of Diagnostic Performance Research Articles

Diagnosis of invasive pulmonary aspergillosis by lateral flow assay of galactomannan in bronchoalveolar lavage fluid: a meta-analysis of diagnostic performance.

The performance of lateral flow assay (LFA) in diagnosing invasive pulmonary aspergillosis (IPA) has not been well demonstrated. To address this, we conducted a meta-analysis assessing the overall accuracy of LFA in diagnosing IPA using bronchoalveolar lavage fluid (BALF). Over a systematical search and assessment of bias risk, we calculated the pooled specificity, sensitivity, and area under the receiver operating curve (AUC) to assess the diagnostic performance. Our meta-analysis included 11 studies. The combined total sensitivity and specificity for diagnosing IPA were 0.78 (95% confidence interval (CI): 0.71, 0.83) and 0.87 (95% CI: 0.81, 0.91), respectively. The AUC was 0.86 (95% CI: 0.82, 0.89). Our results demonstrate that LFA using galactomannan in BALF exhibits high sensitivity and specificity for diagnosing IPA.

Contrast-enhanced Mammography: A Systematic Review and Meta-Analysis of Diagnostic Performance.

Background Contrast-enhanced mammography (CEM) is a promising technique for breast cancer detection, but conflicting results have been reported in previous meta-analyses. Purpose To perform a systematic review and meta-analysis of CEM diagnostic performance considering different interpretation methods and clinical settings. Materials and Methods The MEDLINE, EMBASE, Web of Science, and Cochrane Library databases were systematically searched up to July 15, 2021. Prospective and retrospective studies evaluating CEM diagnostic performance with histopathology and/or follow-up as the reference standard were included. Study quality was assessed with the Quality Assessment of Diagnostic Accuracy Studies 2 tool. Summary diagnostic odds ratio and area under the receiver operating characteristic curve were estimated with the hierarchical summary receiver operating characteristic (HSROC) model. Summary estimates of sensitivity and specificity were obtained with the hierarchical bivariate model, pooling studies with the same image interpretation approach or focused on the same findings. Heterogeneity was investigated through meta-regression and subgroup analysis. Results Sixty studies (67 study parts, 11 049 CEM examinations in 10 605 patients) were included. The overall area under the HSROC curve was 0.94 (95% CI: 0.91, 0.96). Pooled diagnostic odds ratio was 55.7 (95% CI: 42.7, 72.7) with high heterogeneity (τ2 = 0.3). At meta-regression, CEM interpretation with both low-energy and recombined images had higher sensitivity (95% vs 94%, P < .001) and specificity (81% vs 71%, P = .03) compared with recombined images alone. At subgroup analysis, CEM showed a 95% pooled sensitivity (95% CI: 92, 97) and a 78% pooled specificity (95% CI: 66, 87) from nine studies in patients with dense breasts, while in 10 studies on mammography-detected suspicious findings, CEM had a 92% pooled sensitivity (95% CI: 89, 94) and an 84% pooled specificity (95% CI: 73, 91). Conclusion Contrast-enhanced mammography demonstrated high performance in breast cancer detection, especially with joint interpretation of low-energy and recombined images. © RSNA, 2021 Online supplemental material is available for this article. See also the editorial by Bahl in this issue.

A systematic review and meta-analysis of diagnostic performance and physicians' perceptions of artificial intelligence (AI)-assisted CT diagnostic technology for the classification of pulmonary nodules.

BackgroundLung cancer was the second most commonly diagnosed cancer and the leading cause of cancer death in 2020. Although artificial intelligence (AI)-assisted diagnostic technologies have shown promise and has been used in clinical practice in recent years, no products related to AI-assisted CT diagnostic technologies for the classification of pulmonary nodules have been approved by the National Medical Products Administration in China. The objective of this article was to systematically review the diagnostic performance of AI-assisted CT diagnostic technology for the classification of pulmonary nodules as benign or malignant and to analyze physicians’ perceptions of this technology in China.MethodsAll relevant studies from 6 literature databases were searched and screened according to the inclusion and exclusion criteria. Data were extracted and the study quality was assessed by two reviewers. The study heterogeneity and publication bias were estimated. A questionnaire survey on the perceptions of physicians was conducted in 9 public tertiary hospitals in China. A meta-analysis, meta-regression and univariate logistic model were used in the systematic review and to explore the association of physicians’ perceptions with their rate of support for the clinical application of the technology.ResultsTwenty-seven studies with 5,727 pulmonary nodules were finally included in the meta-analysis. We found that the quality of the included studies was generally acceptable and that the pooled sensitivity and specificity of AI-assisted CT diagnostic technology for the classification of pulmonary nodules as benign or malignant were 0.90 and 0.89, respectively. The pooled diagnostic odds ratio (DOR) was 70.33. The majority of the surveyed physicians in China perceived “reduced workload for radiologists” and “improved diagnostic efficiency” as the important benefits of this technology. In addition, diagnostic accuracy (including misdiagnosis) and practical experience were significantly associated with whether physicians supported its clinical application.ConclusionsIn the context of lung cancer diagnosis, AI-assisted CT diagnostic technology for the classification of pulmonary nodules as benign or malignant has good diagnostic performance, but its specificity needs to be improved.

Meta-Analysis of Diagnostic Performance of Contrast-Fractional Flow Reserve versus Quantitative Flow Ratio for Functional Assessment of Coronary Stenoses

Background. Use of the fractional flow reserve (FFR) technique is recommended to evaluate coronary stenosis severity and guide revascularization. However, its high cost, time to administer, and the side effects of adenosine reduce its clinical utility. Two novel adenosine-free indices, contrast-FFR (cFFR) and quantitative flow ratio (QFR), can simplify the functional evaluation of coronary stenosis. This study aimed to analyze the diagnostic performance of cFFR and QFR using FFR as a reference index. Methods. We conducted a systematic review and meta-analysis of observational studies in which cFFR or QFR was compared to FFR. A bivariate model was applied to pool diagnostic parameters. Cochran’s Q test and the I2 index were used to assess heterogeneity and identify the potential source of heterogeneity by metaregression and sensitivity analysis. Results. Overall, 2220 and 3000 coronary lesions from 20 studies were evaluated by cFFR and QFR, respectively. The pooled sensitivity and specificity were 0.87 (95% CI: 0.81, 0.91) and 0.92 (95% CI: 0.88, 0.94) for cFFR and 0.87 (95% CI: 0.82, 0.91) and 0.91 (95% CI: 0.87, 0.93) for QFR, respectively. No statistical significance of sensitivity and specificity for cFFR and QFR were observed in the bivariate analysis (P=0.8406 and 0.4397, resp.). The area under summary receiver-operating curve of cFFR and QFR was 0.95 (95% CI: 0.93, 0.97) for cFFR and 0.95 (95% CI: 0.93, 0.97). Conclusion. Both cFFR and QFR have good diagnostic performance in detecting functional severity of coronary arteries and showed similar diagnostic parameters.

Head-to-head comparison of prostate MRI using an endorectal coil versus a non-endorectal coil: meta-analysis of diagnostic performance in staging T3 prostate cancer

To compare the diagnostic performance of prostate magnetic resonance imaging (MRI) with an endorectal coil (ERC) to performance without an ERC using either body-array (BAC) or pelvic phased-array coil (PAC) in staging T3 prostate cancer. An electronic search of the PUBMED and EMBASE databases was performed until 10 October 2018 to identify studies performing a head-to-head comparison of prostate MRI using a 1.5 or 3 T magnet with an ERC and with a BAC/PAC for staging T3 prostate cancer. Pooled sensitivity and specificity of all studies were plotted in a hierarchical summary receiver operating characteristic plot. The diagnostic performance of the two techniques in staging T3 disease was evaluated using bivariate random-effects meta-analysis. Eight studies comparing head-to-head prostate MRI with an ERC and with a BAC/PAC were identified of which six studies compared the diagnostic performance. The pooled sensitivity and specificity of MRI with an ERC for detecting T3a, T3b and T3a+b was 53% and 95%; 52% and 92%; 72% and 65% respectively. For MRI with a BAC/PAC these were 34%, and 95%; 45% and 94%; 70% and 66%. There was no statistical difference between an ERC and a BAC/PAC in terms of sensitivity (p=0.41) and specificity (p=0.63) for T3a. The area under the receiver operating characteristic (AUROC) curve for T3a, T3b and T3a+b was 0.830, 0.901, 0.741 for an ERC and 0.790, 0.645, 0.711 for BAC, respectively. There is no significant difference in the diagnostic performance of MRI of prostate with an ERC and with a BAC/PAC in staging T3 prostate cancer.

Diagnosis of Knee Meniscal Injuries by Using Three-dimensional MRI: A Systematic Review and Meta-Analysis of Diagnostic Performance.

Purpose To investigate the diagnostic performance of three-dimensional (3D) MRI for depicting meniscal injuries of the knee by using surgery as the standard of reference. Materials and Methods A literature search was performed to identify original studies published between 1985 and 2017. Summary receiver operating characteristic curve and sensitivity analyses were performed to compare the diagnostic performance of 3D versus two-dimensional (2D) MRI for the assessment of knee meniscal injuries and to evaluate the impact of relevant covariates on the diagnostic performance for assessment of knee meniscal injuries. Results Of identified records, 31 studies (1743 3D knee MRI examinations) were included (23 studies also reported the results of 2D MRI). All studies before 2008 used gradient-echo (GRE) sequences, whereas all studies after 2011 used fast spin-echo (FSE) sequences. By comparing FSE and GRE sequences with 2D MRI, pooled estimate of sensitivity (90.0%; P = .2 and 90.1%; P = .2 vs 88.5%) and pooled estimate of specificity (91%; P = .3 and 89.8% vs 90.1%; P = .7) were comparable. The 3D FSE sequences demonstrated similar diagnostic performance as 3D GRE sequences, except for slightly improved sensitivity for depicting lateral meniscal injuries (FSE, 84.6%; GRE, 75%; P = .01). The specificity of 3D sequences improved when multiplanar reformatting was performed (P = .02). Conclusion Both three-dimensional (3D) fast spin-echo (FSE) and 3D gradient-echo (GRE) sequences had similar diagnostic performance as two-dimensional sequences, with slight superior sensitivity of 3D FSE sequences compared with 3D GRE sequences for depicting lateral meniscal injuries of the knee. © RSNA, 2018 Online supplemental material is available for this article.

Contribution of 18F-FDG PET/CT in a case-mix of fever of unknown origin and inflammation of unknown origin: a meta-analysis.

Fever of unknown origin (FUO) and inflammation of unknown origin (IUO) are challenging medical problems. Previous studies have shown that 18F-fluorodeoxyglucose positron emission tomography/computed tomography (18F-FDG PET/CT) plays an important role in the diagnosis of FUO, but few studies have explored this diagnostic technique in relation to IUO. To systematically review and perform a meta-analysis of published data on the diagnostic performance of PET/CT in the diagnosis of FUO and IUO. A comprehensive literature search was performed in accordance with the Preferred Reporting Items for Systematic Review and Meta-analysis (PRISMA) guidelines published in March 2018. Meta-analysis of diagnostic performance was performed using STATA 12.0 software. Subgroup analysis was performed by stratification based on study design, number of patients, geographic area, and final diagnosis based on 18F-FDG PET/CT. Meta-regression analyses were performed to recognize heterogeneity. Our meta-analysis included 23 studies, comprising a total sample size of 1927 patients. The pooled diagnosis performance was calculated with a per-patient-based analysis: sensitivity = 0.84 (95% confidence interval [CI] = 0.79-0.89), specificity = 0.63 (95% CI = 0.49-0.75), positive likelihood ratio = 2.3 (95% CI = 1.5-3.4), negative likelihood ratio = 0.25 (95% CI = 0.16-0.38), diagnostic odds ratio = 9 (95% CI = 4.0-20), and AUC = 0.84 (95% CI = 0.81-0.87). In patients with non-specific symptoms and signs, 18F-FDG PET/CT is very helpful for recognizing and excluding diseases, directing further diagnostic decisions, and avoiding unnecessary invasive examinations. We recommend that 18F-FDG PET/CT should be considered among the first-line diagnostic tools for patients with FUO and IUO.

FDG-PET/CT for treatment response assessment in head and neck squamous cell carcinoma: a systematic review and meta-analysis of diagnostic performance.

18-fluorodeoxyglucose positron emission tomography combined with computed tomography (FDG-PET/CT) is increasingly used to evaluate treatment response in head and neck squamous cell carcinoma (HNSCC). This analysis assessed the diagnostic value of FDG-PET/CT in detecting nodal disease within 6months after treatment, considering patient and disease characteristics. A systematic review was performed using the MEDLINE and Web of Knowledge databases. The results were pooled using a bivariate random effects model of the sensitivity and specificity. Out of 22 identified studies, a meta-analysis of 20 studies (1293 patients) was performed. The pooled estimates of sensitivity, specificity and diagnostic odds ratio (with 95% CI) were 85% (76-91%), 93% (89-96%) and 76 (35-165), respectively. With the prevalence set at 10%, the positive and negative predictive values were 58% and 98%. There was significant heterogeneity between the trials (p< 0.001). HPV positive tumors were associated with lower sensitivity (75% vs 89%; p= 0.01) and specificity (87% vs 95%; p< 0.005). FDG-PET/CT within 6months after (chemo)radiotherapy in HNSCC patients is a reliable method for ruling out residual/recurrent nodal disease and obviates the need for therapeutic intervention. However, FDG-PET/CT may be less reliable in HPV positive tumors and the optimal surveillance strategy remains to be determined.

Polymerase Chain Reaction in the Diagnosis of Invasive Aspergillosis in Hematopoietic Stem Cell Transplant Recipients: A Meta-Analysis of Diagnostic Performance

Background: Invasive aspergillosis (IA) is associated with significant morbidity and mortality among hematopoietic-stem cell transplant (HSCT) recipients. Timely and accurate diagnosis of an active infection is needed in order to initiate targeted antifungal therapy. Although previous studies have assessed the performance of Aspergillusspp. PCR with promising findings, PCR has not yet been incorporated in the diagnostic algorithms by the guideline issuing organizations.Aim: Our goal was to evaluate PCR as a screening or a confirmatory tool for the diagnosis of IA among HSCT patients and to determine the different parameters that could contribute to contradictory reports from the literature regarding PCR performance. Thus, we performed a meta-analysis of clinical trials that evaluated the accuracy of PCR for IA performed on serum and whole blood of HSCT patients.Methods: We performed a bivariate meta-analysis of diagnostic data for Aspergillus spp. PCR on blood specimens across HSCT patients. We included all studies involving human subjects that assessed the performance of any PCR assay for IA on whole blood or serum and that used as reference standard the EORTC/MSG criteria. We performed 2 separate analyses either including or excluding the cases that were defined as “possible”. When possible cases where included they were classified as negative. Out of 37 total studies, 25 met strict quality criteria and were included.Results: 25 studies with 2,595 patients were analyzed. Six studies performed PCR on serum (23%) and the remaining used whole blood assays (77%). The pooled diagnostic performance of whole blood and serum PCR was moderate, with a sensitivity of 84% (95% CI 75%-91%). Specificity was 76% (95% CI 65%-84%) when possible cases were included and 85% (95% CI 74%-91%) when excluded, suggesting that a positive or negative result is unable on its own to confirm or exclude a suspected infection. In subgroup analysis, the performance of PCR on serum was not significantly different from whole blood when possible cases were included. Interestingly, exclusion of possible cases revealed higher specificity of serum PCR (94% vs. 80%, meta-regression p-value=0.05) over whole blood without altering the sensitivity (79% vs. 85%, meta-regression p-value=0.4) and high positive likelihood ratio (LR+=12.6) suggesting that serum PCR could be used as a confirmatory test. No methodological parameter significantly affected the performance of PCR. Importantly, PCR specificity was greatly increased when 2 positive PCR results were used to define positivity (73% vs. 95%, respectively), giving a high positive likelihood ratio of 12.8, whereas sensitivity decreased (85% vs 64%, respectively). Importantly, the European AspergillusPCR Initiative (EAPCRI) recommendations improved even further the performance of PCR when at least two positive specimens were used to define ‘PCR positivity’.Conclusions: Two positive PCR results should be considered highly indicative of an active Aspergillus spp. infection in HSCT patients. Use of the EAPCRI recommendations by clinical laboratories can further enhance PCR performance. DisclosuresNo relevant conflicts of interest to declare.

Stress Echocardiography, Stress Single-Photon-Emission Computed Tomography and Electron Beam Computed Tomography for the Assessment of Coronary Artery Disease: A Meta-Analysis of Diagnostic Performance: Heijenbrok-Kal MH, Fleischmann KE, Hunink MG. Am Heart J 2007;154:415–23

This study combined previous meta-analyses that investigated the diagnostic performance of imaging tests for coronary artery disease (CAD). In each, the sensitivities, specificities, and diagnostic odds ratios were calculated by imaging modality. In addition, a random effects summary receiver operating characteristic analysis was performed as a means to compensate for the differences between each of the primary studies. The authors analyzed 11 meta-analyses that included 351 patient series. Each modality was compared to the gold standard of coronary artery angiography in its ability to demonstrate CAD, defined as 50–100% stenosis in at least one coronary artery.

Ventilation-Perfusion Scanning and Helical CT in Suspected Pulmonary Embolism: Meta-Analysis of Diagnostic Performance

To perform meta-analysis of literature about the role of helical computed tomography (CT) and ventilation-perfusion (V-P) scanning in detection of acute pulmonary embolism (PE) by using summary receiver operating characteristic (ROC) curve analysis. V-P scanning articles published from January 1985 to March 2003 and helical CT articles published from January 1990 to March 2003 in MEDLINE and EMBASE databases were included if (a) tests were performed for evaluation of acute PE, (b) conventional angiography was the reference standard, and (c) absolute numbers of true-positive, false-negative, true-negative, and false-positive results were available. Sensitivity analysis was conducted by excluding articles published before 1995. A total of 12 articles discussing helical CT and/or V-P scanning were included. With a random-effects model, pooled sensitivity for helical CT was 86.0% (95% confidence interval [CI]: 80.2%, 92.1%), and specificity was 93.7% (95% CI: 91.1%, 96.3%). V-P scanning yielded low sensitivity of 39.0% (95% CI: 37.3%, 40.8%) but high specificity of 97.1% (95% CI: 96.0%, 98.3%) with high probability threshold. V-P scanning yielded high sensitivity of 98.3% (95% CI: 97.2%, 99.5%) and low specificity of 4.8% (95% CI: 4.7%, 4.9%) with normal threshold. Regression coefficients for helical CT angiography were 0.588 (95% CI: -1.55, 2.74) and 4.14 (95% CI: -0.002, 8.28) versus V-P scanning with high and normal thresholds, respectively. Regression coefficients for helical CT angiography were 0.588 (95% CI: -1.55, 2.74) and 4.14 (95% CI: -0.002, 8.28) versus V-P scanning with high and normal thresholds, respectively. Helical CT has greater discriminatory power than V-P scanning with normal and/or near-normal threshold to exclude PE, while helical CT and V-P scanning with high probability threshold had similar discriminatory power in the diagnosis of PE.