Hierarchical Summary Receiver Operating Curve Research Articles

Comparison of RIPASA and ALVARADO scores for risk assessment of acute appendicitis: A systematic review and meta-analysis.

In the last decades, several clinical scores have been developed and currently used to improve the diagnosis and risk management of patients with suspected acute appendicitis (AA). However, some of them exhibited different values of sensitivity and specificity. We conducted a systematic review and metanalysis of epidemiological studies, which compared RIPASA and Alvarado scores for the diagnosis of AA. This systematic review was conducted using PubMed and Web of Science databases. Selected studies had to compare RIPASA and Alvarado scores on patients with suspected AA and reported diagnostic parameters. Summary estimates of sensitivity and specificity were calculated by the Hierarchical Summary Receiver Operating Curve (HSROC) using STATA 17 (STATA Corp, College Station, TX) and MetaDiSc (version 1.4) software. We included a total of 33 articles, reporting data from 35 studies. For the Alvarado score, the Hierarchical Summary Receiver Operating Curve (HSROC) model produced a summary sensitivity of 0.72 (95%CI = 0.66-0.77), and a summary specificity of 0.77 (95%CI = 0.70-0.82). For the RIPASA score, the HSROC model produced a summary sensitivity of 0.95 (95%CI = 0.92-0.97), and a summary specificity of 0.71 (95%CI = 0.60-0.80). RIPASA score has higher sensitivity, but low specificity compared to Alvarado score. Since these scoring systems showed different sensitivity and specificity parameters, it is still necessary to develop novel scores for the risk assessment of patients with suspected AA.

A meta-analysis of diagnostic test performance of peripheral arterial tonometry studies.

The objective of this meta-analysis was to analyze agreement in apnea-hypopnea index (AHI) determination between peripheral arterial tonometry (PAT) and polysomnography (PSG) studies. Mean AHI bias and standard deviation extracted from Bland-Altman plots reported in studies were pooled in a meta-analysis, which was then used to calculate percentage errors of limit agreement in AHI determination by PAT using PSG AHI as the reference. Individual participant data (where reported in studies) were used to compute Cohen's kappa to assess agreement between PSG and PAT on sleep apnea severity and for computing the sensitivity and specificity of PAT at different AHI thresholds using PSG AHI as the reference. From 17 studies and 1,318 participants (all underwent simultaneous PSG and use of the WatchPAT device), a pooled mean AHI bias of 0.30 (standard error [SE], 0.74) and a WatchPAT AHI percentage error of 230% was calculated. The meta-analysis of Cohen's kappa for agreement between PSG and WatchPAT studies for classifying patients with no sleep apnea, mild, moderate, or severe sleep apnea severity was 0.45 (SE, 0.06), 0.29 (SE, 0.05), 0.25 (SE, 0.07), and 0.64 (SE, 0.05), respectively. At AHI thresholds of 5, 15 and 30 events/h, WatchPAT studies showed pooled sensitivities and specificities of 94.11% and 43.47%, 92.21% and 72.39%, and 74.11% and 87.10%, respectively. Likelihood ratios were not significant at any AHI threshold. The results of this meta-analysis suggest clinically significant discordance between WatchPAT and PSG measurements of AHI, significant sleep apnea severity misclassification by PAT studies, and poor diagnostic test performance. Iftikhar IH, Finch CE, Shah AS, Augunstein CA, Ioachimescu OC. A meta-analysis of diagnostic test performance of peripheral arterial tonometry studies. J Clin Sleep Med. 2022;18(4):1093-1102.

The accuracy of ACTH as a biomarker for pituitary pars intermedia dysfunction in horses: A systematic review and meta-analysis.

Accuracy of baseline ACTH for the diagnosis of PPID in horses varies between studies. To estimate the diagnostic accuracy of ACTH as a biomarker for PPID in adult horses and appraise potential causes of heterogeneity. Systematic review and meta-analysis. A literature review identified studies reporting diagnostic accuracy data for extraction. Risk of bias was evaluated using QUADAS-2. Two random-effects models, the hierarchical summary receiver operating curve (HSROC) and the bivariate binomial normal model (BBN) were used to pool accuracy measurements. We performed meta-regression using study-level variables. The impact of diagnostic test accuracy on the frequency of false-positive and false-negative results at various pretest probabilities was calculated using the BBN model's accuracy results. Patient selection and index test evaluation demonstrated significant risk of bias. Mean and 95% confidence intervals for sensitivity and specificity for all studies (n=11) based upon the HSROC model were (0.72, 95% CI: 0.62 to 0.82) and (0.88, 95% CI: 0.79 to 0.93), respectively. When studies with a common positivity threshold of 35pg/mL ACTH were evaluated (n=6), sensitivity and specificity were (0.66, 95% CI:0.54 to 0.77) and (0.87, 95% CI: 0.74 to 0.94). In a hypothetical group of one thousand horses with PPID prevalence of 2%, 20%, and 90%, the frequency of resulting false-positive and false-negatives would be (127 and 7), (104 and 68) and (13 and 306), respectively. Factors leading to increased accuracy were case-control design, clinical reference standard and data-driven choice of ACTH threshold. A small number of primary studies (n=11) were available, demonstrating significant biases. Less biased studies examining diagnostic accuracy of ACTH are needed. In horses with a high pretest probability of PPID, ACTH may be a functional "rule-in" test. Baseline ACTH is not recommended for screening purposes or use in horses without clinical signs of PPID.

Preoperative CT or PET/CT to Assess Pelvic and Para-Aortic Lymph Node Status in Epithelial Ovarian Cancer? A Systematic Review and Meta-Analysis.

Background: In advanced epithelial ovarian cancer (EOC), the LION trial restricted lymphadenectomy indication to patients with suspect lymph nodes before and during surgery. Preoperative imaging is used to assess lymph node status, and particularly CT and PET/CT. The aim of this systematic review and meta-analysis was to evaluate the diagnostic accuracy of preoperative CT and PET/CT to detect lymph node metastasis (LNM) in patients with EOC; Methods: Databases were searched from January 1990 to May 2019 for studies that evaluated the diagnostic accuracy of preoperative CT and PET/CT to detect LNM in patients with EOC with histology as the gold standard. Pooled diagnostic accuracy was calculated using bivariate random-effects models and hierarchical summary receiver operating curve (HSROC). This study is registered with PROSPERO number CRD42020179214; Results: A total of five studies were included in the meta-analysis: four articles concerned preoperative CT and four articles concerned preoperative PET/CT, involving 106 and 138 patients, respectively. For preoperative CT, pooled sensitivity was 0.47 95% CI [0.20–0.76], pooled specificity was 0.99 95% CI [0.75–1.00] and area under the curve (AUC) of the HSROC was 0.91 95% CI [0.88–0.93]. For preoperative PET/CT, pooled sensitivity was 0.81 95% CI [0.61–0.92], pooled specificity was 0.96 95% CI [0.91–0.99] and AUC of the HSROC was 0.97 95% CI [0.95–0.98]; Conclusions: PET/CT has a very high diagnostic accuracy, especially for specificity, to detect LNM in EOC and should be realized systematically, additionally to CT recommended to evaluate peritoneal spread, in the preoperative staging of patients with an advanced disease.

The Use of the Central Vein Sign in the Diagnosis of Multiple Sclerosis: A Systematic Review and Meta-analysis.

Background: The central vein sign (CVS) is a radiological feature proposed as a multiple sclerosis (MS) imaging biomarker able to accurately differentiate MS from other white matter diseases of the central nervous system. In this work, we evaluated the pooled proportion of the CVS in brain MS lesions and to estimate the diagnostic performance of CVS to perform a diagnosis of MS and propose an optimal cut-off value. Methods: A systematic search was performed on publicly available databases (PUBMED/MEDLINE and Web of Science) up to 24 August 2020. Analysis of the proportion of white matter MS lesions with a central vein was performed using bivariate random-effect models. A meta-regression analysis was performed and the impact of using particular sequences (such as 3D echo-planar imaging) and post-processing techniques (such as FLAIR*) was investigated. Pooled sensibility and specificity were estimated using bivariate models and meta-regression was performed to address heterogeneity. Inclusion and publication bias were assessed using asymmetry tests and a funnel plot. A hierarchical summary receiver operating curve (HSROC) was used to estimate the summary accuracy in diagnostic performance. The Youden index was employed to estimate the optimal cut-off value using individual patient data. Results: The pooled proportion of lesions showing a CVS in the MS population was 73%. The use of the CVS showed a remarkable diagnostic performance in MS cases, providing a pooled specificity of 92% and a sensitivity of 95%. The optimal cut-off value obtained from the individual patient data pooled together was 40% with excellent accuracy calculated by the area under the ROC (0.946). The 3D-EPI sequences showed both a higher pooled proportion compared to other sequences and explained heterogeneity in the meta-regression analysis of diagnostic performances. The 1.5 Tesla (T) scanners showed a lower (58%) proportion of MS lesions with a CVS compared to both 3T (74%) and 7T (82%). Conclusions: The meta-analysis we have performed shows that the use of the CVS in differentiating MS from other mimicking diseases is encouraged; moreover, the use of dedicated sequences such as 3D-EPI and the high MRI field is beneficial.

Diagnostic accuracy of physical examination for detecting pelvic fractures among blunt trauma patients: a systematic review and meta-analysis

BackgroundPelvic fractures are common among blunt trauma patients, and timely and accurate diagnosis can improve patient outcomes. However, it remains unclear whether physical examinations are sufficient in this context. This study aims to perform a systematic review and meta-analysis of studies on the diagnostic accuracy and clinical utility of physical examination for pelvic fracture among blunt trauma patients.MethodsStudies were identified using the MEDLINE, EMBASE, and CENTRAL databases starting from the creation of the database to January 2020. A total of 20 studies (49,043 patients with 8300 cases [16.9%] of pelvic fracture) were included in the quality assessment and meta-analysis. Two investigators extracted the data and evaluated the risk of bias in each study. The meta-analysis involved a hierarchical summary receiver operating curve (ROC) model to calculate the diagnostic accuracy of the physical exam. Subgroup analysis assessed the extent of between-study heterogeneity. Clinical utility was assessed using decision curve analysis.ResultsThe median prevalence of pelvic fracture was 10.5% (interquartile range, 5.1–16.5). The pooled sensitivity (and corresponding 95% confidence interval) of the hierarchical summary ROC parameters was 0.859 (0.761–0.952) at a given specificity of 0.920, which was the median value among the included studies. Subgroup analysis revealed that the pooled sensitivity among patients with a Glasgow Coma Scale score ≥ 13 was 0.933 (0.847–0.998) at a given specificity of 0.920. The corresponding value for patients with scores ≤ 13 was 0.761 (0.560–0.932). For threshold probability < 0.01 with 10–15% prevalence, the net benefit of imaging tests was higher than that of physical examination.ConclusionImaging tests should be performed in all trauma patients regardless of findings from physical examination or patients’ levels of consciousness. However, the clinical role of physical examination should be considered given the prevalence and threshold probability in each setting.

Diagnostic accuracy of urinary latex agglutination test (KAtex) for the diagnosis of visceral leishmaniasis: A meta-analysis.

Latex agglutination test (KAtex) has been used in the last two decades for the diagnosis of visceral leishmaniasis (VL) in different VL-endemic areas. Here, we present a meta-analysis of studies which evaluated the KAtex for the diagnosis of VL to find out its overall diagnostic performance. A database search was performed on PubMed, Scopus, ISI Web of Science, Iranmedex and Google Scholar. The search of databases found 57 papers, of which 17 articles fulfilled our eligibility criteria. Meta-analysis of diagnostic accuracy (MADA) and Hierarchical Summary Receiver Operating Curve (HSROC) packages were used to do the meta-analysis and to obtain pooled estimates of sensitivity and specificity. Fixed effect bivariate analysis was conducted, using Mantel-Haenszel estimator, to measure the performance and diagnosis odds ratio (DOR) of the test. Heterogeneity of the test results was assessed by Chi-squared test. The sensitivity of individual studies ranged from 39.8 to 100%, and the specificity ranged from 64 to100%. The combined sensitivity and specificity estimates of KAtex were 77% (95% CI, 70-83%), and 97% (95% CI, 93-97%), respectively. Comparing the performance of the test by region suggests a significant difference where the lowest and highest sensitivities are reported from Nepal/Tunisia and Europe/Middle East respectively (p < 0.05). On the other hand, the lowest and highest rates of specificity were reported from Sudan and America/Middle East respectively. The overall specificity of KAtex is satisfactory. However, KAtex suffers from low sensitivity and this shortcoming should be improved. The test provides a rapid and simple diagnosis of VL and improvement of its sensitivity deserve further studies.

Circulating human papillomavirus DNA as a surveillance tool in head and neck squamous cell carcinoma: A systematic review and meta-analysis.

The incidence of human papillomavirus-induced (HPV+) head and neck squamous cell carcinoma (HNSCC), that is, especially oropharyngeal cancers (OPSCC), is increasing, and a significant proportion of patients encounter disease progression. A simple and sensitive test to identify patients with progression is an unmet need. To systematically review the literature and carry out a meta-analysis of studies, investigating circulating HPV-DNA as a biomarker for disease progression in patients with HNSCC. A systematic review and meta-analysis. PubMed, EMBASE and the Cochrane Library were systematically searched for articles published in English from January 1980 to November 2017. Search terms used were related to HPV, cancer sites, blood-based biomarkers and terms for specific use settings. Articles reviewed and selected by authors and data on study design, demographic variables, location, HPV status, number of pre-treatment blood tests, number of post-treatment blood tests, blood HPV status and number of recurrences and length of follow-up were extracted. A meta-analysis of HPV-DNA as a diagnostic test for recurrence by means of a hierarchical summary receiver operating curve (HSROC) model was performed. We identified 5 studies (n=600 subjects) examining circulating HPV-DNA in patients with HNSCC. In these 5 studies (n=411), patients had both pre- and post-treatment blood samples. The pooled sensitivity, in detecting a recurrence, was estimated to be 54% (95% CI: 32%-74%), while the pooled specificity was 98% (95% CI: 93%-99.4%). The pooled false-positive rate is 2% (95% CI: 0.6%-7%). The area under the curve (AUC) of the summary HSROC was 0.93. Positive predictive value was estimated to 93% and the negative predictive value to 94%. Plasma HPV-DNA is a promising tool for surveillance in patients with HPV-related HNSCC, that is, OPSCC, and has a high specificity. By recent technical advances and by increasing follow-up blood samples, the sensitivity could likely be improved.

Abstract 362: Diagnostic Value of Non-invasive Computed Tomography Perfusion Imaging for Assessing Hemodynamically Significant Native Coronary Artery Lesion: A Meta-analysis

Background: Traditionally, hemodynamic significance of a native coronary artery lesion is determined by invasive coronary angiography and fractional flow reserve. Computed tomography perfusion imaging (CTP) is a novel non-invasive method for determining hemodynamic significance of a coronary artery lesion. The objective of our meta-analysis is to determine the diagnostic performance of CTP with and without computed tomography angiography (CTA) in assessment of hemodynamically significant coronary artery lesions in comparison to invasive angiography. Methods: PubMed was searched through December 2014. Nine original studies were found evaluating the diagnostic performance of CTP with and without CTA to invasive coronary angiography in evaluation of hemodynamic significance of coronary lesions (n=951). Sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV) and positive and negative likelihood ratios (LR+ and LR- respectively) were calculated using hierarchical summary receiver operating curves and compared with bivariate random-effects model to accommodate for heterogeneity due to study design, population and diagnostic tests. Results: Total of 951 coronary vessels were evaluated for hemodynamically significant lesions. The sensitivity, specificity, PPV, NPV, LR+ and LR- values for CTP with CTA to diagnose hemodynamically significant coronary artery lesions were 83%, 91.7%, 86.4%, 89.4%, 9.94, and 0.19 respectively. The sensitivity, specificity, PPV, NPV, LR+ and LR- values for CTP alone were 82.9%, 84%. 76.1%, 88.9%, 5.18, and 0.20 respectively. The sensitivity, specificity, PPV, NPV, LR+ and LR- values for CTA alone were 89%, 72%, 64.2%, 92.1%, 3.18, and 0.15 respectively (Figure). Conclusion: The results of our meta-analysis assessing diagnostic value of CTP with or without CTA suggest that adding CTA to CTP significantly improves diagnostic performance of hemodynamic significance of coronary artery lesions compared to CTP alone. CTA with CTP is closely comparable with invasive angiography in assessing hemodynamic significance of coronary artery lesions in patients with stable coronary artery disease.

The diagnostic value of the FIB-4 index for staging hepatitis B-related fibrosis: a meta-analysis.

BackgroundLiver fibrosis stage is an important factor in determining prognosis and need for treatment in patients infected with hepatitis B virus (HBV). Liver biopsies are typically used to assess liver fibrosis; however, noninvasive alternatives such as the FIB-4 index have also been developed.AimsTo quantify the accuracy of the FIB-4 index in the diagnosis of HBV related fibrosis and cirrhosis.MethodsA meta-analysis of studies comparing the diagnostic accuracy of the FIB-4 index vs. liver biopsy in HBV-infected patients was performed using studies retrieved from the following databases: PubMed, Ovid, EMBASE, the Cochrane Library, the Chinese National Knowledge Infrastructure and the Chinese Biology Medicine disc. A hierarchical summary receiver operating curves model and bivariate model were used to produce summary receiver operating characteristic curves and pooled estimates of sensitivity and specificity. The heterogeneity was explored with meta-regression analysis. Publication bias was detected using Egger’s test and the trim and fill method.Results12 studies (N = 1,908) and 10 studies (N = 2,105) were included in the meta-analysis for significant fibrosis and cirrhosis, respectively. For significant fibrosis, the area under the hierarchical summary receiver operating curve (AUHSROC) was 0.78 (95% CI = 0.74–0.81). The recommended cutoff value was between 1.45 and 1.62, and the AUHSROC, summary sensitivity and specificity were 0.78 (95% CI = 0.74–0.81), 0.65 (95% CI = 0.56–0.73) and 0.77 (95% CI = 0.7–0.83), respectively. For cirrhosis, the AUHSROC was 0.89 (95% CI = 0.85–0.91). The recommended cutoff value was between 2.9 and 3.6, and the AUHSROC, summary sensitivity and specificity were 0.96 (95% CI = 0.92–1.00), 0.42 (95% CI = 0.36–0.48) and 0.96 (95% CI = 0.95–0.97), respectively. No publication bias was detected.ConclusionsThe FIB-4 index is valuable for detecting significant fibrosis and cirrhosis in HBV-infected patients, but has suboptimal accuracy in excluding fibrosis and cirrhosis.

Systematic literature review and meta-analysis of diagnostic test accuracy in Alzheimer's disease and other dementia using autopsy as standard of truth.

Early diagnosis of Alzheimer's disease (AD) is crucial to implement the latest treatment strategies and management of AD symptoms. Diagnostic procedures play a major role in this detection process but evidence on their respective accuracy is still limited. To conduct a systematic literature on the sensitivity and specificity of different test modalities to identify AD patients and perform meta-analyses on the test accuracy values of studies focusing on autopsy-confirmation as the standard of truth. The systematic review identified all English papers published between 1984 and 2011 on diagnostic imaging tests and cerebrospinal fluid biomarkers including results on the newest technologies currently investigated in this area. Meta-analyses using bivariate fixed and random-effect models and hierarchical summary receiver operating curve (HSROC) random-effect model were applied. Out of the 1,189 records, 20 publications were identified to report the accuracy of diagnostic tests in distinguishing autopsy-confirmed AD patients from other dementia types and healthy controls. Looking at all tests and comparator populations together, sensitivity was calculated at 85.4% (95% confidence interval [CI]: 80.9%-90.0%) and specificity at 77.7% (95% CI: 70.2%-85.1%). The area under the HSROC curve was 0.88. Sensitivity and specificity values were higher for imaging procedures, and slightly lower for CSF biomarkers. Test-specific random-effect models could not be calculated due to the small number of studies. The review and meta-analysis point to a slight advantage of imaging procedures in correctly detecting AD patients but also highlight the limited evidence on autopsy-confirmations and heterogeneity in study designs.

FibroTest/Fibrosure for Significant Liver Fibrosis and Cirrhosis in Chronic Hepatitis B: A Meta-Analysis

Extent of liver fibrosis is one of the most important factors in determining prognosis and the need for active treatment in chronic hepatitis B (CHB). Noninvasive alternatives such as FibroTest/Fibrosure (FT) have been developed in order to overcome the shortcomings of liver biopsy (LB). We aimed to systematically review studies describing the diagnostic accuracy of FT for predicting CHB-related fibrosis. MEDLINE and EMBASE searches and hand searching methods were performed to identify studies that assessed the diagnostic accuracy of FibroTest in HB patients using LB as a reference standard. We used a hierarchical summary receiver operating curves model and the bivariate model to produce summary receiver operating characteristic curves and pooled estimates of sensitivity and specificity. We included 16 studies (N=2494) and 13 studies (N=1754) in the heterogenous meta-analysis for liver fibrosis and cirrhosis, respectively. The area under the hierarchical summary receiver operating curve for significant liver fibrosis and for all included studies was 0.84 (95% confidence interval (CI): 0.78-0.88). At the FT threshold of 0.48, the sensitivity, specificity, and diagnostic odds ratio (DOR) of FT for significant fibrosis were 61 (48-72%), 80 (72-86%), and 6.2% (3.3-11.9), respectively. The area under the hierarchical summary receiver operating curve for liver cirrhosis and for all included studies was 0.87 (95% CI: 0.85-0.90). At the FT threshold of 0.74, the sensitivity, specificity, and DOR of FT for cirrhosis were 62 (47-75%), 91 (88-93%), and 15.7% (8.6-28.8), respectively. FibroTest is of value in exclusion of patients with CHB-related cirrhosis, but has suboptimal accuracy in the detection of significant fibrosis and cirrhosis. It is necessary to further improve the test or combine it with other noninvasive modalities in order to improve accuracy.

Acute Tc-99m DMSA Scan for Identifying Dilating Vesicoureteral Reflux in Children: A Meta-analysis

Controversy exists regarding the type and/or sequence of imaging studies needed during the first febrile urinary tract infection (UTI) in young children. Several investigators have claimed that because acute-phase Tc-99m dimercaptosuccinic acid (DMSA) renal-scan results are abnormal in the presence of dilating vesicoureteral reflux, a normal DMSA-scan result makes voiding cystourethrography (VCUG) unnecessary in the primary examination of infants with UTI. To evaluate the accuracy of acute-phase DMSA scanning in identifying dilating (grades III through V) vesicoureteral reflux documented by VCUG in children with a first febrile UTI, we performed a meta-analysis of the accuracy of diagnostic tests as reported from relevant studies identified through the PubMed and Scopus databases. Patient-based and renal unit-based analyses were performed. Overall, 13 cohort studies were identified. Nine studies involved patients younger than 2 years, 3 involved children aged 16 years or younger, and 1 involved exclusively neonates. Girls constituted 22% to 85% of the involved children. Pooled (95% confidence intervals) sensitivity and specificity rates of DMSA scanning were 79% and 53%, respectively, for the patient-based analysis (8 studies) and 60% and 65% for the renal unit-based analysis (5 studies). The respective areas under the hierarchical summary receiver operating curves were 0.71 and 0.67. Marked statistical heterogeneity was observed in both analyses, as indicated by I(2) test values of 91% and 87%, respectively. Acute-phase DMSA renal scanning cannot be recommended as replacement for VCUG in the evaluation of young children with a first febrile UTI.