Bivariate Random-effects Model Research Articles

Handheld echocardiography for the screening and diagnosis of rheumatic heart disease: a systematic review to inform WHO guidelines

Early detection and diagnosis of acute rheumatic fever and rheumatic heart disease are key to preventing progression, and echocardiography has an important diagnostic role. Standard echocardiography might not be feasible in high-prevalence regions due to its high cost, complexity, and time requirement. Handheld echocardiography might be an easy-to-use, low-cost alternative, but its performance in screening for and diagnosing acute rheumatic fever and rheumatic heart disease needs further investigation. In this systematic review and meta-analysis, we searched Embase, MEDLINE, LILACS, and Conference Proceedings Citation Index-Science up to Feb 9, 2024, for studies on the screening and diagnosis of acute rheumatic fever and rheumatic heart disease using handheld echocardiography (index test) or standard echocardiography or auscultation (reference tests) in high-prevalence areas. We included all studies with useable data in which the diagnostic performance of the index test was assessed against a reference test. Data on test accuracy in diagnosing rheumatic heart disease, acute rheumatic fever, or carditis with acute rheumatic fever (primary outcomes) were extracted from published articles or calculated, with authors contacted as necessary. Quality of evidence was appraised using GRADE and QUADAS-2 criteria. We summarised diagnostic accuracy statistics (including sensitivity and specificity) and estimated 95% CIs using a bivariate random-effects model (or univariate random-effects models for analyses including three or fewer studies). Area under the curve (AUC) was calculated from summary receiver operating characteristic curves. Heterogeneity was assessed by visual inspection of plots. This study was registered with PROSPERO (CRD42022344081). Out of 4868 records we identified 11 studies, and two additional reports, comprising 15 578 unique participants. Pooled data showed that handheld echocardiography had high sensitivity (0·87 [95% CI 0·76-0·93]), specificity (0·98 [0·71-1·00]), and overall high accuracy (AUC 0·94 [0·84-1·00]) for diagnosing rheumatic heart disease when compared with standard echocardiography (two studies; moderate certainty of evidence), with better performance for diagnosing definite compared with borderline rheumatic heart disease. High sensitivity (0·79 [0·73-0·84]), specificity (0·85 [0·80-0·89]), and overall accuracy (AUC 0·90 [0·85-0·94]) for screening rheumatic heart disease was observed when pooling data of handheld echocardiography versus standard echocardiography (seven studies; high certainty of evidence). Most studies had a low risk of bias overall. Some heterogeneity was observed for sensitivity and specificity across studies, possibly driven by differences in the prevalence and severity of rheumatic heart disease, and level of training or expertise of non-expert operators. Handheld echocardiography has a high accuracy and diagnostic performance when compared with standard echocardiography for diagnosing and screening of rheumatic heart disease in high-prevalence areas. World Health Organization. For the Chinese, French, Italian, Persian, Portuguese, Spanish and Urdu translations of the abstract see Supplementary Materials section.

Performance of LI-RADS category 5 vs combined categories 4 and 5: a systemic review and meta-analysis.

Computed tomography (CT)/magnetic resonance imaging (MRI) Liver Imaging Reporting and Data System (LI-RADS, LR) category 5 has high specificity and modest sensitivity for diagnosis of hepatocellular carcinoma (HCC). The purpose of this study was to compare the diagnostic performance of LR-5 vs combined LR-4 and LR-5 (LR-4/5) for HCC diagnosis. MEDLINE and EMBASE databases through January 03, 2023 were searched for studies reporting the performance of LR-5 and combined LR-4/5 for HCC diagnosis, using CT/MRI LI-RADS version 2014, 2017, or 2018. A bivariate random-effects model was used to calculate the pooled per-observation diagnostic performance. Subgroup analysis was performed based on imaging modalities and type of MRI contrast material. Sixty-nine studies (15,108 observations, 9928 (65.7%) HCCs) were included. Compared to LR-5, combined LR-4/5 showed significantly higher pooled sensitivity (83.0% (95% CI [80.3-85.8%]) vs 65.7% (95% CI [62.4-69.1%]); p < 0.001), lower pooled specificity (75.0% (95% CI [70.5-79.6%]) vs 91.7% (95% CI [90.2-93.1%]); p < 0.001), lower pooled positive likelihood ratio (3.60 (95% CI [3.06-4.23]) vs 6.18 (95% CI [5.35-7.14]); p < 0.001), and lower pooled negative likelihood ratio (0.22 (95% CI [0.19-0.25]) vs 0.38 (95% CI [0.35-0.41]) vs; p < 0.001). Similar results were seen in all subgroups. Our meta-analysis showed that combining LR-4 and LR-5 would increase sensitivity but decrease specificity, positive likelihood ratio, and negative likelihood ratio. These findings may inform management guidelines and individualized management. This meta-analysis estimated the magnitude of changes in the sensitivity and specificity of imaging criteria when LI-RADS categories 4 and 5 were combined; these findings can inform management guidelines and individualized management. There is no single worldwide reporting system for liver imaging, partly due to regional needs. Combining LI-RADS categories 4 and 5 increased sensitivity and decreased specificity and positive and negative likelihood ratios. Changes in the sensitivity and specificity of imaging criteria can inform management guidelines and individualized management.

Diagnostic performance of radiomics for predicting osteoporosis in adults: a systematic review and meta-analysis.

This study aimed to assess the diagnostic accuracy of radiomics for predicting osteoporosis and the quality of radiomic studies. The study protocol was prospectively registered on PROSPERO (CRD42023425058). We searched PubMed, EMBASE, Web of Science, and Cochrane Library databases from inception to June 1, 2023, for eligible articles that applied radiomic techniques to diagnosing osteoporosis or abnormal bone mass. Quality and risk of bias of the included studies were evaluated with radiomics quality score (RQS), METhodological RadiomICs Score (METRICS), and Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) tools. The data analysis utilized the R program with mada, metafor, and meta packages. Ten retrospective studies with 5926 participants were included in the systematic review and meta-analysis. The overall risk of bias and applicability concerns for each domain of the studies were rated as low, except for one study which was considered to have a high risk of flow and time bias. The mean METRICS score was 70.1% (range 49.6-83.2%). There was moderate heterogeneity across studies and meta-regression identified sources of heterogeneity in the data, including imaging modality, feature selection method, and classifier. The pooled diagnostic odds ratio (DOR) under the bivariate random effects model across the studies was 57.22 (95% CI 27.62-118.52). The pooled sensitivity and specificity were 87% (95% CI 81-92%) and 87% (95% CI 77-93%), respectively. The area under the summary receiver operating characteristic curve (AUC) of the radiomic models was 0.94 (range 0.8 to 0.98). The results supported that the radiomic techniques had good accuracy in diagnosing osteoporosis or abnormal bone mass. The application of radiomics in osteoporosis diagnosis needs to be further confirmed by more prospective studies with rigorous adherence to existing guidelines and multicenter validation.

Diagnostic accuracy of cell-free DNA in maternal blood in detecting chromosomal anomalies in twin pregnancies: systematic review and meta-analysis.

To report the diagnostic accuracy of cell-free DNA (cfDNA) in maternal blood in detecting chromosomal anomalies in twin pregnancies. Medline, Embase and Cochrane databases were searched. The inclusion criteria were twin pregnancies undergoing cfDNA screening for Trisomies 13, 18, 21, monosomy X0 and other sex chromosomal anomalies (SCA). The index test was represented by a positive results of cfDNA test. The reference standard was represented by the karyotype results (obtained either pre or postnatally) or, in case of negative cfDNA result, by a normal neonatal phenotype. The quality of the studies was assessed using the revised tool for the quality assessment of diagnostic accuracy studies (QUADAS-2). Summary estimates of sensitivity, specificity, positive and negative likelihood ratios (LR+ and LR-) and diagnostic odds ratio (DOR), with the corresponding 95% Confidence Intervals (95% CI), were computed using the bivariate random-effects model. Thirty-five studies were included. cfDNA had an overall high accuracy in detecting Trisomy 21 in twin pregnancies with a sensitivity of 98.8% (95% CI 96.5-100), a specificity of 100% (95% CI 99.9-100). Sensitivity and specificity were of 94.9% (95% CI 75.6-99.1) and 100 (95% CI 99.9-100) for Trisomy 18, and 84.6% (95% C% 54.6-98.1) and 100% (95% CI 99.9-100) for Trisomy 13 . We could not compute the diagnostic accuracy of cfDNA in detecting monosomy X0 in twins, while cfDNA had a sensitivity of 100% (95% CI 71.5-100) and a specificity of 99.8% (95% CI 99.7-99.9) in detecting other SCA (11 cases). The accuracy of cfDNA in detecting Trisomy 21, 18 and 13 was similar in dichorionic and monochorionic twin pregnancies. cfDNA has a high diagnostic accuracy in detecting Trisomy 18 and 21 in twin pregnancies, irrespective of chorionicity. Accuracy in the detection of Trisomy 13 and SCA was limited by the small number of affected cases and the difficulties in the confirmation of false negative cases in case of SCA and requires confirmation in larger studies. This article is protected by copyright. All rights reserved.

Hierarchical multinomial processing tree models for meta-analysis of diagnostic accuracy studies

Abstract Meta-analysis represents a widely accepted approach for evaluating the accuracy of diagnostic tools in clinical and psychological investigations. This article investigates the applicability of multinomial tree models recently suggested in the literature under a fixed-effects formulation for assessing the accuracy of binary classification tools, where the study specific disease prevalences are taken into account. The model proposed in this article extends previous results to a hierarchical structure accounting for the variability between the studies included in the meta-analysis. Interestingly, by exploiting the parameter separability of the complete likelihood function, the resulting hierarchical multinomial tree model is shown to coincide, in its interest parameter component, with the well-known bivariate random-effects model under an exact within-study distribution for the number of true positives and true negatives subjects. The proposal is in line with a latent-trait approach, where inference follows a frequentist point of view. The applicability of the proposed model and its performance with respect to its fixed-effects counterpart and to the approximate bivariate random-effects model based on normality assumptions commonly used in the literature is evaluated in a series of simulation studies. Methods are applied to a real meta-analysis about the accuracy of the confusion assessment method as delirium screening tool.

Circulating tumour DNA-Based molecular residual disease detection in resectable cancers: a systematic review and meta-analysis

Circulating tumour DNA (ctDNA)-based molecular residual disease (MRD) detection technology has been widely used for recurrence evaluation, but there is no agreement on the efficacy of assessing recurrence and overall survival (OS) prognosis, as well as the sensitivity and specificity of landmark detection and longitudinal detection. We systematically searched Pubmed, Embase, Cochrane, and Scopus for prospective studies or randomized controlled trials that collected blood samples prospectively. The search period was from Jan 1, 2013, to Sept 10, 2023. We excluded retrospective studies. The primary endpoint was to assess the hazard ratio (HR) between circulating tumour DNA positive (ctDNA+) and negative (ctDNA-) for recurrence-free survival incidence (RFS), disease-free survival (DFS), progression-free survival (PFS), event-free survival (EFS), time to recurrence (TTR), distant metastasis-free survival (DMFS) or OS in patients with resectable cancers. We calculated the pooled HR of recurrence and OS and 95% confidence interval (CI) in patients with resected cancers using a random-effects model. Pooled sensitivity and specificity were estimated using the bivariate random effects model. This systematic review and meta-analysis returned 7578 records, yielding 80 included studies after exclusion. We found that the HR of recurrence across all included cancers between patients with ctDNA+ and ctDNA- was 7.48 (95% CI 6.39-8.77), and the OS was 5.58 (95% CI 4.17-7.48). We also found that the sensitivity, area under the summary receiver operating characteristic curve (AUSROC) and diagnostic odds ratio (DOR) of longitudinal tests were higher than that of landmark tests between patients with ctDNA+ and ctDNA- (0.74, 95% CI 0.68-0.80 vs 0.50, 95% CI 0.46-0.55; 0.88 vs. 0.80; 25.70, 95% CI 13.20-45.40 vs. 9.90, 95% CI 7.77-12.40). Postoperative ctDNA testing was a significant prognosis factor for recurrence and OS in patients with resectable cancers. However, the overall sensitivity of ctDNA-MRD detection could be better. Longitudinal monitoring can improve the sensitivity, AUSROC, and DOR. Special fund project for clinical research of Qingyuan People's Hospital (QYRYCRC2023006), plan on enhancing scientific research in GMU (GZMU-SH-301).

Compared with SonoVue® LR-5, Sonazoid® modified LR-5 has better diagnostic sensitivity for hepatocellular carcinoma: a systematic review and meta-analysis.

The contrast-enhanced ultrasound (CEUS) liver imaging reporting and data system (LI-RADS) is a standardized system for reporting liver nodules in patients at risk of developing hepatocellular carcinoma (HCC) and is only recommended for pure blood pool agents such as SonoVue®. A modified LI-RADS was proposed for Sonazoid®, a Kupffer cell-specific contrast agent. This meta-analysis was conducted to compare the diagnostic efficiency of the CEUS LI-RADS for SonoVue® and the modified LI-RADS for Sonazoid®. The PubMed, Medline, Web of Science, Embase, and Cochrane Library databases were systematically searched to retrieve studies on the diagnostic efficiency of the CEUS LI-RADS algorithms in diagnosing HCC using SonoVue® and/or Sonazoid® from January 2016 to June 2023. Histopathology or imaging follow-up served as the reference standards. Only articles published in English on retrospective or prospective studies with full reports were included in the meta-analysis. A bivariate random-effects model was used. Data pooling, meta-regression, and sensitivity analysis were performed for the meta-analysis. Deeks' funnel plot asymmetry test was used to evaluate publication bias, and the QUADAS-2 tool was used to assess the methodological quality of eligible studies. In total, 26 studies comprising 8,495 patients with 9,244 lesions were included in the meta-analysis. The pooled data results for SonoVue® LI-RADS category 5 (LR-5) and Sonazoid® modified LR-5 were as follows: pooled sensitivity: 0.68 [95%confidence interval (CI): 0.64-0.73, I2=89.20%; P<0.01] and 0.82 (95% CI: 0.74-0.87, I2=85.39%; P<0.01) (P<0.05); pooled specificity: 0.93 (95% CI: 0.90-0.96, I2=86.52%; P<0.01) and 0.86 (95% CI: 0.79-0.91, I2=59.91%; P=0.01) (P<0.05); pooled area under the curve (AUC): 0.86 (95% CI: 0.82-0.89) and 0.91 (95% CI: 0.88-0.93) (P<0.05), respectively. The meta-regression analysis revealed that the study design, subject enrollment method, and reference standard contributed to the heterogeneity of SonoVue® LR-5, and the number of lesions was a source of heterogeneity for Sonazoid® modified LR-5. The diagnostic performance of the LI-RADS category M (LR-M) algorithms of SonoVue® and Sonazoid® was comparable. The Sonazoid® modified LR-5 algorithm had a higher diagnostic sensitivity, lower specificity, and higher AUC than SonoVue® LR-5.

Image-based artificial intelligence for the prediction of pathological complete response to neoadjuvant chemoradiotherapy in patients with rectal cancer: a systematic review and meta-analysis.

Artificial intelligence (AI) holds enormous potential for noninvasively identifying patients with rectal cancer who could achieve pathological complete response (pCR) following neoadjuvant chemoradiotherapy (nCRT). We aimed to conduct a meta-analysis to summarize the diagnostic performance of image-based AI models for predicting pCR to nCRT in patients with rectal cancer. This study followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. A literature search of PubMed, Embase, Cochrane Library, and Web of Science was performed from inception to July 29, 2023. Studies that developed or utilized AI models for predicting pCR to nCRT in rectal cancer from medical images were included. The Quality Assessment of Diagnostic Accuracy Studies-AI was used to appraise the methodological quality of the studies. The bivariate random-effects model was used to summarize the individual sensitivities, specificities, and areas-under-the-curve (AUCs). Subgroup and meta-regression analyses were conducted to identify potential sources of heterogeneity. Protocol for this study was registered with PROSPERO (CRD42022382374). Thirty-four studies (9933 patients) were identified. Pooled estimates of sensitivity, specificity, and AUC of AI models for pCR prediction were 82% (95% CI: 76-87%), 84% (95% CI: 79-88%), and 90% (95% CI: 87-92%), respectively. Higher specificity was seen for the Asian population, low risk of bias, and deep-learning, compared with the non-Asian population, high risk of bias, and radiomics (all P < 0.05). Single-center had a higher sensitivity than multi-center (P = 0.001). The retrospective design had lower sensitivity (P = 0.012) but higher specificity (P < 0.001) than the prospective design. MRI showed higher sensitivity (P = 0.001) but lower specificity (P = 0.044) than non-MRI. The sensitivity and specificity of internal validation were higher than those of external validation (both P = 0.005). Image-based AI models exhibited favorable performance for predicting pCR to nCRT in rectal cancer. However, further clinical trials are warranted to verify the findings.

Accuracy of Frozen Section Biopsy in the Diagnosis of Endometrial Cancer: A Systematic Review and Meta-Analysis.

The early and accurate diagnosis of endometrial cancer is of paramount importance for the survival of these patients. The aim of this study was to systematically appraise the available data regarding the accuracy of frozen section biopsy in diagnosing endometrial cancer. A thorough literature search was performed in PubMed/Medline, Scopus and the Cochrane Central Register of Controlled Trials databases from inception up to January 2023, with the use of specific, relevant key terms. A quality evaluation for each study was performed with the QUADAS-2 tool, whereas a bivariate random-effect model was performed to generate a summary receiver-operated curve. Heterogeneity was evaluated with Cochrane Q and Higgins' I2 statistics. Subgroup analyses were performed for studies focused on atypical hyperplasia and those focused on endometrial cancer. The search yielded 47 studies, involving 7790 patients with endometrial cancer. Among them, only 11 could be included in the quantitative analysis. QUADAS-2 evaluation resulted in rather high quality among the included studies. Quantitative synthesis resulted in a pooled sensitivity of 0.863 and pooled specificity of 0.916. The AUC was 0.948, the Q statistic was 10.488 (10 df, p = 0.399) and Higgins' I2 (4.655%) reported no significant heterogeneity. Subgroup analyses based on the diagnosis revealed a pooled sensitivity 0.886, specificity 0.862 and AUC 0.934 for endometrial cancer versus a sensitivity of 0.816, specificity of 0.962 and AUC 0.939 for atypical hyperplasia. Frozen section appears as a valid and reliable diagnostic tool for endometrial cancer. Its reliability seems to be even higher for the diagnosis of atypical hyperplasia. Therefore, this method may be considered in clinical practice and in settings with appropriate resources.

The diagnostic accuracy of the Mini-Cog screening tool for the detection of cognitive impairment-A systematic review and meta-analysis.

The Mini-Cog is a rapid screening tool that can be administered to older adults to detect cognitive impairment (CI); however, the accuracy of the Mini-Cog to detect CI for older patients in various healthcare settings is unclear. To evaluate the diagnostic accuracy of the Mini-Cog to screen for cognitive impairment in older patients across different healthcare settings. We searched nine electronic databases (including MEDLINE, Embase) from inception to January 2023. We included studies with patients ≥60 years old undergoing screening for cognitive impairment using the Mini-Cog across all healthcare settings. A cut-off of ≤ 2/5 was used to classify dementia, mild cognitive impairment (MCI), and cognitive impairment (defined as either MCI or dementia) across various settings. The diagnostic accuracy of the Mini-Cog was assessed against gold standard references such as the Diagnostic and Statistical Manual of Mental Disorders (DSM). A bivariate random-effects model was used to estimate accuracy and diagnostic ability. The risk of bias was assessed using QUADAS-2 criteria. The systematic search resulted in 4,265 articles and 14 studies were included for analysis. To detect dementia (six studies, n = 4772), the Mini-Cog showed 76% sensitivity and 83% specificity. To detect MCI (two studies, n = 270), it showed 84% sensitivity and 79% specificity. To detect CI (eight studies, n = 2152), it had 67% sensitivity and 83% specificity. In the primary care setting, to detect either MCI, dementia, or CI (eight studies, n = 5620), the Mini-Cog demonstrated 73% sensitivity and 84% specificity. Within the secondary care setting (seven studies, n = 1499), the Mini-Cog to detect MCI, dementia or CI demonstrated 73% sensitivity and 76% specificity. A high or unclear risk of bias persisted in the patient selection and timing domain. The Mini-Cog is a quick and freely available screening tool and has high sensitivity and specificity to screen for CI in older adults across various healthcare settings. It is a practical screening tool for use in time-sensitive and resource-limited healthcare settings.

Lever sign test for anterior cruciate ligament injuries: a diagnostic meta-analysis

BackgroundSports-related ACL (anterior cruciate ligament) injuries are frequent. Successful management requires early diagnosis and treatment. One of the clinical tests used to identify ACL damage is the lever sign test. This meta-analysis aimed to assess the lever sign test's diagnostic efficacy for ACL injuries.MethodsAn extensive investigation of the Cochrane Library, Embase, and PubMed databases was conducted until April 2023. Studies assessing the lever sign test's diagnostic efficacy for ACL injuries were also included. A bivariate random-effects model was employed to acquire the pooled estimates of diagnostic odds ratios, specificity, positive and negative likelihood ratios, sensitivity, and curves of the summary receiver operating characteristic (SROC).ResultsThe meta-analysis comprised twelve investigations with a total of 1365 individuals. The lever sign test's combined sensitivity and specificity for the purpose of diagnosing injuries to the ACL were 0.810 (95% confidence interval [CI] 0.686–0.893) and 0.784 (95% CI 0.583–0.904), respectively. The positive and negative likelihood ratios were 3.148 (95% CI 1.784–5.553) and 0.210 (95% CI 0.084–0.528), respectively. The study revealed a diagnostic odds ratio of 17.656, with a 95% CI ranging from 4.800 to 64.951. The SROC curve's area was determined to be 0.912 (95% CI 0.857–0.967).ConclusionWith high specificity and sensitivity, the lever sign test is a reliable diagnostic modality for ACL injuries. However, the test should be used in combination with other diagnostic tests to increase the accuracy of the diagnosis. Further investigations are warranted to assess the clinical practicability of the lever sign test in various populations and settings.

Deep learning performance compared to healthcare experts in detecting wrist fractures from radiographs: A systematic review and meta-analysis

ObjectiveTo perform a systematic review and meta-analysis of the diagnostic accuracy of deep learning (DL) algorithms in the diagnosis of wrist fractures (WF) on plain wrist radiographs, taking healthcare experts consensus as reference standard. MethodsEmbase, Medline, PubMed, Scopus and Web of Science were searched in the period from 1 Jan 2012 to 9 March 2023. Eligible studies were patients with wrist radiographs for radial and ulnar fractures as the target condition, studies using DL algorithms based on convolutional neural networks (CNN), and healthcare experts consensus as the minimum reference standard. Studies were assessed with a modified QUADAS-2 tool, and we applied a bivariate random-effects model for meta-analysis of diagnostic test accuracy data. ResultsOur study was registered at PROSPERO with ID: CRD42023431398. We included 6 unique studies for meta-analysis, with a total of 33,026 radiographs. CNN performance compared to reference standards for the included articles found a summary sensitivity of 92% (95% CI: 80%–97%) and a summary specificity of 93% (95% CI: 76%–98%). The generalized bivariate I-squared statistic indicated considerable heterogeneity between the studies (81.90%). Four studies had one or more domains at high risk of bias and two studies had concerns regarding applicability. ConclusionThe diagnostic accuracy of CNNs was comparable to that of healthcare experts in wrist radiographs for investigation of WF. There is a need for studies with a robust reference standard, external data-set validation and investigation of diagnostic performance of healthcare experts aided with CNNs. Clinical relevance statementDL matches healthcare experts in diagnosing WFs, which potentially benefits patient diagnosis.

Early warning scores for sepsis identification and prediction of in-hospital mortality in adults with sepsis: A systematic review and meta-analysis.

The early warning scores (EWS), quick Sequential Organ Failure Assessment (qSOFA) and systemic inflammatory response syndrome (SIRS) criteria have been proposed as sepsis screening tools. This review aims to summarise and compare the performance of EWS with the qSOFA and SIRS criteria for predicting sepsis diagnosis and in-hospital mortality in patients with sepsis. A systematic review with meta-analysis. Seven databases were searched from January 1, 2016 until March 10, 2022. Study quality was assessed using the Quality Assessment of Diagnostic Accuracy Studies 2 tool. Sensitivity, specificity, likelihood ratios and diagnostic odd ratios were pooled by using the bivariate random effects model. Overall performance was summarised by using the hierarchical summary receiver-operating characteristics curve. This paper adhered to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses of Diagnostic Test Accuracy Studies (PRISMA-DTA) guidelines. Ten studies involving 52,474 subjects were included in the review. For predicting sepsis diagnosis, the pooled sensitivity of EWS (65%, 95% CI: 55, 75) was similar to SIRS ≥2 (70%, 95% CI: 49, 85) and higher than qSOFA ≥2 (37%, 95% CI: 20, 59). The pooled specificity of EWS (77%, 95% CI: 64, 86) was higher than SIRS ≥2 (62%, 95% CI: 41, 80) but lower than qSOFA ≥2 (94%, 95% CI: 86, 98). Results were similar for the secondary outcome of in-hospital mortality. Although no one scoring system had both high sensitivity and specificity, the EWS had at least equivalent values in most measures of diagnostic accuracy compared with SIRS or qSOFA. Healthcare systems in which EWS is already in place should consider whether there is any clinical benefit in adopting qSOFA or SIRS. This systematic review did not directly involve patient or public contribution to the manuscript.

Urea breath test for Helicobacter pylori infection in adult dyspeptic patients: A meta-analysis of diagnostic test accuracy.

Helicobacter pylori (H. pylori) infection has been well-established as a significant risk factor for several gastrointestinal disorders. The urea breath test (UBT) has emerged as a leading non-invasive method for detecting H. pylori. Despite numerous studies confirming its substantial accuracy, the reliability of UBT results is often compromised by inherent limitations. These findings underscore the need for a rigorous statistical synthesis to clarify and reconcile the diagnostic accuracy of the UBT for the diagnosis of H. pylori infection. To determine and compare the diagnostic accuracy of 13C-UBT and 14C-UBT for H. pylori infection in adult patients with dyspepsia. We conducted an independent search of the PubMed/MEDLINE, EMBASE, and Cochrane Central databases until April 2022. Our search included diagnostic accuracy studies that evaluated at least one of the index tests (13C-UBT or 14C-UBT) against a reference standard. We used the QUADAS-2 tool to assess the methodological quality of the studies. We utilized the bivariate random-effects model to calculate sensitivity, specificity, positive and negative test likelihood ratios (LR+ and LR-), as well as the diagnostic odds ratio (DOR), and their 95% confidence intervals. We conducted subgroup analyses based on urea dosing, time after urea administration, and assessment technique. To investigate a possible threshold effect, we conducted Spearman correlation analysis, and we generated summary receiver operating characteristic (SROC) curves to assess heterogeneity. Finally, we visually inspected a funnel plot and used Egger's test to evaluate publication bias. The titles and abstracts of 4621 studies were screened; 79 articles were retrieved and selected for full-text reading. Finally, 60 studies were included in the diagnostic test accuracy meta-analysis. Our analysis demonstrates superior diagnostic accuracy of 13C-UBT over 14C-UBT, indicated by higher sensitivity (96.60% vs 96.15%), specificity (96.93% vs 89.84%), likelihood ratios (LR+ 22.00 vs 10.10; LR- 0.05 vs 0.06), and area under the curve (AUC; 0.979 vs 0.968). Notably, 13C-UBT's DOR (586.47) significantly outperforms 14C-UBT (DOR 226.50), making it the preferred diagnostic tool for dyspeptic individuals with H. pylori infection. Correlation analysis revealed no threshold effect (13C-UBT: r = 0.48; 14C-UBT: r = -0.01), and SROC curves showed consistent accuracy. Both 13C-UBT and 14C-UBT showed high AUC values (13C-UBT 0.979; 14C-UBT 0.968) near 1.00, reinforcing their excellent accuracy and endorsing both as reliable diagnostic tools in clinical practice. In summary, our study has demonstrated that 13C-UBT has been found to outperform the 14C-UBT, making it the preferred diagnostic approach. Additionally, our results emphasize the significance of carefully considering urea dosage, assessment timing, and measurement techniques for both tests to enhance diagnostic precision. Nevertheless, it is crucial for researchers and clinicians to evaluate the strengths and limitations of our findings before implementing them in practice.

The accuracy of screening tools for sarcopenia in older Chinese adults: a systematic review and meta-analysis.

This review aimed to analyze and compare the accuracy of eight screening tools for sarcopenia in older Chinese adults according to different diagnostic criteria. This systematic review was conducted in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. The PubMed, Embase, Web of Science, China National Knowledge Infrastructure (CNKI), and Wanfang databases were searched between the publication of the first expert consensus on sarcopenia in 2010 and April 2023 using relevant MeSH terms. We evaluated the risk bias of the included studies using the Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) tool. The pooled result of sensitivity, specificity, positive likelihood ratio (PLR), negative likelihood ratio (NLR), diagnostic odds ratio (DOR), and plot the summary receiver operating characteristic curve (SROC) were calculated by using a bivariate random-effects model. The accuracies of sensitivity and specificity of the screening tools were compared using the Z-test. A total of 30 studies (23,193 participants) were included, except for calf circumference (CC), Ishii, and Finger-ring Test; Screening tools for sarcopenia in older Chinese adults have consistently shown low to moderate sensitivity and moderate to high specificity. Regional and sex differences affect the accuracy of the screening tools. In terms of sensitivity and specificity, the CC, Ishii, and Finger-ring Test were superior to the other screening tools. The Asian Working Group on Sarcopenia (AWGS) 2019 criteria are more appropriate for the diagnosis of sarcopenia in older Chinese adults. According to the AWGS 2019, CC and Ishii are recommended for sarcopenia screening in older Chinese adults.

An empirical comparison of statistical methods for multiple cut-off diagnostic test accuracy meta-analysis of the Edinburgh postnatal depression scale (EPDS) depression screening tool using published results vs individual participant data

BackgroundSelective reporting of results from only well-performing cut-offs leads to biased estimates of accuracy in primary studies of questionnaire-based screening tools and in meta-analyses that synthesize results. Individual participant data meta-analysis (IPDMA) of sensitivity and specificity at each cut-off via bivariate random-effects models (BREMs) can overcome this problem. However, IPDMA is laborious and depends on the ability to successfully obtain primary datasets, and BREMs ignore the correlation between cut-offs within primary studies.MethodsWe compared the performance of three recent multiple cut-off models developed by Steinhauser et al., Jones et al., and Hoyer and Kuss, that account for missing cut-offs when meta-analyzing diagnostic accuracy studies with multiple cut-offs, to BREMs fitted at each cut-off. We used data from 22 studies of the accuracy of the Edinburgh Postnatal Depression Scale (EPDS; 4475 participants, 758 major depression cases). We fitted each of the three multiple cut-off models and BREMs to a dataset with results from only published cut-offs from each study (published data) and an IPD dataset with results for all cut-offs (full IPD data). We estimated pooled sensitivity and specificity with 95% confidence intervals (CIs) for each cut-off and the area under the curve.ResultsCompared to the BREMs fitted to the full IPD data, the Steinhauser et al., Jones et al., and Hoyer and Kuss models fitted to the published data produced similar receiver operating characteristic curves; though, the Hoyer and Kuss model had lower area under the curve, mainly due to estimating slightly lower sensitivity at lower cut-offs. When fitting the three multiple cut-off models to the full IPD data, a similar pattern of results was observed. Importantly, all models had similar 95% CIs for sensitivity and specificity, and the CI width increased with cut-off levels for sensitivity and decreased with an increasing cut-off for specificity, even the BREMs which treat each cut-off separately.ConclusionsMultiple cut-off models appear to be the favorable methods when only published data are available. While collecting IPD is expensive and time consuming, IPD can facilitate subgroup analyses that cannot be conducted with published data only.

The diagnostic utility of heparin-binding protein among patients with bacterial infections: a systematic review and meta-analysis

BackgroundBacterial infections are considered a leading cause of hospitalization and death globally. There is still a need for a rapid and feasible biomarker for bacterial infections. Heparin-binding protein (HBP) was shown to be related to bacterial infections. The objective of the study is to investigate the diagnostic accuracy of HBP in bacterial infections.MethodsArticles were screened in PubMed, SCOPUS, Web of Science, and Cochrane to recognize eligible studies. We included studies investigating the diagnostic accuracy of HBP and reported the necessary data to construct 2 × 2 tables. A univariate analysis was conducted to determine the pooled sensitivity and specificity, and a bivariate diagnostic random-effects model was used to calculate the optimal cut-off point.ResultsThe analysis comprised sixteen studies in total. Plasma HBP showed a sensitivity of 0.90 (95% CI: [0.79, 0.96]) and a specificity of 0.87 (95% CI: [0.66, 0.96]) in diagnosing bacterial infections using blood samples. Pooling data from seven studies revealed that HBP in cerebrospinal fluid (CSF) has sensitivity and specificity of 96% (95% CI: [0.85, 0.99]), and 95% (95% CI: [0.89, 0.97]), respectively, for the diagnosis of bacterial meningitis. In urinary tract infections (UTI), urine-HBP was revealed to have a high diagnostic value in discriminating bacterial from non-bacterial UTI infection at a cut-off value of 32.868 ng/ml with sensitivity and specificity of 87%.ConclusionHBP has shown a high diagnostic accuracy of bacterial infections, including UTI and meningitis. Further studies are needed to determine its prognostic value and whether it could guide antibiotic therapy.

P458 Diagnostic accuracy of patency capsule and cross-sectional imaging for capsule endoscopy retention: A systematic review and meta-analysis

Abstract Background Although small bowel capsule endoscopy (SBCE) has been widely used to evaluate small bowel lesions including Crohn’s disease, there is a risk of capsule retention that can cause obstructive symptoms potentially necessitating surgical treatment. We conducted a systematic review and meta-analysis to evaluate the accuracy of patency capsule (PC) and cross-sectional imaging (CSI) for predicting capsule retention. Methods MEDLINE/PubMed, EMBASE, Web of science, and the Cochrane library databases were searched for articles that invested the diagnostic accuracy of PC or CSI for predicting capsule retention up to August 15, 2023. Pooled sensitivity and specificity were calculated using a bivariate random-effects model. Considering that SBCE was generally not performed when capsule retention was suspected on PC, the false-negative rates of PC and CSI were separately analyzed and compared using a single-proportion meta-analysis based on random-effects modeling. Quality assessment of the selected studies was performed using the revised Quality Assessment of Diagnostic Accuracy Studies-2 tool. Results A total of 22 peer-reviewed articles, including 17 articles for PC (covering 2,234 patients) and 7 articles for CSI (covering 302 patients) were included in this systematic review. The pooled sensitivity and specificity for predicting capsule retention with CSI were 64% [95% confidence interval (CI), 31%–87%] and 85% [95% CI, 62%–95%], respectively. The pooled sensitivity and specificity for predicting capsule retention with PC were 75% [95% CI, 43%–92%] and 94% [95% CI, 90%–96%], respectively (Figure 1, Table 1). Although there was no statistically significant difference in prediction accuracy between PC and CSI on the bivariate random-effects model (P=0.14), the pooled false-negative rate was significantly lower in the PC compared to CSI (2.5% [95% CI, 1.4%–4.7%] vs. 11.0% [95% CI, 5.2%–21.8%]; P=0.003) (Table 1). Conclusion Cross-sectional imaging showed good specificity, but showed moderate sensitivity in predicting capsule retention. In contrast, patency capsule showed good sensitivity and excellent specificity, with a significantly lower false-negative rate compared to cross-sectional imaging. Therefore, in patients with clinically suspicious small bowel stenosis, the patency capsule is a more reliable modality for predicting capsule retention.

Diagnostic accuracy of Xpert MTB/RIF Ultra for childhood tuberculosis in West Africa – a multicenter pragmatic study

ObjectiveTo evaluate the performance of Xpert Mycobacterium Tuberculosis/rifampicin (MTB/RIF) Ultra (Ultra) for diagnosis of childhood tuberculosis (TB) within public health systems. MethodsIn this cross-sectional study, children aged <15 years with presumptive pulmonary TB were consecutively recruited and evaluated for TB at tertiary-level hospitals in Benin, Mali, and Ghana. Bivariate random-effects models were used to determine the pooled sensitivity and specificity of Ultra against culture. We also estimated its diagnostic yield against a composite microbiological reference standard (cMRS) of positive culture or Ultra. ResultsOverall, 193 children were included in the analyses with a median (interquartile range) age of 4.0 (1.1-9.2) years, 88 (45.6%) were female, and 36 (18.7%) were HIV-positive. Thirty-one (16.1%) children had confirmed TB, 39 (20.2%) had unconfirmed TB, and 123 (63.7%) had unlikely TB. The pooled sensitivity and specificity of Ultra verified by culture were 55.0% (95% confidence interval [CI]: 28.0–79.0%) and 95.0% (95% CI: 88.0–98.0%), respectively. Against the cMRS, the diagnostic yield of Ultra and culture were 67.7% (95% CI: 48.6–83.3%) and 70.9% (95% CI: 51.9–85.8%), respectively. ConclusionUltra has suboptimal sensitivity in children with TB that were investigated under routine conditions in tertiary-level hospitals in three West African countries.

Head-to-head comparison of cone-beam breast computed tomography and mammography in the diagnosis of primary breast cancer: A systematic review and meta-analysis

IntroductionTo compare the diagnostic performance of cone-beam breast computed tomography (CBBCT) and mammography (MG) in primary breast cancer. MethodsPubMed, Embase, Web of Science, China National Knowledge Infrastructure, WanFang DATA, and China Science and Technology Journal databases were searched comprehensively from inception to March 2023. Sensitivity and specificity were calculated using bivariate random-effects models, and a summary receiver operating characteristic (SROC) curve was constructed. Bivariate I2 statistics and meta-regression analyses were also performed. The differences in diagnostic performance between CBBCT and MG were analysed using Z-test statistics. Clinical utility was explored using Fagan’s nomogram, and quality assessment was conducted utilising the Quality Assessment of Diagnostic Accuracy Studies-2 checklist. ResultsThe summary sensitivity and specificity for CBBCT in diagnosing primary breast cancer were 0.92 (95 % CI: 0.87–0.94) and 0.79 (95 % CI: 0.71–0.85), respectively, and the area under the curve (AUC) of the SROC was 0.93 (95 % CI: 0.90–0.95). For MG, the summary sensitivity and specificity were 0.77 (95 % CI: 0.69–0.83) and 0.75 (95 % CI: 0.66–0.82), respectively, with an AUC of 0.83 (95 % CI: 0.80–0.86). The Z-test revealed that the summary sensitivity of CBBCT was significantly higher than that of MG (P < 0.001). Additionally, the summary AUC of CBBCT was significantly higher than that of MG (P < 0.001). ConclusionThe diagnostic performance of CBBCT for primary breast cancer was better than that of MG. However, the results of both the CBBCT and MG are based on studies with small sample sizes. Further studies with larger sample sizes and more comprehensive designs are required to address this issue.