Systematic Review Of Diagnostic Test Accuracy Research Articles

MRI and SPECT/CT demonstrate, with low certainty of evidence, the highest diagnostic accuracy for aseptic knee arthroplasty loosening: A systematic comparative diagnostic test review and meta-analysis.

The purpose of this study was to evaluate and compare the diagnostic accuracy of modalities used to aid the diagnosis of aseptic knee arthroplasty loosening. A comparative diagnostic test accuracy systematic review and meta-analysis was conducted following the Cochrane and PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. PubMed, EMBASEand Cochrane databases were searched for original articles evaluating diagnostic modalities up to March 2024. Included studies compared the modality (index test) to the intraoperative finding as reference test. The QUADAS-C (Quality Assessment of Diagnostic Accuracy Studies-Comparative)tool was used to assess the quality of the included studies. The GRADE (Grading of Recommendations, Assessment, Development and Evaluation) approach was used to evaluate the certainty of evidence. Level of evidence was evaluated using the Oxford Levels of Evidence tool. The primary outcome wasthe summary of diagnostic accuracy metrics for each modality as demonstrated by a summary receiver-operating characteristic (SROC) curve. The search yielded 467 articles. Of these, 14 articles were included. These 14 articles evaluated a total of five different diagnostic modalities: bone scintigraphy (three studies, 146 cases), 18-fluorodeoxyglucose positron emission tomography(two studies, 50 cases), single-photon emission computed tomography combined with computed tomography (SPECT/CT) (seven studies, 371 cases), radionuclide arthrogram (three studies, 196 cases)and magnetic resonance imaging (MRI) (one study, 116 cases). Nine studies exhibited a high risk of bias in patient selection, and all studies showed a high risk of bias related to the reference test. The majority of the included studies were classified as Level III evidence, leading to an overall low level of certainty in the evidence. The most accurate tests, as demonstrated by the SROC analysis, were MRI and SPECT/CT, with sensitivities ranging from 0.00 to 1.00 and 0.33 to 1.00 and specificities between 0.31-1.00 and 0.00-1.00, respectively. This review and meta-analysis evaluated available diagnostic modalities to aid the diagnosis of knee arthroplasty loosening and based on a low certainty of evidence suggests that MRI and SPECT/CT are currently the most accurate modalities available to aid the diagnosis of aseptic loosening of knee arthroplasty components. Level III.

Ultrasound-based radiomics for the differential diagnosis of breast masses: A systematic review and meta-analysis.

Ultrasound-based radiomics has demonstrated excellent diagnostic performance in differentiating benign and malignant breast masses. Given a few clinical studies on their diagnostic role, we conducted a meta-analysis of the potential effects of ultrasound-based radiomics for the differential diagnosis of breast masses, aiming to provide evidence-based medical basis for clinical research. We searched Embase, Web of Science, Cochrane Library, and PubMed databases from inception through to February 2023. The methodological quality assessment of the included studies was performed according to Quality Assessment of Diagnostic Accuracy Studies checklist. A diagnostic test accuracy systematic review and meta-analysis was performed in accordance with PRISMA guidelines. Sensitivity, specificity, and area under curve delineating benign and malignant lesions were recorded. We also used sensitivity analysis and subgroup analysis to explore potential sources of heterogeneity. Deeks' funnel plots was used to examine the publication bias. A total of 11 studies were included in this meta-analysis. For the diagnosis of malignant breast masses worldwide, the overall mean rates of sensitivity and specificity of ultrasound-based radiomics were 0.90 (95% confidence interval [CI], 0.83-0.95) and 0.89 (95% CI, 0.82-0.94), respectively. The summary diagnostic odds ratio was 76 (95% CI, 26-219), and the area under the curve for the summary receiver operating characteristic curve was 0.95 (95% CI, 0.93-0.97). Ultrasound-based radiomics has the potential to improve diagnostic accuracy to discriminate between benign and malignant breast masses, and could reduce unnecessary biopsies.

Atrial Fibrillation Screening During Routine Automated Office, Home, and Ambulatory Blood Pressure Measurement: A Diagnostic Test Accuracy Systematic Review and Meta-Analysis.

Atrial fibrillation (AF) is often asymptomatic and undiagnosed. As AF and hypertension often coexist, opportunistic AF detection during routine automated blood pressure (BP) measurement appears to be an attractive screening method. A systematic literature search was conducted to identify studies assessing the diagnostic test accuracy of office, home, or 24-hour ambulatory BP measuring devices with AF detection algorithms versus reference electrocardiography. Analyses were performed per participant (AF status based on several BP readings; most office/home devices) or per reading (AF status based on individual readings; all ambulatory devices). A meta-analysis stratified by device type (office/home/ambulatory) was conducted to calculate pooled measures of diagnostic accuracy. Sensitivity/meta-regression analyses were also performed. Among 3096 records initially retrieved, 23 diagnostic test accuracy studies were included. Data derived from 11 093 individuals (weighted age 69 years, males 56%, hypertensives 79%, diabetics 24%, and AF prevalence 17%) indicated a pooled sensitivity 0.97 (95% CI, 0.92-0.99), specificity 0.93 (95% CI, 0.90-0.95), and accuracy 0.93 (95% CI, 0.89-0.95), with generally consistent results using office, home, or ambulatory BP devices (slightly lower specificity with the latter). The positive and negative predictive values were 0.70 (95% CI, 0.60-0.80) and 0.99 (95% CI, 0.98-1.00), respectively. Sensitivity analyses indicated lower specificity in studies implementing reading versus participant analyses. Most studies presented a low risk of bias and minor applicability concerns. There is considerable and consistent evidence suggesting high diagnostic accuracy of AF detection algorithms implemented in automated BP monitors during routine BP measurements in and out of the office. AF diagnosis requires verification (electrocardiography) before treatment is administered.

Machine learning-based medical imaging diagnosis in patients with temporomandibular disorders: a diagnostic test accuracy systematic review and meta-analysis.

Temporomandibular disorders (TMDs) are the second most common musculoskeletal condition which are challenging tasks for most clinicians. Recent research used machine learning (ML) algorithms to diagnose TMDs intelligently. This study aimed to systematically evaluate the quality of these studies and assess the diagnostic accuracy of existing models. Twelve databases (Europe PMC, Embase, etc.) and two registers were searched for published and unpublished studies using ML algorithms on medical images. Two reviewers extracted the characteristics of studies and assessed the methodological quality using the QUADAS-2 tool independently. A total of 28 studies (29 reports) were included: one was at unclear risk of bias and the others were at high risk. Thus the certainty of evidence was quite low. These studies used many types of algorithms including 8 machine learning models (logistic regression, support vector machine, random forest, etc.) and 15 deep learning models (Resnet152, Yolo v5, Inception V3, etc.). The diagnostic accuracy of a few models was relatively satisfactory. The pooled sensitivity and specificity were 0.745 (0.660-0.814) and 0.770 (0.700-0.828) in random forest, 0.765 (0.686-0.829) and 0.766 (0.688-0.830) in XGBoost, and 0.781 (0.704-0.843) and 0.781 (0.704-0.843) in LightGBM. Most studies had high risks of bias in Patient Selection and Index Test. Some algorithms are relatively satisfactory and might be promising in intelligent diagnosis. Overall, more high-quality studies and more types of algorithms should be conducted in the future. We evaluated the diagnostic accuracy of the existing models and provided clinicians with much advice about the selection of algorithms. This study stated the promising orientation of future research, and we believe it will promote the intelligent diagnosis of TMDs.

Diagnostic Accuracy of Clinical Tests for Assessing Greater Trochanteric Pain Syndrome: A Systematic Review With Meta-analysis.

OBJECTIVE: We aimed to evaluate the accuracy of clinical tests that are used to diagnose greater trochanteric pain syndrome (GTPS) in clinical practice. DESIGN: Diagnostic test accuracy systematic review with meta-analysis. LITERATURE SEARCH: MEDLINE, Embase, CINAHL, AMED, and SPORTDiscus were searched using key words mapped to diagnostic test accuracy for GTPS. STUDY SELECTION CRITERIA: Studies with published or derivable diagnostic accuracy data were included. DATA SYNTHESIS: Risk of bias was assessed using the QUADAS-2 tool, and certainty of evidence, via the Grading of Recommendations, Assessment, Development, and Evaluations (GRADE) framework. MetaDTA "R" random-effects models were used to summarize individual and pooled data including sensitivity, specificity, likelihood ratios, and pretest/posttest probabilities. RESULTS: From a database yield of 858 studies, 23 full texts were assessed. We included 6 studies for review, involving 15 tests and 272 participants (314 hips). Overall certainty of evidence ranged from very low to moderate. Meta-analysis of 6 tests revealed sequenced test clusters able to significantly shift pretest-posttest probability for or against a GTPS diagnosis. In people reporting lateral hip pain, a negative gluteal tendon (GT) palpation test followed by a negative resisted hip abduction test significantly reduced the posttest probability of GTPS from 59% to 14%. In those with a positive GT palpation test followed by a positive resisted hip abduction test, the posttest probability of GTPS significantly shifted from 59% to 96%. CONCLUSION: The value of magnetic resonance imaging for diagnosing GTPS is debated. We have identified a straightforward, clinically useful diagnostic test cluster to help confirm or refute the presence of GTPS in people reporting lateral hip pain. J Orthop Sports Phys Ther 2024;54(1):1-24. Epub 10 August 2023. doi:10.2519/jospt.2023.11890.

Drain fluid biomarkers for the diagnosis of clinically relevant postoperative pancreatic fistula: a diagnostic accuracy systematic review and meta-analysis.

Pancreatectomy is the only curative treatment available for pancreatic cancer and a necessity for patients with challenging pancreatic pathology. To optimize outcomes, postsurgical complications such as clinically relevant postoperative pancreatic fistula (CR-POPF) should be minimized. Central to this is the ability to predict and diagnose CR-POPF, potentially through drain fluid biomarkers. This study aimed to assess the utility of drain fluid biomarkers for predicting CR-POPF by conducting a diagnostic test accuracy systematic review and meta-analysis. Five databases were searched for relevant and original papers published from January 2000 to December 2021, with citation chaining capturing additional studies. The QUADAS-2 tool was used to assess the risk of bias and concerns regarding applicability of the selected studies. Seventy-eight papers were included in the meta-analysis, encompassing six drain biomarkers and 30758 patients with a CR-POPF prevalence of 17.42%. The pooled sensitivity and specificity for 15 cut-offs were determined. Potential triage tests (negative predictive value >90%) were identified for the ruling out of CR-POPF and included postoperative day 1 (POD1) drain amylase in pancreatoduodenectomy (PD) patients (300U/l) and in mixed surgical cohorts (2500U/l), POD3 drain amylase in PD patients (1000-1010U/l) and drain lipase in mixed surgery groups (180U/l). Notably, drain POD3 lipase had a higher sensitivity than POD3 amylase, while POD3 amylase had a higher specificity than POD1. The current findings using the pooled cut-offs will offer options for clinicians seeking to identify patients for quicker recovery. Improving the reporting of future diagnostic test studies will further clarify the diagnostic utility of drain fluid biomarkers, facilitating their inclusion in multivariable risk-stratification models and the improvement of pancreatectomy outcomes.

An open competition involving thousands of competitors failed to construct useful abstract classifiers for new diagnostic test accuracy systematic reviews.

There are currently no abstract classifiers, which can be used for new diagnostic test accuracy (DTA) systematic reviews to select primary DTA study abstracts from database searches. Our goal was to develop machine-learning-based abstract classifiers for new DTA systematic reviews through an open competition. We prepared a dataset of abstracts obtained through database searches from 11 reviews in different clinical areas. As the reference standard, we used the abstract lists that required manual full-text review. We randomly splitted the datasets into a train set, a public test set, and a private test set. Competition participants used the training set to develop classifiers and validated their classifiers using the public test set. The classifiers were refined based on the performance of the public test set. They could submit as many times as they wanted during the competition. Finally, we used the private test set to rank the submitted classifiers. To reduce false exclusions, we used the Fbeta measure with a beta set to seven for evaluating classifiers. After the competition, we conducted the external validation using a dataset from a cardiology DTA review. We received 13,774 submissions from 1429 teams or persons over 4 months. The top-honored classifier achieved a Fbeta score of 0.4036 and a recall of 0.2352 in the external validation. In conclusion, we were unable to develop an abstract classifier with sufficient recall for immediate application to new DTA systematic reviews. Further studies are needed to update and validate classifiers with datasets from other clinical areas.

Clinical tests for confirming tracheal intubation or excluding oesophageal intubation: a diagnostic test accuracy systematic review and meta-analysis.

Unrecognised oesophageal intubation causes preventable serious harm to patients undergoing tracheal intubation. When capnography is unavailable or doubted, clinicians still use clinical findings to confirm tracheal intubation, or exclude oesophageal intubation, and false reassurance from clinical examination is a recurring theme in fatal cases of unrecognised oesophageal intubation. We conducted a systematic review and meta-analysis of the diagnostic accuracy of five clinical examination tests and the oesophageal detector device when used to confirm tracheal intubation. We searched four databases for studies reporting index clinical tests against a reference standard, from inception to 28 February 2023. We included 49 studies involving 10,654 participants. Methodological quality was overall moderate to high. We looked at misting (three studies, 115 participants); lung auscultation (three studies, 217 participants); combined lung and epigastric auscultation (four studies, 506 participants); the oesophageal detector device (25 studies, 3024 participants); 'hang-up' (two non-human studies); and chest rise (one non-human study). The reference standards used were capnography (22 studies); direct vision (10 studies); and bronchoscopy (three studies). When used to confirm tracheal intubation, misting has a false positive rate (95%CI) of 0.69 (0.43-0.87); lung auscultation 0.14 (0.08-0.23); five-point auscultation 0.18 (0.08-0.36); and the oesophageal detector device 0.05 (0.02-0.09). Tests to exclude events that invariably lead to severe damage or death must have a negligible false positive rate. Misting or auscultation have too high a false positive rate to reliably exclude oesophageal intubation and there is insufficient evidence to support the use of 'hang-up' or chest rise. The oesophageal detector device may be considered where other more reliable means are not available, though waveform capnography remains the reference standard for confirmation of tracheal intubation.

MRI vs. CT for pancreatic adenocarcinoma vascular invasion: comparative diagnostic test accuracy systematic review and meta-analysis.

To perform a systematic review comparing the diagnostic accuracy of MRI vs. CT for assessing pancreatic ductal adenocarcinoma (PDAC) vascular invasion. MEDLINE, EMBASE, Cochrane Central, and Scopus were searched until December 2021 for diagnostic accuracy studies comparing MRI vs. CT to evaluate vascular invasion of pathologically confirmed PDAC in the same patients. Findings on resection or exploratory laparotomy were the preferred reference standard. Data extraction, risk of bias, and applicability assessment were performed by two authors using the Quality Assessment of Diagnostic Accuracy Studies-Comparative Tool. Bivariate random-effects meta-analysis and meta-regression were performed with 95% confidence intervals (95% CI). Three studies were included assessing 474 vessels without vascular invasion and 65 with vascular invasion in 107 patients. All patients were imaged using MRI at ≥ 1.5T and a pancreatic protocol CT. No difference was shown between MRI and CT for diagnosing PDAC vascular invasion: MRI/CT sensitivity (95% CI) were 71% (47-87%)/74% (56-86%), and specificity were 97% (94-99%)/97% (94-98%). Sources of bias included selection bias from only a subset of CT patients undergoing MRI and verification bias from patients with unresectable disease not confirmed on surgery. No patients received neoadjuvant therapy prior to staging. Based on limited data, no difference was observed between MRI and pancreatic protocol CT for PDAC vascular invasion assessment. MRI may be an adequate substitute for pancreatic protocol CT in some patients, particularly those who have already had a single-phase CT. Larger and more recent cohort studies at low risk of bias, including patients who have received neoadjuvant therapy, are needed. Abdominal MRI performed similarly to pancreatic protocol CT at assessing pancreatic ductal adenocarcinoma vascular invasion, suggesting local staging is adequate in some patients using MRI. More data are needed using larger, more recent cohorts including patients with neoadjuvant treatment. • Based on limited data, no difference was found between MRI and pancreatic protocol CT sensitivity and specificity for diagnosing PDAC vascular invasion (p = 0.81, 0.73 respectively). • Risk of bias could be reduced in future PDAC MRI vs CT comparative diagnostic test accuracy research by ensuring all enrolled patients undergo both imaging modalities being compared in random order and regardless of the findings on either modality. • More studies are needed that directly compare the diagnostic performance of MRI and CT for PDAC staging after neoadjuvant therapy.

Measuring quality of reporting in systematic reviews of diagnostic test accuracy studies in medical imaging: comparison of PRISMA-DTA and PRISMA.

To compare the reporting quality measured by the Preferred Reporting Items for Systematic Reviews and Meta-Analyses of Diagnostic Test Accuracy studies (PRISMA-DTA) vs the original PRISMA checklist for systematic reviews of diagnostic test accuracy studies in imaging and survey the use of PRISMA-DTA by researchers and endorsement by journals. Systematic reviews of DTA studies published in 2020 and 2021 in Quartile 1 and Quartile 3 medical imaging journals (defined by Journal Citation Reports) were identified through PubMed. The reporting of each systematic review was assessed using PRISMA-DTA, PRISMA-2009 and PRISMA-2020. The item scores and overall score were compared among the three checklists. We also examined checklist adoption by the included systematic reviews and surveyed checklist endorsement from author instructions of included journals. A total of 173 systematic reviews from 66 journals were included. The use of PRISMA-DTA, compared with PRISMA-2009 and PRISMA-2020, identified more issues in the reporting of title (proportion of systematic reviews with proper reporting, 27.2% vs 98.8% vs 98.8%), abstract (39.3% vs 97.1% vs 64.7%), eligibility criteria (67.6% vs 94.2% vs 94.2%), search (28.9% vs 72.3% vs 28.9%), definitions for data extraction (14.5% vs 91.9% vs 91.9%), diagnostic accuracy measures (38.2% vs 93.6% vs 93.6%), synthesis of results (28.9% vs 89.6% vs 73.4%) and results of individual studies (40.5% vs 80.3% vs 80.3%). The overall median reporting score measured by PRISMA-DTA (72.0% (interquartile range (IQR), 66.7-77.8%)) was lower than that measured by PRISMA-2009 (88.9% (IQR, 84.0-92.6%)) and similar to that measured by PRISMA-2020 (74.1% (IQR, 66.7-77.8%)). Additionally, PRISMA-DTA was used by only 43 (24.9%) systematic reviews and endorsed by two (3.0%) journals. These trends remained consistent for reviews published in journals with diverse scientific impact. The use of PRISMA-DTA may identify more reporting inadequacies compared with the original PRISMA checklists when assessing diagnostic test accuracy systematic reviews, especially in critical sections such as title, abstract and methods. However, this tool is not commonly used by researchers and is inadequately endorsed by imaging journals. Our findings suggest a strong need to use PRISMA-DTA for reporting of diagnostic test accuracy systematic reviews by authors and its endorsement by journals. © 2022 International Society of Ultrasound in Obstetrics and Gynecology.

TOMAS-R: A template to identify and plan analysis for clinically important variation and multiplicity in diagnostic test accuracy systematic reviews

The Cochrane Handbook for Systematic Reviews of Diagnostic Test Accuracy (DTA) provides guidance on important aspects of conducting a test accuracy systematic review. In this paper we present TOMAS-R (Template of Multiplicity and Analysis in Systematic Reviews), a structured template to use in conjunction with current Cochrane DTA guidance, to help identify complexities in the review question and to assist planning of data extraction and analysis when clinically important variation and multiplicity is present. Examples of clinically important variation and multiplicity could include differences in participants, index tests and test methods, target conditions and reference standards used to define them, study design and methodological quality. Our TOMAS-R template goes beyond the broad topic headings in current guidance that are sources of potential variation and multiplicity, by providing prompts for common sources of heterogeneity encountered from our experience of authoring over 100 reviews. We provide examples from two reviews to assist users. The TOMAS-R template adds value by supplementing available guidance for DTA reviews by providing a tool to facilitate discussions between methodologists, clinicians, statisticians and patient/public team members to identify the full breadth of review question complexities early in the process. The use of a structured set of prompting questions at the important stage of writing the protocol ensures clinical relevance as a main focus of the review, while allowing identification of key clinical components for data extraction and later analysis thereby facilitating a more efficient review process.

Accuracy of the Most Common Provocation Tests for Diagnosing Carpal Tunnel Syndrome: A Systematic Review With Meta-analysis.

To estimate the screening performances of the most important provocation tests for diagnosing carpal tunnel syndrome (CTS). Diagnostic test accuracy systematic review with meta-analysis. We systematically searched the MEDLINE, Scopus, Web of Science, and Cochrane databases from inception to November 2020. Observational studies comparing the accuracies of the Durkan test (DT), the hand elevation test (HET), the Phalen test (PT), the Tinel test (TT), and the upper-limb neurodynamic test specific to the median nerve (ULNT1) with electrodiagnosis for screening for CTS. Random-effects models for the diagnostic odds ratio (dOR) values computed by Moses' constant for a linear model and 95% confidence intervals (CIs) were used to calculate the accuracy of these tests. Hierarchical summary receiver operating characteristic curve analyses were used to summarize the overall test performance. Thirty-seven studies were included in the meta-analysis, with a total sample of 2662 wrists for DT, 864 wrists for HET, 6361 wrists for PT, 6094 wrists for TT, and 571 wrists for ULNT1. The pooled dORs for screening for CTS were 15.84 (95% CI: 3.78, 66.38) for DT, 128.63 (95% CI: 40.64, 407.12) for HET, 7.23 (95% CI: 4.06, 12.86) for PT, 5.31 (95% CI: 3.49, 8.09) for TT, and 1.78 (95% CI: 0.61, 5.19) for ULNT1. HET has the best clinical performance for detecting CTS and should be considered the first screening test of choice during the physical examination. The most common tests (DT, PT, and TT) have good accuracies for screening for CTS. J Orthop Sports Phys Ther 2022;52(8):522-531. Epub: 19 June 2022. doi:10.2519/jospt.2022.10828.

Abstract screening using the automated tool Rayyan: results of effectiveness in three diagnostic test accuracy systematic reviews

ObjectiveTo evaluate the performance of the automated abstract screening tool Rayyan.MethodsThe records obtained from the search for three systematic reviews were manually screened in four stages. At the end of each stage, Rayyan was used to predict the eligibility score for the remaining records. At two different thresholds (≤2.5 and < 2.5 for exclusion of a record) Rayyan-generated ratings were compared with the decisions made by human reviewers in the manual screening process and the tool’s accuracy metrics were calculated.ResultsTwo thousand fifty-four records were screened manually, of which 379 were judged to be eligible for full-text assessment, and 112 were eventually included in the final review. For finding records eligible for full-text assessment, at the threshold of < 2.5 for exclusion, Rayyan managed to achieve sensitivity values of 97-99% with specificity values of 19-58%, while at the threshold of ≤2.5 for exclusion it had a specificity of 100% with sensitivity values of 1-29%. For the task of finding eligible reports for inclusion in the final review, almost similar results were obtained.DiscussionAt the threshold of < 2.5 for exclusion, Rayyan managed to be a reliable tool for excluding ineligible records, but it was not much reliable for finding eligible records. We emphasize that this study was conducted on diagnostic test accuracy reviews, which are more difficult to screen due to inconsistent terminology.

Radiomic Detection of Malignancy within Thyroid Nodules Using Ultrasonography-A Systematic Review and Meta-Analysis.

Background: Despite investigation, 95% of thyroid nodules are ultimately benign. Radiomics is a field that uses radiological features to inform individualized patient care. We aimed to evaluate the diagnostic utility of radiomics in classifying undetermined thyroid nodules into benign and malignant using ultrasonography (US). Methods: A diagnostic test accuracy systematic review and meta-analysis was performed in accordance with PRISMA guidelines. Sensitivity, specificity, and area under curve (AUC) delineating benign and malignant lesions were recorded. Results: Seventy-five studies including 26,373 patients and 46,175 thyroid nodules met inclusion criteria. Males accounted for 24.6% of patients, while 75.4% of patients were female. Radiomics provided a pooled sensitivity of 0.87 (95% CI: 0.86–0.87) and a pooled specificity of 0.84 (95% CI: 0.84–0.85) for characterizing benign and malignant lesions. Using convolutional neural network (CNN) methods, pooled sensitivity was 0.85 (95% CI: 0.84–0.86) and pooled specificity was 0.82 (95% CI: 0.82–0.83); significantly lower than studies using non-CNN: sensitivity 0.90 (95% CI: 0.89–0.90) and specificity 0.88 (95% CI: 0.87–0.89) (p < 0.05). The diagnostic ability of radiologists and radiomics were comparable for both sensitivity (OR 0.98) and specificity (OR 0.95). Conclusions: Radiomic analysis using US provides a reproducible, reliable evaluation of undetermined thyroid nodules when compared to current best practice.

Reporting completeness in abstracts of systematic reviews of diagnostic test accuracy studies in cardiovascular diseases is suboptimal

ObjectiveJournal abstracts are crucial for the identification and initial assessment of content of studies. We evaluated whether authors in the field of cardiovascular diseases (CVDs) reported Diagnostic Test Accuracy Systematic Reviews (DTA SRs) abstracts adequately, as defined by the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA)-DTA guidelines. MethodsSRs of DTA studies in CVDs published in general and specialized medical journals were identified in a MEDLINE search between 2010 and 2020. Adherence to 12 PRISMA-DTA for abstracts items was assessed independently by two reviewers and compared by journal's type. Moreover, the association of reporting completeness with different characteristics was investigated. ResultsWe included 72 abstracts. Studies published in general medical journals had higher mean reporting score than those in specialized journals (6.2 vs. 5.3 out of 12 items; mean difference: 0.88; 95% confidence interval: 0.21, 1.55). PRISMA-DTA adherence was higher in journals that adopted this guideline and in articles with structured abstracts. However, number of participants analyzed, funding, and registration were the least-reported items in the identified abstracts. ConclusionThe reporting of abstracts of DTA reports in CVDs is suboptimal according to PRISMA-DTA guidelines. Abstract reporting could be improved with the use of higher word count limits and the adoption of PRISMA-DTA guidelines especially in specialized journals.

Automation of literature screening using machine learning in medical evidence synthesis: a diagnostic test accuracy systematic review protocol

BackgroundSystematic review is an indispensable tool for optimal evidence collection and evaluation in evidence-based medicine. However, the explosive increase of the original literatures makes it difficult to accomplish critical appraisal and regular update. Artificial intelligence (AI) algorithms have been applied to automate the literature screening procedure in medical systematic reviews. In these studies, different algorithms were used and results with great variance were reported. It is therefore imperative to systematically review and analyse the developed automatic methods for literature screening and their effectiveness reported in current studies.MethodsAn electronic search will be conducted using PubMed, Embase, ACM Digital Library, and IEEE Xplore Digital Library databases, as well as literatures found through supplementary search in Google scholar, on automatic methods for literature screening in systematic reviews. Two reviewers will independently conduct the primary screening of the articles and data extraction, in which nonconformities will be solved by discussion with a methodologist. Data will be extracted from eligible studies, including the basic characteristics of study, the information of training set and validation set, and the function and performance of AI algorithms, and summarised in a table. The risk of bias and applicability of the eligible studies will be assessed by the two reviewers independently based on Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2). Quantitative analyses, if appropriate, will also be performed.DiscussionAutomating systematic review process is of great help in reducing workload in evidence-based practice. Results from this systematic review will provide essential summary of the current development of AI algorithms for automatic literature screening in medical evidence synthesis and help to inspire further studies in this field.Systematic review registrationPROSPERO CRD42020170815 (28 April 2020).

Anti-DFS70 Antibodies for Differentiating Systemic Autoimmune Rheumatic Disease in Patients with Positive ANA Tests: A Systematic Review and Meta-Analysis.

Anti-DFS70 antibodies have been proposed as a marker to exclude systemic autoimmune rheumatic disease (SARD). We conducted this systematic diagnostic test accuracy review and meta-analysis to determine the performance of anti-DFS70 antibodies in patients with a positive anti-nuclear antibody (ANA) test result to exclude SARD. We searched PubMed, Embase, Web of Science, Scopus and the Cochrane Library up to 22 February 2021, and included studies examining the diagnostic accuracy of anti-DFS70 antibodies in patients with a positive ANA test result. The results were pooled using a hierarchical bivariate model and plotted in summary receiver operating characteristic curves. R software and Stata Statistical Software were used for the statistical analysis. Eight studies with 4168 patients were included. The summary sensitivity was 0.19 (95% confidence interval: 0.12–0.28) and the specificity was 0.93 (95% confidence interval: 0.88–0.96). The area under the curve was 0.69 (95% confidence interval: 0.64–0.72). The meta-regression analysis showed that targeting only ANA-associated rheumatic disease was associated with higher specificity. In addition, the studies with a non-SARD prevalence of <80% and using a chemiluminescence assay were associated with higher specificity. Anti-DFS70 antibodies have high specificity for the exclusion of SARD among patients presenting with a positive ANA test, but the sensitivity is low.

Procalcitonin Has Good Accuracy for Prognosis of Critical Condition and Mortality in COVID-19: A Diagnostic Test Accuracy Systematic Review and Meta-analysis.

Several reports have determined that changes in white blood cell counts and inflammatory biomarkers are related to disease outcome of coronavirus disease 2019 (COVID-19) and they can be utilized as prognostic biomarkers. For introducing a factor as a diagnostic/prognostic biomarker, diagnostic test accuracy (DTA) systematic review and meta-analysis are recommended. For the first time, we aimed to determine the accuracies of white blood cell counts and inflammatory biomarkers for prognosis of COVID-19 patient's outcome by a DTA meta-analysis. Until August24, 2020, we searched Web of Sciences, Scopus, and MEDLINE/PubMed databases to achieve related papers. Summary points and lines of included studies were calculated from 2×2 tables by bivariate/hierarchical models. Critical condition and mortality were considered as outcomes. A total of 13387 patients from 28 studies were included in this study. Six biomarkers containing leukocytosis, neutrophilia, lymphopenia, increased level of C-reactive protein, procalcitonin (PCT), and ferritin met the inclusion criteria. Analysis of the area under the curve (AUCHSROC) indicated that the PCT was the only applicable prognostic biomarker for critical condition and mortality (AUCHSROC=0.80 for both conditions). Pooled-diagnostic odds ratios were 6.78 (95% CI, 3.65-12.61) for prognosis of critical condition and 13.21 (95% CI, 3.95-44.19) for mortality. Other biomarkers had insufficient accuracies for both conditions (AUCHSROC< 0.80). Among evaluated biomarkers, only PCT has good accuracy for the prognosis of both critical condition and mortality in COVID-19 and it can be considered as a single prognostic biomarker for poor outcomes. Also, PCT has more accuracy for the prognosis of mortality in comparison to critical condition.

Noninvasive Determination of IDH and 1p19q Status of Lower-grade Gliomas Using MRI Radiomics: A Systematic Review.

Determination of isocitrate dehydrogenase (IDH) status and, if IDH-mutant, assessing 1p19q codeletion are an important component of diagnosis of World Health Organization grades II/III or lower-grade gliomas. This has led to research into noninvasively correlating imaging features ("radiomics") with genetic status. Our aim was to perform a diagnostic test accuracy systematic review for classifying IDH and 1p19q status using MR imaging radiomics, to provide future directions for integration into clinical radiology. Ovid (MEDLINE), Scopus, and the Web of Science were searched in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses for Diagnostic Test Accuracy guidelines. Fourteen journal articles were selected that included 1655 lower-grade gliomas classified by their IDH and/or 1p19q status from MR imaging radiomic features. For each article, the classification of IDH and/or 1p19q status using MR imaging radiomics was evaluated using the area under curve or descriptive statistics. Quality assessment was performed with the Quality Assessment of Diagnostic Accuracy Studies 2 tool and the radiomics quality score. The best classifier of IDH status was with conventional radiomics in combination with convolutional neural network-derived features (area under the curve = 0.95, 94.4% sensitivity, 86.7% specificity). Optimal classification of 1p19q status occurred with texture-based radiomics (area under the curve = 0.96, 90% sensitivity, 89% specificity). A meta-analysis showed high heterogeneity due to the uniqueness of radiomic pipelines. Radiogenomics is a potential alternative to standard invasive biopsy techniques for determination of IDH and 1p19q status in lower-grade gliomas but requires translational research for clinical uptake.

IPDmada: An R Shiny tool for analyzing and visualizing individual patient data meta-analyses of diagnostic test accuracy.

BackgroundIndividual patient data meta‐analyses (IPD‐MA) are regarded as the gold standard for systematic reviews, which also applies to systematic reviews of diagnostic test accuracy (DTA) studies. An increasing number of DTA systematic reviews with IPD‐MA have been published in recent years, but there is much variation in how these IPD‐MA were performed. A number of existing methods were found, but there is no consensus as to which methods are preferred as the standard methods for statistical analysis in DTA IPD‐MA.ObjectivesTo create a web‐based tool which integrates recommended statistical analyses for DTA IPD‐MA, and allows researchers to analyse the data and visualize the results with interactive plots.MethodsA systematic methodological review was performed to identify statistical analyses and data visualization methods used in DTA IPD‐MA. Methods were evaluated by the authors and recommended analyses were integrated into the IPDmada tool which is freely available online with the user interface developed with R Shiny package.ResultsIPDmada allows users to upload their own data, perform the meta‐analysis with both continuous and dichotomized tests, and incorporate individual level covariate‐adjusted analysis. All tables and figures can be exported as .csv or .pdf files. A hypothetical dataset was used to illustrate the application of IPDmada.ConclusionsIPDmada will be very helpful to researchers doing DTA IPD‐MA, since it not only facilitates the statistical analysis but also provides a standard framework. The introduction of IPDmada will harmonize the methods used in DTA IPD‐MA and ensure the quality of such analyses.Highlights IPDmada is a newly developed web‐based tool for performing statistical analysis of individual patient data meta‐analysis of diagnostic accuracy and visualizing the results.The tool is freely available to all the researchers, and requiring no installation of statistical software/packages.The tool has an user‐friendly interface, and allows meta‐analysis on both dichotomized and continuous test results. Researchers can easily use this tool to investigate the threshold effect and covariate effect on the summary accuracy.The introduction and implementation of IPDmada will serve as a useful tool for DTA IPD‐MA and increase the quality of such studies.