NIMG-35. MACHINE LEARNING GLIOMA GRADE PREDICTION LITERATURE: A TRIPOD ANALYSIS OF REPORTING QUALITY

Abstract

Abstract PURPOSE Reporting guidelines are crucial in model development studies to ensure the quality, transparency and objectivity of reporting. While machine learning (ML) models have proven themselves effective in predicting glioma grade, their potential use can only be determined if they are clearly and comprehensively reported. Reporting quality has not yet been evaluated for ML glioma grade prediction studies, to our knowledge. We measured published literature against the TRIPOD Statement, a checklist of items considered essential for the reporting of diagnostic studies. MATERIALS AND METHODS A literature review, in agreement with PRISMA, was conducted by a university librarian in October 2020 and verified by a second librarian in February 2021 using four databases: Cochrane trials (CENTRAL), Ovid Embase, Ovid MEDLINE, and Web of Science core-collection. Keywords and controlled vocabulary included artificial intelligence, machine learning, deep learning, radiomics, magnetic resonance imaging, glioma, and glioblastoma. Publications were screened in Covidence and scored against the 27 items in the TRIPOD Statement that were relevant and applicable. RESULTS The search identified 11,727 candidate articles with 1,135 articles undergoing full text review. 86 articles met the criteria for our study. The mean adherence rate to TRIPOD was 44.4% (range: 22.2% - 66.7%), with poor reporting adherence in categories including abstract (0%), model performance (0%), title (1.2%), justification of sample size (2.3%), full model specification (2.3%), participant demographics and missing data (7%). Studies had high reporting adherence in categories including results interpretation (100%), background (98.8%), study design/source of data (96.5%), and objectives (95.3%). CONCLUSION Existing publications on the use of ML in glioma grade prediction have a low overall quality of reporting. Improvements can be made in the reporting of titles and abstracts, justification of sample size, and model specification and performance.