Autonomous artificial intelligence for sorting the results of preventive radiological studies on the example of mammography

Abstract

The purpose of research. Radiation diagnostics is central to the detection of malignant neoplasms. Recently, the implementation of screening programs has faced a number of obstacles, including staff shortages and limited funding. The introduction of artificial intelligence (AI)-based systems capable of absolutely accurate sorting of research into two categories - "normal" and "not normal", seems to be a promising solution to these problems. However, before they are widely used, it is critically important to verify their ability to guarantee the safety and high quality of the screening process. The aim of the study is to evaluate the possibility of using autonomous sorting of mammographic examination results in real clinical conditions. Methods. The study was carried out in 2 stages. At the first stage, 25,892 mammographic studies processed by the AI service were retrospectively analyzed. A ROC analysis of these results was carried out in order to assess the possibility of configuring the AI service for 100% sensitivity. At the prospective stage, the results of 82,372 mammograms were analyzed. All studies were processed by AI services configured for 100% sensitivity. The tasks of the AI services included the sorting of mammography results into the categories "normal" and "not normal". Next, the decisions of AI services and radiologists on categorization were compared. Results. According to the results of a retrospective study, when configuring the AI service for 100% sensitivity, the specificity was 39%. In the course of a prospective study, the proportion of defects (false attribution of research results to the "norm" category) was 0.08%, the specific weight of clinically significant defects in AI services was 0.02%, which is significantly lower than that of a radiologist. Conclusion. The use of autonomous sorting of mammographic research results in clinical practice is possible in order to optimize the diagnostic process during preventive measures, as well as under the condition of monitoring the quality of artificial intelligence technologies. Keywords: artificial intelligence, mammography, preventive examinations, radiation diagnostics. Conflict of interest: The author declares the absence of obvious and potential conflicts of interest related to the publication of this article.