Deep feature analysis, classification with AI-driven gastrointestinal diagnostics

Abstract

Several AI-based methods have substantially progressed the area of medical image and video-based diagnostics, which encompasses radiography, pathology, endoscopy, and the categorization of gastrointestinal (GI) diseases. When it comes to classifying numerous GI disorders, the majority of prior research that relies solely on spatial cues performs poorly. While some prior research has made use of temporal features trained on a 3D convolution neural network, these studies have focused on a very small subset of the gastrointestinal system and have used very few classes. To address these concerns, we introduce an all-inclusive AI-based system for classifying different GI illnesses using endoscopic recordings. This system can extract spatial and temporal data concurrently, leading to improved classification performance. For temporal variables, we employ a long short-term memory model; for spatial features, we employ two independent residual networks in cascade mode.