Medical Image Recognition Research Articles

Application of AI-Driven Medical Image Recognition in Precision Medicine and Healthcare

Abstract. Artificial Intelligence (AI) has been playing an important role in medical image recognition, especially in precision medicine and health management, where AI can improve the accuracy and efficiency of diagnosis by utilizing advanced technologies such as deep learning. This paper explores in detail the application of AI techniques in the early diagnosis of cancer, image analysis of cardiovascular diseases, and assessment of neuropsychiatric disorders. We also identify challenges in technical standards, data security and privacy protection, and interdisciplinary collaboration, and emphasize the importance of establishing effective technical standards and evaluation systems, as well as fostering collaboration among experts in various fields.

Medical image recognition based on multilayer neural network

As a common accidental injury, accurate identification of burns and scalded injuries is of great significance to the development of treatment programs and prognosis assessment. Traditional identification methods are subjective and inaccurate, this paper proposes a burns and scalds grade identification technique based on multilayer neural network. The three-degree classification standard of burns and scalds is described, and the structure and principle of multilayer neural network are introduced, including the network structure composed of input layer, hidden layer and output layer, forward propagation, back propagation and training process. The implementation steps of burns and scald grade recognition technology based on multi-layer neural network are discussed in detail, such as data acquisition, image pre-processing, feature extraction, classifier design, model training and evaluation. Through experiments, the model is tested using a dataset containing 362 burns and scalds images, and the model achieves more than 90% accuracy on the test set with high accuracy and reliability. The multi-layer neural network model is used to classify the burn and scald data, which improves the diagnostic accuracy, shortens the delay time of the disease, reduces the pressure of professional doctors, and helps patients have a preliminary understanding of the degree of burn.

Application of Convolutional Neural Network in Image Recognition

Image recognition is of great significance for both human social development and daily life. This paper mainly discusses the application research of convolutional neural network (CNN) in the field of image recognition. Firstly, the basic structure and working principle of CNN, including the core components of convolution layer, pooling layer and full connection layer, are introduced, and then the structure and characteristics of the middle layer are explained. Then, this paper compares the advantages and disadvantages of different CNN models such as LeNet-5, AlexNet, GoogLeNet, ResNet, etc., and analyzes their application in face recognition, medical image recognition, traffic recognition, character recognition and other fields. Finally, this paper summarizes the application of CNN in image recognition, and points out the problems faced in its practical application, such as model complexity, computational resource requirements, etc., aiming to provide reference for further research of image recognition technology.

An Improved Medical Image Classification Algorithm Based on Adam Optimizer

Due to the complexity and illegibility of medical images, it brings inconvenience and difficulty to the diagnosis of medical personnel. To address these issues, an optimization algorithm called GSL(Gradient sine linear) based on Adam algorithm improvement is proposed in this paper, which introduces gradient pruning strategy, periodic adjustment of learning rate, and linear interpolation strategy. The gradient trimming technique can scale the gradient to prevent gradient explosion, while the periodic adjustment of the learning rate and linear interpolation strategy adjusts the learning rate according to the characteristics of the sinusoidal function, accelerating the convergence while reducing the drastic parameter fluctuations, improving the efficiency and stability of training. The experimental results show that compared to the classic Adam algorithm, this algorithm can demonstrate better classification accuracy, the GSL algorithm achieves an accuracy of 78% and 75.2% on the MobileNetV2 network and ShuffleNetV2 network under the Gastroenterology dataset; and on the MobileNetV2 network and ShuffleNetV2 network under the Glaucoma dataset, an accuracy of 84.72% and 83.12%. The GSL optimizer achieved significant performance improvement on various neural network structures and datasets, proving its effectiveness and practicality in the field of deep learning, and also providing new ideas and methods for solving the difficulties in medical image recognition.

Naloxone combined with non-invasive ventilation for the treatment of chronic obstructive pulmonary disease based on radioactive X-ray image inspection

The purpose of this study was to investigate the application of radiography in patients with COPD and analyze its value in diagnosis and evaluation. During radiological X-rays, patients wear specific lead protective equipment to reduce radiation exposure and obtain images from different angles and fields of view. The obtained X-ray images were evaluated and analyzed to examine the structural and morphological features of the lung tissue. In this study, the treatment scheme of naloxone combined with salbutamol combined with non-invasive ventilator was adopted, which improved the effectiveness and accuracy of treatment by supporting the computer medical image segmentation recognition system. The analysis results showed that the respiratory function of patients in naloxone combined with non-invasive ventilation treatment group was significantly improved after treatment, and the lung image characteristics also had positive changes. Compared with the conventional treatment group, naloxone combined with noninvasive ventilation has significant advantages in improving ventilation function and reducing pulmonary disease in COPD patients. Naloxone combined with non-invasive ventilation based on medical image recognition has the potential to improve the condition of COPD patients and predict treatment response. The results of this study provide a new idea for the treatment of COPD patients and provide a reference for further optimization of treatment.

Application of artificial intelligence in the diagnosis and treatment of urinary tumors.

Diagnosis and treatment of urological tumors, relying on auxiliary data such as medical imaging, while incorporating individual patient characteristics into treatment selection, has long been a key challenge in clinical medicine. Traditionally, clinicians used extensive experience for decision-making, but recent artificial intelligence (AI) advancements offer new solutions. Machine learning (ML) and deep learning (DL), notably convolutional neural networks (CNNs) in medical image recognition, enable precise tumor diagnosis and treatment. These technologies analyze complex medical image patterns, improving accuracy and efficiency. AI systems, by learning from vast datasets, reveal hidden features, offering reliable diagnostics and personalized treatment plans. Early detection is crucial for tumors like renal cell carcinoma (RCC), bladder cancer (BC), and Prostate Cancer (PCa). AI, coupled with data analysis, improves early detection and reduces misdiagnosis rates, enhancing treatment precision. AI's application in urological tumors is a research focus, promising a vital role in urological surgery with improved patient outcomes. This paper examines ML, DL in urological tumors, and AI's role in clinical decisions, providing insights for future AI applications in urological surgery.

Asymptotic multilayer pooled transformer based strategy for medical assistance in developing countries

With the continuous progress of medical imaging technology, pathology images have become an important basis for doctors to judge the condition. However, pathology images have problems such as large numbers, large sizes, and complex backgrounds, which make the task of manual recognition exceptionally difficult. The use of computer-aided diagnosis technology can improve the diagnostic accuracy of medical image recognition. Transformer model-based methods have made great progress in the field of medical image recognition, but the self-attention mechanism in them has high computational complexity. Although single-layer pooling can reduce the computational cost, the strategy is prone to feature loss, and too many self-attention operations can exacerbate the distraction problem. Based on this, this study proposes an asymptotic multilayer pooling transformer-based pathology image assistance strategy in medical decision-making systems. First, we pre-process the pathology images with denoising and enhancement to accurately capture the detailed features of the lesion region. Then the asymptotic multilayer pooling transformer pyramid structure (PMPSNet) is used to identify cell nuclei. In the self-focused module, a multilayer pooling operation is employed to simplify the sequence and efficiently capture contextual features. In addition, the strategy utilizes a pyramid encoder to obtain multi-scale feature maps and a novel multilayer perceptual structure to limit the attention interference problem. The results show that our proposed PMPSNet-L model achieves a DSC value of 0.822, which is about 1.4 % better than the second-ranked model, and the IoU value reaches up to 0.702. In addition, our PMPSNet-S maintains a relatively lightweight parameter size of about 14.49 million, which is considerably lower than the existing segmentation models. Our proposed method not only achieves higher segmentation accuracy but also has fewer model parameters and lower computational complexity.

Efficient deep learning-based automated diagnosis from echocardiography with contrastive self-supervised learning

BackgroundAdvances in self-supervised learning (SSL) have enabled state-of-the-art automated medical image diagnosis from small, labeled datasets. This label efficiency is often desirable, given the difficulty of obtaining expert labels for medical image recognition tasks. However, most efforts toward SSL in medical imaging are not adapted to video-based modalities, such as echocardiography.MethodsWe developed a self-supervised contrastive learning approach, EchoCLR, for echocardiogram videos with the goal of learning strong representations for efficient fine-tuning on downstream cardiac disease diagnosis. EchoCLR pretraining involves (i) contrastive learning, where the model is trained to identify distinct videos of the same patient, and (ii) frame reordering, where the model is trained to predict the correct of video frames after being randomly shuffled.ResultsWhen fine-tuned on small portions of labeled data, EchoCLR pretraining significantly improves classification performance for left ventricular hypertrophy (LVH) and aortic stenosis (AS) over other transfer learning and SSL approaches across internal and external test sets. When fine-tuning on 10% of available training data (519 studies), an EchoCLR-pretrained model achieves 0.72 AUROC (95% CI: [0.69, 0.75]) on LVH classification, compared to 0.61 AUROC (95% CI: [0.57, 0.64]) with a standard transfer learning approach. Similarly, using 1% of available training data (53 studies), EchoCLR pretraining achieves 0.82 AUROC (95% CI: [0.79, 0.84]) on severe AS classification, compared to 0.61 AUROC (95% CI: [0.58, 0.65]) with transfer learning.ConclusionsEchoCLR is unique in its ability to learn representations of echocardiogram videos and demonstrates that SSL can enable label-efficient disease classification from small amounts of labeled data.

Medical Tumor Image Classification Based on Few-Shot Learning.

As a high mortality disease, cancer seriously affects people's life and well-being. Reliance on pathologists to assess disease progression from pathological images is inaccurate and burdensome. Computer aided diagnosis (CAD) system can effectively assist diagnosis and make more credible decisions. However, a large number of labeled medical images that contribute to improve the accuracy of machine learning algorithm, especially for deep learning in CAD, are difficult to collect. Therefore, in this work, an improved few-shot learning method is proposed for medical image recognition. In addition, to make full use of the limited feature information in one or more samples, a feature fusion strategy is involved in our model. On the dataset of BreakHis and skin lesions, the experimental results show that our model achieved the classification accuracy of 91.22% and 71.20% respectively when only 10 labeled samples are given, which is superior to other state-of-the-art methods.

Towards long-tailed, multi-label disease classification from chest X-ray: Overview of the CXR-LT challenge

Many real-world image recognition problems, such as diagnostic medical imaging exams, are “long-tailed” – there are a few common findings followed by many more relatively rare conditions. In chest radiography, diagnosis is both a long-tailed and multi-label problem, as patients often present with multiple findings simultaneously. While researchers have begun to study the problem of long-tailed learning in medical image recognition, few have studied the interaction of label imbalance and label co-occurrence posed by long-tailed, multi-label disease classification. To engage with the research community on this emerging topic, we conducted an open challenge, CXR-LT, on long-tailed, multi-label thorax disease classification from chest X-rays (CXRs). We publicly release a large-scale benchmark dataset of over 350,000 CXRs, each labeled with at least one of 26 clinical findings following a long-tailed distribution. We synthesize common themes of top-performing solutions, providing practical recommendations for long-tailed, multi-label medical image classification. Finally, we use these insights to propose a path forward involving vision-language foundation models for few- and zero-shot disease classification.

PNNCLR: Stochastic pseudo neighborhoods for contrastive learning based unsupervised representation learning problems

Nearest neighbor (NN) sampling provides more semantic variations than predefined transformations for self-supervised learning (SSL) based image recognition problems. However, its performance is restricted by the quality of the support set, which holds positive samples for the contrastive loss. In this work, we show that the quality of the support set plays a crucial role in any nearest neighbor based method for SSL. We then provide a refined baseline (pNNCLR) to the nearest neighbor based SSL approach (NNCLR). To this end, we introduce pseudo nearest neighbors (pNN) to control the quality of the support set, wherein, rather than sampling the nearest neighbors, we sample in the vicinity of hard nearest neighbors by varying the magnitude of the resultant vector and employing a stochastic sampling strategy to improve the performance. Additionally, to stabilize the effects of uncertainty in NN-based learning, we employ a smooth-weight-update approach for training the proposed network. Evaluation of the proposed method on multiple public image recognition and medical image recognition datasets shows that it performs up to 8 percent better than the baseline nearest neighbor method, and is comparable to other previously proposed SSL methods. The code is available at https://github.com/mb16biswas/pnnclr.

Deep Learning-Based Lung Medical Image Recognition

Pulmonary nodules serve as critical indicators for early lung cancer diagnosis, making their detection and classification essential. The prevalent use of transfer learning in recognition algorithms often encounters a significant disparity between source and target datasets, which hampers effective feature extraction from pulmonary nodules and degrades performance. An enhanced neural network model leveraging convolutional neural networks is introduced to address this issue. This model integrates a pre-trained GoogLeNet Inception V3 network with a custom-designed feature fusion layer, improving the network’s ability to extract features. To ascertain the optimal configuration, the models were evaluated based on accuracy in various combinations. The experiments conducted on the LUNA16 pulmonary nodule dataset revealed that the refined network model achieved an accuracy of 88.78% and a sensitivity of 87.18%. This represents an increase of 2.7 and 2.22 percentage points in accuracy and sensitivity, respectively, compared to the GoogLeNet Inception V3 algorithm. Further tests across different dataset proportions also yielded superior outcomes, demonstrating enhanced generalization capabilities. These findings can offer objective benchmarks for clinical diagnosis.

Hardware-efficient quantum principal component analysis for medical image recognition

Hardware-efficient quantum principal component analysis for medical image recognition

Fine-Grained Self-Supervised Learning with Jigsaw puzzles for medical image classification

Classifying fine-grained lesions is challenging due to minor and subtle differences in medical images. This is because learning features of fine-grained lesions with highly minor differences is very difficult in training deep neural networks. Therefore, in this paper, we introduce Fine-Grained Self-Supervised Learning(FG-SSL) method for classifying subtle lesions in medical images. The proposed method progressively learns the model through hierarchical block such that the cross-correlation between the fine-grained Jigsaw puzzle and regularized original images is close to the identity matrix. We also apply hierarchical block for progressive fine-grained learning, which extracts different information in each step, to supervised learning for discovering subtle differences. Our method does not require an asymmetric model, nor does a negative sampling strategy, and is not sensitive to batch size. We evaluate the proposed fine-grained self-supervised learning method on comprehensive experiments using various medical image recognition datasets. In our experiments, the proposed method performs favorably compared to existing state-of-the-art approaches on the widely-used ISIC2018, APTOS2019, and ISIC2017 datasets.

Retraction Note: Burn Image Recognition of Medical Images Based on Deep Learning: From CNNs to Advanced Networks

Retraction Note: Burn Image Recognition of Medical Images Based on Deep Learning: From CNNs to Advanced Networks

Resilience-aware MLOps for AI-based medical diagnostic system.

The healthcare sector demands a higher degree of responsibility, trustworthiness, and accountability when implementing Artificial Intelligence (AI) systems. Machine learning operations (MLOps) for AI-based medical diagnostic systems are primarily focused on aspects such as data quality and confidentiality, bias reduction, model deployment, performance monitoring, and continuous improvement. However, so far, MLOps techniques do not take into account the need to provide resilience to disturbances such as adversarial attacks, including fault injections, and drift, including out-of-distribution. This article is concerned with the MLOps methodology that incorporates the steps necessary to increase the resilience of an AI-based medical diagnostic system against various kinds of disruptive influences. Post-hoc resilience optimization, post-hoc predictive uncertainty calibration, uncertainty monitoring, and graceful degradation are incorporated as additional stages in MLOps. To optimize the resilience of the AI based medical diagnostic system, additional components in the form of adapters and meta-adapters are utilized. These components are fine-tuned during meta-training based on the results of adaptation to synthetic disturbances. Furthermore, an additional model is introduced for post-hoc calibration of predictive uncertainty. This model is trained using both in-distribution and out-of-distribution data to refine predictive confidence during the inference mode. The structure of resilience-aware MLOps for medical diagnostic systems has been proposed. Experimentally confirmed increase of robustness and speed of adaptation for medical image recognition system during several intervals of the system's life cycle due to the use of resilience optimization and uncertainty calibration stages. The experiments were performed on the DermaMNIST dataset, BloodMNIST and PathMNIST. ResNet-18 as a representative of convolutional networks and MedViT-T as a representative of visual transformers are considered. It is worth noting that transformers exhibited lower resilience than convolutional networks, although this observation may be attributed to potential imperfections in the architecture of adapters and meta-adapters. The main novelty of the suggested resilience-aware MLOps methodology and structure lie in the separating possibilities and activities on creating a basic model for normal operating conditions and ensuring its resilience and trustworthiness. This is significant for the medical applications as the developer of the basic model should devote more time to comprehending medical field and the diagnostic task at hand, rather than specializing in system resilience. Resilience optimization increases robustness to disturbances and speed of adaptation. Calibrated confidences ensure the recognition of a portion of unabsorbed disturbances to mitigate their impact, thereby enhancing trustworthiness.

TTDCapsNet: Tri Texton-Dense Capsule Network for complex and medical image recognition.

Convolutional Neural Networks (CNNs) are frequently used algorithms because of their propensity to learn relevant and hierarchical features through their feature extraction technique. However, the availability of enormous volumes of data in various variations is crucial for their performance. Capsule networks (CapsNets) perform well on a small amount of data but perform poorly on complex images. To address this, we proposed a new Capsule Network architecture called Tri Texton-Dense CapsNet (TTDCapsNet) for better complex and medical image classification. The TTDCapsNet is made up of three hierarchic blocks of Texton-Dense CapsNet (TDCapsNet) models. A single TDCapsNet is a CapsNet architecture composed of a texton detection layer to extract essential features, which are passed onto an eight-layered block of dense convolution that further extracts features, and then the output feature map is given as input to a Primary Capsule (PC), and then to a Class Capsule (CC) layer for classification. The resulting feature map from the first PC serves as input into the second-level TDCapsNet, and that from the second PC serves as input into the third-level TDCapsNet. The routing algorithm receives feature maps from each PC for the various CCs. Routing the concatenation of the three PCs creates an additional CC layer. All these four feature maps combined, help to achieve better classification. On fashion-MNIST, CIFAR-10, Breast Cancer, and Brain Tumor datasets, the proposed model is evaluated and achieved validation accuracies of 94.90%, 89.09%, 95.01%, and 97.71% respectively. Findings from this work indicate that TTDCapsNet outperforms the baseline and performs comparatively well with the state-of-the-art CapsNet models using different performance metrics. This work clarifies the viability of using Capsule Network on complex tasks in the real world. Thus, the proposed model can be used as an intelligent system, to help oncologists in diagnosing cancerous diseases and administering treatment required.

FoPro-KD: Fourier Prompted Effective Knowledge Distillation for Long-Tailed Medical Image Recognition.

Representational transfer from publicly available models is a promising technique for improving medical image classification, especially in long-tailed datasets with rare diseases. However, existing methods often overlook the frequency-dependent behavior of these models, thereby limiting their effectiveness in transferring representations and generalizations to rare diseases. In this paper, we propose FoPro-KD, a novel framework that leverages the power of frequency patterns learned from frozen pre-trained models to enhance their transferability and compression, presenting a few unique insights: 1) We demonstrate that leveraging representations from publicly available pre-trained models can substantially improve performance, specifically for rare classes, even when utilizing representations from a smaller pre-trained model. 2) We observe that pre-trained models exhibit frequency preferences, which we explore using our proposed Fourier Prompt Generator (FPG), allowing us to manipulate specific frequencies in the input image, enhancing the discriminative representational transfer. 3) By amplifying or diminishing these frequencies in the input image, we enable Effective Knowledge Distillation (EKD). EKD facilitates the transfer of knowledge from pre-trained models to smaller models. Through extensive experiments in long-tailed gastrointestinal image recognition and skin lesion classification, where rare diseases are prevalent, our FoPro-KD framework outperforms existing methods, enabling more accessible medical models for rare disease classification. Code is available at https://github.com/xmed-lab/FoPro-KD.

Exploring low-resource medical image classification with weakly supervised prompt learning

Most advances in medical image recognition supporting clinical auxiliary diagnosis meet challenges due to the low-resource situation in the medical field, where annotations are highly expensive and professional. This low-resource problem can be alleviated by leveraging the transferable representations of large-scale pre-trained vision-language models like CLIP. After being pre-trained using large-scale unlabeled medical images and texts (such as medical reports), the vision-language models can learn transferable representations and support flexible downstream clinical tasks such as medical image classification via relevant medical text prompts. However, existing pre-trained vision-language models require domain experts (clinicians) to carefully design the medical text prompts based on different datasets when applied to specific medical image tasks, which is extremely time-consuming and greatly increases the burden on clinicians. To address this problem, we propose a weakly supervised prompt learning method MedPrompt for automatically generating medical prompts, which includes an unsupervised pre-trained vision-language model and a weakly supervised prompt learning model. The unsupervised pre-trained vision-language model adopts large-scale medical images and texts for pre-training, utilizing the natural correlation between medical images and corresponding medical texts without manual annotations. The weakly supervised prompt learning model only utilizes the classes of images in the dataset to guide the learning of the specific class vector in the prompt, while the learning of other context vectors in the prompt does not require any manual annotations for guidance. To the best of our knowledge, this is the first model to automatically generate medical prompts. With the assistance of these prompts, the pre-trained vision-language model can be freed from the strong expert dependency of manual annotation and manual prompt design, thus achieving end-to-end, low-cost medical image classification. Experimental results show that the model using our automatically generated prompts outperforms all its hand-crafted prompts counterparts in full-shot learning on all four datasets, and achieves superior accuracy on zero-shot image classification and few-shot learning in three of the four medical benchmark datasets and comparable accuracy in the remaining one. In addition, the proposed prompt generator is lightweight and therefore has the potential to be embedded into any network architecture.

Medical Image Recognition Using a Novel Neural Network Construction Controlled by a Kernel Method Encoder

Medical Image Recognition Using a Novel Neural Network Construction Controlled by a Kernel Method Encoder