Multi-class Image Classification Research Articles

An Enhanced LightGBM-Based Breast Cancer Detection Technique Using Mammography Images.

Breast cancer (BC) is the leading cause of mortality among women across the world. Earlier screening of BC can significantly reduce the mortality rate and assist the diagnostic process to increase the survival rate. Researchers employ deep learning (DL) techniques to detect BC using mammogram images. However, these techniques are resource-intensive, leading to implementation complexities in real-life environments. The performance of convolutional neural network (CNN) models depends on the quality of mammogram images. Thus, this study aimed to build a model to detect BC using a DL technique. Image preprocessing techniques were used to enhance image quality. The authors developed a CNN model using the EfficientNet B7 model's weights to extract the image features. Multi-class classification of BC images was performed using the LightGBM model. The Optuna algorithm was used to fine-tune LightGBM for image classification. In addition, a quantization-aware training (QAT) strategy was followed to implement the proposed model in a resource-constrained environment. The authors generalized the proposed model using the CBIS-DDSM and CMMD datasets. Additionally, they combined these two datasets to ensure the model's generalizability to diverse images. The experimental findings revealed that the suggested BC detection model produced a promising result. The proposed BC detection model obtained an accuracy of 99.4%, 99.9%, and 97.0%, and Kappa (K) values of 96.9%, 96.9%, and 94.1% in the CBIS-DDSM, CMMD, and combined datasets. The recommended model streamlined the BC detection process in order to achieve an exceptional outcome. It can be deployed in a real-life environment to support physicians in making effective decisions. Graph convolutional networks can be used to improve the performance of the proposed model.

A Novel Decision Level Class-Wise Ensemble Method in Deep Learning for Automatic Multi-Class Classification of HER2 Breast Cancer Hematoxylin-Eosin Images

A Novel Decision Level Class-Wise Ensemble Method in Deep Learning for Automatic Multi-Class Classification of HER2 Breast Cancer Hematoxylin-Eosin Images

A variable metric proximal stochastic gradient method: An application to classification problems

Due to the continued success of machine learning and deep learning in particular, supervised classification problems are ubiquitous in numerous scientific fields. Training these models typically involves the minimization of the empirical risk over large data sets along with a possibly non-differentiable regularization. In this paper, we introduce a stochastic gradient method for the considered classification problem. To control the variance of the objective's gradients, we use an automatic sample size selection along with a variable metric to precondition the stochastic gradient directions. Further, we utilize a non-monotone line search to automatize step size selection. Convergence results are provided for both convex and non-convex objective functions. Extensive numerical experiments verify that the suggested approach performs on par with state-of-the-art methods for training both statistical models for binary classification and artificial neural networks for multi-class image classification. The code is publicly available at https://github.com/koblererich/lisavm.

Transfer Learning for Alzheimer's Disease Diagnosis using EfficientNet-B0 Convolutional Neural Network

Alzheimer's disease (AD) is an irreversible neurological disorder that causes the gradual decline of one's cognitive abilities, and thus, early detection is significant to slow down its deterioration. Magnetic resonance imaging (MRI) images have been commonly used to diagnose AD. Furthermore, deep learning techniques such as the Convolutional Neural Network (CNN) are utilized to assist the diagnosis due to the complexity of MRI's analysis. However, CNN models require large datasets for training and have a challenging nature for model optimization. Thus, Transfer Learning, an emerging method that can improve the performance of the deep learning model by eliminating the need for training from scratch, is introduced. This paper will propose a Transfer Learning-based EfficientNet-B0 model to classify MRI brain images for AD diagnosis. The MRI images are obtained from Alzheimer's Disease Neuroimaging Initiative (ADNI) database; only axial-plane images are used in this study. As a result, the multi-class classification of MRI images into AD, MCI, and NC classes using a Transfer Learning-based model resulted in a training accuracy of 98.93% and a validation accuracy of 87.17%. These results evidenced the significance of Transfer Learning in improving model performance.

Advancing deep learning-based detection of floating litter using a novel open dataset

Supervised Deep Learning (DL) methods have shown promise in monitoring the floating litter in rivers and urban canals but further advancements are hard to obtain due to the limited availability of relevant labeled data. To address this challenge, researchers often utilize techniques such as transfer learning (TL) and data augmentation (DA). However, there is no study currently reporting a rigorous evaluation of the effectiveness of these approaches for floating litter detection and their effects on the models' generalization capability. To overcome the problem of limited data availability, this work introduces the “TU Delft—Green Village” dataset, a novel labeled dataset of 9,473 camera and phone images of floating macroplastic litter and other litter items, captured using experiments in a drainage canal of TU Delft. We use the new dataset to conduct a thorough evaluation of the detection performance of five DL architectures for multi-class image classification. We focus the analysis on a systematic evaluation of the benefits of TL and DA on model performances. Moreover, we evaluate the generalization capability of these models for unseen litter items and new device settings, such as increasing the cameras' height and tilting them to 45°. The results obtained show that, for the specific problem of floating litter detection, fine-tuning all layers is more effective than the common approach of fine-tuning the classifier alone. Among the tested DA techniques, we find that simple image flipping boosts model accuracy the most, while other methods have little impact on the performance. The SqueezeNet and DenseNet121 architectures perform the best, achieving an overall accuracy of 89.6 and 91.7%, respectively. We also observe that both models retain good generalization capability which drops significantly only for the most complex scenario tested, but the overall accuracy raises significantly to around 75% when adding a limited amount of images to training data, combined with flipping augmentation. The detailed analyses conducted here and the released open source dataset offer valuable insights and serve as a precious resource for future research.

Multi-class classification of brain tumour magnetic resonance images using multi-branch network with inception block and five-fold cross validation deep learning framework

The expertise of radiologists plays a pivotal role in the intricate task of diagnosing brain tumors. However, the escalating number of patients has rendered traditional diagnostic methods increasingly formidable and expensive. Consequently, researchers have diligently delved into the realm of medical image analysis to seek more efficient and precise approaches for the detection and classification of brain malignancies. In recent times, the surge in interest surrounding Deep Learning (DL) techniques has been notable, particularly in the development of automated systems with the capability to swiftly and reliably categorize brain tumors. The essence of this study revolves around the endeavor to confront the technical challenges inherent in this domain, with a specific focus on the intricate task of classifying brain tumors through the analysis of magnetic resonance images (MRI). The crux of the proposed model for brain tumor classification rests upon the foundation of Convolutional Neural Networks (CNNs), further fortified by a multi-branch network enriched with an inception block, elegantly incorporating a five-fold cross-validation methodology. This comprehensive approach was meticulously calibrated and evaluated using the Br35H dataset, a repository encompassing 395 images devoid of tumors, 826 images depicting gliomas, 822 portraying meningiomas, and 827 capturing pituitary tumors. This research diligently concentrates on discerning among three tumor types, including scenarios where no tumors are present, and the outcomes are meticulously juxtaposed against an array of cutting-edge classification models, such as the Support Vector Classifier (SVC), Decision Tree Classifier, Logistic Regression, and Gaussian Naive Bayes. To provide a thorough assessment of the proposed model's prowess, a battery of performance metrics was subjected to intense scrutiny, spanning accuracy, loss, and variance. The meticulous analysis culminated in the revelation that the CNN with Multi-Branch Network and Inception block exhibited unparalleled excellence, achieving an awe-inspiring accuracy rate of 99.30% and a scarcely perceptible variance of 0.0005 in its classification of the four distinct tumor classes, firmly establishing its supremacy over the existing state-of-the-art models in the field.

A color-based deep-learning approach for tissue slide lung cancer classification

Non-Small Cell Lung Cancer is the most common type of lung cancer, accounting for more than 80% of all cases. The analysis of histopathological images is the appropriate way to detect lung cancer in its initial stages. However, due to the heterogeneous patterns of molecular structures and the high magnification factor, the classification of whole slide images is difficult. Furthermore, these large-pixel images cannot be considered directly due to the high computational requirements. Several deep-learning models have been developed for the classification of histopathological images, but only in the default RGB format. Existing models are complex and rely on pathologist annotations which increases the computational cost and time. The present paper proposes a deep-learning framework, a Color-based Dilated Convolutional Neural Network (CD-CNN) for the multi-class classification of patch-based whole slide images of lung cancer. The proposed CD-CNN framework includes data preparation, color space transformation, and the classification stages. It thoroughly examines the impact of five color spaces on classification performance. The proposed model was also compared to three pre-trained models and the Convolutional Neural Network model on three different datasets namely: The Cancer Genome Atlas dataset, the Clinical Proteomic Tumor Analysis Consortium cohorts, and the LC25000 dataset. The analysis of all the models reveals that the HSV color space outperforms the other transformations for all of the datasets tested. The results depict that the proposed CD-CNN achieved the best classification results in HSV color space for all three datasets i.e. accuracy of 0.97–0.99, precision, recall, and F1 score 0.97–0.98 and AUC value of 0.970–0.984. In addition, the highest value of the kappa score 0.986 has been achieved by the proposed model. These findings demonstrate the efficacy of the proposed method and show an improvement in diagnostic systems.

A multi-class deep learning model for early lung cancer and chronic kidney disease detection using computed tomography images.

Lung cancer is a fatal disease caused by an abnormal proliferation of cells in the lungs. Similarly, chronic kidney disorders affect people worldwide and can lead to renal failure and impaired kidney function. Cyst development, kidney stones, and tumors are frequent diseases impairing kidney function. Since these conditions are generally asymptomatic, early, and accurate identification of lung cancer and renal conditions is necessary to prevent serious complications. Artificial Intelligence plays a vital role in the early detection of lethal diseases. In this paper, we proposed a modified Xception deep neural network-based computer-aided diagnosis model, consisting of transfer learning based image net weights of Xception model and a fine-tuned network for automatic lung and kidney computed tomography multi-class image classification. The proposed model obtained 99.39% accuracy, 99.33% precision, 98% recall, and 98.67% F1-score for lung cancer multi-class classification. Whereas, it attained 100% accuracy, F1 score, recall and precision for kidney disease multi-class classification. Also, the proposed modified Xception model outperformed the original Xception model and the existing methods. Hence, it can serve as a support tool to the radiologists and nephrologists for early detection of lung cancer and chronic kidney disease, respectively.

Fisher Regularized ε-Dragging for Image Classification

Discriminative least squares regression (DLSR) has been shown to achieve promising performance in multi-class image classification tasks. Its key idea is to force the regression labels of different classes to move in opposite directions by means of the ε-dragging technique, yielding discriminative regression model exhibiting wider margins. However, the ε-dragging technique ignores an important problem: its relaxation matrix is dynamically updated in optimization, which means the dragging values can also cause the labels from the same class to be uncorrelated. In order to learn a more powerful projection, as well as regression labels, we propose a Fisher regularized ε-dragging framework (Fisher-ε) for image classification by constraining the relaxed labels using the Fisher criterion. On one hand, the Fisher criterion improves the intra-class compactness of the relaxed labels during relaxation learning. On the other hand, it is expected further to enhance the inter-class separability of ε-dragging. Fisher-ε for the first time ever attempts to integrate the Fisher criterion and ε-dragging technique into a unified model because they are complementary in learning discriminative projection. Extensive experiments on various datasets demonstrate that the proposed Fisher-ε method achieves performance that is superior to other state-of-the-art classification methods. The Matlab codes are available at https://github.com/chenzhe207/Fisher-epsilon.

Patch-Based Siamese 3D Convolutional Neural Network for Early Alzheimer's Disease Using Multi-Modal Approach

Alzheimer's Disease (AD), the most common type of dementia, is characterized by memory issues that worsen with time. When evaluating single modalities, there are specific efficient learning techniques that produce a poor identification rate. The clinical significance of Mild Cognitive Impairment (MCI) has clinical importance, which is crucial for identifying and categorizing AD patients. This study includes the utilization of 3D T1 weighted /Magnetic Resonance Imaging (3D T1WI MRI) images where the structural changes in the brain are identified for predicting early AD. The classification accuracy for AD, MCI, and Normal Control (NC) has also increased due to cognitive evaluations when comparing three one vs one classifications, i.e. AD vs. NC, MCI vs. NC, AD vs. MCI, and multi-class classification. The proposed approach’s novelty is a binary and multi-class classification of structural MRI images using a Siamese 3D Convolutional Neural Network (Siamese 3D-CNN). The Stochastic Gradient Descent (SGD) has been employed to modify the proposed network's weights, and 5-Fold Cross-Validation (CV) has been used for each binary classification task. Our study used the neuropsychological data of 417 people from the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset to validate the suggested methodology. Experimental results demonstrate that accuracy, sensitivity, and specificity for three binary classifications produce the maximum percentage, in contrast to other relevant approaches found in the literature. In addition, the multi-class classification accuracy of 99.8% was attained.

Ensembled EfficientNetB3 architecture for multi-class classification of tumours in MRI images

Healthcare informatics is one of the major concern domains in the processing of medical imaging for the diagnosis and treatment of brain tumours all over the world. Timely diagnosis of abnormal structures in brain tumours helps the clinical applications, medicines, doctors etc. in processing and analysing the medical imaging. The multi-class image classification of brain tumours faces challenges such as the scaling of large dataset, training of image datasets, efficiency, accuracy etc. EfficientNetB3 neural network scales the images in three dimensions resulting in improved accuracy. The novel neural network framework utilizes the optimization of an ensembled architecture of EfficientNetB3 with U-Net for MRI images which applies a semantic segmentation model for pre-trained backbone networks. The proposed neural model operates on a substantial network which will adapt the robustness by capturing the extraction of features in the U-Net encoder. The decoder will be enabling pixel-level localization at the definite precision level by an average ensemble of segmentation models. The ensembled pre-trained models will provide better training and prediction of abnormal structures in MRI images and thresholds for multi-classification of medical image visualization. The proposed model results in mean accuracy of 99.24 on the Kaggle dataset with 3064 images with a mean Dice score coefficient (DSC) of 0.9124 which is being compared with two state-of-art neural models.

Detecting COVID-19 Effectively with Transformers and CNN-Based Deep Learning Mechanisms

The COVID-19 pandemic has been a major global concern in the field of respiratory diseases, with healthcare institutions and partners investing significant resources to improve the detection and severity assessment of the virus. In an effort to further enhance the detection of COVID-19, researchers have investigated the performance of current detection methodologies and proposed new approaches that leverage deep learning techniques. In this article, the authors propose a two-step transformer model for the multi-class classification of COVID-19 images in a patient-aware manner. This model is implemented using transfer learning, which allows for the efficient use of pre-trained models to accelerate the training of the proposed model. The authors compare the performance of their proposed model to other CNN models commonly used in the detection of COVID-19. The experimental results of the study show that CNN-based deep learning networks obtained an accuracy in the range of 0.76–0.92. However, the proposed two-step transformer model implemented with transfer learning achieved a significantly higher accuracy of 0.9735 ± 0.0051. This result indicates that the proposed model is a promising approach to improving the detection of COVID-19. Overall, the findings of this study highlight the potential of deep learning techniques, particularly the use of transfer learning and transformer models, to enhance the detection of COVID-19. These approaches can help healthcare institutions and partners to reduce the time and difficulty in detecting the virus, ultimately leading to more effective and timely treatment for patients.

Multi-Class classification of prostate cancer MRI images based on UCLA score using RegNetY-320 model

Prostate cancer (PCa) is the most frequent non-skin cancer in males, and it represents a significant global healthcare problem. Another challenge is the development of an accurate classification model for the detection of PCa. As a result, developing an accurate classification model for PCa is extremely important and has potentially significant clinical implications. These models have the potential to boost the benefits of treatment while also increasing the likelihood of a patient's survival. The PCa is classified in this research based on the T2w magnetic resonance images (MRI), which are collected from the prostate dataset. In this work, a deep learning-based approach RegNetY-320 model is proposed to classify and detect the PCa. The RegNet model is a pre-trained deep transfer learning architecture, which is most commonly used for the image classification process. The proposed model is optimized using various optimizers, including Adam, AdaMax, SGD, RMSprop, Ftrl, and Nadam, and the optimized models are termed model-01 to model-06. For the evaluation, a multiclass classification system was employed to classify 845 patient records from a mpMRI dataset with a unique "UCLA" score of the ROI. Accuracy, precision, sensitivity, specificity, and the F1 score are all calculated based on the classification for the purpose of performance analysis. Finally, in accordance with the findings, the performances of the various proposed models are evaluated in order to determine their validity. When compared among proposed models, the proposed model RegNetY-320_Model-03 optimized using the RMSprop optimizer has obtained greater performance with 95.70 percent accuracy, which is the highest accuracy performance obtained in this research.

Maxillofacial fracture detection and classification in computed tomography images using convolutional neural network-based models

The purpose of this study was to evaluate the performance of convolutional neural network-based models for the detection and classification of maxillofacial fractures in computed tomography (CT) maxillofacial bone window images. A total of 3407 CT images, 2407 of which contained maxillofacial fractures, were retrospectively obtained from the regional trauma center from 2016 to 2020. Multiclass image classification models were created by using DenseNet-169 and ResNet-152. Multiclass object detection models were created by using faster R-CNN and YOLOv5. DenseNet-169 and ResNet-152 were trained to classify maxillofacial fractures into frontal, midface, mandibular and no fracture classes. Faster R-CNN and YOLOv5 were trained to automate the placement of bounding boxes to specifically detect fracture lines in each fracture class. The performance of each model was evaluated on an independent test dataset. The overall accuracy of the best multiclass classification model, DenseNet-169, was 0.70. The mean average precision of the best multiclass detection model, faster R-CNN, was 0.78. In conclusion, DenseNet-169 and faster R-CNN have potential for the detection and classification of maxillofacial fractures in CT images.

Deep Network Architectures as Feature Extractors for Multi-Label Classification of Remote Sensing Images

Data in the form of images are now generated at an unprecedented rate. A case in point is remote sensing images (RSI), now available in large-scale RSI archives, which have attracted a considerable amount of research on image classification within the remote sensing community. The basic task of single-target multi-class image classification considers the case where each image is assigned exactly one label from a predefined finite set of class labels. Recently, however, image annotations have become increasingly complex, with images labeled with several labels (instead of just one). In other words, the goal is to assign multiple semantic categories to an image, based on its high-level context. The corresponding machine learning tasks is called multi-label classification (MLC). The classification of RSI is currently predominantly addressed by deep neural network (DNN) approaches, especially convolutional neural networks (CNNs), which can be utilized as feature extractors as well as end-to-end methods. After only considering single-target classification for a long period, DNNs have recently emerged that address the task of MLC. On the other hand, trees and tree ensembles for MLC have a long tradition and are the best-performing class of MLC methods, but need predefined feature representations to operate on. In this work, we explore different strategies for model training based on the transfer learning paradigm, where we utilize different families of (pre-trained) CNN architectures, such as VGG, EfficientNet, and ResNet. The architectures are trained in an end-to-end manner and used in two different modes of operation, namely, as standalone models that directly perform the MLC task, and as feature extractors. In the latter case, the learned representations are used with tree ensemble methods for MLC, such as random forests and extremely randomized trees. We conduct an extensive experimental analysis of methods over several publicly available RSI datasets and evaluate their effectiveness in terms of standard MLC measures. Of these, ranking-based evaluation measures are most relevant, especially ranking loss. The results show that, for addressing the RSI-MLC task, it is favorable to use lightweight network architectures, such as EfficientNet-B2, which is the best performing end-to-end approach, as well as a feature extractor. Furthermore, in the datasets with a limited number of images, using traditional tree ensembles for MLC can yield better performance compared to end-to-end deep approaches.

Multiclass Image Classification Based on Quantum-Inspired Convolutional Neural Network

Multiclass Image Classification Based on Quantum-Inspired Convolutional Neural Network

Novel Meta-Learning Techniques for the Multiclass Image Classification Problem

Multiclass image classification is a complex task that has been thoroughly investigated in the past. Decomposition-based strategies are commonly employed to address it. Typically, these methods divide the original problem into smaller, potentially simpler problems, allowing the application of numerous well-established learning algorithms that may not apply directly to the original task. This work focuses on the efficiency of decomposition-based methods and proposes several improvements to the meta-learning level. In this paper, four methods for optimizing the ensemble phase of multiclass classification are introduced. The first demonstrates that employing a mixture of experts scheme can drastically reduce the number of operations in the training phase by eliminating redundant learning processes in decomposition-based techniques for multiclass problems. The second technique for combining learner-based outcomes relies on Bayes' theorem. Combining the Bayes rule with arbitrary decompositions reduces training complexity relative to the number of classifiers even further. Two additional methods are also proposed for increasing the final classification accuracy by decomposing the initial task into smaller ones and ensembling the output of the base learners along with that of a multiclass classifier. Finally, the proposed novel meta-learning techniques are evaluated on four distinct datasets of varying classification difficulty. In every case, the proposed methods present a substantial accuracy improvement over existing traditional image classification techniques.

Fusion of U-Net and CNN model for segmentation and classification of skin lesion from dermoscopy images

Skin is one of the most significant organs, which serves as a barrier to the outside surroundings of the human body. To improve mortality, skin disease detection at a prior stage is necessary else it may convert to skin cancer. But its diagnosis at the prior stage that may increase life expectancy is a great experiment since it has a similar look to skin diseases. To deal with biomedical images, a new innovative automated system is required that can quickly and precisely identify skin lesions. Deep Learning is attracting a lot of attention in the treatment of numerous disorders. A fusion model is proposed here with the integration of the U-Net and Convolution Neural Network model. For this, the U-Net model has been utilized to segment the diseases using skin images and the Convolution Neural Network model has been proposed for the multi-class classification of segmented images. The model is simulated and analyzed using the HAM10000 dataset having 10,015 dermoscopy images of seven different classifications of skin diseases. The proposed model has been analyzed using two optimizers i.e. Adam and Adadelta on 20 epochs and 32 batch sizes for the skin disease classification. The model has outperformed on Adadelta optimizer with an accuracy value of 97.96%.

Multiclass classification of breast cancer histopathology images using multilevel features of deep convolutional neural network

Breast cancer is a common malignancy and a leading cause of cancer-related deaths in women worldwide. Its early diagnosis can significantly reduce the morbidity and mortality rates in women. To this end, histopathological diagnosis is usually followed as the gold standard approach. However, this process is tedious, labor-intensive, and may be subject to inter-reader variability. Accordingly, an automatic diagnostic system can assist to improve the quality of diagnosis. This paper presents a deep learning approach to automatically classify hematoxylin-eosin-stained breast cancer microscopy images into normal tissue, benign lesion, in situ carcinoma, and invasive carcinoma using our collected dataset. Our proposed model exploited six intermediate layers of the Xception (Extreme Inception) network to retrieve robust and abstract features from input images. First, we optimized the proposed model on the original (unnormalized) dataset using 5-fold cross-validation. Then, we investigated its performance on four normalized datasets resulting from Reinhard, Ruifrok, Macenko, and Vahadane stain normalization. For original images, our proposed framework yielded an accuracy of 98% along with a kappa score of 0.969. Also, it achieved an average AUC-ROC score of 0.998 as well as a mean AUC-PR value of 0.995. Specifically, for in situ carcinoma and invasive carcinoma, it offered sensitivity of 96% and 99%, respectively. For normalized images, the proposed architecture performed better for Makenko normalization compared to the other three techniques. In this case, the proposed model achieved an accuracy of 97.79% together with a kappa score of 0.965. Also, it attained an average AUC-ROC score of 0.997 and a mean AUC-PR value of 0.991. Especially, for in situ carcinoma and invasive carcinoma, it offered sensitivity of 96% and 99%, respectively. These results demonstrate that our proposed model outperformed the baseline AlexNet as well as state-of-the-art VGG16, VGG19, Inception-v3, and Xception models with their default settings. Furthermore, it can be inferred that although stain normalization techniques offered competitive performance, they could not surpass the results of the original dataset.

AI-based analysis of oral lesions using novel deep convolutional neural networks for early detection of oral cancer.

Artificial intelligence (AI) applications in oncology have been developed rapidly with reported successes in recent years. This work aims to evaluate the performance of deep convolutional neural network (CNN) algorithms for the classification and detection of oral potentially malignant disorders (OPMDs) and oral squamous cell carcinoma (OSCC) in oral photographic images. A dataset comprising 980 oral photographic images was divided into 365 images of OSCC, 315 images of OPMDs and 300 images of non-pathological images. Multiclass image classification models were created by using DenseNet-169, ResNet-101, SqueezeNet and Swin-S. Multiclass object detection models were fabricated by using faster R-CNN, YOLOv5, RetinaNet and CenterNet2. The AUC of multiclass image classification of the best CNN models, DenseNet-196, was 1.00 and 0.98 on OSCC and OPMDs, respectively. The AUC of the best multiclass CNN-base object detection models, Faster R-CNN, was 0.88 and 0.64 on OSCC and OPMDs, respectively. In comparison, DenseNet-196 yielded the best multiclass image classification performance with AUC of 1.00 and 0.98 on OSCC and OPMD, respectively. These values were inline with the performance of experts and superior to those of general practictioners (GPs). In conclusion, CNN-based models have potential for the identification of OSCC and OPMDs in oral photographic images and are expected to be a diagnostic tool to assist GPs for the early detection of oral cancer.