Deep Learning For Image Classification Research Articles

Detection of Viable but Nonculturable E. coli Induced by Low-Level Antimicrobials Using AI-Enabled Hyperspectral Microscopy.

Rapid detection of bacterial pathogens is essential for food safety and public health, yet bacteria can evade detection by entering a viable but nonculturable (VBNC) state under sublethal stress, such as antimicrobial residues. These bacteria remain active but undetectable by standard culture-based methods without extensive enrichment, necessitating advanced detection methods. This study developed an AI-enabled hyperspectral microscope imaging (HMI) framework for rapid VBNC detection under low-level antimicrobials. The objectives were to (i) induce the VBNC state in Escherichia coli K-12 by exposure to selected antimicrobial stressors, (ii) obtain HMI data capturing physiological changes in VBNC cells, and (iii) automate the classification of normal and VBNC cells using deep learning image classification. The VBNC state was induced by low-level oxidative (0.01% hydrogen peroxide) and acidic (0.001% peracetic acid) stressors for 3days, confirmed by live-dead staining and plate counting. HMI provided spatial and spectral data, extracted into pseudo-RGB images using three characteristic spectral wavelengths. An EfficientNetV2-based convolutional neural network architecture was trained on these pseudo-RGB images, achieving 97.1% accuracy of VBNC classification (n=200), outperforming the model trained on RGB images at 83.3%. The results highlight the potential for rapid, automated VBNC detection using AI-enabled hyperspectral microscopy, contributing to timely intervention to prevent foodborne illnesses and outbreaks.

Revisiting non-learned operators based deep learning for image classification: a lightweight directional-aware network

Due to the stable feature representation capability provided by non-learned operators, the integration with deep learning models, i.e., non-learned operator based deep learning models, has become a paradigm, however, performance-wise, it is still not promising. In this paper, by revisiting non-learned operator based deep learning models, we reveal the reasons for their underperformance: lack of geometric invariance, insufficient sparsity, and neglect of directional importance. In response, we present a Lightweight Directional-Aware Network (LDAN) for image classification. Specifically, to generate sparse geometric-invariant features, we propose a ShearletNet to capture multi-directional features in three different levels. Then, a Directional-Aware module is designed to highlight the discriminative multi-directional features and generate multi-scale features. Finally, a Pointwise Convolution module is used to integrate the multi-directional features with the multi-scale ones for reducing the computational resources. Experiments on the commonly used CIFAR10, CIFAR100, Self-Taught Learning 10 (STL10), and Tiny ImageNet datasets demonstrate the efficiency and effectiveness of the proposed LDAN. Compared to the existing non-learned operator based models, LDAN reduces the parameter count by 80.83% while achieving a 6.32% increase in accuracy.

Ulcerative Colitis, LAIR1 and TOX2 Expression, and Colorectal Cancer Deep Learning Image Classification Using Convolutional Neural Networks.

Ulcerative colitis is a chronic inflammatory bowel disease of the colon mucosa associated with a higher risk of colorectal cancer. This study classified hematoxylin and eosin (H&E) histological images of ulcerative colitis, normal colon, and colorectal cancer using artificial intelligence (deep learning). A convolutional neural network (CNN) was designed and trained to classify the three types of diagnosis, including 35 cases of ulcerative colitis (n = 9281 patches), 21 colon control (n = 12,246), and 18 colorectal cancer (n = 63,725). The data were partitioned into training (70%) and validation sets (10%) for training the network, and a test set (20%) to test the performance on the new data. The CNNs included transfer learning from ResNet-18, and a comparison with other CNN models was performed. Explainable artificial intelligence for computer vision was used with the Grad-CAM technique, and additional LAIR1 and TOX2 immunohistochemistry was performed in ulcerative colitis to analyze the immune microenvironment. Conventional clinicopathological analysis showed that steroid-requiring ulcerative colitis was characterized by higher endoscopic Baron and histologic Geboes scores and LAIR1 expression in the lamina propria, but lower TOX2 expression in isolated lymphoid follicles (all p values < 0.05) compared to mesalazine-responsive ulcerative colitis. The CNN classification accuracy was 99.1% for ulcerative colitis, 99.8% for colorectal cancer, and 99.1% for colon control. The Grad-CAM heatmap confirmed which regions of the images were the most important. The CNNs also differentiated between steroid-requiring and mesalazine-responsive ulcerative colitis based on H&E, LAIR1, and TOX2 staining. Additional classification of 10 new cases of colorectal cancer (adenocarcinoma) were correctly classified. CNNs are especially suited for image classification in conditions such as ulcerative colitis and colorectal cancer; LAIR1 and TOX2 are relevant immuno-oncology markers in ulcerative colitis.

Uncertainty Quantification in Data Fusion Classifier for Ship-Wake Detection

Using deep learning model predictions requires not only understanding the model’s confidence but also its uncertainty, so we know when to trust the prediction or require support from a human. In this study, we used Monte Carlo dropout (MCDO) to characterize the uncertainty of deep learning image classification algorithms, including feature fusion models, on simulated synthetic aperture radar (SAR) images of persistent ship wakes. Comparing to a baseline, we used the distribution of predictions from dropout with simple mean value ensembling and the Kolmogorov—Smirnov (KS) test to classify in-domain and out-of-domain (OOD) test samples, created by rotating images to angles not present in the training data. Our objective was to improve the classification robustness and identify OOD images during the test time. The mean value ensembling did not improve the performance over the baseline, in that there was a –1.05% difference in the Matthews correlation coefficient (MCC) from the baseline model averaged across all SAR bands. The KS test, by contrast, saw an improvement of +12.5% difference in MCC and was able to identify the majority of OOD samples. Leveraging the full distribution of predictions improved the classification robustness and allowed labeling test images as OOD. The feature fusion models, however, did not improve the performance over the single SAR-band models, demonstrating that it is best to rely on the highest quality data source available (in our case, C-band).

Artificial intelligence as an auxiliary tool in pediatric otitis media diagnosis

ObjectivesIn order to promote the use of AI technology as the auxiliary tool in pediatric otitis media diagnosis, we use the convolutional neural networks and deep learning for image classification and disease diagnosis. We also designed a Pediatric Otitis Media Classifier to analyze and classify the images for physicians. MethodsA pediatric otitis media classifier was designed for junior physicians (doctors who have been engaged in clinical practice for a short time) as an auxiliary diagnostic tool. To design this classifier for children with otitis media, we used a large number of images of acute otitis media (AOM), secretory otitis media (OME), and normal otoscope images to obtain the optimal convolutional neural network model. ResultsThe average recognition accuracies of the ZFNet and the TSL16 for classification were 97.87 % and 97.62 %, far exceeding the accuracy of human diagnosis. The results of using the Pediatric Otitis Media Classifier show that we can use the classifier to correctly identify the image types of child middle ear infections. ConclusionsWe developed the Pediatric Otitis Media Classifier for the successful automated classification of AOM and OME in children using otoscopic images. In contrast to the traditional diagnosis of pediatric otitis media, which relies heavily on the experience of doctors, the diagnostic accuracy of even experienced physicians is only approximately 80 %. With AI technology, we can improve the accuracy rate to over 98 %, which can effectively assist doctors in auxiliary diagnosis. It also reduces delayed treatment, antibiotic misuse, and unnecessary surgery caused by misdiagnosis.

Handwritten Digit Recognition by Deep Learning

This paper evaluates recent advances in handwritten digit recognition models, focusing on strategies developed and deployed in practical applications. The project utilizes both traditional and deep learning approaches, employing architectures such as Convolutional Neural Networks (CNNs). This paper explores the comparative performance of various models, discusses their deployment in real-world scenarios, and highlights future prospects for enhancing handwritten digit recognition technology. Keywords: Handwritten Digit Recognition, Multi-Layer Perceptron (MLP), Convolutional Neural Networks (CNN), AlexNet, Deep Learning for Image Classification, Neural Networks, Image Preprocessing, Data Augmentation, Feature Extraction, Image to Grayscale Conversion, Image Normalization, Training and Validation, Accuracy Metrics, Model Evaluation, Transfer Learning, Classification Algorithms, Real- Time Processing, Computer Vision, Image Recognition.

Classification Model of Grassland Desertification Based on Deep Learning

Grasslands are one of the most important ecosystems on earth, and the impact of grassland desertification on the earth’s environment and ecosystem cannot be ignored. Accurately distinguishing grassland desertification types has important application value. The appropriate grazing strategies can be implemented based on these distinctions. Grassland conservation measures can be tailored accordingly. This contributes to further protecting and restoring grassland vegetation. This project takes color images labeled with the desertification types of grasslands as the research object, uses the currently popular deep learning model as the classification tool, and then establishes a color image-based grassland desertification classification model based on the feature extraction network, based on the Vision Transformer model, by comparing the various deep learning image classification models. The experimental results show that, despite the complex structure and large number of parameters of the grassland desertification classification model obtained in this project, the test accuracy rate reaches 88.72% and the training loss is only 0.0319. Compared with the popular classification models such as VGG16, ResNet50, ResNet101, DenseNet101, DenseNet169, and DenseNet201, and so on, the Vision Transformer demonstrates clear advantages in classification accuracy, fitting ability, and generalization capacity. By integrating with deep learning technology, the model can be applied to grassland management and ecological restoration. Mobile devices can be used to conveniently capture image data, and information can be processed quickly. This provides efficient tools for grazing managers, environmental scientists, and conservation organizations. These tools assist in quickly assessing the extent of grassland desertification, optimizing grassland management and conservation decisions. Furthermore, strong technical support is offered for the ecological restoration and sustainable management of desertification grasslands.

Enhancing deep learning image classification using data augmentation and genetic algorithm-based optimization

Enhancing deep learning image classification using data augmentation and genetic algorithm-based optimization

Implementation and Efficient Analysis of Preprocessing Techniques in Deep Learning for Image Classification

Deep learning models have recently been preferred to perform certain image-processing tasks. Recently, with the increasing radiation, heat, and poor lighting conditions, the raw image samples may contain noisy and ambiguous information. To process these images, the deep learning model requires a large number of data samples to learn the missing information from other clear data samples. This necessitates training the neural network with a huge dataset. The researchers are now attempting to filter and improve such noisy images via preprocessing in order to provide valid and accurate feature information to the neural network layers. However, certain research studies claim that some useful information may be lost when the image is not preprocessed with an appropriate filter or enhancement technique. The MSA (meta-synthesis and analysis) approach is utilized in this work to present the impact of the image processing applications done with and without preprocessing steps. Also, this work summarizes the existing deep learning-based image processing models utilizing or not preprocessing steps in their implementation. This work has also found that 85% of the existing techniques involve a preprocessing step while developing a deep learning model. However, a maximum accuracy of 96.89% is observed on Sine-Net when it is implemented without a preprocessing and the same model gave 96.85% when implemented with preprocessing. This research provides various research insights on the requirement and non-requirement of preprocessing steps in a deep learning-based implementation.

Enhancing trustworthy deep learning for image classification against evasion attacks: a systematic literature review

In the rapidly evolving field of Deep Learning (DL), the trustworthiness of models is essential for their effective application in critical domains like healthcare and autonomous systems. Trustworthiness in DL encompasses aspects such as reliability, fairness, and transparency, which are crucial for its real-world impact and acceptance. However, the development of trustworthy DL models faces significant challenges. This is notably due to adversarial examples, a sophisticated form of evasion attack in adversarial machine learning (AML), which subtly alter inputs to deceive these models and pose a major threat to their safety and reliability. The current body of research primarily focuses on defensive measures, such as enhancing the robustness of models or implementing explainable AI techniques. However, this approach often neglects to address the fundamental vulnerabilities that adversaries exploit. As a result, the field tends to concentrate more on counteracting measures rather than gaining an in-depth understanding of the vulnerabilities and attack strategies inherent in DL systems. This gap in comprehensive understanding impedes the formulation of effective defense mechanisms. This research aims to shift the focus from predominantly defensive strategies toward a more extensive comprehension of adversarial techniques and the innate vulnerabilities of DL models. We undertake this by conducting a thorough systematic literature review, encompassing 49 diverse studies from the previous decade. Our findings reveal the key characteristics of adversarial examples that enable their success against image classification-based DL models. Building on these insights, we propose the Transferable Pretrained Adversarial Deep Learning framework (TPre-ADL). This conceptual model aims to rectify the deficiencies in current defense strategies by incorporating the analyzed traits of adversarial examples, potentially enhancing the robustness and trustworthiness of DL models.

Comparing hybrid models for recognising objects in thermal images at nighttime

This research aims to revolutionize urban object recognition by developing cloud-based Python programs using intelligent algorithms. Unlike current models that focus on colour enhancement in nighttime thermal images, this work addresses the critical challenge of accurate object detection in urban landscapes. The proposed method incorporates a binary generative adversarial network (GAN) generator that can switch bidirectionally between daytime colour (DC) and nighttime infrared (NTIR) images. memory-based visual image memory (MVAM), system extracts important descriptive information from urban landscape images, reducing problems related to small sample sizes. This discussion presents a comprehensive improvement and evaluation of a deep learning image classification pipeline using Google Colab, demonstrating advanced image processing. Using TensorFlow, Keres and scikit image libraries combined with advanced algorithms such as DenseNet121 and MobileNetV2 presents a clear approach. We created a Bidirectional GAN + MVAM for object recognition in this work. Our method performed well, with an accuracy of 81.43%, precision of 51.16, recall of 50.11, and F-score of 46.37. The systematic presentation of the code presents a careful strategy to ensure optimal performance, stability, and efficiency of deep learning and image processing tasks.

Colour fusion effect on deep learning classification of uveal melanoma.

Reliable differentiation of uveal melanoma and choroidal nevi is crucial to guide appropriate treatment, preventing unnecessary procedures for benign lesions and ensuring timely treatment for potentially malignant cases. The purpose of this study is to validate deep learning classification of uveal melanoma and choroidal nevi, and to evaluate the effect of colour fusion options on the classification performance. A total of 798 ultra-widefield retinal images of 438 patients were included in this retrospective study, comprising 157 patients diagnosed with UM and 281 patients diagnosed with choroidal naevus. Colour fusion options, including early fusion, intermediate fusion and late fusion, were tested for deep learning image classification with a convolutional neural network (CNN). F1-score, accuracy and the area under the curve (AUC) of a receiver operating characteristic (ROC) were used to evaluate the classification performance. Colour fusion options were observed to affect the deep learning performance significantly. For single-colour learning, the red colour image was observed to have superior performance compared to green and blue channels. For multi-colour learning, the intermediate fusion is better than early and late fusion options. Deep learning is a promising approach for automated classification of uveal melanoma and choroidal nevi. Colour fusion options can significantly affect the classification performance.

Deep learning and random light structuring ensure robust free-space communications

Having shown early promise, free-space optical (FSO) communications face formidable challenges in the age of information explosion. The ever-growing demand for greater channel communication capacity is one of the challenges. The inter-channel crosstalk, which severely degrades the quality of transmitted information, creates another roadblock in the way of efficient implementation of FSO communication systems. Here, we advance theoretically and realize experimentally a potentially high-capacity FSO protocol that enables high-fidelity transfer of an image or set of images through a complex environment. In our protocol, we complement random light structuring at the transmitter with a deep learning image classification platform at the receiver. Multiplexing unique, independent, mutually orthogonal degrees of freedom available to structured random light can potentially significantly boost the channel communication capacity of our protocol without introducing any deleterious crosstalk. Specifically, we show how one can multiplex the degrees of freedom associated with the source coherence radius and a spatial position of a beamlet within an array of structured random beams to greatly enhance the capacity of our communication link. The superb resilience of structured random light to environmental noise, as well as extreme efficiency of deep learning networks at classifying images, guarantees high-fidelity image transfer within the framework of our protocol.

Systematic review and best practices for drone remote sensing of invasive plants

Abstract Drones have emerged as a cost‐effective solution to detect and map plant invasions, offering researchers and land managers flexibility in flight design, sensors and data collection schedules. A systematic review of trends in drone‐based image collection, data processing and analytical approaches is needed to advance the science of invasive species monitoring and management and improve scalability and replicability. We systematically reviewed studies using drones for plant invasion research to identify knowledge gaps, best practices and a path toward advancing the science of invasive plant monitoring and management. We devised a database of 33 standardized reporting parameters, coded each study to those parameters, calculated descriptive statistics and synthesized how these technologies are being implemented and used. Trends show a general increase in studies since 2009 with a bias toward temperate regions in North America and Europe. Most studies have focused on testing the validity of a machine learning or deep learning image classification technique with fewer studies focused on monitoring or modelling spread. Very few studies used drones for assessing ecosystem dynamics and impacts such as determining environmental drivers or tracking re‐emergence after disturbance. Overall, we noted a lack of standardized reporting on field survey design, flight design, drone systems, image processing and analyses, which hinders replicability and scalability of approaches. Based on these findings, we develop a standard framework for drone applications in invasive species monitoring to foster cross‐study comparability and reproducibility. We suggest several areas for advancing the use of drones in invasive plant studies including (1) utilizing standardized reporting frameworks to facilitate scientific research practices, (2) integrating drone data with satellite imagery to scale up relationships over larger areas, (3) using drones as an alternative to in‐person ground surveys and (4) leveraging drones to assess community trait shifts tied to plant fitness and reproduction.

Recommendation System Building based on CNN and TF-IDF Approaches

Online shopping has becoming increasingly popular. Customers remain engaged with shopping sites due to effective product recommendations. By analyzing users’ past actions and preferences, shopping platforms effectively identify customer interests and desires, enhancing their overall shopping experience. This paper presents a recommendation system that displays 5 items relevant to the product currently being viewed by the customer. The system processes images with an adapted ResNet-50, a deep learning image classification model in convolutional neural network (CNN) and use the acquired embedded vector to determine similarities with cosine functions. Additionally, the system employs term frequency-inverse document frequency (TF-IDF) method for text analysis in product descriptions, generating word embedding that assists recommendations. This blend of visual and textual analysis ensures that the suggestions closely match the item’s category. The system achieves 94.72% accuracy in subcategories’ classification, a 4% increase compared to using the CNN method alone, confirming its effectiveness in recommending relevant items.

Mysore sentinel-2: deep learning for image classification with optimizer exploration

The classification of Sentinel-2 image is presented in this work using a tile based methodology. The Mysore district of India's Karnataka state serves as the subject region of this research. By tiling Sentinel-2 images, we were able to construct a distinct dataset and get approximately 3,000 training samples for the five classes. These images are manually labelled and geo-referenced. Three different optimizers were employed in a thorough analysis with deep learning models such as ResNet50, MobileNetV2, ShuffleNet, and VGG16 to achieve better performance metrics. With a classification accuracy of 98.1% on RESNet50 using ADAM surpassed the others. This facilitates investigating various geographical data analytics applications of the study region.

A novel women's ovulation prediction through salivary ferning using the box counting and deep learning

There are several methods to predict a woman's ovulation time, including using a calendar system, basal body temperature, ovulation prediction kit, and OvuScope. This is the first study to predict the time of ovulation in women by calculating the results of detecting the fractal shape of the full ferning (FF) line pattern in salivary using pixel counting, box counting, and deep learning for computer vision methods. The peak of a woman's ovulation every month in her menstrual cycle occurs when the number of ferning lines is the most numerous or dense, and this condition is called FF. In this study, the computational results based on the visualization of the fractal shape of the salivary ferning line pattern from the pixel-counting method have an accuracy of 80%, while the fractal dimensions achieved by the box-counting are 1.474. On the other hand, using the deep learning image classification, we obtain the highest accuracy of 100% with a precision value of 1.00, recall of 1.00, and F1-score 1.00 on the pre-trained network model ResNet-18. Furthermore, visualization of the ResNet-34 model results in the highest number of patches, i.e., 586 patches (equal to 36,352 pixels), by applying fern-like lines pattern detection with windows size 8x8 pixels.

An improved post-hurricane building damaged detection method based on transfer learning

After a natural disaster, it is very important for the government to conduct a damaged assessment as soon as possible. Fast and accurate disaster assessment helps the government disaster relief departments allocate resources and respond quickly and effectively to minimize the losses caused by the disaster. Usually, the method of measuring disaster losses is to rely on manual field exploration and measurement, and then calculate and label the damaged buildings or land, or rely on unmanned collections to remotely collect pictures of the disaster-stricken area, and compare the original pictures to carry out the disaster annotation and calculation. These methods are time-consuming, labor-intensive, and inefficient. This paper proposes a post-hurricane building damage detection method based on transfer learning, which uses deep learning image classification algorithms to achieve post-disaster satellite image damage detection and classification, thereby improving disaster assessment efficiency and preparing for disaster relief and post-disaster reconstruction. The proposed method adopts the theory of transfer learning, establishes a disaster image detection model based on the convolutional neural network model, and uses the 2017 Hurricane Harvey data as the experimental data set. Experiments have proved that our proposed model accuracy of disaster detection reaches 97%, which is 1% higher than other models.

An Approach for Egg Parasite Classification Based on Ensemble Deep Learning

Opisthorchis viverrini and minute intestinal fluke (MIF) infections are heavily epidemic in northeastern Thailand. Their primary cause is eating raw or undercooked cyprinid fishes, and they cause health problems in the human digestive system. In cases of liver fluke, these parasites can go through the bile duct system, which may cause cholangiocarcinoma (bile duct cancer). When a medical doctor suspects that a patient is infected with parasites, they typically request a stool analysis to determine the type of egg parasites using microscopy. Both parasites have similar characteristics, thus, it is necessary for a specialist to identify the specific type of egg parasites present. Many automatic systems have been developed using deep learning to assist doctors in diagnosing the type of egg parasite. In this study, we proposed three models of deep learning architectures and created voting ensembles to analyze egg parasite images. Images of similar liver fluke eggs and MIF eggs were taken from the Parasitology Laboratory, Faculty of Medicine, Khon Kaen University, Khon Kaen, Thailand. Image data augmentation is used to expand images from different perspectives and assist the system in acquiring a greater variety of images. Three models performed effectively, by employing the hard voting ensemble, the accuracy increased to 86.67%, while for the second group, the accuracies reached 68.00%, 76.00%, and 77.33%, respectively. Using the soft voting ensemble, the accuracy improved to 79.33%. These outcomes highlight the potential of ensemble deep learning in image classification. Furthermore, these results align closely with those achieved by several experts in image classification. Hence, a promising ensemble approach can aid doctors in accurately classifying images of egg parasites.

An extended focused assessment with sonography in trauma ultrasound tissue-mimicking phantom for developing automated diagnostic technologies.

Introduction: Medical imaging-based triage is critical for ensuring medical treatment is timely and prioritized. However, without proper image collection and interpretation, triage decisions can be hard to make. While automation approaches can enhance these triage applications, tissue phantoms must be developed to train and mature these novel technologies. Here, we have developed a tissue phantom modeling the ultrasound views imaged during the enhanced focused assessment with sonography in trauma exam (eFAST). Methods: The tissue phantom utilized synthetic clear ballistic gel with carveouts in the abdomen and rib cage corresponding to the various eFAST scan points. Various approaches were taken to simulate proper physiology without injuries present or to mimic pneumothorax, hemothorax, or abdominal hemorrhage at multiple locations in the torso. Multiple ultrasound imaging systems were used to acquire ultrasound scans with or without injury present and were used to train deep learning image classification predictive models. Results: Performance of the artificial intelligent (AI) models trained in this study achieved over 97% accuracy for each eFAST scan site. We used a previously trained AI model for pneumothorax which achieved 74% accuracy in blind predictions for images collected with the novel eFAST tissue phantom. Grad-CAM heat map overlays for the predictions identified that the AI models were tracking the area of interest for each scan point in the tissue phantom. Discussion: Overall, the eFAST tissue phantom ultrasound scans resembled human images and were successful in training AI models. Tissue phantoms are critical first steps in troubleshooting and developing medical imaging automation technologies for this application that can accelerate the widespread use of ultrasound imaging for emergency triage.