Deep Learning For Image Classification Research Articles

Enhancing deep learning image classification using data augmentation and genetic algorithm-based optimization

Enhancing deep learning image classification using data augmentation and genetic algorithm-based optimization

Implementation and Efficient Analysis of Preprocessing Techniques in Deep Learning for Image Classification

Deep learning models have recently been preferred to perform certain image-processing tasks. Recently, with the increasing radiation, heat, and poor lighting conditions, the raw image samples may contain noisy and ambiguous information. To process these images, the deep learning model requires a large number of data samples to learn the missing information from other clear data samples. This necessitates training the neural network with a huge dataset. The researchers are now attempting to filter and improve such noisy images via preprocessing in order to provide valid and accurate feature information to the neural network layers. However, certain research studies claim that some useful information may be lost when the image is not preprocessed with an appropriate filter or enhancement technique. The MSA (meta-synthesis and analysis) approach is utilized in this work to present the impact of the image processing applications done with and without preprocessing steps. Also, this work summarizes the existing deep learning-based image processing models utilizing or not preprocessing steps in their implementation. This work has also found that 85% of the existing techniques involve a preprocessing step while developing a deep learning model. However, a maximum accuracy of 96.89% is observed on Sine-Net when it is implemented without a preprocessing and the same model gave 96.85% when implemented with preprocessing. This research provides various research insights on the requirement and non-requirement of preprocessing steps in a deep learning-based implementation.

Enhancing trustworthy deep learning for image classification against evasion attacks: a systematic literature review

In the rapidly evolving field of Deep Learning (DL), the trustworthiness of models is essential for their effective application in critical domains like healthcare and autonomous systems. Trustworthiness in DL encompasses aspects such as reliability, fairness, and transparency, which are crucial for its real-world impact and acceptance. However, the development of trustworthy DL models faces significant challenges. This is notably due to adversarial examples, a sophisticated form of evasion attack in adversarial machine learning (AML), which subtly alter inputs to deceive these models and pose a major threat to their safety and reliability. The current body of research primarily focuses on defensive measures, such as enhancing the robustness of models or implementing explainable AI techniques. However, this approach often neglects to address the fundamental vulnerabilities that adversaries exploit. As a result, the field tends to concentrate more on counteracting measures rather than gaining an in-depth understanding of the vulnerabilities and attack strategies inherent in DL systems. This gap in comprehensive understanding impedes the formulation of effective defense mechanisms. This research aims to shift the focus from predominantly defensive strategies toward a more extensive comprehension of adversarial techniques and the innate vulnerabilities of DL models. We undertake this by conducting a thorough systematic literature review, encompassing 49 diverse studies from the previous decade. Our findings reveal the key characteristics of adversarial examples that enable their success against image classification-based DL models. Building on these insights, we propose the Transferable Pretrained Adversarial Deep Learning framework (TPre-ADL). This conceptual model aims to rectify the deficiencies in current defense strategies by incorporating the analyzed traits of adversarial examples, potentially enhancing the robustness and trustworthiness of DL models.

Comparing hybrid models for recognising objects in thermal images at nighttime

This research aims to revolutionize urban object recognition by developing cloud-based Python programs using intelligent algorithms. Unlike current models that focus on colour enhancement in nighttime thermal images, this work addresses the critical challenge of accurate object detection in urban landscapes. The proposed method incorporates a binary generative adversarial network (GAN) generator that can switch bidirectionally between daytime colour (DC) and nighttime infrared (NTIR) images. memory-based visual image memory (MVAM), system extracts important descriptive information from urban landscape images, reducing problems related to small sample sizes. This discussion presents a comprehensive improvement and evaluation of a deep learning image classification pipeline using Google Colab, demonstrating advanced image processing. Using TensorFlow, Keres and scikit image libraries combined with advanced algorithms such as DenseNet121 and MobileNetV2 presents a clear approach. We created a Bidirectional GAN + MVAM for object recognition in this work. Our method performed well, with an accuracy of 81.43%, precision of 51.16, recall of 50.11, and F-score of 46.37. The systematic presentation of the code presents a careful strategy to ensure optimal performance, stability, and efficiency of deep learning and image processing tasks.

Colour fusion effect on deep learning classification of uveal melanoma.

Reliable differentiation of uveal melanoma and choroidal nevi is crucial to guide appropriate treatment, preventing unnecessary procedures for benign lesions and ensuring timely treatment for potentially malignant cases. The purpose of this study is to validate deep learning classification of uveal melanoma and choroidal nevi, and to evaluate the effect of colour fusion options on the classification performance. A total of 798 ultra-widefield retinal images of 438 patients were included in this retrospective study, comprising 157 patients diagnosed with UM and 281 patients diagnosed with choroidal naevus. Colour fusion options, including early fusion, intermediate fusion and late fusion, were tested for deep learning image classification with a convolutional neural network (CNN). F1-score, accuracy and the area under the curve (AUC) of a receiver operating characteristic (ROC) were used to evaluate the classification performance. Colour fusion options were observed to affect the deep learning performance significantly. For single-colour learning, the red colour image was observed to have superior performance compared to green and blue channels. For multi-colour learning, the intermediate fusion is better than early and late fusion options. Deep learning is a promising approach for automated classification of uveal melanoma and choroidal nevi. Colour fusion options can significantly affect the classification performance.

Deep learning and random light structuring ensure robust free-space communications

Having shown early promise, free-space optical (FSO) communications face formidable challenges in the age of information explosion. The ever-growing demand for greater channel communication capacity is one of the challenges. The inter-channel crosstalk, which severely degrades the quality of transmitted information, creates another roadblock in the way of efficient implementation of FSO communication systems. Here, we advance theoretically and realize experimentally a potentially high-capacity FSO protocol that enables high-fidelity transfer of an image or set of images through a complex environment. In our protocol, we complement random light structuring at the transmitter with a deep learning image classification platform at the receiver. Multiplexing unique, independent, mutually orthogonal degrees of freedom available to structured random light can potentially significantly boost the channel communication capacity of our protocol without introducing any deleterious crosstalk. Specifically, we show how one can multiplex the degrees of freedom associated with the source coherence radius and a spatial position of a beamlet within an array of structured random beams to greatly enhance the capacity of our communication link. The superb resilience of structured random light to environmental noise, as well as extreme efficiency of deep learning networks at classifying images, guarantees high-fidelity image transfer within the framework of our protocol.

Systematic review and best practices for drone remote sensing of invasive plants

Abstract Drones have emerged as a cost‐effective solution to detect and map plant invasions, offering researchers and land managers flexibility in flight design, sensors and data collection schedules. A systematic review of trends in drone‐based image collection, data processing and analytical approaches is needed to advance the science of invasive species monitoring and management and improve scalability and replicability. We systematically reviewed studies using drones for plant invasion research to identify knowledge gaps, best practices and a path toward advancing the science of invasive plant monitoring and management. We devised a database of 33 standardized reporting parameters, coded each study to those parameters, calculated descriptive statistics and synthesized how these technologies are being implemented and used. Trends show a general increase in studies since 2009 with a bias toward temperate regions in North America and Europe. Most studies have focused on testing the validity of a machine learning or deep learning image classification technique with fewer studies focused on monitoring or modelling spread. Very few studies used drones for assessing ecosystem dynamics and impacts such as determining environmental drivers or tracking re‐emergence after disturbance. Overall, we noted a lack of standardized reporting on field survey design, flight design, drone systems, image processing and analyses, which hinders replicability and scalability of approaches. Based on these findings, we develop a standard framework for drone applications in invasive species monitoring to foster cross‐study comparability and reproducibility. We suggest several areas for advancing the use of drones in invasive plant studies including (1) utilizing standardized reporting frameworks to facilitate scientific research practices, (2) integrating drone data with satellite imagery to scale up relationships over larger areas, (3) using drones as an alternative to in‐person ground surveys and (4) leveraging drones to assess community trait shifts tied to plant fitness and reproduction.

Recommendation System Building based on CNN and TF-IDF Approaches

Online shopping has becoming increasingly popular. Customers remain engaged with shopping sites due to effective product recommendations. By analyzing users’ past actions and preferences, shopping platforms effectively identify customer interests and desires, enhancing their overall shopping experience. This paper presents a recommendation system that displays 5 items relevant to the product currently being viewed by the customer. The system processes images with an adapted ResNet-50, a deep learning image classification model in convolutional neural network (CNN) and use the acquired embedded vector to determine similarities with cosine functions. Additionally, the system employs term frequency-inverse document frequency (TF-IDF) method for text analysis in product descriptions, generating word embedding that assists recommendations. This blend of visual and textual analysis ensures that the suggestions closely match the item’s category. The system achieves 94.72% accuracy in subcategories’ classification, a 4% increase compared to using the CNN method alone, confirming its effectiveness in recommending relevant items.

Mysore sentinel-2: deep learning for image classification with optimizer exploration

The classification of Sentinel-2 image is presented in this work using a tile based methodology. The Mysore district of India's Karnataka state serves as the subject region of this research. By tiling Sentinel-2 images, we were able to construct a distinct dataset and get approximately 3,000 training samples for the five classes. These images are manually labelled and geo-referenced. Three different optimizers were employed in a thorough analysis with deep learning models such as ResNet50, MobileNetV2, ShuffleNet, and VGG16 to achieve better performance metrics. With a classification accuracy of 98.1% on RESNet50 using ADAM surpassed the others. This facilitates investigating various geographical data analytics applications of the study region.

A novel women's ovulation prediction through salivary ferning using the box counting and deep learning

There are several methods to predict a woman's ovulation time, including using a calendar system, basal body temperature, ovulation prediction kit, and OvuScope. This is the first study to predict the time of ovulation in women by calculating the results of detecting the fractal shape of the full ferning (FF) line pattern in salivary using pixel counting, box counting, and deep learning for computer vision methods. The peak of a woman's ovulation every month in her menstrual cycle occurs when the number of ferning lines is the most numerous or dense, and this condition is called FF. In this study, the computational results based on the visualization of the fractal shape of the salivary ferning line pattern from the pixel-counting method have an accuracy of 80%, while the fractal dimensions achieved by the box-counting are 1.474. On the other hand, using the deep learning image classification, we obtain the highest accuracy of 100% with a precision value of 1.00, recall of 1.00, and F1-score 1.00 on the pre-trained network model ResNet-18. Furthermore, visualization of the ResNet-34 model results in the highest number of patches, i.e., 586 patches (equal to 36,352 pixels), by applying fern-like lines pattern detection with windows size 8x8 pixels.

An improved post-hurricane building damaged detection method based on transfer learning

After a natural disaster, it is very important for the government to conduct a damaged assessment as soon as possible. Fast and accurate disaster assessment helps the government disaster relief departments allocate resources and respond quickly and effectively to minimize the losses caused by the disaster. Usually, the method of measuring disaster losses is to rely on manual field exploration and measurement, and then calculate and label the damaged buildings or land, or rely on unmanned collections to remotely collect pictures of the disaster-stricken area, and compare the original pictures to carry out the disaster annotation and calculation. These methods are time-consuming, labor-intensive, and inefficient. This paper proposes a post-hurricane building damage detection method based on transfer learning, which uses deep learning image classification algorithms to achieve post-disaster satellite image damage detection and classification, thereby improving disaster assessment efficiency and preparing for disaster relief and post-disaster reconstruction. The proposed method adopts the theory of transfer learning, establishes a disaster image detection model based on the convolutional neural network model, and uses the 2017 Hurricane Harvey data as the experimental data set. Experiments have proved that our proposed model accuracy of disaster detection reaches 97%, which is 1% higher than other models.

An Approach for Egg Parasite Classification Based on Ensemble Deep Learning

Opisthorchis viverrini and minute intestinal fluke (MIF) infections are heavily epidemic in northeastern Thailand. Their primary cause is eating raw or undercooked cyprinid fishes, and they cause health problems in the human digestive system. In cases of liver fluke, these parasites can go through the bile duct system, which may cause cholangiocarcinoma (bile duct cancer). When a medical doctor suspects that a patient is infected with parasites, they typically request a stool analysis to determine the type of egg parasites using microscopy. Both parasites have similar characteristics, thus, it is necessary for a specialist to identify the specific type of egg parasites present. Many automatic systems have been developed using deep learning to assist doctors in diagnosing the type of egg parasite. In this study, we proposed three models of deep learning architectures and created voting ensembles to analyze egg parasite images. Images of similar liver fluke eggs and MIF eggs were taken from the Parasitology Laboratory, Faculty of Medicine, Khon Kaen University, Khon Kaen, Thailand. Image data augmentation is used to expand images from different perspectives and assist the system in acquiring a greater variety of images. Three models performed effectively, by employing the hard voting ensemble, the accuracy increased to 86.67%, while for the second group, the accuracies reached 68.00%, 76.00%, and 77.33%, respectively. Using the soft voting ensemble, the accuracy improved to 79.33%. These outcomes highlight the potential of ensemble deep learning in image classification. Furthermore, these results align closely with those achieved by several experts in image classification. Hence, a promising ensemble approach can aid doctors in accurately classifying images of egg parasites.

An extended focused assessment with sonography in trauma ultrasound tissue-mimicking phantom for developing automated diagnostic technologies.

Introduction: Medical imaging-based triage is critical for ensuring medical treatment is timely and prioritized. However, without proper image collection and interpretation, triage decisions can be hard to make. While automation approaches can enhance these triage applications, tissue phantoms must be developed to train and mature these novel technologies. Here, we have developed a tissue phantom modeling the ultrasound views imaged during the enhanced focused assessment with sonography in trauma exam (eFAST). Methods: The tissue phantom utilized synthetic clear ballistic gel with carveouts in the abdomen and rib cage corresponding to the various eFAST scan points. Various approaches were taken to simulate proper physiology without injuries present or to mimic pneumothorax, hemothorax, or abdominal hemorrhage at multiple locations in the torso. Multiple ultrasound imaging systems were used to acquire ultrasound scans with or without injury present and were used to train deep learning image classification predictive models. Results: Performance of the artificial intelligent (AI) models trained in this study achieved over 97% accuracy for each eFAST scan site. We used a previously trained AI model for pneumothorax which achieved 74% accuracy in blind predictions for images collected with the novel eFAST tissue phantom. Grad-CAM heat map overlays for the predictions identified that the AI models were tracking the area of interest for each scan point in the tissue phantom. Discussion: Overall, the eFAST tissue phantom ultrasound scans resembled human images and were successful in training AI models. Tissue phantoms are critical first steps in troubleshooting and developing medical imaging automation technologies for this application that can accelerate the widespread use of ultrasound imaging for emergency triage.

Improved deep learning image classification algorithm based on Swin Transformer V2

While convolutional operation effectively extracts local features, their limited receptive fields make it challenging to capture global dependencies. Transformer, on the other hand, excels at global modeling and effectively captures global dependencies. However, the self-attention mechanism used in Transformers lacks a local mechanism for information exchange within specific regions. This article attempts to leverage the strengths of both Transformers and convolutional neural networks (CNNs) to enhance the Swin Transformer V2 model. By incorporating both convolutional operation and self-attention mechanism, the enhanced model combines the local information-capturing capability of CNNs and the long-range dependency-capturing ability of Transformers. The improved model enhances the extraction of local information through the introduction of the Swin Transformer Stem, inverted residual feed-forward network, and Dual-Branch Downsampling structure. Subsequently, it models global dependencies using the improved self-attention mechanism. Additionally, downsampling is applied to the attention mechanism’s Q and K to reduce computational and memory overhead. Under identical training conditions, the proposed method significantly improves classification accuracy on multiple image classification datasets, showcasing more robust generalization capabilities.

Advances in Quantum Machine Learning and Deep Learning for Image Classification: A Survey

Image classification, which is a fundamental element of Computer Vision (CV) and Artificial Intelligence (AI), has been researched intensively in numerous domains and embedded in many products. However, with the exponential increase in the number of images and the complexity of the required tasks, deep-learning classification algorithms demand more intensive resources and computational power to train the models and update the massive number of parameters. Quantum computing is a new research technology with a promising capability of exponential speed up and operational parallelization with its unique phenomena including superposition and entanglement. Researchers have already started utilizing Quantum Deep Learning (QDL) and Quantum Machine Learning (QML) in image classification. Yet, to our knowledge, there exists no comprehensive published literature review on quantum image classification. Therefore, this paper analyzes the advances in this field by dividing the studies based on a unique taxonomy, discussing the limitations, summarizing essential aspects of each research, and finally, emphasizing the gaps, challenges, and recommendations. One of the key challenges presented in the paper is that quantum computers are in the Noisy Intermediate-Scale Quantum (NISQ) era, where they contain a limited number of noisy qubits, therefore challenging complex quantum classifiers and complex images from advanced datasets. This research recommends constructing a novel quantum image encoding method that adapts to the available number of qubits and enables RGB images as a critical contribution to the existing research.

Rolling Bearing Fault Diagnosis Based on SVD-GST Combined with Vision Transformer

Aiming at rolling bearing fault diagnosis, the collected vibration signal contains complex noise interference, and one-dimensional information cannot be used to fully mine the data features of the problem. This paper proposes a rolling bearing fault diagnosis method based on SVD-GST combined with the Vision Transformer. Firstly, the one-dimensional vibration signal is preprocessed to reduce noise using singular value decomposition (SVD) to obtain a more accurate and useful signal. Then, the generalized S-transform (GST) is used to convert the processed one-dimensional vibration signal into a two-dimensional time–frequency image and make full use of the advantages of deep learning in image classification with higher recognition accuracy. In order to avoid the problem of limited sensory fields in CNN and the need for an RNN to compute step by step over time when processing sequence data, the use of a Vision Transformer model for pattern recognition classification is proposed. Finally, an experimental platform for the fault diagnosis of rolling bearings is built. The model is experimentally validated, achieving an average accuracy of 98.52% over multiple tests. Additionally, compared with the SVD-GST-2DCNN, STFT-CNN-LSTM, SVD-GST-LSTM, and GST-ViT fault diagnosis models, the proposed method has higher diagnostic accuracy and stability, providing a new method for rolling bearing fault diagnosis.

Detecting the technology's evolutionary pathway using HiDS-trait-driven tech mining strategy

Detecting and identifying the future trends of disruptive technologies is crucial for both government R&D strategic planning and firms' practices. To monitor disruptive technology trends and grasp technological opportunities, this paper proposes an analytical framework that integrates appropriate tech mining and semantic analysis methods based on HiDS (high-dimensional and sparse)-trait patent abstract data and then visualizes the technology evolutionary pathway. Deep Learning technology is selected as a case study. In this case, tech mining methods are applied to analyze the Deep Learning technology evolutionary pathway and then refine Deep Learning technological prospects. Results indicate that Deep Learning has formulated three progressive clusters during its evolution, which strongly demonstrate the high application value of Deep Learning technology. In addition, Deep Learning technology will continue to maintain a rapid development stage, and Deep Learning Accelerator, Transfer Learning, Image Classification, Object Detection, and Deep Reinforcement Learning are the key technical topics in the future. Our study contributes to the technology forecast field by suggesting a data-trait-driven framework for HiDS data, which introduces data-trait-driven idea into technological evolution detection and combines it with technology life cycle theory, and helps experts make more precise and in-depth tech mining in technological evolution research.

Microstructure quality control of steels using deep learning

In quality control, microstructures are investigated rigorously to ensure structural integrity, exclude the presence of critical volume defects, and validate the formation of the target microstructure. For quenched, hierarchically-structured steels, the morphology of the bainitic and martensitic microstructures are of major concern to guarantee the reliability of the material under service conditions. Therefore, industries conduct small sample-size inspections of materials cross-sections through metallographers to validate the needle morphology of such microstructures. We demonstrate round-robin test results revealing that this visual grading is afflicted by pronounced subjectivity despite the thorough training of personnel. Instead, we propose a deep learning image classification approach that distinguishes steels based on their microstructure type and classifies their needle length alluding to the ISO 643 grain size assessment standard. This classification approach facilitates the reliable, objective, and automated classification of hierarchically structured steels. Specifically, an accuracy of 96% and roughly 91% is attained for the distinction of martensite/bainite subtypes and needle length, respectively. This is achieved on an image dataset that contains significant variance and labeling noise as it is acquired over more than 10 years from multiple plants, alloys, etchant applications, and light optical microscopes by many metallographers (raters). Interpretability analysis gives insights into the decision-making of these models and allows for estimating their generalization capability.

Facial Emotion Recognition System for Isolated Patient Monitoring using ResNet-50 based Convolutional Neural Network Model

Facial emotion recognition is a promising technology that has the potential to improve the quality of care for isolated patients by enabling healthcare professionals to assess the emotional state of these patients more accurately. Isolated patient monitoring is the practice of closely observing patients who have been isolated due to the risk of infection or other health concerns, and it is essential to ensure the well-being of these patients. The Facial Expression Recognition system is the process of identifying the emotional state of a person. In this system, captured image is compared with the trained dataset available in database and then emotional state of the image will be displayed. This will also integrate the system into existing patient monitoring systems and collect data on its effectiveness in improving the care and well-being of isolated patients. The ultimate goal is to demonstrate the value of facial emotion recognition in isolated patient monitoring, and to identify any potential ethical or privacy concerns that may need to be addressed. This is for facial emotion recognition (FER) in isolated patient monitoring. FER is achieved using computer vision techniques and voice recognition techniques to analyze and interpret facial expressions, which can be useful for identifying and tracking changes in patient’s emotional states. The proposed FER system utilizes deep learning algorithms for real-time detection and classification of emotions with high accuracy. Two popular methods utilized mostly in the literature for the automatic FER systems are based on geometry and appearance. Facial Expression Recognition usually performed in three-stages consisting of pre-processing, face detection & feature extraction, and expression classification. The paper analyses various deep learning image classification models (convolutional neural networks) to identify the certain human emotions: depressed, despair, fear, irritated, uneasy, shocked and neutrality.

Deep learning for image classification between primary central nervous system lymphoma and glioblastoma in corpus callosal tumors.

It can be challenging in some situations to distinguish primary central nervous system lymphoma (PCNSL) from glioblastoma (GBM) based on magnetic resonance imaging (MRI) scans, especially those involving the corpus callosum. The objective of this study was to assess the diagnostic performance of deep learning (DL) models between PCNSLs and GBMs in corpus callosal tumors. The axial T1-weighted gadolinium-enhanced MRI scans of 274 individuals with pathologically confirmed PCNSL (n = 94) and GBM (n = 180) were examined. After image pooling, pre-operative MRI scans were randomly split with an 80/20 procedure into a training dataset (n = 709) and a testing dataset (n = 177) for DL model development. Therefore, the DL model was deployed as a web application and validated with the unseen images (n = 114) and area under the receiver operating characteristic curve (AUC); other outcomes were calculated to assess the discrimination performance. The first baseline DL model had an AUC of 0.77 for PCNSL when evaluated with unseen images. The 2nd model with ridge regression regularization and the 3rd model with drop-out regularization increased an AUC of 0.83 and 0.84. In addition, the last model with data augmentation yielded an AUC of 0.57. DL with regularization may provide useful diagnostic information to help doctors distinguish PCNSL from GBM.