Deep Convolutional Neural Network Approach Research Articles

A deep convolutional neural network approach using medical image classification

The epidemic diseases such as COVID-19 are rapidly spreading all around the world. The diagnosis of epidemic at initial stage is of high importance to provide medical care to and recovery of infected people as well as protecting the uninfected population. In this paper, an automatic COVID-19 detection model using respiratory sound and medical image based on internet of health things (IoHT) is proposed. In this model, primarily to screen those people having suspected Coronavirus disease, the sound of coughing used to detect healthy people and those suffering from COVID-19, which finally obtained an accuracy of 94.999%. This approach not only expedites diagnosis and enhances accuracy but also facilitates swift screening in public places using simple equipment. Then, in the second step, in order to help radiologists to interpret medical images as best as possible, we use three pre-trained convolutional neural network models InceptionResNetV2, InceptionV3 and EfficientNetB4 and two data sets of chest radiology medical images, and CT Scan in a three-class classification. Utilizing transfer learning and pre-existing knowledge in these models leads to notable improvements in disease diagnosis and identification compared to traditional techniques. Finally, the best result obtained for CT-Scan images belonging to InceptionResNetV2 architecture with 99.414% accuracy and for radiology images related to InceptionV3 and EfficientNetB4 architectures with the accuracy is 96.943%. Therefore, the proposed model can help radiology specialists to confirm the initial assessments of the COVID-19 disease.

Accuracy of automated forensic dental age estimation lab (F-DentEst Lab) on large Malaysian dataset

When a disaster occurs, the authority must prioritise two things. First, the search and rescue of lives, and second, the identification and management of deceased individuals. However, with thousands of dead bodies to be individually identified in mass disasters, forensic teams face challenges such as long working hours resulting in a delayed identification process and a public health concern caused by the decomposition of the body. Using dental panoramic imaging, teeth have been used in forensics as a physical marker to estimate the age of an individual. Traditionally, dental age estimation has been performed manually by experts. Although the procedure is fairly simple, the large number of victims and the limited amount of time available to complete the assessment during large-scale disasters make forensic work even more challenging. The emergence of artificial intelligence (AI) in the fields of medicine and dentistry has led to the suggestion of automating the current process as an alternative to the conventional method. This study aims to test the accuracy and performance of the developed deep convolutional neural network system for age estimation in large, out-of-sample Malaysian children dataset using digital dental panoramic imaging. Forensic Dental Estimation Lab (F-DentEst Lab) is a computer application developed to perform the dental age estimation digitally. The introduction of this system is to improve the conventional method of age estimation that significantly increase the efficiency of the age estimation process based on the AI approach. A total number of one-thousand-eight-hundred-and-ninety-two digital dental panoramic images were retrospectively collected to test the F-DentEst Lab. Data training, validation, and testing have been conducted in the early stage of the development of F-DentEst Lab, where the allocation involved 80 % training and the remaining 20 % for testing. The methodology was comprised of four major steps: image preprocessing, which adheres to the inclusion criteria for panoramic dental imaging, segmentation, and classification of mandibular premolars using the Dynamic Programming-Active Contour (DP-AC) method and Deep Convolutional Neural Network (DCNN), respectively, and statistical analysis. The suggested DCNN approach underestimated chronological age with a small ME of 0.03 and 0.05 for females and males, respectively.

Peak response regularization for localization

Deep convolutional neural networks approaches often assume that the feature response has a Gaussian distribution with target-centered peak response, which can be used to guide the target location and classification. Nevertheless, such an assumption is implausible when there is progressive interference from other targets and/or background noise, which produces sub-peaks on the tracking response map and causes model drift. In this paper, we propose a feature response regularization approach for sub-peak response suppression and peak response enforcement and aim to handle progressive interference systematically. Our approach, referred to as Peak Response Regularization (PRR), applies simple-yet-efficient method to aggregate and align discriminative features, which convert local extremal response in discrete feature space to extremal response in continuous space, which enforces the localization and representation capability of convolutional features. Experiments on human pose detection, object detection, object tracking, and image classification demonstrate that PRR improves the performance of image tasks with a negligible computational cost.

An effective multiclass skin cancer classification approach based on deep convolutional neural network

Skin cancer is one of the most dangerous types of cancer due to its immediate appearance and the possibility of rapid spread. It arises from uncontrollably growing cells, rapidly dividing cells in one area of the body, invading other bodily tissues, and spreading throughout the body. Early detection helps prevent cancer progress from reaching critical levels, reducing the risk of complications and the need for more aggressive treatment options. Convolutional neural networks (CNNs) revolutionize skin cancer diagnosis by extracting intricate features from images, enabling an accurate classification of lesions. Their role extends to early detection, providing a powerful tool for dermatologists to identify abnormalities in their nascent stages, ultimately improving patient outcomes. This study proposes a novel deep convolutional neural network (DCNN) approach to classifying skin cancer lesions. The proposed DCNN model is evaluated using two unbalanced datasets, namely HAM10000 and ISIC-2019. The DCNN model is compared with other transfer learning models, including VGG16, VGG19, DenseNet121, DenseNet201, and MobileNetV2. Its performance is assessed using four widely used evaluation metrics: accuracy, recall, precision, F1-score, specificity, and AUC. The experimental results demonstrate that the proposed DCNN model outperforms other deep learning (DL) models that utilized these datasets. The proposed DCNN model achieved the highest accuracy with the HAM10000 and ISIC-2019 datasets, reaching 98.5%\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$98.5\\%$$\\end{document} and 97.1%\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$97.1\\%$$\\end{document}, respectively. These experimental results show how competitive and successful the DCNN model is in overcoming the problems caused by class imbalance and raising skin cancer classification accuracy. Furthermore, the proposed model demonstrates superior performance, particularly excelling in terms of accuracy, compared to other recent studies that utilize the same datasets, which highlights the robustness and effectiveness of the proposed DCNN.

An Effective Deep Learning Approach For Handwritten Ol-Chiki Character Recognition

In this paper, we propose a deep convolution neural network approach to recognize Ol-Chiki handwritten characters. Here we describe recognition of handwritten basic characters of Ol-Chiki script, used by more than 10 million tribal people in India mostly from Assam, Bengal, Bihar, Odisha and Jharkhand. There are 30 basic characters and 10 numeral digits in Ol-Chiki. We have used a dataset of 10000 handwritten isolated character samples written by 100 persons. Convolution Neural Network (CNN) architecture has been used for the recognition of handwritten isolated Ol-Chiki characters. Our system has been tested on Ol-Chiki isolated dataset and we have achieved 92% accuracy on almost on all Ol-Chiki characters.

Enhancing breast cancer segmentation and classification: An Ensemble Deep Convolutional Neural Network and U-net approach on ultrasound images

Breast cancer is a condition where the irregular growth of breast cells occurs uncontrollably, leading to the formation of tumors. It poses a significant threat to women’s lives globally, emphasizing the need for enhanced methods of detecting and categorizing the disease. In this work, we propose an Ensemble Deep Convolutional Neural Network (EDCNN) model that exhibits superior accuracy compared to several transfer learning models and the Vision Transformer model. Our EDCNN model integrates the strengths of the MobileNet and Xception models to improve its performance in breast cancer detection and classification. We employ various preprocessing techniques, including image resizing, data normalization, and data augmentation, to prepare the data for analysis. By following these measures, the formatting is optimized, and the model’s capacity to make generalizations is improved. We trained and evaluated our proposed EDCNN model using ultrasound images, a widely available modality for breast cancer imaging. The outcomes of our experiments illustrate that the EDCNN model attains an exceptional accuracy of 87.82% on Dataset 1 and 85.69% on Dataset 2, surpassing the performance of several well-known transfer learning models and the Vision Transformer model. Furthermore, an AUC value of 0.91 on Dataset 1 highlights the robustness and effectiveness of our proposed model. Moreover, we highlight the incorporation of the Grad-CAM Explainable Artificial Intelligence (XAI) technique to improve the interpretability and transparency of our proposed model. Additionally, we performed image segmentation using the U-Net segmentation technique on the input ultrasound images. This segmentation process allowed for the identification and isolation of specific regions of interest, facilitating a more comprehensive analysis of breast cancer characteristics. In conclusion, the study presents a creative approach to detecting and categorizing breast cancer, demonstrating the superior performance of the EDCNN model compared to well-established transfer learning models. Through advanced deep learning techniques and image segmentation, this study contributes to improving diagnosis and treatment outcomes in breast cancer.

Cancerous and Non-Cancerous MRI Classification Using Dual DCNN Approach.

Brain cancer is a life-threatening disease requiring close attention. Early and accurate diagnosis using non-invasive medical imaging is critical for successful treatment and patient survival. However, manual diagnosis by radiologist experts is time-consuming and has limitations in processing large datasets efficiently. Therefore, efficient systems capable of analyzing vast amounts of medical data for early tumor detection are urgently needed. Deep learning (DL) with deep convolutional neural networks (DCNNs) emerges as a promising tool for understanding diseases like brain cancer through medical imaging modalities, especially MRI, which provides detailed soft tissue contrast for visualizing tumors and organs. DL techniques have become more and more popular in current research on brain tumor detection. Unlike traditional machine learning methods requiring manual feature extraction, DL models are adept at handling complex data like MRIs and excel in classification tasks, making them well-suited for medical image analysis applications. This study presents a novel Dual DCNN model that can accurately classify cancerous and non-cancerous MRI samples. Our Dual DCNN model uses two well-performed DL models, i.e., inceptionV3 and denseNet121. Features are extracted from these models by appending a global max pooling layer. The extracted features are then utilized to train the model with the addition of five fully connected layers and finally accurately classify MRI samples as cancerous or non-cancerous. The fully connected layers are retrained to learn the extracted features for better accuracy. The technique achieves 99%, 99%, 98%, and 99% of accuracy, precision, recall, and f1-scores, respectively. Furthermore, this study compares the Dual DCNN's performance against various well-known DL models, including DenseNet121, InceptionV3, ResNet architectures, EfficientNetB2, SqueezeNet, VGG16, AlexNet, and LeNet-5, with different learning rates. This study indicates that our proposed approach outperforms these established models in terms of performance.

Novel hybrid optimization based adaptive deep convolution neural network approach for human activity recognition system

Novel hybrid optimization based adaptive deep convolution neural network approach for human activity recognition system

A Novel Deep Convolutional Neural Network Approach using Jacobi Polynomial and Laplacian Function (JPLF) in Recognition of Plant Leaf Disease

Background/Objectives: Enhancing agricultural productivity is crucial for fostering economic growth. Plant diseases significantly threaten crops, necessitating timely detection to mitigate adverse impacts on quality, quantity, and overall productivity. This research addresses the importance of early disease detection in agriculture and proposes an innovative method utilizing Jacobian Polynomial and Laplacian Function for precise identification. Methods: Efficient monitoring of large-scale crop farms with minimal workforce is essential. To achieve this, an automatic method for plant disease detection is proposed. The method leverages Jacobian polynomials to expand input features, mitigating correlation issues among input vectors. The expanded Jacobi polynomial is the input vector for a backpropagation algorithm with a novel activation function based on the Laplacian function. Findings: The efficacy of the proposed JPLF model is demonstrated through the accurate identification of leaf diseases, achieving a high testing accuracy of 92.07%. Comparative analysis with existing models, such as CNN with MobileNet V2 (85.38%) and the IoU model (83.75%), highlights the superiority of the JPLF model in plant disease detection. Novelty: To overcome the limitations of existing approaches, the incorporation of Jacobian polynomials plays a pivotal role in expanding input features. This expansion aids in eliminating correlations among input vectors, enhancing the efficacy of disease detection. The proposed model, Jacobi Polynomial and Laplacian Function (JPLF) introduces a unique activation function based on the Laplacian function, improving accuracy. Keywords: Plant Disease Detection, Jacobi Polynomial, Laplacian Transform, Deep Learning Model, Feature Expansion

A Review on Sign Language Recognition and Learning System

This paper presents innovative approaches to various aspects of sign language recognition and learning, catering to the diverse needs within this field. It introduces a system utilizing 2D image sampling and concatenation, trained with convolutional neural networks, achieving accurate and robust sign recognition even with low-cost cameras. Another system, SignQuiz, offers a cost-effective web-based solution for learning finger-spelled signs in Indian Sign Language (ISL), outperforming traditional printed mediums. Additionally, a dynamic hand gesture recognition system employing deep learning architectures demonstrates superior performance over existing methods, addressing challenges such as hand segmentation and sequence modeling. Furthermore, an efficient deep convolutional neural network approach for hand gesture recognition, including transfer learning, achieves high recognition rates across various datasets. Finally, a robust model for static sign recognition in ISL, utilizing CNNs and evaluating on a diverse dataset, attains exceptional accuracy and outperforms previous works. These contributions collectively advance the field of sign language recognition and learning, offering solutions that are accurate, cost-effective, and efficient, thereby facilitating better communication and interaction for the hearing-impaired community. Key Words: CNN, Sign language recognition, Hand gesture recognition, Machine learning, Transfer Learning, SVM.

Siamese Neural Networks for Kinship Prediction: A Deep Convolutional Neural Network Approach

Siamese Neural Networks for Kinship Prediction: A Deep Convolutional Neural Network Approach

Negative Stances Detection from Multilingual Data Streams in Low-Resource Languages on Social Media Using BERT and CNN-Based Transfer Learning Model

Online social media allows users to connect with a large number of people across the globe and facilitate the exchange of information efficiently. These platforms cater to many of our day-to-day needs. However, at the same time, social media have been increasingly used to transmit negative stances such as derogatory language, hate speech, and cyberbullying. The task of identifying the negative stances from social media posts or comments or tweets is termed negative stance detection . One of the major challenges associated with negative stance detection is that most of the content published on social media is often in a multilingual format. This work aims to identify negative stances from multilingual data streams in low-resource languages on social media using a hybrid transfer learning and deep convolutional neural network approach. The proposed work starts by preprocessing the multilingual datasets by removing irrelevant information such as special characters and hyperlinks. The processed dataset is then passed through a pretrained BERT (bidirectional encoder representations from Transformers) model to generate embeddings by fine-tuning the model as per the dataset under consideration. The generated word embeddings are then passed to a deep convolutional neural network for extracting the latent features from the texts and removing the unessential information. This helps our model to achieve robustness and effectiveness for efficient learning on the given dataset and make appropriate predictions on zero-shot data. The article utilizes several optimization strategies for examining the impact of fine-tuning different BERT layers on the model’s performance. Intensive experiments on a variety of languages — namely, English, French, Italian, Danish, Arabic, Spanish, Indonesian, German, and Portuguese — are performed. The experimental results demonstrate the effectiveness and efficiency of the proposed framework.

Tool Condition Monitoring for milling process using Convolutional Neural Networks

Tool condition monitoring has emerged as an essential approach in the machining industry to drive cost reductions and enhance productivity. In the era of Industry 4.0, tool wear monitoring can be done using various Internet of Things sensors, such as those recording acoustic emission, vibration, temperature, and pressure. Signals acquired can be processed by extracting numeric features or converting them into images.In this study, experimental milling campaigns with different input machine parameters were conducted, leading to the creation of a dataset based on tool wear measurements and acoustic emission registrations. Then we investigated a deep convolutional neural networks approach to classify image representations of the registered acoustic signals, aiming to predict the status of tool wear. Since the dataset was imbalanced, a class weights approach was used to improve model performance. An accuracy exceeding 90% was reached, demonstrating a great potential of the model in predicting tool wear state.

Detecting major depressive disorder presence using passively-collected wearable movement data in a nationally-representative sample

Major Depressive Disorder (MDD) is a heterogeneous disorder, resulting in challenges with early detection. However, changes in sleep and movement patterns may help improve detection. Thus, this study aimed to explore the utility of wrist-worn actigraphy data in combination with machine learning (ML) and deep learning techniques to detect MDD using a commonly used screening method: Patient Health Questionnaire-9 (PHQ-9). Participants (N = 8,378; MDD Screening = 766 participants) completed the and wore Actigraph GT3X+ for one week as part of the National Health and Nutrition Examination Survey (NHANES). Leveraging minute-level, actigraphy data, we evaluated the efficacy of two commonly used ML approaches and identified actigraphy-derived biomarkers indicative of MDD. We employed two ML modeling strategies: (1) a traditional ML approach with theory-driven feature derivation, and (2) a deep learning Convolutional Neural Network (CNN) approach, coupled with gramian angular field transformation. Findings revealed movement-related features to be the most influential in the traditional ML approach and nighttime movement to be the most influential in the CNN approach for detecting MDD. Using a large, nationally-representative sample, this study highlights the potential of using passively-collected, actigraphy data for understanding MDD to better improve diagnosing and treating MDD.

Machine learning identification of Pseudomonas aeruginosa strains from colony image data.

When grown on agar surfaces, microbes can produce distinct multicellular spatial structures called colonies, which contain characteristic sizes, shapes, edges, textures, and degrees of opacity and color. For over one hundred years, researchers have used these morphology cues to classify bacteria and guide more targeted treatment of pathogens. Advances in genome sequencing technology have revolutionized our ability to classify bacterial isolates and while genomic methods are in the ascendancy, morphological characterization of bacterial species has made a resurgence due to increased computing capacities and widespread application of machine learning tools. In this paper, we revisit the topic of colony morphotype on the within-species scale and apply concepts from image processing, computer vision, and deep learning to a dataset of 69 environmental and clinical Pseudomonas aeruginosa strains. We find that colony morphology and complexity under common laboratory conditions is a robust, repeatable phenotype on the level of individual strains, and therefore forms a potential basis for strain classification. We then use a deep convolutional neural network approach with a combination of data augmentation and transfer learning to overcome the typical data starvation problem in biological applications of deep learning. Using a train/validation/test split, our results achieve an average validation accuracy of 92.9% and an average test accuracy of 90.7% for the classification of individual strains. These results indicate that bacterial strains have characteristic visual 'fingerprints' that can serve as the basis of classification on a sub-species level. Our work illustrates the potential of image-based classification of bacterial pathogens and highlights the potential to use similar approaches to predict medically relevant strain characteristics like antibiotic resistance and virulence from colony data.

A Cloud-Based Platform for Leaf Disease Segmentation and Classification using Hybrid Deep Learning Model

This paper presents a cloud-based hybrid deep learning method for classifying leaf diseases. At first, sensors aid in detecting soil factors such as moisture content, pH level, air temperature, and humidity. The hybrid Recurrent Layer based Deep Convolutional Neural Network (RLDCNN) approach consists of five distinct stages: preprocessing, segmentation, handcrafted feature extraction, feature selection, and classification. The preprocessing of image involves removal of noise using Averaged Double Plateau Histogram Equalisation (ADPHE). Afterwards, the specific part of the image that is impacted is divided into segments using an improved Wavelet transform. After the process of segmentation, the GLCM (Gray-Level Co-occurrence Matrix) is used to extract features. The hybrid Fire Hawk with Egret Swarm Optimisation (FHESO) algorithm is a very efficient approach for feature selection, significantly lowering the dimensionality of features. The detection of apple, banana mango and groundnut leaf disease are accomplished via the use of a Recurrent Layer based Deep Convolutional Neural Network (RLDCNN), which is trained using the Deer Hunting Algorithm (DHA) that has been created. The suggested concept is implemented inside a cloud-based collaborative framework to provide immediate assistance to farmers. The experimental findings exhibit favourable outcomes, demonstrating a high level of accuracy, precision, a low rate of loss, recall, and F-score. The RLDCNN network method outperforms previous parameters, obtaining an accuracy of 98.51% according to comparative research.

A machine learning approach to seizure detection in a rat model of post-traumatic epilepsy

Epilepsy is a common neurologic condition frequently investigated using rodent models, with seizures identified by electroencephalography (EEG). Given technological advances, large datasets of EEG are widespread and amenable to machine learning approaches for identification of seizures. While such approaches have been explored for human EEGs, machine learning approaches to identifying seizures in rodent EEG are limited. We utilized a predesigned deep convolutional neural network (DCNN), GoogLeNet, to classify images for seizure identification. Training images were generated through multiplexing spectral content (scalograms), kurtosis, and entropy for two-second EEG segments. Over 2200 h of EEG data were scored for the presence of seizures, with 95.6% of seizures identified by the DCNN and a false positive rate of 34.2% (1.52/h), as compared to visual scoring. Multiplexed images were superior to scalograms alone (scalogram-kurtosis-entropy 0.956 ± 0.010, scalogram 0.890 ± 0.028, t(7) = 3.54, p < 0.01) and a DCNN trained specifically for the individual animal was superior to using DCNNs across animals (intra-animal 0.960 ± 0.0094, inter-animal 0.811 ± 0.015, t(30) = 5.54, p < 0.01). For this dataset the DCNN approach is superior to a previously described algorithm utilizing longer local line lengths, calculated from wavelet-decomposition of EEG, to identify seizures. We demonstrate the novel use of a predesigned DCNN constructed to classify images, utilizing multiplexed images of EEG spectral content, kurtosis, and entropy, to rapidly and objectively identifies seizures in a large dataset of rat EEG with high sensitivity.

Time frequency domain deep CNN for automatic background classification in speech signals

Many application areas, such as background identification, predictive maintenance in industrial applications, smart home applications, assisting deaf people with their daily activities and indexing and retrieval of content-based multimedia, etc., use automatic background classification using speech signals. It is challenging to predict the background environment accurately from speech signal information. Thus, a novel synchrosqueezed wavelet transform (SWT)-based deep learning (DL) approach is proposed in this paper for automatically classifying background information embedded in speech signals. Here, SWT is incorporated to obtain the time-frequency plot from the speech signals. These time-frequency signals are then fed to a deep convolutional neural network (DCNN) to classify background information embedded in speech signals. The proposed DCNN model consists of three convolution layers, one batch-normalization layer, three max-pooling layers, one dropout layer, and one fully connected layer. The proposed method is tested using various background signals embedded in speech signals, such as airport, airplane, drone, street, babble, car, helicopter, exhibition, station, restaurant, and train sounds. According to the results, the proposed SWT-based DCNN approach has an overall classification accuracy of 97.96 (± 0.53)% to classify background information embedded in speech signals. Finally, the performance of the proposed approach is compared to the existing methods.

RiceNet: A deep convolutional neural network approach for classification of rice varieties

The cultivation of desired grain varieties holds immense significance as about 67% of the world’s population is associated with the agriculture sector. Unknowingly sowing the wrong variety of seeds may lead to a colossal waste of effort and money. Furthermore, the growing issue of rice grain adulteration in high-quality rice poses a threat to the trust of rice importers and exporters. While traditional methods are expensive, laborious, and error-prone, Computer Vision provides a good alternative that constitutes a current, advanced technology for image processing and data evaluation that holds tremendous promise and potential. In this research study, five varieties of rice grains including Jehlum Sr-1, Mushkibudji, Sr-2, and Sr-4 were collected from local grain and were used for research analysis. A computer vision system “RiceNet” contingent upon Deep Convolutional Neural Network (DCNN) framework has been designed for ameliorating the accuracy of identifying five unique groups of rice grain varieties. Deep Learning (DL) based pre-trained architectures including InceptionV3 and InceptionResNetV2 models were also adopted for classifying five specific groups of rice species. To optimize model parameters and alleviate back-propagation error during training, the Adam optimizer with a learning rate (lr) of 0.00003 has been employed to fine-tune the pre-trained InceptionV3 and ResNetInceptionV2 models. The proposed RiceNet architecture and pre-trained models were also compared with traditional ML approaches of HOG-SVM, SIFT-SVM, HOG-Logistic Regression(HOG-LR), SIFT-Logistic Regression(SIFT-LR), HOG-KNN, and SIFT-KNN for rice grain classification. With these experimentations at hand, it was observed that our proposed model “RiceNet” outperformed other approaches in similar computer vision tasks. The prediction accuracy outcome for the test dataset by HOG-SVM, SIFT-SVM, HOG-LR, SIFT-LR, HOG-KNN, and SIFT-KNN models were 66.0%, 65.33%, 62.67%, 65.0%, 54.0%, and 52.0% respectively. RiceNet, InceptionV3 and ResNetInceptionV2 have the best prediction accuracy of 94%, 84% and 81.333%. The remarkably high success rate of DCNN models makes them highly valuable and can be extended to endorse an integrated grain identification system that can operate in real-world situations.

Mapping Irrigated Croplands from Sentinel-2 Images Using Deep Convolutional Neural Networks

Understanding the spatial distribution of irrigated croplands is crucial for food security and water use. To map land cover classes with high-spatial-resolution images, it is necessary to analyze the semantic information of target objects in addition to the spectral or spatial–spectral information of local pixels. Deep convolutional neural networks (DCNNs) can characterize the semantic features of objects adaptively. This study uses DCNNs to extract irrigated croplands from Sentinel-2 images in the states of Washington and California in the United States. We integrated the DCNNs of 101 layers, discarded pooling layers, and employed dilation convolution to preserve location information; these are models which were used based on fully convolutional network (FCN) architectures. The findings indicated that irrigated croplands may be effectively detected at various phases of crop growth in the fields. A quantitative analysis of the trained models revealed that the three models in the two states had the lowest values of Intersection over Union (IoU) and Kappa, i.e., 0.88 and 0.91, respectively. The deep models’ temporal portability across different years was acceptable. The lowest values of recall and OA (overall accuracy) from 2018 to 2021 were 0.91 and 0.87, respectively. In Washington, the lowest OA value from 10 to 300 m resolution was 0.76. This study demonstrates the potential of FCNs + DCNNs approaches for mapping irrigated croplands across large regions, providing a solution for irrigation mapping. The spatial resolution portability of deep models could be improved further by designing model architectures.