Image Recognition Approach Research Articles

Lifetime prediction of epoxy coating using convolutional neural networks and post processing image recognition methods

The rapid failure of organic coatings in deep-sea environments complicates accurate lifetime prediction. Given the rapid cracking characteristic on the coating surface in this environment, a comprehensive “performance-structure” failure model was established. Initially, a targeted image recognition approach containing convolutional neural network (CNN) and post-processing was constructed for the crack area detection. An overall precision of 82.81% demonstrated the network’s good accuracy. The length distribution and the statistical evolution of cracks were extracted from SEM images to obtain the kinetic equation of the cracks related to coating structure degradation. In addition, the kinetics of water diffusion and coating adhesion were examined, as they represent critical parameters of coating performance. Based on this achievement, a failure model incorporating three dominant factors was integrated by the gray relational analysis method. The average prediction error of the model was 2.60%, which lays the groundwork for developing image-based methods to predict coating life.

A deep learning approach for line-level Amharic Braille image recognition

Braille, the most popular tactile-based writing system, uses patterns of raised dots arranged in cells to inscribe characters for visually impaired persons. Amharic is Ethiopia’s official working language, spoken by more than 100 million people. To bridge the written communication gap between persons with and without eyesight, multiple Optical braille recognition systems for various language scripts have been developed utilizing both statistical and deep learning approaches. However, the need for half-character identification and character segmentation has complicated these systems, particularly in the Amharic script, where each character is represented by two braille cells. To address these challenges, this study proposed deep learning model that combines a CNN and a BiLSTM network with CTC. The model was trained with 1,800 line images with 32 × 256 and 48 × 256 dimensions, and validated with 200 line images and evaluated using Character Error Rate. The best-trained model had a CER of 7.81% on test data with a 48 × 256 image dimension. These findings demonstrate that the proposed sequence-to-sequence learning method is a viable Optical Braille Recognition (OBR) solution that does not necessitate extensive image pre and post processing. Inaddition, we have made the first Amharic braille line-image data set available for free to researchers via the link: https://github.com/Ne-UoG-git/Am-Br-line-image.github.io.

BahanbaKu: intuitive mobile application for buying recipe ingredients

<p>Many solutions were proposed to help people get their food or recipe ingredients easily without having to go to the market in person. Especially for people who have limited time and energy to go out and buy groceries. However, the existing solutions still lack the intuitiveness for users to get the ingredient information of a food recipe and still can’t facilitate the customers to have an all-in-one solution to get the needed ingredients. This study aims to combine the machine learning modalities and image recognition approach to provide a mobile app that can help people find food recipes intuitively and provide a digital ecosystem that can accommodate collaboration between various business actors including the MSMEs (Micro, Small, and Medium Enterprises). Instead of users buying items separately, the unique value of the proposed app (BahanbaKu) is that each of the ingredients needed by the user will be delivered in a single package. The preliminary evaluation result reveals that the accuracy of the proposed app is promising to assist people while getting recipe information for a particular food. The proposed app is also considered intuitive to the users with 81.7 SUS score.</p>

An Efficient Multi-Label Classification-Based Municipal Waste Image Identification

Sustainable and green waste management has become increasingly crucial due to the rising volume of waste driven by urbanization and population growth. Deep learning models based on image recognition offer potential for advanced waste classification and recycling methods. However, traditional image recognition approaches usually rely on single-label images, neglecting the complexity of real-world waste occurrences. Moreover, there is a scarcity of recognition efforts directed at actual municipal waste data, with most studies confined to laboratory settings. Therefore, we introduce an efficient Query2Label (Q2L) framework, powered by the Vision Transformer (ViT-B/16) as its backbone and complemented by an innovative asymmetric loss function, designed to effectively handle the complexity of multi-label waste image classification. Our experiments on the newly developed municipal waste dataset “Garbage In, Garbage Out”, which includes 25,000 street-level images, each potentially containing up to four types of waste, showcase the Q2L framework’s exceptional ability to identify waste types with an accuracy exceeding 92.36%. Comprehensive ablation experiments, comparing different backbones, loss functions, and models substantiate the efficacy of our approach. Our model achieves superior performance compared to traditional models, with a mean average precision increase of up to 2.39% when utilizing the asymmetric loss function, and switching to ViT-B/16 backbone improves accuracy by 4.75% over ResNet-101.

Multi-scale image recognition strategy based on convolutional neural network

The accurate recognition and interpretation of multi-scale visual information is a critical focus within contemporary computer vision research. To this end, this study explores and innovatively constructs a multi-scale image recognition strategy based on a Convolutional Neural Network (CNN) with a multi-level and multi-resolution perception domain. This strategy is embedded with an advanced multi-level convolutional operation mechanism, which enables the model to intelligently explore and learn the multi-scale feature representation space of images from tiny texture to grand structure, from shallow simple features to deep semantic abstraction. The core technology path of this paper is to design a deep separable convolutional architecture and combine pyramid pool technology to form a unique network module. This modular design not only ensures the computational efficiency of the model but also improves the ability of extracting and integrating multi-scale image features. Following intensive experimentation on an array of extensively recognized and substantial image datasets, the multi-scale image recognition approach introduced in our study has demonstrated marked enhancements in both recognition capability and stability, manifesting clear superiority compared to conventional, single-scale image recognition methodologies. This research not only enriches the theoretical framework of image recognition, but also provides a new and efficient solution for dealing with complex multi-scale image recognition challenges in practical applications, and further promotes the development of image understanding and recognition technology.

Image Analysis and Detection of Olive Leaf Diseases Using Recurrent Neural Networks

The widespread adoption of DL has led to a rise in academic interest in image recognition approaches, enabling applications such as automated image classification and the detection of plant diseases. The world's largest producer of olives is Morocco. Plant health might be harmed by illnesses, which therefore affects its development. Numerous illnesses affecting olive leaves specifically target crop growth rate. The objective of this research is to create deep RNNs to identify olive plant illnesses using a collection of leaf images, collected from various sources (Disease note The peacock eye falls on olive trees, Field Guide to Olive Pests, Diseases and Disorders in Australia. Thus, this technique is the best RNN model and is employed in further applications to enhance diagnostic measurements regarding olive leaves and other plant leaves.

SpatialPPI: Three-dimensional space protein-protein interaction prediction with AlphaFold Multimer

Rapid advancements in protein sequencing technology have resulted in gaps between proteins with identified sequences and those with mapped structures. Although sequence-based predictions offer insights, they can be incomplete due to the absence of structural details. Conversely, structure-based methods face challenges with respect to newly sequenced proteins. The AlphaFold Multimer has remarkable accuracy in predicting the structure of protein complexes. However, it cannot distinguish whether the input protein sequences can interact. Nonetheless, by analyzing the information in the models predicted by the AlphaFold Multimer, we propose a highly accurate method for predicting protein interactions. This study focuses on the use of deep neural networks, specifically to analyze protein complex structures predicted by the AlphaFold Multimer. By transforming atomic coordinates and utilizing sophisticated image-processing techniques, vital 3D structural details were extracted from protein complexes. Recognizing the significance of evaluating residue distances in protein interactions, this study leveraged image recognition approaches by integrating Densely Connected Convolutional Networks (DenseNet) and Deep Residual Network (ResNet) within 3D convolutional networks for protein 3D structure analysis. When benchmarked against leading protein-protein interaction prediction methods, such as SpeedPPI, D-script, DeepTrio, and PEPPI, our proposed method, named SpatialPPI, exhibited notable efficacy, emphasizing the promising role of 3D spatial processing in advancing the realm of structural biology. The SpatialPPI code is available at: https://github.com/ohuelab/SpatialPPI.

Metode Pembentukan Basis Data Spasial Rambu Lalu Lintas dengan Machine Learning

Traffic signs are part of road equipment whose existence is very important, in addition to functioning as warnings, prohibitions, orders, or instructions for road users, traffic signs are also a means to reduce accidents and regulate driver behavior. Because of the importance of this function, it is necessary to collect accurate sign data in a spatial database. Currently, there have been many database developments for the management of traffic signs, but data collection is still done manually, by means of surveyors recording groups of traffic signs and entering them into the database. The difficulty faced is the time and accuracy of the surveyors when it comes to selecting groups of signs, this is due to the large number of groups/sub-groups of signs. This problem needs to be solved with the help of a sign group detection tool with an image recognition approach. This study aims to develop an image recognition method to extract photo geotagging information on traffic signs into spatial data and attributes of traffic sign groups. The object of the signs that are sampled are signs that are on roads with the status of provincial roads in the Special Region of Yogyakarta. The results showed that the machine learning-based image recognition accuracy reached 88.66%, further research is needed to improve accuracy by paying attention to the geotagging photo capture variable.

Two‐stage coarse‐to‐fine method for pathological images in medical decision‐making systems

AbstractArtificial intelligence decision systems play an important supporting role in the field of medical information. Medical image analysis is an important part of decision systems and an even more important part of medical diagnosis and treatment. The wealth of cellular information in histopathological images makes them a reliable means of diagnosing tumors. However, due to the large size, high resolution, and complex background structure of pathology images, deep learning methods still have various difficulties in the recognition of pathology images. Based on this, this study proposes a two‐stage continuous improvement‐based approach for pathology image recognition in medical decision systems. For pathology images with complex backgrounds, normalization and enhancement is performed to remove the effects of noise color, and light‐dark inconsistencies on the segmentation network. The continuous refinement PSP Net (CRPSPNet) is then designed for accurate recognition of the pathology images. CRPSPNet is divided into two stages: Pyramid Scene Parsing Network segmentation to obtain coarse segmentation results; and continuous refinement model refines the results of the first stage. Experiments using more than 1,000 osteosarcoma pathology images have shown that the method gives more accurate results with fewer computer resources and processing time than traditional optimization models. Its Intersection over Union achieves 0.76.

Transfer Learning and Tuning of Deep Pre-trained Architecture for Face Recognition

Automatic Image Identification is one of the interests of software developers with the application of machine and deep learning methods. With the incorporation of Transfer Learning and Tuning in pre-trained architecture, a substantial increase in the model’s performance is evident. This paper performs face recognition using an image identification and recognition approach. Feature extraction was performed using ResNet50 pre-trained architecture with Support Vector Machine as a classifier. Initial evaluation was made to generate a precision of 62.50%, recall of 65.55%, and f1-score of 63.99%. With this poor performance of ResNet50, the hyperparameters were tuned using transfer learning and tuning. After several times of manual experiments, a significant increase in precision is 93.75%, recall is 94.36%, and f1-score is 94.05%. Based on the remarkable yield of 35.25% for accuracy, 38.79% for recall, and an f1-score of 30.06%, it is advisable to apply the model for image identification and recognition

Advances in Computer-Aided Medical Image Processing

The primary objective of this study is to provide an extensive review of deep learning techniques for medical image recognition, highlighting their potential for improving diagnostic accuracy and efficiency. We systematically organize the paper by first discussing the characteristics and challenges of medical imaging techniques, with a particular focus on magnetic resonance imaging (MRI) and computed tomography (CT). Subsequently, we delve into direct image processing methods, such as image enhancement and multimodal medical image fusion, followed by an examination of intelligent image recognition approaches tailored to specific anatomical structures. These approaches employ various deep learning models and techniques, including convolutional neural networks (CNNs), transfer learning, attention mechanisms, and cascading strategies, to overcome challenges related to unclear edges, overlapping regions, and structural distortions. Furthermore, we emphasize the significance of neural network design in medical imaging, concentrating on the extraction of multilevel features using U-shaped structures, dense connections, 3D convolution, and multimodal feature fusion. Finally, we identify and address the key challenges in medical image recognition, such as data quality, model interpretability, generalizability, and computational resource requirements. By proposing future directions in data accessibility, active learning, explainable AI, model robustness, and computational efficiency, this study paves the way for the successful integration of AI in clinical practice and enhanced patient care.

Recognition of Disease in Leaves Using Genetic Algorithm and Neural Network Based Feature Selection

Objectives : To suggest a suitable image recognition approach for the early recognition of leaf diseases using hybrid features with genetic algorithm and neural network feature selection technique to maximize the accuracy. Methods: Various image processing techniques are utilized to recognize disease in the leaf. In the pre-processing phase, CNN based de-noising is utilized to remove noise from the image. Next, disease part of the leaf is segmented by Pixel wise Classification approach with an optimization technique. Then, the colour and the segmented area of an image is used to remove out texture features. With GLCM and SIFT technique. Then the appropriate features are selected by Genetic Algorithm and Neural Network based feature selection. Extracted features are classified using an Ensemble classifier for recognizing disease in the leaf. For this experiment images are taken from the plant village data set. In this work, the disease caused by Alternaria solani and Pytopthara infestans pathogens is considered for recognizing the disease in the leaf. 1500 leaves are used. From each image, 1654 features are extracted. There is a 70% training and 30% test data split. Classification accuracy, precision and recall measures are considered for evaluating the proposed work’s performance. Findings: The proposed work gives 97.7% classification accuracy, 97.3% precision and 97.5% recall measures with various visual feature descriptors and GANN feature selection. Novelty: The in-depth investigation compares the proposed descriptor GANN_SVM and GANN ES detection and classification technique to local and global SVMs. The suggested descriptor outperforms current approaches for diagnosing Alternaria solani and Pytopthara infestans leaves and the method can be applied to all plants infected leaves. Keywords: Genetic Algorithm; Leaf disease detection; Image processing; Neural Network; ensemble classifier

Classification of Image-Based Wheat Leaf Diseases using Deep Learning Approach: A Survey

This paper focuses on detecting leaf diseases in wheat plants from the beginning to the end of the plant's life cycle. It highlights the best techniques for detecting various types of wheat leaf diseases and emphasizes the use of computer vision, image processing, and machine learning. The main focus is on classifying these diseases through deep convolutional neural networks, a popular image recognition and classification approach. The paper reviews various techniques for classifying image-based wheat leaf diseases, including spot blotch, stripe rust, brown rust, and powdery mildew. The paper aims to summarize the state-of-the-art techniques for detecting wheat leaf diseases.

Cross-Cultural Comparison of Urban Green Space through Crowdsourced Big Data: A Natural Language Processing and Image Recognition Approach

Understanding the relationship between environmental features and perceptions of urban green spaces (UGS) is crucial for UGS design and management. However, quantifying park perceptions on a large spatial and temporal scale is challenging, and it remains unclear which environmental features lead to different perceptions in cross-cultural comparisons. This study addressed this issue by collecting 11,782 valid social media comments and photos covering 36 UGSs from 2020 to 2022 using a Python 3.6-based crawler. Natural language processing and image recognition methods from Google were then utilized to quantify UGS perceptions. This study obtained 32 high-frequency feature words through sentiment analysis and quantified 17 environmental feature factors that emerged using object and scene recognition techniques for photos. The results show that users generally perceive Japanese UGSs as more positive than Chinese UGSs. Chinese UGS users prioritize plant green design and UGS user density, whereas Japanese UGS focuses on integrating specific cultural elements. Therefore, when designing and managing urban greenspace systems, local environmental and cultural characteristics must be considered to meet the needs of residents and visitors. This study offers a replicable and systematic approach for researchers investigating the utilization of UGS on a global scale.

A Conic Radon-based Convolutional Neural Network for Image Recognition

This article presents a new approach for image recognition that proposes to combine Conical Radon Transform (CRT) and Convolutional Neural Networks (CNN). In order to evaluate the performance of this approach for pattern recognition task, we have built a Radon descriptor enhancing features extracted by linear, circular and parabolic RT. The main idea consists in exploring the use of Conic Radon transform to define a robust image descriptor. Specifically, the Radon transformation is initially applied on the image. Afterwards, the extracted features are combined with image and then entered as an input into the convolutional layers. Experimental evaluation demonstrates that our descriptor which joins together extraction of features of different shapes and the convolutional neural networks achieves satisfactory results for describing images on public available datasets such as, ETH80, and FLAVIA. Our proposed approach recognizes objects with an accuracy of 96 % when tested on the ETH80 dataset. It also has yielded competitive accuracy than state-of-the-art methods when tested on the FLAVIA dataset with accuracy of 98 %. We also carried out experiments on traffic signs dataset GTSBR. We investigate in this work the use of simple CNN models to focus on the utility of our descriptor. We propose a new lightweight network for traffic signs that does not require a large number of parameters. The objective of this work is to achieve optimal results in terms of accuracy and to reduce network parameters. This approach could be adopted in real time applications. It classified traffic signs with high accuracy of 99%.

A Randomized Sparsity Preserving Projection and its Exponential Approach for Image Recognition

A Randomized Sparsity Preserving Projection and its Exponential Approach for Image Recognition

Image recognition based on optical reservoir computing.

We propose an image recognition approach using a single physical node based optical reservoir computing. Specifically, an optically injected semiconductor laser with self-delayed feedback is used as the reservoir. We perform a handwritten-digit recognition task by greatly increasing the number of virtual nodes in delayed feedback using outputs from multiple delay times. Final simulation results confirm that the recognition accuracy can reach 99% after systematically optimizing the reservoir hyperparameters. Due to its simple architecture, this scheme may provide a resource-efficient alternative approach to image recognition.

Label Diffusion Graph Learning network for semi-supervised breast histological image recognition

Breast cancer has been a significant cause of female death worldwide, usually recognized by histological images. Due to the outstanding performance of computer-aided methods, many breast histological recognition algorithms are based on deep learning. Nonetheless, these advanced breast cancer recognition approaches exist two primary issues. Firstly, these methods rely on abundant pre-annotated labels, which is an expensive and heavy workload. Besides, they lack the multi-level (both pixel-level and sample-level) feature learning ability to reveal the complex semantic characteristics in histology tissue images. For these challenging problems, we proposed a Label Diffusion Graph Learning (LDGL) method, which can optimize the model in a semi-supervised manner with limited labels, and then adopt graph convolution layers to mine correlations among different breast tissues. Concretely, our LDGL model first employs a convolutional neural network and graph convolution network to extract comprehensive multi-level representations. Then it improves the identification capability through a multi-level consistency loss among unlabeled breast images. Finally, a novel pseudo-label building method is introduced to combine confidence, graph degree, and the expected calibration error to expand labeled data via credible breast samples. To prove the excellent recognition performance of our LDGL model, we compare it with several superior breast cancer histological image recognition approaches. The results indicate that our model (with only 20% labels) achieves 95.05% Accuracy, 95.27% Precision, 95.05% Recall, and 95.0% F1-score, separately. Moreover, we also verify the contribution of each module in LDGL through a series of ablation experiments. In conclusion, the evaluation proves that our LDGL model is excellent and robust for semi-supervised breast histological image recognition task.

Obfuscation detection in Android applications using deep learning

Malware is often hidden in illegitimately cloned software. Android, with over two billions active devices, is one of the most affected platforms because code cloning is quite simple and there are several not controlled markets. Obfuscation is both a cause and a solution to this scenario: a cause because obfuscated malware is harder to detect, a solution because obfuscation of legitimate applications makes code cloning more difficult. A deeper understanding of the obfuscation techniques would lead to more effective and aware use. In the literature, there are few methods of obfuscation detection with limited accuracy. Manual reverse engineering is too time-consuming to achieve this purpose, we need faster and automated techniques.In this work, we propose several deep learning models that can detect and classify the presence of obfuscation in Android applications. In addition to classical ML methods, we leverage natural language processing or image recognition approaches, then with a hybrid model, we exploit the best of each approach. Tests over a large dataset, made using different obfuscation tools, showed improvements compared to previous obfuscation detection methods. We target four obfuscation classes: identifier renaming, string encryption, reflection and class encryption, achieving an average F-measure of 0.985.

Development and Validation of a Model for Laparoscopic Colorectal Surgical Instrument Recognition Using Convolutional Neural Network–Based Instance Segmentation and Videos of Laparoscopic Procedures

Deep learning-based automatic surgical instrument recognition is an indispensable technology for surgical research and development. However, pixel-level recognition with high accuracy is required to make it suitable for surgical automation. To develop a deep learning model that can simultaneously recognize 8 types of surgical instruments frequently used in laparoscopic colorectal operations and evaluate its recognition performance. This quality improvement study was conducted at a single institution with a multi-institutional data set. Laparoscopic colorectal surgical videos recorded between April 1, 2009, and December 31, 2021, were included in the video data set. Deep learning-based instance segmentation, an image recognition approach that recognizes each object individually and pixel by pixel instead of roughly enclosing with a bounding box, was performed for 8 types of surgical instruments. Average precision, calculated from the area under the precision-recall curve, was used as an evaluation metric. The average precision represents the number of instances of true-positive, false-positive, and false-negative results, and the mean average precision value for 8 types of surgical instruments was calculated. Five-fold cross-validation was used as the validation method. The annotation data set was split into 5 segments, of which 4 were used for training and the remainder for validation. The data set was split at the per-case level instead of the per-frame level; thus, the images extracted from an intraoperative video in the training set never appeared in the validation set. Validation was performed for all 5 validation sets, and the average mean average precision was calculated. In total, 337 laparoscopic colorectal surgical videos were used. Pixel-by-pixel annotation was manually performed for 81 760 labels on 38 628 static images, constituting the annotation data set. The mean average precisions of the instance segmentation for surgical instruments were 90.9% for 3 instruments, 90.3% for 4 instruments, 91.6% for 6 instruments, and 91.8% for 8 instruments. A deep learning-based instance segmentation model that simultaneously recognizes 8 types of surgical instruments with high accuracy was successfully developed. The accuracy was maintained even when the number of types of surgical instruments increased. This model can be applied to surgical innovations, such as intraoperative navigation and surgical automation.