Automatic Recognition Method Research Articles

End-to-End Roadway Disease Recognition Based on Transformer Architecture

Road disease is a significant factor causing traffic accidents. Timely detection and recognition of road disease is significant for maintaining road safety and reducing traffic accidents. Therefore, it is urgent to study an automatic pavement disease recognition method with accuracy and real-time. However, existing real-time target detectors generally use a convolutional neural network-based architecture, and these detectors usually require post-processing of NMS, which makes the detectors difficult to optimize and unstable, resulting in a delay in reasoning speed. Therefore, we design a target detection model based on Transformer, which uses MobileNet as the backbone network to simplify the network structure and enables interaction and integration of features through an efficient hybrid encoder, which reduces the computational load and does not reduce the detection accuracy. Iou-aware query selection optimizes the object query vector in the Transformer structure and reduces the number of candidate boxes that the model needs to process. The experimental results show that we have achieved good results on the RDD2022 dataset.

Risk assessment and automatic identification of autistic children based on appearance

The diagnosis of Autism Spectrum Disorder (ASD) is mainly based on some diagnostic scales and evaluations by professional doctors, which may have limitations such as subjectivity, time, and cost. This research introduces a novel assessment and auto-identification approach for autistic children based on the appearance of children, which is a relatively objective, fast, and cost-effective approach. Initially, a custom social interaction scenario was developed, followed by a facial data set (ACFD) that contained 187 children, including 92 ASD and 95 children typically developing (TD). Using computer vision techniques, some appearance features of children including facial appearing time, eye concentration analysis, response time to name calls, and emotional expression ability were extracted. Subsequently, these features were combined and machine learning methods were used for the classification of children. Notably, the Bayes classifier achieved a remarkable accuracy of 94.1%. The experimental results show that the extracted visual appearance features can reflect the typical symptoms of children, and the automatic recognition method can provide an auxiliary diagnosis or data support for doctors.

HCTC: Hybrid Convolutional Transformer Classifier for Automatic Modulation Recognition

Automatic modulation recognition (AMR) methods used in advanced wireless communications systems can identify unknown signals without requiring reference information. However, the acceptance of these methods depends on the accuracy, number of parameters, and computational complexity. This study proposes a hybrid convolutional transformer classifier (HCTC) for the classification of unknown signals. The proposed method utilizes a three-stage framework to extract features from in-phase/quadrature (I/Q) signals. In the first stage, spatial features are extracted using a convolutional layer. In the second stage, temporal features are extracted using a transformer encoder. In the final stage, the features are mapped using a deep-learning network. The proposed HCTC method is investigated using the benchmark RadioML database and compared with state-of-the-art methods. The experimental results demonstrate that the proposed method achieves a better performance in modulation signal classification. Additionally, the performance of the proposed method is evaluated when applied to different batch sizes and model configurations. Finally, open issues in modulation recognition research are addressed, and future research perspectives are discussed.

IC-IE-AKS-O: an automatic recognition method for coastal slope landslide areas

Automatically and accurately identifying the deformation zone of coastal slope landslides is crucial for exploring the mechanism of landslides and predicting landslide disasters. To this end, this study proposes an integrated automatic recognition method combining Image Clipping (IC), Image Information Enhancement (IE), Adaptive K-means Clustering Segmentation (AKS), and Optimization (O): IC-IE-AKS-O, which achieves precise extraction of the deformation area in coastal slope landslide images. Firstly, due to the more complex natural environment of field slopes, to extend the monitoring duration, we introduce a hierarchical operation algorithm based on the HSV color model, which effectively mitigates the impact of sunlight, rain, and foggy weather on image recognition accuracy. Secondly, this study proposes a 2D landslide image segmentation technique that combines K-means clustering with global threshold segmentation for landslide images, enabling the segmentation of small image regions with precision. Finally, we combine image information enhancement technology with image segmentation technology. To verify its effectiveness, we identify a landslide image of a coastal slope in Pingtan. The method displays an average relative error of 5.20% and 5.14% in the X and Y directions, respectively. Its advantages are threefold: (1) The combination of image information enhancement and segmentation techniques can more accurately identify landslide areas that appear blurred in the image; (2) expanding the temporal dimension of coastal slope monitoring; (3) providing excellent boundary conditions and segmentation results. The practical application of this method ensures the stable and accurate operation of the coastal slope monitoring system, providing a safeguard for the sustainable development of marine safety.

A Tobacco Brand Recognition Method Based on HOG and SVM

The appearance inspection system cannot automatically switch the brand, and a person needs to log into the system and manually switch the inspection brand in the process of production and brand change. To address this problem, a deep learning-based automatic cigarette brand recognition method is developed and validated. Experiments show that: the system can automatically detect the production brand, effectively save the time to change the brand, and has important reference significance for the application in the field of brand identification and automatic switching detection of the brand.

Study on automatic and rapid diagnosis of distal radius fracture by X-ray

This article aims to combine deep learning with image analysis technology and propose an effective classification method for distal radius fracture types. Firstly, an extended U-Net three-layer cascaded segmentation network was used to accurately segment the most important joint surface and non joint surface areas for identifying fractures. Then, the images of the joint surface area and non joint surface area separately were classified and trained to distinguish fractures. Finally, based on the classification results of the two images, the normal or ABC fracture classification results could be comprehensively determined. The accuracy rates of normal, A-type, B-type, and C-type fracture on the test set were 0.99, 0.92, 0.91, and 0.82, respectively. For orthopedic medical experts, the average recognition accuracy rates were 0.98, 0.90, 0.87, and 0.81, respectively. The proposed automatic recognition method is generally better than experts, and can be used for preliminary auxiliary diagnosis of distal radius fractures in scenarios without expert participation.

Non-Intrusive System for Honeybee Recognition Based on Audio Signals and Maximum Likelihood Classification by Autoencoder.

Artificial intelligence and Internet of Things are playing an increasingly important role in monitoring beehives. In this paper, we propose a method for automatic recognition of honeybee type by analyzing the sound generated by worker bees and drone bees during their flight close to an entrance to a beehive. We conducted a wide comparative study to determine the most effective preprocessing of audio signals for the detection problem. We compared the results for several different methods for signal representation in the frequency domain, including mel-frequency cepstral coefficients (MFCCs), gammatone cepstral coefficients (GTCCs), the multiple signal classification method (MUSIC) and parametric estimation of power spectral density (PSD) by the Burg algorithm. The coefficients serve as inputs for an autoencoder neural network to discriminate drone bees from worker bees. The classification is based on the reconstruction error of the signal representations produced by the autoencoder. We propose a novel approach to class separation by the autoencoder neural network with various thresholds between decision areas, including the maximum likelihood threshold for the reconstruction error. By classifying real-life signals, we demonstrated that it is possible to differentiate drone bees and worker bees based solely on audio signals. The attained level of detection accuracy enables the creation of an efficient automatic system for beekeepers.

Classification and identification of extreme wind events by CNNs based on Shapelets and improved GASF-GADF

In this manuscript, we propose an automatic classification and recognition method for extreme wind events based on Convolutional Neural Networks (CNNs) and combining the Shapelet Transform (ST) algorithm with the improved Gramian Angular Summation Field - Gramian Angular Difference Field (GASF-GADF) 2D images construction format. First, a CNN model suitable for wind speed time series 2D images classification and recognition among five mainstream CNNs (ResNet-50, ShuffleNet0.5 × , DenseNet-121, EfficientNet-B2, and EfficientNetV2-S) is preferred based on the basic Gramian Angular Field (GAF) method; then, the improved GASF-GADF images construction format is proposed, and the optimal CNN is used to compare the classification and recognition results based on other three image conversion methods: Markov Transition Field (MTF), GASF, GADF. Last, it is proposed to utilize the ST algorithm to extract the feature subsequence Shapelets of wind speed time series to further improve the classification and recognition effect on extreme wind events. The effectiveness and applicability of the proposed method were verified through three extreme wind event datasets in this paper.The results show that the combination of Shapelets and the improved GASF-GADF images transformation method proposed in this paper can effectively enhance the classification and recognition of extreme wind events by CNNs. Among them, EfficientNetV2-S combined with the method proposed in this paper achieves 99.50%, 99.50% and 97.50% recognition Accuracy for thunderstorm, gust front and typhoon, respectively. Meanwhile, it still has good robustness for extreme wind events disturbed by noise.

A Collaborative Neural Network-based Automatic Object Recognition Method For Environmental Space Under Virtual Reality Scenes

A Collaborative Neural Network-based Automatic Object Recognition Method For Environmental Space Under Virtual Reality Scenes

One2ThreeNet: An Automatic Microscale-Based Modulation Recognition Method for Underwater Acoustic Communication Systems

One2ThreeNet: An Automatic Microscale-Based Modulation Recognition Method for Underwater Acoustic Communication Systems

An automatic recognition method for power quality disturbances based on CAB-Net

Abstract The accurate identification of power quality disturbances (PQDs) is crucial for maintaining the stability and reliability of power systems. In this paper, an automatic identification method for PQDs based on CNN-BiGRU-Attention Network (CAB-Net) is proposed. To handle the temporal characteristics and complexity of composite PQDs signals, the proposed model leverages the bidirectional information transmission of the BiGRU model to efficiently extract temporal features. Furthermore, to boost recognition accuracy, an attention mechanism is incorporated, the key information can be intelligently locked in the feature extraction stage, and the information can be efficiently screened and utilized, thereby enhancing its ability to identify power quality disturbance signals. To confirm the validity of the method, we use the simulation data for experimental proof. Experimental results demonstrate that compared to traditional power quality disturbance identification methods, the method has excellent recognition ability and stronger robustness.

Research note: A method for recognizing and evaluating typical behaviors of laying hens in a thermal environment

Automatically identifying abnormal behaviors of caged laying hens in a thermal environment improves manual management efficiency. It also provides reference indicators for breeding heat-tolerant hens. In this study, we propose a deep learning-based method for automatic recognition and evaluation of typical heat stress behaviors in hens. We developed a lightweight object detection algorithm, YOLO-HGP, based on the YOLOv8n as the baseline model. YOLO-HGP achieves Precision (P), Recall (R), and mean average precision (mAP) of 95.952%, 94.127%, and 97.667%, respectively, effectively detecting typical heat stress behaviors in hens. Compared to the original YOLO v8n, YOLO-HGP improves R, and mAP by 6.257%, and 1.963%, respectively. The FLOPs (floating point operations) and parameter count of YOLO-HGP are 4.3G and 1.729M, reducing by 47.56% and 42.58% compared to the original model. Additionally, we introduce the "ORC-ratio" (The ratio of the combined frequency of open-beak breathing and retching behaviors to the frequency of closed-beak behaviors.) as an evaluation indicator for the frequency of typical heat stress behaviors in hens and combine it with the Hybrid-SORT multiobject tracking algorithm to achieve tracking detection of individual hens. The study demonstrates that the proposed model effectively identifies and quantitatively evaluates typical behaviors of hens in a thermal environment, providing an effective approach for the automated recognition of heat stress behaviors in hens.

Automatic recognition of excavator working cycles using supervised learning and motion data obtained from inertial measurement units (IMUs)

This paper proposes an automatic method for excavator working cycle recognition using supervised classification methods and motion information obtained from four inertial measurement units (IMUs) attached to moving parts of an excavator. Monitoring and analyzing tasks that have been performed by heavy-duty mobile machines (HDMMs) are significantly required to assist management teams in productivity and progress monitoring, efficient resource allocation, and scheduling. Nevertheless, traditional methods depend on human observations, which are costly, time-consuming, and error-prone. There is a lack of a method to automatically detect excavator major activities. In this paper, a data-driven method is presented to identify excavator activities, including loading, trenching, grading, and idling, using motion information, such as angular velocities and joint angles, obtained from moving parts, including swing body, boom, arm, and bucket. Firstly, a dataset lasting 3 h is collected using a medium-rated excavator. One experienced and one inexperienced operator performed tasks under different working conditions, such as different types of material, swing angle, digging depth, and weather conditions. Four classification methods, including support vector machine (SVM), k-nearest neighbor (KNN), decision tree (DT), and naive Bayes, are off-line trained. The results show that the proposed method can effectively identify excavator working cycles with a high accuracy of 99%. Finally, the impacts of parameters, such as time window, overlapping configuration, and feature selection methods, on the classification accuracy are comprehensively analyzed.

Research on automated rapid diagnosis of distal radius fractures using X-ray images

The primary diagnostic method for distal radius fractures remains conventional X-ray imaging. In emergency situations, rapid assessment and decision-making are often required from non-orthopedic physicians or junior radiologists in the emergency room. Therefore, an accurate and efficient auxiliary diagnostic technology for distal radius fractures is of great significance. This paper combines deep learning with image analysis techniques to propose an effective classification method for types of distal radius fractures. Firstly, an extended U-Net three-level cascade segmentation network is used for precise segmentation of the most critical joint surface and non-joint surface areas for fracture identification. The edge is further optimized using the central pixel image block classification method. Then, fracture identification is performed separately on the joint surface and non-joint surface areas. Finally, based on the classification results of the two types of images, a comprehensive judgment is made to determine normal or ABC fracture types. The experimental X-ray data comes from three tertiary hospitals, with a total of 12,000 images in the training set, 3,000 of each type, and 1,200 images in the test set, 300 of each type. To further demonstrate the generalization performance of the classification experiment, an additional 500 images were added for fracture classification testing, coming from collaborative medical institutions in the United States and Germany. All images were annotated by orthopedic medical experts with more than ten years of experience. The accuracy rates for normal, type A, type B, and type C fractures in the test set were 0.99, 0.92, 0.91, and 0.82, respectively. For orthopedic medical experts, the average recognition accuracy rates were 0.98, 0.90, 0.87, and 0.81. The proposed automatic recognition method overall performs better than experts and can be used for preliminary auxiliary diagnosis of distal radius fractures without expert participation.

Research on automated rapid diagnosis of distal radius fractures using X-ray images

The primary diagnostic method for distal radius fractures remains conventional X-ray imaging. In emergency situations, rapid assessment and decision-making are often required from non-orthopedic physicians or junior radiologists in the emergency room. Therefore, an accurate and efficient auxiliary diagnostic technology for distal radius fractures is of great significance. This paper combines deep learning with image analysis techniques to propose an effective classification method for types of distal radius fractures. Firstly, an extended U-Net three-level cascade segmentation network is used for precise segmentation of the most critical joint surface and non-joint surface areas for fracture identification. The edge is further optimized using the central pixel image block classification method. Then, fracture identification is performed separately on the joint surface and non-joint surface areas. Finally, based on the classification results of the two types of images, a comprehensive judgment is made to determine normal or ABC fracture types. The experimental X-ray data comes from three tertiary hospitals, with a total of 12,000 images in the training set, 3,000 of each type, and 1,200 images in the test set, 300 of each type. To further demonstrate the generalization performance of the classification experiment, an additional 500 images were added for fracture classification testing, coming from collaborative medical institutions in the United States and Germany. All images were annotated by orthopedic medical experts with more than ten years of experience. The accuracy rates for normal, type A, type B, and type C fractures in the test set were 0.99, 0.92, 0.91, and 0.82, respectively. For orthopedic medical experts, the average recognition accuracy rates were 0.98, 0.90, 0.87, and 0.81. The proposed automatic recognition method overall performs better than experts and can be used for preliminary auxiliary diagnosis of distal radius fractures without expert participation.

An Automatic Method for Elbow Joint Recognition, Segmentation and Reconstruction.

Elbow computerized tomography (CT) scans have been widely applied for describing elbow morphology. To enhance the objectivity and efficiency of clinical diagnosis, an automatic method to recognize, segment, and reconstruct elbow joint bones is proposed in this study. The method involves three steps: initially, the humerus, ulna, and radius are automatically recognized based on the anatomical features of the elbow joint, and the prompt boxes are generated. Subsequently, elbow MedSAM is obtained through transfer learning, which accurately segments the CT images by integrating the prompt boxes. After that, hole-filling and object reclassification steps are executed to refine the mask. Finally, three-dimensional (3D) reconstruction is conducted seamlessly using the marching cube algorithm. To validate the reliability and accuracy of the method, the images were compared to the masks labeled by senior surgeons. Quantitative evaluation of segmentation results revealed median intersection over union (IoU) values of 0.963, 0.959, and 0.950 for the humerus, ulna, and radius, respectively. Additionally, the reconstructed surface errors were measured at 1.127, 1.523, and 2.062 mm, respectively. Consequently, the automatic elbow reconstruction method demonstrates promising capabilities in clinical diagnosis, preoperative planning, and intraoperative navigation for elbow joint diseases.

Research on coal-rock identification method and data augmentation algorithm of comprehensive working face based on FL-Segformer

Coal-rock interface identification technology was pivotal in automatically adjusting the shearer’s cutting drum during coal mining. However, it also served as a technical bottleneck hindering the advancement of intelligent coal mining. This study aimed to address the poor accuracy of current coal-rock identification technology on comprehensive working faces, coupled with the limited availability of coal-rock datasets. The loss function of the SegFormer model was enhanced, the model’s hyperparameters and learning rate were adjusted, and an automatic recognition method was proposed for coal-rock interfaces based on FL-SegFormer. Additionally, an experimental platform was constructed to simulate the dusty environment during coal-rock cutting by the shearer, enabling the collection of coal-rock test image datasets. The morphology-based algorithms were employed to expand the coal-rock image datasets through image rotation, color dithering, and Gaussian noise injection so as to augment the diversity and applicability of the datasets. As a result, a coal-rock image dataset comprising 8424 samples was generated. The findings demonstrated that the FL-SegFormer model achieved a Mean Intersection over Union (MIoU) and mean pixel accuracy (MPA) of 97.72% and 98.83%, respectively. The FL-SegFormer model outperformed other models in terms of recognition accuracy, as evidenced by an MIoU exceeding 95.70% of the original image. Furthermore, the FL-SegFormer model using original coal-rock images was validated from No. 15205 working face of the Yulin test mine in northern Shaanxi. The calculated average error was only 1.77%, and the model operated at a rate of 46.96 frames per second, meeting the practical application and deployment requirements in underground settings. These results provided a theoretical foundation for achieving automatic and efficient mining with coal mining machines and the intelligent development of coal mines.

Finite-Element Analysis of Temperature Field and Effect on Steel-Concrete Composite Pylon of Cable-Stayed Bridge without Backstays

The backless cable-stayed bridge has the advantages of beautiful shape and reasonable force, but due to the low overall stiffness of the bridge pylon during cantilever construction, it is susceptible to the effect of solar temperature. To reveal the temperature deformation laws and achieve accurate alignment prediction during the installation process of steel–concrete composite pylons in complex environments, a refined numerical simulation model for the 3D bridge temperature field was established based on the proposed automatic sunshine-shadow recognition method. Subsequently, the optimal time periods for construction control are provided. The results of the study show that, during the cantilever construction of the bridge pylon, one pylon column will shade the other pylon column, resulting in asynchronous deformation that can reach 7.6 mm. The effect of solar temperature on the displacement of the bridge pylon is significant, where the maximum daily change in transverse displacement in the cantilevered state of the pylon can reach 33.6 mm, and the maximum change in cable force value can reach 52 kN. In order to mitigate the effect of solar radiation, the best construction time for the bridge pylon is 19:30~9:30, while the tensioning and measurement of the cable should be avoided from 6:00~18:00. This strategy ensures that the control of the pylon top displacement is maintained within 1/4000 of the pylon height, and the error in cable force is kept within 5%.

A Review on Autism Spectrum Disorder Screening by Artificial Intelligence Methods.

With the increasing prevalence of autism spectrum disorders (ASD), the importance of early screening and diagnosis has been subject to considerable discussion. Given the subtle differences between ASD children and typically developing children during the early stages of development, it is imperative to investigate the utilization of automatic recognition methods powered by artificial intelligence. We aim to summarize the research work on this topic and sort out the markers that can be used for identification. We searched the papers published in the Web of Science, PubMed, Scopus, Medline, SpringerLink, Wiley Online Library, and EBSCO databases from 1st January 2013 to 13th November 2023, and 43 articles were included. These articles mainly divided recognition markers into five categories: gaze behaviors, facial expressions, motor movements, voice features, and task performance. Based on the above markers, the accuracy of artificial intelligence screening ranged from 62.13 to 100%, the sensitivity ranged from 69.67 to 100%, the specificity ranged from 54 to 100%. Therefore, artificial intelligence recognition holds promise as a tool for identifying children with ASD. However, it still needs to continually enhance the screening model and improve accuracy through multimodal screening, thereby facilitating timely intervention and treatment.

Automatic Modulation Recognition Method Based on Phase Transformation and Deep Residual Shrinkage Network

Automatic Modulation Recognition (AMR) is currently a research hotspot, and research under low Signal-to-Noise Ratio (SNR) conditions still poses certain challenges. This paper proposes an AMR method based on phase transformation and deep residual shrinkage network to improve recognition accuracy. Firstly, the raw I/Q data from the benchmark dataset RML2016.10a are used as the input. Then, an end-to-end modulation recognition is performed using the model. Phase transformation is used to correct the raw I/Q data and reduce the interference of phase shift on modulation recognition. Convolutional neural network (CNN) and Gate Recurrent Unit (GRU) extract the spatial and temporal features of the modulation signal, respectively. The improved deep residual shrinkage network is added after CNN to eliminate unimportant features through soft thresholding. Finally, the proposed model is trained and tested. The experimental results show that the proposed model notably reduces the number of parameters compared to other models, effectively improving the recognition accuracy under low SNR conditions. The average recognition accuracy reaches 62.46%, and the highest recognition accuracy reaches 92.41%.