Feature Extraction Model Research Articles

Object identification using Interleaved feature extraction model

Object identification using Interleaved feature extraction model

Utilizing language models for advanced electrocardiogram analysis

Electrocardiography (ECG) signals are often referred to as the language of the heart and have been widely utilized for diagnosing various heart ailments, particularly arrhythmias. Consequently, numerous machine learning models have been employed to automatically detect heart disorders using ECG signals. In this research, the primary objective is to detect arrhythmias using a center-symmetric self-organized textual pattern. A novel feature engineering model has been introduced, which includes the following components: (i) multilevel feature extraction using the proposed center-symmetric self-organized textual pattern (CSSOTP), (ii) iterative neighborhood component analysis (INCA), and (iii) classification using k-nearest neighbors (kNN) with 10-fold cross-validation. During the feature extraction phase, a multilevel feature extraction model incorporating maximum absolute pooling (MAP) and the proposed CSSOTP was applied. The CSSOTP was designed to select the most appropriate pattern for the given data block. A large language model (LLM) was leveraged to generate text for creating patterns, and ChatGPT was used to assist in text generation. To identify the most informative features, the INCA feature selector was employed, and the selected features were subsequently classified using the kNN classifier. An impressive 96.20 % classification accuracy was achieved by the CSSOTP-based feature engineering model when tested on an ECG dataset containing 17 classes. Furthermore, comparisons with state-of-the-art feature engineering models were conducted, demonstrating that the proposed model has superior classification capabilities.

Design of Intelligent Financial System Based on Adaptive Learning Algorithm

The high-frequency trading system in the financial domain has long been a focal point of investigation. This study posits an intelligent financial system design framework predicated on a cross-adaptive self-entropy projection clustering model, aimed at enhancing the efficacy of high-frequency trading systems. A composite distribution model of financial data is formulated to derive sequences of financial data activities. And cross-adaptive learning algorithm is employed to ascertain the interrelated attributes of financial data. Following this, the support vector machine algorithm is applied for the classification processing of these interrelated features, yielding a set of financial data feature vectors, which are then fed into the gray correlation-based information feature extraction model. Through extensive empirical evaluations with authentic trading data, the proposed intelligent financial system design framework exhibits commendable performance, furnishing a viable solution for the intelligent optimization of high-frequency trading systems.

Novel Hybrid Quantum Architecture-Based Lung Cancer Detection Using Chest Radiograph and Computerized Tomography Images.

Lung cancer, the second most common type of cancer worldwide, presents significant health challenges. Detecting this disease early is essential for improving patient outcomes and simplifying treatment. In this study, we propose a hybrid framework that combines deep learning (DL) with quantum computing to enhance the accuracy of lung cancer detection using chest radiographs (CXR) and computerized tomography (CT) images. Our system utilizes pre-trained models for feature extraction and quantum circuits for classification, achieving state-of-the-art performance in various metrics. Not only does our system achieve an overall accuracy of 92.12%, it also excels in other crucial performance measures, such as sensitivity (94%), specificity (90%), F1-score (93%), and precision (92%). These results demonstrate that our hybrid approach can more accurately identify lung cancer signatures compared to traditional methods. Moreover, the incorporation of quantum computing enhances processing speed and scalability, making our system a promising tool for early lung cancer screening and diagnosis. By leveraging the strengths of quantum computing, our approach surpasses traditional methods in terms of speed, accuracy, and efficiency. This study highlights the potential of hybrid computational technologies to transform early cancer detection, paving the way for wider clinical applications and improved patient care outcomes.

A lightweight dual-attention network for tomato leaf disease identification.

Tomato disease image recognition plays a crucial role in agricultural production. Today, while machine vision methods based on deep learning have achieved some success in disease recognition, they still face several challenges. These include issues such as imbalanced datasets, unclear disease features, small inter-class differences, and large intra-class variations. To address these challenges, this paper proposes a method for classifying and recognizing tomato leaf diseases based on machine vision. First, to enhance the disease feature details in images, a piecewise linear transformation method is used for image enhancement, and oversampling is employed to expand the dataset, compensating for the imbalanced dataset. Next, this paper introduces a convolutional block with a dual attention mechanism called DAC Block, which is used to construct a lightweight model named LDAMNet. The DAC Block innovatively uses Hybrid Channel Attention (HCA) and Coordinate Attention (CSA) to process channel information and spatial information of input images respectively, enhancing the model's feature extraction capabilities. Additionally, this paper proposes a Robust Cross-Entropy (RCE) loss function that is robust to noisy labels, aimed at reducing the impact of noisy labels on the LDAMNet model during training. Experimental results show that this method achieves an average recognition accuracy of 98.71% on the tomato disease dataset, effectively retaining disease information in images and capturing disease areas. Furthermore, the method also demonstrates strong recognition capabilities on rice crop disease datasets, indicating good generalization performance and the ability to function effectively in disease recognition across different crops. The research findings of this paper provide new ideas and methods for the field of crop disease recognition. However, future research needs to further optimize the model's structure andcomputational efficiency, and validate its application effects in more practical scenarios.

Fault Diagnosis of Rolling Bearings in Agricultural Machines Using SVD-EDS-GST and ResViT

In the complex and harsh environment of agriculture, rolling bearings, as the key transmission components in agricultural machinery, are very prone to failure, so research on the intelligent fault diagnosis of agricultural machinery components is critical. Therefore, this paper proposes a new method based on SVD-EDS-GST and ResNet-Vision Transformer (ResViT) for the fault diagnosis of rolling bearings in agricultural machines. Firstly, an experimental platform for rolling bearing failure in agricultural machinery is built, and one-dimensional vibration signals are obtained using acceleration sensors. Next, the signal is preprocessed for noise reduction using singular value decomposition (SVD) combined with the energy difference spectrum (EDS) to solve for the interference of complex noise and redundant components in the vibration signal. Secondly, generalized S-transform (GST) is used to process vibration signals into images. Then, the ResViT model is proposed, where the ResNet34 network is used to replace the image chunking mechanism in the original Vision Transformer model for feature extraction. Finally, an improved Vision Transformer (ViT) is utilized to synthesize global and local information for fault classification. The experimental results show that the proposed method’s average accuracy in rolling bearing fault classification for agricultural machinery reaches 99.08%. In addition, compared with SVD-EDS-GST-CNN, SVD-EDS-GST-LSTM, STFT-ViT, GST-ViT, and SVD-EDS-GST-ViT, the accuracy rate was improved by 3.5%, 3.84%, 4.8%, 8.02%, and 0.56%, and the standard deviation was also minimized.

Hybrid convolutional neural network-long short-term memory combined model for arrhythmia classification

The automated examination of electrocardiogram (ECG) signals holds significant importance within the medical field for managing various critical cardiac conditions. Identifying cardiomyopathy and arrhythmias is presently recognized as a challenging endeavor. While machine learning techniques have garnered substantial attention for categorizing these patterns, a predominant focus has been on the classification of arrhythmias. However, existing studies have overlooked instances where arrhythmia leads to cardiomyopathy, a specific cardiac disease scenario. In our research, we introduce an innovative method aimed at distinguishing between cardiomyopathy and cardiomyopathy accompanied by arrhythmia by employing a convolutional neural network (CNN-based) model. This novel approach fills the gap in existing literature by addressing the critical need to classify cases where arrhythmia induces cardiomyopathy, thereby presenting a potential advancement in accurately identifying and managing complex cardiac conditions. The proposed model uses convolution-based CNN model for feature extraction and combines these features with temporal features. Further, a CNN combined long short-term memory (CNN-LSTM) model is presented for classification where CNN models help to obtain the spatial information and LSTM helps to retain the temporal information resulting in improved classification accuracy. the experimental analysis is carried out into two phases where we have classified the rhythms and arrhythmias.

Risk early warning model of tunnel engineering based on computer vision and CNN

Abstract Safety management in tunnel construction is important to ensure the safety of construction personnel and equipment. This paper proposes a tunnel engineering risk early warning model based on computer vision and convolutional neural network (CNN), aiming at realizing real-time monitoring and risk early warning of the construction site using modern image processing technology and deep learning algorithm. Many image data of tunnel engineering construction sites were collected, and the data were preprocessed and marked. Then, the paper designs a depth CNN model for feature extraction and risk identification of construction site images. Through the performance evaluation of the model on the training set and test set, the effectiveness and feasibility of the model in risk early warning are verified. The experimental results show that the proposed model achieves high accuracy, recall, and F1 score on the test set, which is superior to the traditional method based on image features and artificial rules. At the same time, we analyzed the prediction results of the model on the actual construction site images. We found that the model can effectively identify different risk factors and has strong generalization ability and practicability. To sum up, this study provides a new technical means and solution for the safety management of tunnel engineering, which has important theoretical and practical significance.

Unsupervised discriminative projection based on contrastive learning

Feature extraction can effectively alleviate the curse of dimensionality on high-dimensional data. Contrastive learning, as a self-supervised learning method, has garnered widespread attention in recent years. In this study, we propose a new unsupervised feature extraction model based on contrastive learning. We integrate the principle of contrastive learning into the feature extraction model in a novel way without data augmentation or negative samples, defining positive samples more accurately and flexibly. Additionally, we propose new structure preserving terms based on the selected positive samples to preserve the distribution structure of specific categories. An iterative algorithm is designed to solve the proposed model. Numerical experiments on four real datasets demonstrate that our method outperforms existing methods, highlighting its potential in handling high-dimensional data and extracting discriminative features.

Advanced differential evolution for gender-aware English speech emotion recognition

Speech emotion recognition (SER) technology involves feature extraction and prediction models. However, recognition efficiency tends to decrease because of gender differences and the large number of extracted features. Consequently, this paper introduces a SER system based on gender. First, gender and emotion features are extracted from speech signals to develop gender recognition and emotion classification models. Second, according to gender differences, distinct emotion recognition models are established for male and female speakers. The gender of speakers is determined before executing the corresponding emotion model. Third, the accuracy of these emotion models is enhanced by utilizing an advanced differential evolution algorithm (ADE) to select optimal features. ADE incorporates new difference vectors, mutation operators, and position learning, which effectively balance global and local searches. A new position repairing method is proposed to address gender differences. Finally, experiments on four English datasets demonstrate that ADE is superior to comparison algorithms in recognition accuracy, recall, precision, F1-score, the number of used features and execution time. The findings highlight the significance of gender in refining emotion models, while mel-frequency cepstral coefficients are important factors in gender differences.

Deep Learning Approach to Detect Fake Video on Raspberry PI

Abstract: This project proposes a deep learning-based approach for real-time detection of fake videos on a resource-constrained device, specifically the Raspberry Pi. The solution combines the power of computer vision and recurrent neural networks to discern manipulated content from authentic videos effectively. The methodology involves using a pre-trained ResNeXt model for feature extraction, capturing spatial information from each video frame. These features are then fed into a Long Short-Term Memory (LSTM) network, allowing the model to understand and exploit temporal dependencies within the sequence of frames. The LSTM network learns patterns and nuances indicative of authentic or manipulated video content. The training process involves a carefully curated dataset containing both real and fake videos. The model is fine-tuned to optimize its performance, and metrics such as accuracy, precision, recall, and F1 score are employed for evaluation. To accommodate the constraints of the Raspberry Pi, the model is further optimized through techniques such as quantization, ensuring a balance between model size and inference accuracy. The final model is deployed on the Raspberry Pi, with a user-friendly interface capturing video frames in real-time. The system provides instantaneous feedback, indicating whether the observed video content is genuine or manipulated. This project contributes to the growing field of deepfake detection while addressing the challenges of implementing sophisticated models on edge devices. The combination of ResNeXt and LSTM offers a robust solution for discerning manipulated videos, making it suitable for real-world applications where computational resources are limited.

Conversations in the wild: Data collection, automatic generation and evaluation

The aim of conversational speech processing is to analyze human conversations in natural settings. It finds numerous applications in personality traits identification, speech therapy, speaker identification and verification, speech emotion detection, and speaker diarization. However, large-scale annotated datasets required for feature extraction and conversational model training only exist for a handful of languages (e.g. English, Mandarin, and French) as the gathering, cleaning, and annotation of such datasets is tedious, time-consuming, and expensive. We propose two scalable, language-agnostic algorithms for automatically generating multi-speaker, variable-length, spontaneous conversations. These algorithms synthesize conversations using existing non-conversational speech datasets. We also contribute the resulting datasets (283 hours, 50 speakers). As a comparison, we also gathered the first spontaneous conversational dataset for Urdu (24 hours, 212 speakers) from public talk shows. Using speaker diarization as an example, we evaluate our datasets and report the first baseline diarization error rates (DER) for Urdu (25% for synthetic dataset-based models, and 29% for natural conversations). Our conversational speech generation technique allows training speaker diarization pipelines without the need for preparing huge conversational repositories.

Improving Machine Learning Predictive Capacity for Supply Chain Optimization through Domain Adversarial Neural Networks

In today’s dynamic business environment, the accurate prediction of sales orders plays a critical role in optimizing Supply Chain Management (SCM) and enhancing operational efficiency. In a rapidly changing, Fast-Moving Consumer Goods (FMCG) business, it is essential to analyze the sales of the products and accordingly plan the supply. Due to low data volume and complexity, traditional forecasting methods struggle to capture intricate patterns. Domain Adversarial Neural Networks (DANNs) offer a promising solution by integrating transfer learning techniques to improve prediction accuracy across diverse datasets. This study presents a new sales order prediction framework that combines DANN-based feature extraction and various machine learning models. The DANN method generalizes the data, maintaining the data behavior’s originality. The approach addresses challenges like limited data availability and high variability in sales behavior. Using the transfer learning approach, the DANN model is trained on the training data, and this pre-trained DANN model extracts relevant features from unknown products. In contrast, Machine Learning (ML) algorithms are used to build predictive models based on it. The hyperparameter tuning of ensemble models such as Decision Tree (DT) and Random Forest (RF) is also performed. Models like the DT and RF Regressor perform better than Linear Regression and Support Vector Regressor. Notably, even without hyperparameter tuning, the Extreme Gradient Boost (XGBoost) Regressor model outperforms all the other models. This comprehensive analysis highlights the comparative benefits of various models and establishes the superiority of XGBoost in predicting sales orders effectively.

LCFE-X: Pluggable Local Channel Feature Extraction model enhancement method for hyperspectral image classification

Spectral information of hyperspectral images offers high-dimensional features for downstream tasks. Local spectral signatures in different wavelength ranges are critical for material identification and pixel classification. In line with conventional vision methods, recent studies have focused on bolstering the spatial modelling capabilities of transformers. However, the focus remains predominantly global when the channel dimension is considered. Current research on enhancing local channel feature extraction is primarily model specific and lacks generalisable methods that can be applied to various models. Therefore, this study introduces a Local Channel Feature Extraction (LCFE) module. It extracts spectral-spatial features and key features within each band group and then integrates the features to obtain local channel features. Subsequently, a pluggable LCFE-X model enhancement method is proposed. This involves performing LCFE at the front end of the model and fusing the extracted features with the original features. Three enhanced hyperspectral image classification models, namely, LCFE-ViT, LCFE-SF, and LCFE-MF, are constructed based on recently proposed models. Extensive experiments demonstrate that the LCFE module effectively extracts local spectral signatures, and the proposed method enhances the performance of the various basic models. The code is available at https://github.com/YiSu1997/LCFE-X.

Hydrogen solubility in different chemicals: A modelling approach and review of literature data

Hydrogen (H2) solubility is a crucial parameter for industrial processes. This study utilises various Machine Learning (ML) techniques, including Decision Tree (DT), Multilayer Perceptron (MLP), Random Forest (RF), and Extremely Randomized Trees (ET), to predict H2 solubility across diverse chemical classes, encompassing n-alkanes, aliphatic and aromatic hydrocarbons, alcohols, aldehydes, diols, esters, ethers, ketones, and halides. An extensive database of 4337 samples of H2 solubility in 100 different chemicals was compiled from open literature. Problematic samples were identified through preprocessing. Three input sets were utilised for model development to determine the optimal combination of regressors. It was found that including dimensionless pressure and temperature significantly improved modelling accuracy. Higher accuracy was achieved by employing polynomial extracted features. 76 chemicals trained the model, and 20 tested it, with none overlapping. High accuracy on the test set shows applicability to a diverse chemical range beyond the study's dataset. The study's modelling results indicate RF and ET ensemble methods outperform DT and MLP in accuracy and stability, with ET being the most accurate. This study improves our understanding of H2 solubility in various chemicals, crucial for industrial processes like designing H2-based renewable energy plants. Our study advances ML in predicting chemical solubility by introducing advanced feature extraction and testing models with unseen chemicals. This not only validates our models' predictive capability but also yields deeper insights into H2 solubility. With standardized data preprocessing and a model adept at handling diverse chemicals, we demonstrate a substantial advancement in the field through a meticulous testing methodology.

Short-Term Photovoltaic Power Generation Based on MVMD Feature Extraction and Informer Model

Short-Term Photovoltaic Power Generation Based on MVMD Feature Extraction and Informer Model

Advancing Crayfish Disease Detection: A Comparative Study of Deep Learning and Canonical Machine Learning Techniques

This study evaluates the effectiveness of deep learning and canonical machine learning models for detecting diseases in crayfish from an imbalanced dataset. In this study, measurements such as weight, size, and gender of healthy and diseased crayfish individuals were taken, and at least five photographs of each individual were used. Deep learning models outperformed canonical models, but combining both approaches proved the most effective. Utilizing the ResNet50 model for automatic feature extraction and subsequent training of the RF algorithm with these extracted features led to a hybrid model, RF-ResNet50, which achieved the highest performance in diseased sample detection. This result underscores the value of integrating canonical machine learning algorithms with deep learning models. Additionally, the ConvNeXt-T model, optimized with AdamW, performed better than those using SGD, although its disease detection sensitivity was 1.3% lower than the hybrid model. McNemar’s test confirmed the statistical significance of the performance differences between the hybrid and the ConvNeXt-T model with AdamW. The ResNet50 model’s performance was improved by 3.2% when combined with the RF algorithm, demonstrating the potential of hybrid approaches in enhancing disease detection accuracy. Overall, this study highlights the advantages of leveraging both deep learning and canonical machine learning techniques for early and accurate detection of diseases in crayfish populations, which is crucial for maintaining ecosystem balance and preventing population declines.

Assessing Selected CNN Models for Efficient Feature Extraction in SSD for Text Detection in Advertisement Images

Assessing Selected CNN Models for Efficient Feature Extraction in SSD for Text Detection in Advertisement Images

Convolutional Block Attention Module-Multimodal Feature-Fusion Action Recognition: Enabling Miner Unsafe Action Recognition.

The unsafe action of miners is one of the main causes of mine accidents. Research on underground miner unsafe action recognition based on computer vision enables relatively accurate real-time recognition of unsafe action among underground miners. A dataset called unsafe actions of underground miners (UAUM) was constructed and included ten categories of such actions. Underground images were enhanced using spatial- and frequency-domain enhancement algorithms. A combination of the YOLOX object detection algorithm and the Lite-HRNet human key-point detection algorithm was utilized to obtain skeleton modal data. The CBAM-PoseC3D model, a skeleton modal action-recognition model incorporating the CBAM attention module, was proposed and combined with the RGB modal feature-extraction model CBAM-SlowOnly. Ultimately, this formed the Convolutional Block Attention Module-Multimodal Feature-Fusion Action Recognition (CBAM-MFFAR) model for recognizing unsafe actions of underground miners. The improved CBAM-MFFAR model achieved a recognition accuracy of 95.8% on the NTU60 RGB+D public dataset under the X-Sub benchmark. Compared to the CBAM-PoseC3D, PoseC3D, 2S-AGCN, and ST-GCN models, the recognition accuracy was improved by 2%, 2.7%, 7.3%, and 14.3%, respectively. On the UAUM dataset, the CBAM-MFFAR model achieved a recognition accuracy of 94.6%, with improvements of 2.6%, 4%, 12%, and 17.3% compared to the CBAM-PoseC3D, PoseC3D, 2S-AGCN, and ST-GCN models, respectively. In field validation at mining sites, the CBAM-MFFAR model accurately recognized similar and multiple unsafe actions among underground miners.

A Novel Approach to Detect Drones Using Deep Convolutional Neural Network Architecture.

Over the past decades, drones have become more attainable by the public due to their widespread availability at affordable prices. Nevertheless, this situation sparks serious concerns in both the cyber and physical security domains, as drones can be employed for malicious activities with public safety threats. However, detecting drones instantly and efficiently is a very difficult task due to their tiny size and swift flights. This paper presents a novel drone detection method using deep convolutional learning and deep transfer learning. The proposed algorithm employs a new feature extraction network, which is added to the modified YOU ONLY LOOK ONCE version2 (YOLOv2) network. The feature extraction model uses bypass connections to learn features from the training sets and solves the "vanishing gradient" problem caused by the increasing depth of the network. The structure of YOLOv2 is modified by replacing the rectified linear unit (relu) with a leaky-relu activation function and adding an extra convolutional layer with a stride of 2 to improve the small object detection accuracy. Using leaky-relu solves the "dying relu" problem. The additional convolution layer with a stride of 2 reduces the spatial dimensions of the feature maps and helps the network to focus on larger contextual information while still preserving the ability to detect small objects. The model is trained with a custom dataset that contains various types of drones, airplanes, birds, and helicopters under various weather conditions. The proposed model demonstrates a notable performance, achieving an accuracy of 77% on the test images with only 5 million learnable parameters in contrast to the Darknet53 + YOLOv3 model, which exhibits a 54% accuracy on the same test set despite employing 62 million learnable parameters.