Integrated Feature Extraction Research Articles

Predicting Continuous Locomotion Modes via Multidimensional Feature Learning From sEMG.

Walking-assistive devices require adaptive control methods to ensure smooth transitions between various modes of locomotion. For this purpose, detecting human locomotion modes (e.g., level walking or stair ascent) in advance is crucial for improving the intelligence and transparency of such robotic systems. This study proposes Deep-STF, a unified end-to-end deep learning model designed for integrated feature extraction in spatial, temporal, and frequency dimensions from surface electromyography (sEMG) signals. Our model enables accurate and robust continuous prediction of nine locomotion modes and 15 transitions at varying prediction time intervals, ranging from 100 to 500 ms. Experimental results showcased Deep-STP's cutting-edge prediction performance across diverse locomotion modes and transitions, relying solely on sEMG data. When forecasting 100 ms ahead, Deep-STF achieved an improved average prediction accuracy of 96.60%, outperforming seven benchmark models. Even with an extended 500ms prediction horizon, the accuracy only marginally decreased to 93.22%. The averaged stable prediction times for detecting next upcoming transitions spanned from 31.47 to 371.58 ms across the 100-500 ms time advances. Although the prediction accuracy of the trained Deep-STF initially dropped to 71.12% when tested on four new terrains, it achieved a satisfactory accuracy of 92.51% after fine-tuning with just 5 trials and further improved to 96.27% with 15 calibration trials. These results demonstrate the remarkable prediction ability and adaptability of Deep-STF, showing great potential for integration with walking-assistive devices and leading to smoother, more intuitive user interactions.

Lightweight rail surface defect detection algorithm based on an improved YOLOv8

Existing deep learning methods for rail surface defect detection face issues such as poor compatibility with embedded detection systems, high computational resource consumption, and slow detection speeds. To address these challenges, we propose a lightweight rail surface defect detection algorithm11Code: https://github.com/haichao67/GD-YOLOv8. based on an improved YOLOv8.Inspired by Huawei’s Gold-YOLO, our algorithm redesigns the neck architecture, integrates feature extraction, fusion, and injection modules, and replaces Complete Intersection over Union with Scylla Intersection over Union. Comparative experiments confirm its efficacy, achieving 94.9% precision and 81.9% recall on the Rail Surface Defect Dataset, a 26.3% increase in frames per second, and a model size reduction to 63%. Our algorithm not only ensures satisfactory detection results but also reduces the number of model parameters and increases the detection speed.

Center-enhanced video captioning model with multimodal semantic alignment

Video captioning aims at automatically generating descriptive sentences based on the given video, establishing an association between the visual contents and textual languages, has attracted great attention and plays a significant role in many practical applications. Previous researches focus more on the aspect of caption generation, ignoring the alignment of multimodal feature and just simply concatenating them. Besides, video feature extraction is usually done in an off-line manner, which leads to the fact that the extracted feature may not adapted to the subsequent caption generation task. To improve the applicability of extracted features for downstream caption generation and to address the issue of multimodal semantic alignment fusion, we propose an end-to-end center-enhanced video captioning model with multimodal semantic alignment, which integrates feature extraction and caption generation task into a unified framework. In order to enhance the completeness of semantic features, we design a center enhancement strategy where the visual–textual deep joint semantic feature can be captured via incremental clustering, then the cluster centers can serve as the guidance for better caption generation. Moreover, we propose to promote the visual–textual multimodal alignment fusion by learning the visual and textual representation in a shared latent semantic space, so as to alleviate the multimodal misalignment problem. Experimental results on two popular datasets MSVD and MSR-VTT demonstrate that the proposed model could outperform the state-of-the-art methods, obtaining higher-quality caption results.

Multi-step electric vehicles charging loads forecasting: An autoformer variant with feature extraction, frequency enhancement, and error correction blocks

The extensive integration of electric vehicles (EVs) into power grids has raised safety concerns. Meanwhile current EVs charging loads forecasting models mainly focus on single-step predictions, neglect load sparsity and underutilize residuals, limiting their accuracy. To tackle these issues, a multi-step short-term forecasting model, specifically designed to predict charging loads at public EVs charging stations using historical data, is proposed. The model begins with a preprocessing phase to handle missing data and outliers. Subsequently, an Autoformer variant is intruduced, which initially integrates feature extraction block leveraging the Temporal Convolutional Network (TCN) to adeptly capture temporal dynamics. This is further enhanced with a Discrete Cosine Transform (DCT)-based frequency enhancement block to learn sparsity and periodicity features of EVs charging loads by frequency mapping. In addition, an advanced error correction block, comprising Bayesian optimization algorithm, Convolutional Neural Networks, Multi-Head Self-Attention, and Gated Recurrent Units (BCMG), is incorporated to refine initial prediction results. Above all, the TCN-DCT enhanced Autoformer-BCMG (TDformerBCMG) model is proposed. Finally, a comprehensive experimental analysis is conducted on ACN-data for EVs charging load forecasting in 1–3 h steps. It is demonstrated that TDformerBCMG not only is effective and superior in each component, but also achieves a reduction in Mean Absolute Error by 20.94 % to 74.05 % compared to existing models. Moreover, stability is evidenced across 50 repeated trials, with the standard deviation for the Coefficient of Determination varying between 8.5844e-3 and 3.1580e-2. Further discussion on application analysis is provided. Consequently, TDformerBCMG offers a viable methodology and establishes a new benchmark for power system implementation.

Retraction Note: Improvement in Hadoop performance using integrated feature extraction and machine learning algorithms

Retraction Note: Improvement in Hadoop performance using integrated feature extraction and machine learning algorithms

Identification of Bolt Loosening Damage of Steel Truss Structure Based on MFCC-WPES and Optimized Random Forest

In the field of bolt loosening detection, although some progress has been made, there are still challenges such as high operational complexity, single feature extraction methods, and insufficient analysis model performance, especially in large steel truss structures, where there is a lack of efficient and accurate bolt loosening identification solutions. In response to these shortcomings, this article proposes an innovative bolt loosening damage recognition method based on sound signals. This method integrates feature extraction techniques of Mel frequency cepstral coefficients (MFCCs) and wavelet packet energy spectra (WPES), and comprehensively characterizes sound signals by constructing MFCC-WPES combined features. Subsequently, the random forest (RF) algorithm optimized by genetic algorithm was used for feature selection and model training, aiming to improve recognition accuracy and robustness. The experimental results show that this method can not only accurately identify bolt loosening signals in steel truss structure bolt loosening detection, but also has strong identification ability for environmental noise. Compared with traditional methods, the proposed solution in this article shows significant improvements in both performance and practicality, providing a new perspective and solution for the technological advancement of bolt loosening detection in steel truss structures.

Graph recurrent neural networks-integrated real-time prediction of key displacements for fire-induced collapse early warning of steel frames

This study proposes the FRAME-Net, which can extract spatial-temporal features of discrete structures like planar steel frames, for early warning systems of fire-induced building collapse. FRAME-Net, based on graph neural networks and recurrent neural networks, seamlessly integrates feature extraction techniques, advanced graph convolution operations, and an enhanced graph long short-term memory mechanism, resolving the critical issue that the actual state of burning buildings, e.g., fire scenario, load case, material properties, etc., cannot be identified accurately and rapidly. The temperatures of steel components and easy-to-measure displacements are inputs, and hard-to-measure displacements at the top and interior of steel frames under fire can be predicted in real time. Numerical examples indicate that the trained agent accurately predicts the hard-to-measure displacements for the trained steel frame under completely unknown datasets, showcasing its potential in real-world unknown fire scenarios. Besides, the trained intelligent agent can be directly applied to untrained steel frames with different topological forms without re-training, which significantly reduces computational costs and is beneficial for swift emergency responses. Subsequently, satisfactory results predicted by the trained agent without re-training for the steel frame under the real fire test further underscores the promising generalization capability of the trained agent to adapt to unknown fire scenarios in real-world steel frames. Finally, the feasibility of the proposed framework to facilitate the implementation of the early-warning systems of fire-induced collapse is proved by comparing the predicted and actual remaining building collapse time, thereby assisting in reducing casualties during the rescue process and contributing to smart firefighting advancements.

An Intelligent Fault Diagnosis Framework for Rolling Bearings With Integrated Feature Extraction and Ordering-Based Causal Discovery

An Intelligent Fault Diagnosis Framework for Rolling Bearings With Integrated Feature Extraction and Ordering-Based Causal Discovery

A LeViT–EfficientNet-Based Feature Fusion Technique for Alzheimer’s Disease Diagnosis

Alzheimer’s disease (AD) is a progressive neurodegenerative condition. It causes cognitive impairment and memory loss in individuals. Healthcare professionals face challenges in detecting AD in its initial stages. In this study, the author proposed a novel integrated approach, combining LeViT, EfficientNet B7, and Dartbooster XGBoost (DXB) models to detect AD using magnetic resonance imaging (MRI). The proposed model leverages the strength of improved LeViT and EfficientNet B7 models in extracting high-level features capturing complex patterns associated with AD. A feature fusion technique was employed to select crucial features. The author fine-tuned the DXB using the Bayesian optimization hyperband (BOHB) algorithm to predict AD using the extracted features. Two public datasets were used in this study. The proposed model was trained using the Open Access Series of Imaging Studies (OASIS) Alzheimer’s dataset containing 86,390 MRI images. The Alzheimer’s dataset was used to evaluate the generalization capability of the proposed model. The proposed model obtained an average generalization accuracy of 99.8% with limited computational power. The findings highlighted the exceptional performance of the proposed model in predicting the multiple types of AD. The recommended integrated feature extraction approach has supported the proposed model to outperform the state-of-the-art AD detection models. The proposed model can assist healthcare professionals in offering customized treatment for individuals with AD. The effectiveness of the proposed model can be improved by generalizing it to diverse datasets.

Deep Multimodal Data Fusion

Multimodal Artificial Intelligence (Multimodal AI), in general, involves various types of data (e.g., images, texts, or data collected from different sensors), feature engineering (e.g., extraction, combination/fusion), and decision-making (e.g., majority vote). As architectures become more and more sophisticated, multimodal neural networks can integrate feature extraction, feature fusion, and decision-making processes into one single model. The boundaries between those processes are increasingly blurred. The conventional multimodal data fusion taxonomy (e.g., early/late fusion), based on which the fusion occurs in, is no longer suitable for the modern deep learning era. Therefore, based on the main-stream techniques used, we propose a new fine-grained taxonomy grouping the state-of-the-art (SOTA) models into five classes: Encoder-Decoder methods, Attention Mechanism methods, Graph Neural Network methods, Generative Neural Network methods, and other Constraint-based methods. Most existing surveys on multimodal data fusion are only focused on one specific task with a combination of two specific modalities. Unlike those, this survey covers a broader combination of modalities, including Vision + Language (e.g., videos, texts), Vision + Sensors (e.g., images, LiDAR), and so on, and their corresponding tasks (e.g., video captioning, object detection). Moreover, a comparison among these methods is provided, as well as challenges and future directions in this area.

DenseNet Architecture for Efficient and Accurate Recognition of Javanese Script Hanacaraka Character

This study introduced a specifically optimized DenseNet architecture for recognizing Javanese Hanacaraka characters, focusing on enhancing efficiency and accuracy. The research aimed to preserve and celebrate Java’s rich cultural heritage and historical significance through the development of precise character recognition technology. The method used advanced techniques within convolutional neural networks (CNN) to integrate feature extraction across densely connected layers efficiently. The result of this study was that the developed model achieved a training accuracy of 100% and a validation accuracy of approximately 99.50% after 30 training epochs. Furthermore, when tested on previously unseen datasets, the model exhibited exceptional accuracy, precision, recall, and F1-score, reaching 100%. These findings underscored the remarkable capability of DenseNet architecture in character recognition, even across novel datasets, suggesting significant potential for automating Javanese Hanacaraka text processing across various applications, ranging from text recognition to digital archiving. The conclusion drawn from this study suggests that optimizing DenseNet architecture can be a significant step in preserving and developing character recognition technology for Javanese

BioDeepfuse: a hybrid deep learning approach with integrated feature extraction techniques for enhanced non-coding RNA classification

ABSTRACT The accurate classification of non-coding RNA (ncRNA) sequences is pivotal for advanced non-coding genome annotation and analysis, a fundamental aspect of genomics that facilitates understanding of ncRNA functions and regulatory mechanisms in various biological processes. While traditional machine learning approaches have been employed for distinguishing ncRNA, these often necessitate extensive feature engineering. Recently, deep learning algorithms have provided advancements in ncRNA classification. This study presents BioDeepFuse, a hybrid deep learning framework integrating convolutional neural networks (CNN) or bidirectional long short-term memory (BiLSTM) networks with handcrafted features for enhanced accuracy. This framework employs a combination of k-mer one-hot, k-mer dictionary, and feature extraction techniques for input representation. Extracted features, when embedded into the deep network, enable optimal utilization of spatial and sequential nuances of ncRNA sequences. Using benchmark datasets and real-world RNA samples from bacterial organisms, we evaluated the performance of BioDeepFuse. Results exhibited high accuracy in ncRNA classification, underscoring the robustness of our tool in addressing complex ncRNA sequence data challenges. The effective melding of CNN or BiLSTM with external features heralds promising directions for future research, particularly in refining ncRNA classifiers and deepening insights into ncRNAs in cellular processes and disease manifestations. In addition to its original application in the context of bacterial organisms, the methodologies and techniques integrated into our framework can potentially render BioDeepFuse effective in various and broader domains.

Detection of Coronary Artery Disease Based on Clinical Phonocardiogram and Multiscale Attention Convolutional Compression Network.

Heart sound is an important physiological signal that contains rich pathological information related with coronary stenosis. Thus, some machine learning methods are developed to detect coronary artery disease (CAD) based on phonocardiogram (PCG). However, current methods lack sufficient clinical dataset and fail to achieve efficient feature utilization. Besides, the methods require complex processing steps including empirical feature extraction and classifier design. To achieve efficient CAD detection, we propose the multiscale attention convolutional compression network (MACCN) based on clinical PCG dataset. Firstly, PCG dataset including 102 CAD subjects and 82 non-CAD subjects was established. Then, a multiscale convolution structure was developed to catch comprehensive heart sound features and a channel attention module was developed to enhance key features in multiscale attention convolutional block (MACB). Finally, a separate downsampling block was proposed to reduce feature losses. MACCN combining the blocks can automatically extract features without empirical and manual feature selection. It obtains good classification results with accuracy 93.43%, sensitivity 93.44%, precision 93.48%, and F1 score 93.42%. The study implies that MACCN performs effective PCG feature mining aiming for CAD detection. Further, it integrates feature extraction and classification and provides a simplified PCG processing case.

Graph-SeTES: A graph based search task extraction using Siamese network

Search task extraction is a sub-process for query suggestion/reformulation, personalized recommendation, and advertisement in search engines and e-commerce platforms. However, they face both internal and external challenges. Internal challenges include short and misspelled queries and incomplete keywords. External challenges include an unknown number of clusters and a limited number of labeled datasets. Deep-learning models require a large amount of data for training; however, search task datasets are rare and small. To overcome these limitations, we proposed Graph-SeTES, which integrates feature extraction with a decision network that utilizes both distance metrics and decision networks. The existing graph-clustering algorithms use the similarities between search query pairs. Because the Siamese network (SN) finds similarities between two objects, it fits search task extraction. Compared with existing models, SN requires fewer parameters for training due to the shared weights. However, it yields good results even with less labeled data, overcoming the external challenges. We benefit from both distance metrics and narrowing of the linear layers for decision networks. Graph-SeTES was compared with state-of-the-art models, and it outperformed its counterparts. The results were 6% better than those of the best baseline on the CSTE dataset, which maintained this performance difference on the WSMC12 dataset.

A big data driven vegetation disease and pest region identification method based on self supervised convolutional neural networks and parallel extreme learning machines

A self supervised convolutional neural network-parallel extreme learning machine classification model based on big data is proposed to address the subjectivity and inaccuracy of traditional methods for identifying vegetation pests and diseases that rely on manual observation and empirical judgment. This model is constructed using convolutional neural networks and parallel extreme learning machines, and integrates feature extraction networks with dual attention mechanisms to improve the accuracy of identifying pests and diseases. The model utilized a large amount of big data for training, achieving a recall rate of 98.42 % on multispectral datasets, and an overall classification accuracy of 99.04 %. After optimizing the residual network, the overall accuracy of identifying vegetation pest and disease areas has been further improved to 99.77 %, and the recall rate has also reached 98.91 %. These results indicate that the method proposed in this study has high accuracy and efficiency in the application of big data, can meet the needs of disease and pest identification, and provides effective technical support for the monitoring and prevention of crop diseases and pests, which has important practical significance.

A Method for Industrial Robots to Grasp and Detect Parts of Instrument under 3D Visual Guidance

<p>Guiding industrial robots to complete grasping tasks through machine vision is an important part of achieving autonomous robot operation. This article explores the control method of industrial robots under 3D vision, focusing on the feature that two-dimensional vision can only perform color and pose recognition but lacks depth recognition. Firstly, a high-precision point cloud registration calibration matrix solution method is proposed. Then, an improved recognition model is designed to address the issue of how vision guides robots to grasp and detect. This model integrates feature extraction and object detection modules, and describes the parameters of each module. Finally, the effectiveness of the proposed method is verified in the assembly scene of gas instruments. Finally, experimental results show that, the method proposed in this article can limit the grasping accuracy to within 2 millimeters in guiding robots to grasp detection scenes, achieving the expected effect.</p> <p> </p>

SyntDiaNet: Integrating feature extraction, transfer learning and classifier-embedded generative adversarial network for advanced pneumonia diagnosis

SyntDiaNet: Integrating feature extraction, transfer learning and classifier-embedded generative adversarial network for advanced pneumonia diagnosis

68-channel neural signal processing system-on-chip with integrated feature extraction, compression, and hardware accelerators for neuroprosthetics in 22 nm FDSOI.

Multi-channel electrophysiology systems for recording of neuronal activity face significant data throughput limitations, hampering real-time, data-informed experiments. These limitations impact both experimental neurobiology research and next-generation neuroprosthetics. We present a novel solution that leverages the high integration density of 22nm fully-depleted silicon-on-insulator technology to address these challenges. The proposed highly integrated programmable System-on-Chip (SoC) comprises 68-channel 0.41 μW/Ch recording frontends, spike detectors, 16-channel 0.87-4.39 μW/Ch action potentials and 8-channel 0.32 μW/Ch local field potential codecs, as well as a multiply-accumulate-assisted power-efficient processor operating at 25 MHz (5.19 μW/MHz). The system supports on-chip training processes for compression, training, and inference for neural spike sorting. The spike sorting achieves an average accuracy of 91.48 or 94.12% depending on the utilized features. The proposed programmable SoC is optimized for reduced area (9 mm2) and power. On-chip processing and compression capabilities free up the data bottlenecks in data transmission (up to 91% space saving ratio), and moreover enable a fully autonomous yet flexible processor-driven operation. Combined, these design considerations overcome data-bottlenecks by allowing on-chip feature extraction and subsequent compression.

Prediction of Traffic Congestion in Vehicular Ad-Hoc Networks Employing Extreme Deep Learning Machines (Edrlm)

Vehicular Ad-Hoc Networks (VANETs) represent a crucial component of intelligent transportation systems (ITS), enabling vehicles to communicate with each other and with roadside infrastructure. Predicting traffic congestion in VANETs is essential for enhancing road safety, optimizing traffic flow, and improving overall transportation efficiency. Traditional machine learning methods have shown promise in this domain; however, they often fall short in handling the complex, high-dimensional data typical of VANETs. To address these challenges, this study employs Extreme Deep Learning Machines (EDRLM), an advanced deep learning technique, for traffic congestion prediction. The EDRLM framework leverages the strengths of deep neural networks and extreme learning machines, offering a robust and scalable solution for processing the dynamic and heterogeneous data in VANETs. By integrating feature extraction, selection, and prediction into a unified model, EDRLM can capture intricate patterns and temporal dependencies within traffic data. The proposed model is trained and validated using real-world VANET datasets, incorporating various traffic parameters such as vehicle speed, density, and inter-vehicular distances. Our experimental results demonstrate that EDRLM outperforms conventional machine learning algorithms in terms of prediction accuracy, computational efficiency, and robustness to noise and missing data. The model's ability to provide timely and precise congestion predictions can facilitate proactive traffic management strategies, including dynamic routing and adaptive traffic signal control, ultimately leading to reduced travel times and enhanced road safety. This study underscores the potential of EDRLM in transforming traffic management in VANETs, paving the way for more intelligent and adaptive ITS solutions. Future research directions include exploring hybrid models combining EDRLM with other advanced machine learning techniques and expanding the framework to accommodate emerging vehicular communication technologies such as 5G and Internet of Things (IoT) devices.

Enhancing Real-Time Malware Analysis with Quantum Neural Networks

The proposed Quantum Neural Networks (QNN) perform better than traditional machine learning models. The escalating complexity of malware poses a significant challenge to cybersecurity, necessitating innovative approaches to keep pace with its rapid evolution. Contemporary malware analysis techniques underscore the urgent need for solutions that can adapt to the dynamic functionalities of evolving malware. In this context, Quantum Neural Networks (QNNs) emerge as a cutting-edge and distinctive approach to malware analysis, promising to overcome the limitations of conventional methods. Our exploration of QNNs focuses on uncovering their valuable applications, particularly in real-time malware research. We meticulously examine the advantages of QNNs in contrast to conventional machine-learning methods employed in malware detection and classification. The proposed QNN showcases its unique capability to handle complex patterns, emphasizing its potential to achieve heightened levels of accuracy. Our contribution extends to introducing a dedicated framework for QNN-based malware analysis, harnessing the formidable computational capabilities of quantum computing for real-time malware analysis. This framework is structured around three pivotal components, Malware Feature Extraction utilizes quantum feature extraction techniques to identify relevant features from malware samples. Malware Classification employs a QNN classifier to categorize malware samples as benign or malicious. Real-Time Analysis enables the instantaneous examination of malware samples by integrating feature extraction and classification within a streaming data pipeline. Our proposed methodology undergoes comprehensive evaluation using a benchmark dataset of malware samples. The Proposed Quantum Neural Networks (QNNs) demonstrated a high accuracy of 0.95, outperforming other quantum models such as Quantum Support Vector Machines (QSVM) and Quantum Decision Trees (QDT), as well as classical models like Random Forest (RF), Support Vector Machines (SVM), and Decision Trees (DT) on the Malware DB dataset. The results affirm the framework's exceptional accuracy rates and low latency, establishing its suitability for real-time malware analysis. These findings underscore the potential for QNNs to revolutionize malware evaluation and strengthen real-time defenses against cyberattacks. While our research demonstrates promising outcomes, further exploration and development in this domain are imperative to fully exploit the extensive viability that QNNs offer for cybersecurity applications.