Data Feature Extraction Research Articles

Deep Information Retention Network‐Enabled Data Modeling for Key Quality Indicator Prediction in the Chemical Industry

ABSTRACTDeep learning has attracted widespread attention in data modeling and key quality indicator prediction in the chemical industry. However, traditional deep learning networks usually distort the original data distribution due to the superposition effect of multiple layers of nonlinear activation functions. In this case, multivariate statistical learning techniques present an avenue to reveal the intrinsic relationship of the data by combining the linear trends between input and predictor variables. To comprehensively capture data features from multiple perspectives, this study proposes a deep learning‐based data modeling network called the information retention unit (IRU). This network combines intrinsic attributes to partial least squares (PLS) and autoencoder (AE) modalities, thus engendering an adaptive response to the complex linear and nonlinear data features. Furthermore, multiple IRUs can be stacked to construct a deep information retention network (DIRN), which enhances the robust extraction of deep data features. Finally, the effectiveness of the proposed network is validated through its prediction application on a dataset obtained from a real‐world chemical industrial process. This method combines multivariate statistical learning techniques based on deep learning, providing an innovative and practical solution for data analysis and prediction in the chemical industry.

Grade Identification of Strong-flavor Raw Liquor Based on GC-MS Combined with Spearman-KPCA Feature Extraction

Taking different grades of strong-flavor raw liquor as the research object, gas chromatography-mass spectrometry (GC-MS) technology was used to obtain the volatile components mapping data of raw liquor, and Spearman correlation coefficient (Spearman) combined with principal component analysis (PCA) and kernel principal component analysis (KPCA) was used to realize the secondary feature extraction of the GC-MS data, and then combined with the support vector machine (SVM), extreme gradient boosting (XGBoost), and BP neural network to establish the raw liquor grades identification model, respectively. The results show that the prediction accuracy of the grade identification model based on Spearman-KPCA dimensionality reduction data is better, in which the Spearman-KPCA-BP neural network model has the best classification effect, and the accuracy of the correction set and prediction set reaches 99.44% and 96.10%, respectively. Research shows that the principal components extracted based on Spearman-KPCA secondary features can better characterize the characteristic information of different grades of raw liquor. Combined with the BP neural network model, it can effectively realize the identification of different grades of raw liquor. It is an effective method for identifying the grade of raw liquor.

A FRAMEWORK TO ANALYZE OS SYSTEMS ARTIFACTS FROM LINUX MACHINES

Memory forensics plays a pivotal role in digital investigations, providing crucial insights into the activities and artifacts of an operating system. This paper explores the application of deep learning techniques in the domain of memory forensics within the Linux environment. Linux-based systems are widely used in various contexts, including servers, embedded devices, and desktops, making memory analysis in this ecosystem of paramount importance. Traditional memory forensics techniques have relied on manual analysis, which is often time-consuming and error prone. Deep learning, a subfield of machine learning, has demonstrated remarkable capabilities in pattern recognition and feature extraction tasks. In response, this paper presents a novel framework that automates and improves memory analysis through deep learning. Key components of this framework include data collection, preprocessing, feature extraction, and model selection. We introduce a unique dataset specifically curated for Linux memory forensics, facilitating the development and evaluation of deep learning models. Our experimental results demonstrate the efficacy of using a ResNet-50 model for detecting and classifying malware from memory dumps, achieving a detection rate of 98.75% and an accuracy rate of 89% in classifying malware types. Additionally, we acknowledged the challenges and limitations of applying deep learning in memory forensics, such as model interpretability and data privacy concerns. Future research directions are discussed, including real-time memory analysis integration and techniques for handling encrypted and compressed memory data.

Disinformation, Fakes and Propaganda Identifying Methods in Online Messages Based on NLP and Machine Learning Methods

A new method of propaganda analysis is proposed to identify signs and change the dynamics of the behaviour of coordinated groups based on machine learning at the processing disinformation stages. In the course of the work, two models were implemented to recognise propaganda in textual data - at the message level and the phrase level. Within the framework of solving the problem of analysis and recognition of text data, in particular, fake news on the Internet, an important component of NLP technology (natural language processing) is the classification of words in text data. In this context, classification is the assignment or assignment of textual data to one or more predefined categories or classes. For this purpose, the task of binary text classification was solved. Both models are built based on logistic regression, and in the process of data preparation and feature extraction, such methods as vectorisation using TF-IDF vectorisation (Term Frequency – Inverse Document Frequency), the BOW model (Bag-of-Words), POS marking (Part-Of-Speech), word embedding using the Word2Vec two-layer neural network, as well as manual feature extraction methods aimed at identifying specific methods of political propaganda in texts are used. The analogues of the project under development are analysed the subject area (the propaganda used in the media and the basis of its production methods) is studied. The software implementation is carried out in Python, using the seaborn, matplotlib, genism, spacy, NLTK (Natural Language Toolkit), NumPy, pandas, scikit-learn libraries. The model's score for propaganda recognition at the phrase level was obtained: 0.74, and at the message level: 0.99. The implementation of the results will significantly reduce the time required to make the most appropriate decision on the implementation of counter-disinformation measures concerning the identified coordinated groups of disinformation generation, fake news and propaganda. Different classification algorithms for detecting fake news and non-fakes or fakes identification accuracy from Internet resources ana social mass media are used as the decision tree (for non-fakes identification accuracy 0.98 and fakes identification accuracy 0.9903), the k-nearest neighbours (0.83/0.999), the random forest (0.991/0.933), the multilayer perceptron (0.9979/0.9945), the logistic regression (0.9965/0.9988), and the Bayes classifier (0.998/0.913). The logistic regression (0.9965) the multilayer perceptron (0.9979) and the Bayesian classifier (0.998) are more optimal for non-fakes news identification. The logistic regression (0.9988), the multilayer perceptron (0.9945), and k-nearest neighbours (0.999) are more optimal for identifying fake news identification.

Mental illness detection through harvesting social media: a comprehensive literature review

Mental illness is a common disease that at its extremes leads to personal and societal suffering. A complicated multi-factorial disease, mental illness is influenced by a number of socioeconomic and clinical factors, including individual risk factors. Traditionally, approaches relying on personal interviews and filling out questionnaires have been employed to diagnose mental illness; however, these manual procedures have been found to be frequently prone to errors and unable to reliably identify individuals with mental illness. Fortunately, people with mental illnesses frequently express their ailments on social media, making it possible to more precisely identify mental disease by harvesting their social media posts. This study offers a thorough analysis of how to identify mental illnesses (more specifically, depression) from users’ social media data. Along with the explanation of data acquisition, preprocessing, feature extraction, and classification techniques, the most recent published literature is presented to give the readers a thorough understanding of the subject. Since, in the recent past, the majority of the relevant scientific community has focused on using machine learning (ML) and deep learning (DL) models to identify mental illness, so the review also focuses on these techniques and along with their detail, their critical analysis is presented. More than 100 DL, ML, and natural language processing (NLP) based models developed for mental illness in the recent past have been reviewed, and their technical contributions and strengths are discussed. There exist multiple review studies, however, discussing extensive recent literature along with the complete road map on how to design a mental illness detection system using social media data and ML and DL classification methods is limited. The review also includes detail on how a dataset may be acquired from social media platforms, how it is preprocessed, and features are extracted from it to employ for mental illness detection. Hence, we anticipate that this review will help readers learn more and give them a comprehensive road map for identifying mental illnesses using users’ social media data.

Network Data Intrusion Detection and Data Feature Extraction of Electromechanical Facilities from Machine Learning

With the rapid development of Internet technology, network security issues have become more complex and changeable. Various intrusion methods threaten the information network environment in the Electromechanical Facility (EF) system. This paper focuses on EF to study the relevant detection methods and data feature extraction in complex network intrusions. Firstly, four common machine learning algorithms are used to calculate the data set. The advantages and disadvantages of each algorithm are analyzed after tuning and comparison. Secondly, a network intrusion detection algorithm is proposed based on Recursive Feature Elimination (RFE) principal component analysis. It uses RFE to reduce the number of features and improve the elimination judgment index to align with the detection requirements of information network datasets. Finally, a fault diagnosis method is proposed based on empirical pattern decomposition and support vector machine under Renyi entropy complexity measurement. This method trains and identifies the Renyi entropy of several basic pattern components obtained by decomposing empirical patterns as feature vectors. The results show that the RFE method judged by random forest removes irrelevant features, and the evaluation index is improved to align with the network dataset’s detection requirements. It reduces the data dimension, reduces the operation time, and improves the accuracy of a few attack types. The comprehensive final detection effect is better than other algorithms. Additionally, the embedded operating system construction method based on the protection mechanism realizes the separate storage of the operating system and key data. Also, it can prevent the network system from being maliciously invaded, ensuring the stability of the instrument operation under harsh working conditions.

Human activity recognition using binary sensors: A systematic review

Human activity recognition (HAR) is an emerging area of study and research field that explores the development of automated systems to identify and categorize human activities using data collected from various sensors. In the field of Human Activity Recognition (HAR), binary sensors offer a distinct approach by providing simpler on/off readings to indicate the presence of events such as door openings or light switch activations. Compared to other sensors used for HAR, binary sensors have several advantages, including lower cost, low power consumption, ease of installation, and privacy preservation. For instance, they can be effectively used in smart homes to detect when someone enters or leaves a room without user input. This study presents a systematic review of the state-of-the-art methods and techniques for HAR using binary sensors. We comprehensively consider five crucial aspects: data collection methods, preprocessing techniques, feature extraction and fusion strategies, classification algorithms, and evaluation metrics. Furthermore, we identify the gaps and limitations of the existing studies and provide directions for future research. This comprehensive and up-to-date review can serve as a valuable reference for researchers and practitioners in the field of HAR using binary sensors.

DeepKernel: 2D-kernels clustering based mutant reduction for cost-effective deep learning model testing

Mutation testing is a practical approach for evaluating the quality of deep learning (DL) testing datasets. However, the enormous mutants during testing lead to significant testing overhead. Feature clustering is a conventional method that reduces the number of mutants while preserving the mutants’ distribution diversity. This distribution diversity is considered crucial for maintaining the effectiveness of testing assessment ability. DL model relies on convolutional kernels to extract data features and construct logic. Thus, using kernels to measure the differences among DL mutants is a feasible approach. This paper proposes DeepKernel, a convolutional kernel features clustering based reduction method. Specifically, it considers 2D-Kernel sparsity and 2D-Kernel entropy as kernel features. The features are clustered to construct a subset with equivalent testing assessment capability to the original set. Empirical studies on four classical DL models demonstrate that: (1) there is a significant correlation between the distribution diversity of the mutants and their testing assessment ability, as indicated by a Spearman Correlation Coefficient of 0.9689. (2) the reduced set maintains a similar distribution diversity and testing effectiveness as the original set. (3) when preserving the effectiveness of the mutation testing, our method reduces 63.47% of mutants and outperforms random selection.Editor’s note: Open Science material was validated by the Journal of Systems and Software Open Science Board.

A Crack Detection Method for Civil Engineering Bridges Based on Feature Extraction and Parametric Modeling of Point Cloud Data

Accurate detection and analysis of cracks is critical for ensuring the safety and reliability of concrete bridges. Point cloud data (PCD) obtained from 3D scanning provides a promising avenue for automated crack assessment. However, processing the massive and unstructured PCD poses significant challenges in feature extraction and crack modeling. This paper proposes a novel method for bridge crack analysis by combining PCD feature extraction with a hierarchical neural network and Rodriguez rotation. The method first extracts crack features from PCD using outlier removal, denoising, and 3D coordinate conversion. A crack analysis model is then constructed by integrating multi-scale feature extraction and Rodriguez rotation into a hierarchical neural network, enabling the capture of both local and global crack patterns. Experiments on a benchmark data set demonstrate the effectiveness of the proposed approach, achieving 92.83% feature extraction accuracy, 95.73% parameter analysis accuracy, 93.51% recognition accuracy, and 0.91 F1 score. The method also shows improved efficiency compared to existing techniques. These results highlight the potential of the proposed PCD-based approach for accurate and efficient crack analysis in concrete bridges.

Image Recognition of New Year Pictures based on Machine Learning

New Year pictures are an essential part of Chinese traditional culture, with profound historical deposits and unique artistic value. However, with the rapid development of society, the inheritance and protection of traditional New Year pictures are facing many challenges. One of them is the recognition of the New Year painting images. This paper introduces image recognition technology based on machine learning, including research background, method steps, result discovery, and advantage limitations. Image recognition is an essential means to protect and inherit the traditional New Year painting culture and machine learning technology can improve recognition accuracy and efficiency. This paper presents deep learning implemented through data collection, feature extraction, and classification. The experimental results show that the method can effectively identify New Year images with high accuracy and recall.

Application of Machine Learning Techniques for Countering Side-Channel Attacks in Cryptographic Systems

The use of machine learning algorithms in order to, not only, detect the adversarial intend behind side-channel attacks on cryptographic systems, but also to resist Differential Power Analysis (DPA) attacks. In particular, with the help of the DPA Challenge Dataset containing power traces of AES encryption operations, we propose a detailed step-by-step approach that includes data acquisition, preprocessing, feature extraction, and model assessment. The pre-processing includes noise reduction, normalization and segmental processing of the collected data for which basic statistical and frequency domain analysis can be used for extraction of relevant features. Support Vector Machines (SVMs) are then trained and tested in order to classify and in turn predict attack scenarios as per the subsequently derived features. As the outcome of the result pages show, the SVM model successfully classifies attack and non-attack traces at a rate of 88% on the validation set, which underlines the usage of machine learning to boost cryptographic security. Investigation of the feature relevance demonstrates that frequency-domain features, namely FFT coefficients are most impactful. The findings of this research prove that machine learning can be useful in preventing side-channel attacks apart from providing valuable information on enhancing the understanding of different defenses in cryptographic systems as well as future development of this domain.

Swimtrans Net: a multimodal robotic system for swimming action recognition driven via Swin-Transformer.

Currently, using machine learning methods for precise analysis and improvement of swimming techniques holds significant research value and application prospects. The existing machine learning methods have improved the accuracy of action recognition to some extent. However, they still face several challenges such as insufficient data feature extraction, limited model generalization ability, and poor real-time performance. To address these issues, this paper proposes an innovative approach called Swimtrans Net: A multimodal robotic system for swimming action recognition driven via Swin-Transformer. By leveraging the powerful visual data feature extraction capabilities of Swin-Transformer, Swimtrans Net effectively extracts swimming image information. Additionally, to meet the requirements of multimodal tasks, we integrate the CLIP model into the system. Swin-Transformer serves as the image encoder for CLIP, and through fine-tuning the CLIP model, it becomes capable of understanding and interpreting swimming action data, learning relevant features and patterns associated with swimming. Finally, we introduce transfer learning for pre-training to reduce training time and lower computational resources, thereby providing real-time feedback to swimmers. Experimental results show that Swimtrans Net has achieved a 2.94% improvement over the current state-of-the-art methods in swimming motion analysis and prediction, making significant progress. This study introduces an innovative machine learning method that can help coaches and swimmers better understand and improve swimming techniques, ultimately improving swimming performance.

Distributed PV carrying capacity prediction and assessment for differentiated scenarios based on CNN-GRU deep learning

The increasing penetration of distributed photovoltaic (PV) brings challenges to the safe and reliable operation of distribution networks, distributed PV access to the grid changes the characteristics of the traditional distribution grid. Therefore, the assessment of distributed PV carrying capacity is of great significance for distribution network planning. To this end, a differentiated scenario-based distributed PV carrying capacity assessment method based on a combination of Convolutional Neural Networks (CNN) and Gated Recurrent Unit (GRU) is proposed. Firstly, the meteorological characteristics affecting PV power are quantitatively analyzed using Pearson’s correlation coefficient, and the influence of external factors on PV power characteristics is assessed by integrating the measured data. Then, for the problem of high blindness of clustering parameters and initial clustering centers in the K-means clustering algorithm, the optimal number of clusters is determined by combining the cluster Density Based Index (DBI) and hierarchical clustering. The improved K-means clustering method reduces the complexity of massive scenarios to obtain distributed PV power under differentiated scenarios. On this basis, a distributed PV power prediction method based on the CNN-GRU model is proposed, which employs the CNN model for feature extraction of high-dimensional data, and then the temporal feature data are optimally trained by the GRU model. Based on the clustering results, the solution efficiency is effectively improved and the accurate prediction of distributed PV power is realized. Finally, taking into account the PV access demand of the distribution network, combined with the power flow calculation of distribution network, the bearing capacity of distribution network considering node voltage in differentiated scenarios is evaluated. In addition, verified by source-grid-load measured data in IEEE 33-bus distribution system. The simulation results show that the proposed CNN-GRU fusion deep learning model can accurately and efficiently assess the distributed PV carrying capacity of the distribution network and provide theoretical guidance for realizing distributed PV access on a large scale.

MURDA: Multisource Unsupervised Raman Spectroscopy Domain Adaptation Model with Reconstructed Target Domains for Medical Diagnosis Assistance.

Artificial intelligence combined with Raman spectroscopy for disease diagnosis is on the rise. However, these methods require a large amount of annotated spectral data for modeling to achieve high diagnostic accuracy. Annotating labels consumes significant medical resources and time. To reduce dependence on labeled medical data resources, we propose a method called Multisource Unsupervised Raman Spectroscopy Domain Adaptation Model with Reconstructed Target Domains (MURDA). It transfers knowledge learned from source domain data sets of different diseases to an unlabeled target domain data set. Compared to knowledge transfer from a single source domain, knowledge from multiple disease source domains provides more generalized knowledge. Considering the diversity of autoimmune diseases and the limited sample size, we apply MURDA to assist in the medical diagnosis of autoimmune diseases. Additionally, we propose a Double-Branch Multiscale Convolutional Self-Attention (DMCS) feature extractor that is more suitable for spectral data feature extraction. On three sets of serum Raman spectroscopy data sets for autoimmune diseases, the multisource domain adaptation diagnostic accuracy of MURDA was superior to traditional single source and multisource models, with accuracy rates of 73.6%, 83.4%, and 82.9%, respectively. Compared with pure source tasks without domain adaptation, it improved by 15.1%, 36%, and 21.6%, respectively. This demonstrates the effectiveness of Raman spectroscopy combined with MURDA in diagnosing autoimmune diseases. We investigated the important decision dependency peaks in migration tasks, providing assistance for future research on artificial intelligence combined with Raman spectroscopy for diagnosing autoimmune diseases. Furthermore, to validate the effectiveness and generalization performance of MURDA, we conducted experiments on the publicly available RRUFF data set, exploring the application of multisource unsupervised domain adaptation in more Raman spectroscopy scenarios.

Portable Network Resolving Huge-Graph Isomorphism Problem

Abstract The graph isomorphism, as a key task in graph data analysis, is of great significance for the understanding, feature extraction, and pattern recognition of graph data. The best performance of traditional methods is the quasi-polynomial time complexity, which is infeasible for huge graphs. This paper aims to propose a lightweight graph network to resolve the problem of isomorphism in huge graphs. We propose a partitioning algorithm with linear time complexity based on isomorphic necessary condition to handle network graphs that cannot be fully computed by a single computer. We use anti-weight convolution analysis and skip connections to obtain a more stable representation with fewer layers and parameters. We implement simulations on personal computer (PC) with graphs consisting of hundred millions of edges, demonstrating the identification performance ($>98\%$) and time efficiency.

Data-driven classification and explainable-AI in the field of lung imaging.

Detecting lung diseases in medical images can be quite challenging for radiologists. In some cases, even experienced experts may struggle with accurately diagnosing chest diseases, leading to potential inaccuracies due to complex or unseen biomarkers. This review paper delves into various datasets and machine learning techniques employed in recent research for lung disease classification, focusing on pneumonia analysis using chest X-ray images. We explore conventional machine learning methods, pretrained deep learning models, customized convolutional neural networks (CNNs), and ensemble methods. A comprehensive comparison of different classification approaches is presented, encompassing data acquisition, preprocessing, feature extraction, and classification using machine vision, machine and deep learning, and explainable-AI (XAI). Our analysis highlights the superior performance of transfer learning-based methods using CNNs and ensemble models/features for lung disease classification. In addition, our comprehensive review offers insights for researchers in other medical domains too who utilize radiological images. By providing a thorough overview of various techniques, our work enables the establishment of effective strategies and identification of suitable methods for a wide range of challenges. Currently, beyond traditional evaluation metrics, researchers emphasize the importance of XAI techniques in machine and deep learning models and their applications in classification tasks. This incorporation helps in gaining a deeper understanding of their decision-making processes, leading to improved trust, transparency, and overall clinical decision-making. Our comprehensive review serves as a valuable resource for researchers and practitioners seeking not only to advance the field of lung disease detection using machine learning and XAI but also from other diverse domains.

Research on Fault Prediction and Diagnosis of Mechanical and Electrical Equipment in Construction Machinery based on Big Data Technology

This article aims to explore how to use big data technology for fault prediction and diagnosis of mechanical and electrical equipment in construction machinery. Through steps such as data collection and storage, data feature extraction and selection, and data analysis and processing, a fault prediction and diagnosis model is constructed to achieve real-time monitoring and early warning. The accuracy and efficiency of fault prediction are improved through decision feedback and algorithm optimization.

Real-time monitoring and optimization of machine learning intelligent control system in power data modeling technology

In response to the problems of insufficient model accuracy and poor real-time performance in real-time monitoring and optimization of data models in traditional power systems, this paper explored them based on machine learning. It used methods such as box plots and Kalman filters to preprocess power data and used Fourier transform and long short-term memory (LSTM) network to extract data features. Based on long-term and short-term memory networks, this paper constructed a deep neural network model to process data. Recursive feature elimination method can be used for feature selection in the model, and multi-model integration method can be used for feature fusion. The experiment trained and tested the model on two datasets, IEEE 39-Bus and Pecan Street. The experimental results show that the accuracy of the paper's model in both the training and testing sets is higher than that of the convolutional neural network, decision tree, and support vector machine models in the comparative experiments, reaching 93 % and 94 %, respectively. The average response times in three different testing methods were 139.8 ms, 151 ms, and 140.6 ms, respectively. The lowest daily failure rate for 30 consecutive days of work was 0 %, which reflects the stability of the model; in the satisfaction survey of practitioners, the proportion of high recognition answers to each question was higher than 80 %. The experimental results show that the machine learning intelligent control system has achieved good application in power data modeling technology, providing a reference for similar research in the future.

Toward an AI Era: Advances in Electronic Skins.

Electronic skins (e-skins) have seen intense research and rapid development in the past two decades. To mimic the capabilities of human skin, a multitude of flexible/stretchable sensors that detect physiological and environmental signals have been designed and integrated into functional systems. Recently, researchers have increasingly deployed machine learning and other artificial intelligence (AI) technologies to mimic the human neural system for the processing and analysis of sensory data collected by e-skins. Integrating AI has the potential to enable advanced applications in robotics, healthcare, and human-machine interfaces but also presents challenges such as data diversity and AI model robustness. In this review, we first summarize the functions and features of e-skins, followed by feature extraction of sensory data and different AI models. Next, we discuss the utilization of AI in the design of e-skin sensors and address the key topic of AI implementation in data processing and analysis of e-skins to accomplish a range of different tasks. Subsequently, we explore hardware-layer in-skin intelligence before concluding with an analysis of the challenges and opportunities in the various aspects of AI-enabled e-skins.

Optimizing Recurrent Neural Network with Bayesian Algorithm for Behavioural Authentication System

Current studies on behavioural biometrics authentication have been focused on the use of deep learning and keystroke dynamics but the aspect of conscious optimization of the algorithm in order to obtain best outcome has not been considered. This study employed and incorporated Bayesian algorithm into Recurrent Neural Network to build a Keystroke Behavioural Biometric (KBB) authentication model used against social engineering attacks. The model begins with importing the keylogging dataset for data pre-processing, feature extraction, and RNN algorithm was used to build the KBB model. Hyperparameter tuning was done to achieve optimal results. A traditional optimizer called Adaptive Momentum Estimation (Adam) was used and evaluated so as to estimate the impact of optimization in model inferencing. RNN model result with Bayesian optimization technique shows a better performance than the result of RNN model with ADAM optimization. The essence of incorporating and evaluating the best optimization technique is to come up with an effective and accurate model for behavioural biometric authentication, that could mitigate effectively against social engineering attacks.