Traditional Feature Extraction Methods Research Articles

Automatic Landmark Detection for Preoperative Planning of High Tibial Osteotomy Using Traditional Feature Extraction and Deep Learning Methods.

Automatic High Tibial Osteotomy (HTO) landmark detection methods promise to improve the effectiveness and standardisation of HTO preoperative planning. Unfortunately, due to the limited number of HTO datasets, existing methods are less robust when dealing with patients with varied deformities than traditional manual planning, severely limiting their clinical viability and application in practical surgical settings. Here, we present a new HTO landmark detection framework using an integration of optimised heatmap-offset aggregation method and traditional feature extraction. Subjective and objective approaches were employed to reflect the final clinical acceptance of our model. Average Mean Absolute Error of prediction results compared to the surgeon's gold standard was 0.35° for the hip-knee-ankle angle. The objective score rated by surgeons reached 4.4 on a scale of 5. The study demonstrated that the automatic detection method has great potential serving as an alternative to manual radiological analysis in practical surgical pre-operative planning.

Research and performance analysis of random forest-based feature selection algorithm in sports effectiveness evaluation

The rapid progress in fields such as data mining and machine learning, as well as the explosive growth of sports big data, have posed new challenges to the research of sports big data. Most of the available sports data mining techniques concentrates on extracting and constructing effective features for basic sports data, which cannot be achieved simply by using data statistics. Especially in the targeted mining of sports data, traditional mining techniques still have shortcomings such as low classification accuracy and insufficient refinement. In order to solve the problem of low accuracy in traditional mining methods, the study combines the random forest algorithm with the artificial raindrop algorithm, and adopts a sports data mining method based on feature selection to achieve effective analysis of sports big data. This study is based on the evaluation method of motion effects using random forests, and uses feature extraction algorithms to study the motion effect impacts. It uses the information gain index to rank the importance of features and accurately gain the degree of influence of exercise on various indicators of the human body. Through simulation verification, the algorithm proposed by the research institute performs the best in accuracy and FI scores on the training and testing sets, with accuracies of 0.849 ± 0.021 and 0.819 ± 0.022, respectively, and F1 scores of 0.837 ± 0.020 and 0.864 ± 0.021, respectively. This indicates that the algorithm proposed by the research institute has high classification accuracy and performance proves that the Random Forest-based feature selection algorithm established in this study is superior to the existing traditional feature extraction and extraction methods in terms of both performance and accuracy. The proposal of this data analysis method has achieved accurate and efficient utilization of sports big data, which is of great significance for the development of the sports education industry.

Autism Identification Based on the Intelligent Analysis of Facial Behaviors: An Approach Combining Coarse- and Fine-Grained Analysis

Background: Facial behavior has emerged as a crucial biomarker for autism identification. However, heterogeneity among individuals with autism poses a significant obstacle to traditional feature extraction methods, which often lack the necessary discriminative power. While deep-learning methods hold promise, they are often criticized for their lack of interpretability. Methods: To address these challenges, we developed an innovative facial behavior characterization model that integrates coarse- and fine-grained analyses for intelligent autism identification. The coarse-grained analysis provides a holistic view by computing statistical measures related to facial behavior characteristics. In contrast, the fine-grained component uncovers subtle temporal fluctuations by employing a long short-term memory (LSTM) model to capture the temporal dynamics of head pose, facial expression intensity, and expression types. To fully harness the strengths of both analyses, we implemented a feature-level attention mechanism. This not only enhances the model’s interpretability but also provides valuable insights by highlighting the most influential features through attention weights. Results: Upon evaluation using three-fold cross-validation on a self-constructed autism dataset, our integrated approach achieved an average recognition accuracy of 88.74%, surpassing the standalone coarse-grained analysis by 8.49%. Conclusions: This experimental result underscores the improved generalizability of facial behavior features and effectively mitigates the complexities stemming from the pronounced intragroup variability of those with autism, thereby contributing to more accurate and interpretable autism identification.

Research on fault diagnosis of mechanical component in high-speed train based on one-dimensional convolutional block residual channel attention

The yaw damper and the rolling bearing are key components to ensure the safe and reliable operation of high-speed trains. However, fault identification in these components remains challenging, with traditional feature extraction methods often suffering from low diagnostic accuracy. To address these issues, a one-dimensional convolutional block residual channel attention (1DCBRCA) method for fault diagnosis of high-speed train components is introduced. Firstly, the convolutional layer is constructed for feature extraction, and the convolution block attention module is utilized for adaptive feature optimization in both channel and space dimensions. Subsequently, a residual neural network model is established, with channel attention added after each residual block to focus on critical feature information, which is used for adjusting the weight parameters. Furthermore, the proposed method was validated through damper fault experiments and bearing fault experiments. Comparative analysis with state-of-the-art methods demonstrated that the proposed 1DCBRCA approach achieves higher diagnostic accuracy, confirming its potential to enhance fault diagnosis in high-speed train components.

Underwater acoustic target recognition based on multi-resolution wavelet feature deep learning

The application of underwater acoustic target recognition is extensive, exploration of marine resources, submarine vehicle detection and so on. However, traditional feature extraction methods are susceptible to the influence of complex marine environments and target operating conditions, leading to a significant reduction in the correct recognition rate. This paper introduces an underwater acoustic target recognition method that integrates multi-resolution wavelet features with deep learning algorithms, aiming to overcome the limitations of traditional time-frequency analysis techniques, which are unable to extract multiple signal characteristics simultaneously due to the trade-off between time and frequency resolution. Specifically, the essence of this technique is twofold: (1) Selecting suitable wavelet bases and decomposition levels to capture signal characteristics at different resolutions, effectively seizing the signal's local features within the time-frequency domain; (2) Fusing signal features across different resolutions to optimize the feature extraction process and enhance the distinguishability of target features. Finally, by applying deep learning algorithms to experimentally measured underwater acoustic data, the results demonstrate that this method can effectively enhance the accuracy of underwater acoustic target recognition.

VSLAM based on deep learning in low-textured scenes

Abstract Traditional Visual Simultaneous Localization and Mapping (VSLAM) algorithms often suffer from the low positioning accuracy and robustness of the traditional feature extraction methods. These methods typically require environments with clear features, perform poorly or even fail in low-textured scenes. To solve this problem, we propose an RGB-D VSLAM algorithm that integrates a deep learning feature extraction network. First, to solve the problem in which sufficient feature points cannot be extracted, the proposed algorithm uses the R2D2 feature extraction network to extract keypoints and generate descriptors. We also perform lightweight optimization on the R2D2 network, ensuring accuracy while doubling the inference speed. Subsequently, we employ the L2 distance to measure the distance between descriptors, thereby enhancing the accuracy of keypoint matching. Ultimately, we add a dense mapping thread to obtain a dense 3D point map generated by the RGB-D information and poses of the keyframes. The experimental results on the TUM dataset show that the average absolute trajectory error is reduced by 59% and the relative trajectory error is reduced by 56%. The results demonstrate that our algorithm significantly improves localization accuracy and system robustness in low-textured environments.

Fusion-driven fault diagnosis based on adaptive tuning feature mode decomposition and synergy graph enhanced transformer for bearings under noisy conditions

Bearing fault diagnosis is critical for maintaining the reliability of health monitoring in electromechanical systems. However, traditional feature extraction methods often struggle to accurately capture fault information in complex environments. This paper proposes an adaptive tuning feature mode decomposition (ATFMD) method, based on the intrinsic signal characteristics, to effectively extract robust features. ATFMD dynamically adjusts to complex fault signals, providing more representative feature inputs and pruning redundant features induced by noise. Additionally, given the limitations of single-dimensional feature domains in fully revealing fault information, this study constructs feature topology graphs by mapping spatial phase and time–frequency characteristics, offering a comprehensive representation of fault information. To achieve complementary fusion of fault information within the feature topological graph, this paper proposes the synergy graph enhanced transformer (SGET). SGET optimizes the fusion process by reinforcing feature interactions through its synergy graph representation module. Additionally, a hierarchical cross-attention mechanism is employed to modulate attention distribution across feature dimensions, enhancing the sensitivity to critical features during fusion. Experimental validation was conducted on two distinct rotating machinery transmission systems. The results demonstrate that the proposed method maintains exceptional robustness and generalization, even in the presence of severe noise and complex fault conditions. Compared to the leading methods, including MS-DGCNs, CapsFormer, TFT, and ConvFormer, the proposed method achieves notable accuracy improvements of 8.13 %, 8.71 %, 11.94 %, and 6.25 %, respectively, under challenging conditions.

Low probability of interception radar overlapping signal modulation recognition based on an improved you-only-look-once version 8 network

Low probability of interception (LPI) radar is widely used in modern electronic warfare. With the increased radiation sources, multiple signals will arrive simultaneously. The traditional feature extraction method has too many features, which brings great trouble to the subsequent data processing. Most modulation recognition methods based on deep learning only consider the single signal after preprocessing, and the generalization ability is weak. This paper proposes a deep learning solution based on an improved you only look once version 8 (YOLOv8) network with a global attention mechanism (GAM), achieving recognition accuracy over 98% in a -10 dB signal-to-noise ratio (SNR) scenario to address the above problems. We improved the performance of the original network, which can be used in electronic countermeasures.

Adaptive feature extraction for entity relation extraction

Effective capturing of semantic dependencies within sentences is pivotal to support relation extraction. However, challenges such as feature sparsity, and the complexity of identifying the structure of target entity pairs brought by the traditional methods of feature extraction pose significant obstacles for relation extraction. Existing methods that rely on combined features or recurrent networks also face limitations, such as over-reliance on prior knowledge or the gradient vanishing problem. To address these limitations, we propose an Adaptive Feature Extraction (AFE) method, combining neural networks with feature engineering to capture high-order abstract and long-distance semantic dependencies. Our approach extracts atomic features from sentences, maps them into distributed representations, and categorizes these representations into multiple mixed features through adaptive combination, setting it apart from other methods. The proposed AFE-based model uses four different convolutional layers to facilitate feature learning and weighting from the adaptive feature representations, thereby enhancing the discriminative power of deep networks for relation extraction. Experimental results on the English datasets ACE05 English, SciERC, and the Chinese datasets ACE05 Chinese, and CLTC(SanWen) demonstrated the superiority of our method, the F1 scores were improved by 4.16%, 3.99%, 0.82%, and 1.60%, respectively. In summary, our AFE method provides a flexible, and effective solution to some challenges in cross-domain and cross-language relation extraction.

Enhancing CNN model classification performance through RGB angle rotation method

In recent years, convolutional neural networks have significantly advanced the field of computer vision by automatically extracting features from image data. CNNs enable the modeling of complex and abstract image features using learnable filters, eliminating the need for manual feature extraction. However, combining feature maps obtained from CNNs with different approaches can lead to more complex and interpretable inferences, thereby enhancing model performance and generalizability. In this study, we propose a new method called RGB angle rotation to effectively obtain feature maps from RGB images. Our method rotates color channels at different angles and uses the angle information between channels to generate new feature maps. We then investigate the effects of integrating models trained with these feature maps into an ensemble architecture. Experimental results on the CIFAR-10 dataset show that using the proposed method in the ensemble model results in performance increases of 9.10 and 8.42% for the B and R channels, respectively, compared to the original model, while the effect of the G channel is very limited. For the CIFAR-100 dataset, the proposed method resulted in a 17.09% improvement in ensemble model performance for the R channel, a 5.06% increase for the B channel, and no significant improvement for the G channel compared to the original model. Additionally, we compared our method with traditional feature extraction methods like scale-invariant feature transform and local binary pattern and observed higher performance. In conclusion, it has been observed that the proposed RGB angle rotation method significantly impacts model performance.

Improved spectral dynamic features extracted from audio data for classification of marine vessels

Underwater sound classification presents a unique challenge due to the complex propagation characteristics of sound in water, including absorption, scattering, and refraction. These complexities can distort and alter spectral features, hindering the effectiveness of traditional feature extraction methods for vessel classification. To address this challenge, this study proposes a novel feature extraction method that combines Mel-frequency cepstral coefficients (MFCCs) with a spectral dynamic feature (SDF) vector. MFCCs capture the spectral content of the audio signal, whereas SDF provides information on the temporal dynamics of spectral features. This combined approach aims to achieve a more comprehensive representation of underwater vessel sounds, potentially leading to improved classification accuracy. Validation with real-world underwater audio recordings demonstrated the effectiveness of the proposed method. Results indicated an improvement of up to 94.68% in classification accuracy when combining SDF with several classical extractors evaluated. This finding highlights the potential of SDF in overcoming the challenges associated with underwater sound classification.

Tsallis Entropy-Based Complexity-IPE Casualty Plane: A Novel Method for Complex Time Series Analysis.

Due to its capacity to unveil the dynamic characteristics of time series data, entropy has attracted growing interest. However, traditional entropy feature extraction methods, such as permutation entropy, fall short in concurrently considering both the absolute amplitude information of signals and the temporal correlation between sample points. Consequently, this limitation leads to inadequate differentiation among different time series and susceptibility to noise interference. In order to augment the discriminative power and noise robustness of entropy features in time series analysis, this paper introduces a novel method called Tsallis entropy-based complexity-improved permutation entropy casualty plane (TC-IPE-CP). TC-IPE-CP adopts a novel symbolization approach that preserves both absolute amplitude information and inter-point correlations within sequences, thereby enhancing feature separability and noise resilience. Additionally, by incorporating Tsallis entropy and weighting the probability distribution with parameter q, it integrates with statistical complexity to establish a feature plane of complexity and entropy, further enriching signal features. Through the integration of multiscale algorithms, a multiscale Tsallis-improved permutation entropy algorithm is also developed. The simulation results indicate that TC-IPE-CP requires a small amount of data, exhibits strong noise resistance, and possesses high separability for signals. When applied to the analysis of heart rate signals, fault diagnosis, and underwater acoustic signal recognition, experimental findings demonstrate that TC-IPE-CP can accurately differentiate between electrocardiographic signals of elderly and young subjects, achieve precise bearing fault diagnosis, and identify four types of underwater targets. Particularly in underwater acoustic signal recognition experiments, TC-IPE-CP achieves a recognition rate of 96.67%, surpassing the well-known multi-scale dispersion entropy and multi-scale permutation entropy by 7.34% and 19.17%, respectively. This suggests that TC-IPE-CP is highly suitable for the analysis of complex time series.

Applications of encoding-decoding network on numerical simulation mapping for propeller wake

Numerical Simulation methods of RANS and LES have been widely used to simulate the velocity field induced by propellers. In order to combine advantages of quick computation time from RANS and detailed information from LES, this paper innovatively proposed a customized data-driven encoding-decoding network to achieve mapping from RANS results to LES results. Firstly, an encoding-decoding neural network model was constructed to extract features from RANS/LES for propeller wake. The extracted features with additional information concatenation during the encoding steps were then used to reconstruct the original samples and got a reconstruction error of 1%, which proved the effectiveness of feature extraction ability of the proposed model. The proposed model was then used to map directly from RANS to LES data with a better performance compared to traditional PCA feature extraction and mapping method. Afterwards, the proposed network was applied to two more RANS to LES mapping scenarios to validate the generalization ability. The model could map a coarse-grid RANS to LES of ship propeller with less than 9% MSE error. Similarly, mapped LES of nominal wake was 98% more alike the original LES samples than the RANS samples. As a result, the proposed model could be used either to extract features for potential feature-based performance prediction, or as a quicker method for detailed simulation for propeller wake and nominal wake, thus expedites the design process of ship design.

Pyramid Feature Attention Network for Speech Resampling Detection

Speech forgery and tampering, increasingly facilitated by advanced audio editing software, pose significant threats to the integrity and privacy of digital speech avatars. Speech resampling is a post-processing operation of various speech-tampering means, and the forensic detection of speech resampling is of great significance. For speech resampling detection, most of the previous works used traditional methods of feature extraction and classification to distinguish original speech from forged speech. In view of the powerful ability of deep learning to extract features, this paper converts the speech signal into a spectrogram with time-frequency characteristics, and uses the feature pyramid network (FPN) with the Squeeze and Excitation (SE) attention mechanism to learn speech resampling features. The proposed method combines the low-level location information and the high-level semantic information, which dramatically improves the detection performance of speech resampling. Experiments were carried out on a resampling corpus made on the basis of the TIMIT dataset. The results indicate that the proposed method significantly improved the detection accuracy of various resampled speech. For the tampered speech with a resampling factor of 0.9, the detection accuracy is increased by nearly 20%. In addition, the robustness test demonstrates that the proposed model has strong resistance to MP3 compression, and the overall performance is better than the existing methods.

The ringed residual u-net with non-natural regions feature for image splicing forgery detection and localization

Recently, with the emergence of many image editing tools (photoshop, Topaz studio, etc.), the authenticity of images has been severely challenged. However, the performance of some existing traditional feature extraction methods and detection methods based on convolutional neural network (CNN) is poor, and the information provided by the features extracted from the network is limited and single. In this paper, an end-to-end ringed residual U-Net is proposed to detect image splicing forgery by blending features of non-natural regions. Some regions with significant differences from the image background are defined as non-natural regions(such as the irregular border at the splicing of images). In this paper, a feature enhancement module for non-natural regions is constructed, which the image through the pooling of four different scales, and these features are then combined with the original image and input to the backbone network for processing, aiming to highlight regions of the image that differ significantly from the background. Therefore, after adding the feature enhancement module for non-natural regions to the end-to-end ring residual U-Net, more attention will be paid to the tampering regions in the feature extraction stage, image manipulation detection and localization will also become more accurate. Compared with some mainstream methods, this method achieves better performance on the three standard datasets(CASIA2.0, NIST2016, COLUMBIA). In addition, it has excellent robustness under JPEG compression attack and noise corruption attack.

Seizure detection via deterministic learning feature extraction

Epileptic seizures have a significant impact on the well-being of a large number of individuals worldwide. Utilizing electroencephalographic (EEG) signals for automatic seizure detection proves to be a valuable solution. However, dealing with raw EEG signals is inherently complex, necessitating a preliminary step of feature extraction prior to detection. Traditional feature extraction methods often amalgamate various types of features for seizure detection, as each type typically captures specific properties. In contrast, this paper focuses on detecting seizures by analyzing the system dynamics. The proposed Deterministic Learning Feature Extraction (DLFE) method extracts a single type of nonlinear dynamical feature rooted in the EEG system dynamics. DLFE employs deterministic learning to discern the inherent system dynamics of the EEG under both seizure and normal conditions. Through the feature extraction process, the infinite-dimensional system dynamics are transformed into feature vectors, exhibiting distinct distributions in seizure and normal states. This disparity can be effectively utilized for classification using standard classifiers. The performance of the proposed seizure detection method was assessed using the CHB-MIT and Bonn datasets. The average classification accuracy was found to be 98.63% with a specificity of 99.19% and a sensitivity of 98.06% on CHB-MIT dataset. Compared with the latest similar methods, the accuracy, specificity and sensitivity are improved by 0.31%, 0.21% and 0.05% respectively. Moreover, the performance was achieved with the short-time interval EEG signals within a few channels. The average classification accuracy was found to be 99.90% with a 0.22% improvement on Bonn dataset, which indicates the good generalization performance.

STIRUnet: SwinTransformer and inverted residual convolution embedding in unet for Sea–Land segmentation

Extraction of coastline from optical remote sensing images is of paramount importance for coastal zone management, erosion monitoring, and intelligent ocean construction. However, nearshore marine environment complexity presents a challenge when capturing small-scale and detailed information regarding coastlines. Furthermore, the presence of numerous tidal flats, suspended sediments, and coastal biological communities exacerbates the reduction in segmentation accuracy, which is particularly noticeable in medium–high-resolution remote sensing image segmentation tasks. Most previous related studies, based primarily on convolutional neural networks (CNNs) or traditional feature extraction methods, faced challenges in detailed pixel-level refinement and lacked comprehensive understanding of the studied images. Therefore, we proposed a new U-shaped deep learning model (STIRUnet) that combines the excellent global modeling ability of SwinTransformer with an improved CNN using an inverted residual module. The proposed method has the capability of global supervised feature learning and layer-by-layer feature extraction, and we conducted sea–land segmentation experiments using GF-HNCD and BSD remote sensing image datasets to validate the performance of the proposed model. The results indicate the following: 1) suspended sediments and coastal biological communities are major contributors to coastline blurring, and 2) the recovery of minute features (e.g., narrow watercourses and microscale artificial structures) effectively enhances edge details and leads to more realistic segmentation outcomes. The findings of this study are highly important in relation of accurate extraction of sea–land information in complex marine environments, and they offer novel insights regarding mixed-pixel identification.

A new method of ship detection in complex background of SAR images based on YOLO

Synthetic Aperture Radar (SAR) is a remote sensing technology capable of high-resolution imaging of the ground surface under any weather and light conditions. SAR image ship detection is a technique that uses the ship target features in SAR images to identify and locate ships, which is of great value for applications in the fields of maritime traffic management, marine environment monitoring, and maritime security and defence. However, SAR image ship detection also faces some challenges, such as complex sea surface background, low signal-to-noise ratio, and the diversity and density of ship targets, which lead to the shortcomings of traditional feature extraction and classifier-based detection methods in terms of accuracy and efficiency. To address these challenges, this paper proposes a new method for ship detection in SAR images based on YOLOv7. When dealing with SAR images containing clutter interference and complex backgrounds, many models face the dual challenge of insufficient real-time and accuracy. To address this problem, this study proposes a new PCAN aggregation network, which firstly introduces the SimAM attention mechanism, which significantly enhances the model's ability to identify the differences between ships and background clutter, further improves the ability of focusing on target features, and effectively It further improves the ability to focus on target features, effectively reduces the interference of background noise, and improves the detection accuracy in complex scenes. At the same time, the PConv strategy is added to further lighten the model structure, thus accelerating the computation process and improving the inference efficiency. We trained and tested the model on the SAR-Ship-Dataset dataset, and achieved an accuracy of 91.1%, an F1 score of 92.9, and an FPS of 46, demonstrating its excellent detection capability. By comparing and analysing the model with several classical and cutting-edge methods in the current field, the proposed model in this study demonstrates obvious performance advantages, and in addition, through ablation experiments, we further confirm the effectiveness and contribution of PCAN.

Remaining useful life prediction of lithium-ion batteries combined with SVD-SDAE and support vector quantile regression

Lithium-ion batteries are important energy storage materials, and the prediction of their remaining useful life has practical importance. Since traditional feature extraction methods depend on parameter settings and have poor adaptability, singular value decomposition was used to extract 15 health indicators from the degradation data of lithium-ion batteries. To eliminate redundancy among the extracted health indicators, Spearman correlation analysis was subsequently used to determine the most appropriate health indicators. On this basis, the selected health indicators were processed by the denoising stack autoencoder, and a fusion health indicator was obtained. Finally, the support vector quantile regression model was used to predict the battery capacity interval by the fusion health indicator. The National Aeronautics and Space Administration battery dataset and Massachusetts Institute of Technology battery dataset were used to verify the validity and generalizability of our proposed model, and our proposed model was compared with the existing four classical prediction models. The experimental results showed that our proposed prediction model had higher prediction accuracy and better robustness than the other models and could effectively improve the prediction effect of the remaining useful life of batteries. The mean value of the root mean square error of the predicted results using our proposed model remained within 1.3%, and the mean value of the coefficient of determination was above 0.97.

Quantitative Prediction of Surface Hardness in Cr12MoV Steel and S136 Steel with Two Magnetic Barkhausen Noise Feature Extraction Methods.

The correlation between magnetic Barkhausen noise (MBN) features and the surface hardness of two types of die steels (Cr12MoV steel and S136 steel in Chinese standards) was investigated in this study. Back-propagation neural network (BP-NN) models were established with MBN magnetic features extracted by different methods as the input nodes to realize the quantitative prediction of surface hardness. The accuracy of the BP-NN model largely depended on the quality of the input features. In the extraction process of magnetic features, simplifying parameter settings and reducing manual intervention could significantly improve the stability of magnetic features. In this study, we proposed a method similar to the magnetic Barkhausen noise hysteresis loop (MBNHL) and extracted features. Compared with traditional MBN feature extraction methods, this method simplifies the steps of parameter setting in the feature extraction process and improves the stability of the features. Finally, a BP-NN model of surface hardness was established and compared with the traditional MBN feature extraction methods. The proposed MBNHL method achieved the advantages of simple parameter setting, less manual intervention, and stability of the extracted parameters at the cost of small accuracy reduction.