Multi-feature Fusion Research Articles

Low-Complexity Wireless Technique Classification With Multifeature Fusion Broad Learning Network

Low-Complexity Wireless Technique Classification With Multifeature Fusion Broad Learning Network

SPFDNet: Water Extraction Method Based on Spatial Partition and Feature Decoupling

Extracting water information from remote-sensing images is of great research significance for applications such as water resource protection and flood monitoring. Current water extraction methods aggregated richer multi-level features to enhance the output results. In fact, there is a difference in the requirements for the water body and the water boundary. Indiscriminate multi-feature fusion can lead to perturbation and competition of information between these two types of features during the optimization. Consequently, models cannot accurately locate the internal vacancies within the water body with the external boundary. Therefore, this paper proposes a water feature extraction network with spatial partitioning and feature decoupling. To ensure that the water features are extracted with deep semantic features and stable spatial information before decoupling, we first design a chunked multi-scale feature aggregation module (CMFAM) to construct a context path for obtaining deep semantic information. Then, an information interaction module (IIM) is designed to exchange information between two spatial paths with two fixed resolution intervals and the two paths through. During decoding, a feature decoupling module (FDM) is developed to utilize internal flow prediction to acquire the main body features, and erasing techniques are employed to obtain boundary features. Therefore, the deep features of the water body and the detailed boundary information are supplemented, strengthening the decoupled body and boundary features. Furthermore, the integrated expansion recoupling module (IERM) module is designed for the recoupling stage. The IERM expands the water body and boundary features using expansion and adaptively compensates the transition region between the water body and boundary through information guidance. Finally, multi-level constraints are combined to realize the supervision of the decoupled features. Thus, the water body and boundaries can be extracted more accurately. A comparative validation analysis is conducted on the public datasets, including the gaofen image dataset (GID) and the gaofen2020 challenge dataset (GF2020). By comparing with seven SOTAs, the results show that the proposed method achieves the best results, with IOUs of 91.22 and 78.93, especially in the localization of water bodies and boundaries. By applying the proposed method in different scenarios, the results show the stable capability of the proposed method for extracting water with various shapes and areas.

Adaptive feature fusion and disturbance correction for accurate remaining useful life prediction of rolling bearings

As a key component in the transmission system of high-speed trains, bearings need to withstand certain loads while rotating at high speeds. Once a failure occurs, it can directly affect the safety of train operations. Therefore, it is of great significance to establish a reliable remaining useful life model to ensure train operation safety. Addressing the problems of redundant features in the existing multi-feature fusion process, which affects diagnostic performance, and the spurious fluctuations in the fusion features, which cause inaccurate determination of the start fault time and lead to low prediction accuracy of remaining useful life, we propose a method based on adaptive feature fusion and the autoregressive integrated moving average model for rolling bearing prediction. Firstly, features from the time domain, frequency domain, and entropy are extracted. A feature selection mechanism with minimum redundancy is constructed to screen the optimal sensitive feature set. Secondly, based on adaptive feature fusion, the optimal sensitive feature set is dynamically fused, and the spurious fluctuations of the health index are corrected using linear regression and the 3σ principle. Next, a bottom-up time series segmentation method is employed to divide the health status of the Improved Health Indicators. Finally, a remaining useful life prediction model based on the autoregressive integrated moving average model is established. This study demonstrates that the proposed method effectively identifies features that are most sensitive to degradation trends, accurately determines the initial fault moment of bearings, and achieves effective prediction of the remaining useful life of bearings.

Feasibility study of opportunistic osteoporosis screening on chest CT using a multi-feature fusion DCNN model

SummaryA multi-feature fusion DCNN model for automated evaluation of lumbar vertebrae L1 on chest combined with clinical information and radiomics permits estimation of volumetric bone mineral density for evaluation of osteoporosis.PurposeTo develop a multi-feature deep learning model based on chest CT, combined with clinical information and radiomics to explore the feasibility in screening for osteoporosis based on estimation of volumetric bone mineral density.MethodsThe chest CT images of 1048 health check subjects were retrospectively collected as the master dataset, and the images of 637 subjects obtained from a different CT scanner were used for the external validation cohort. The subjects were divided into three categories according to the quantitative CT (QCT) examination, namely, normal group, osteopenia group, and osteoporosis group. Firstly, a deep learning–based segmentation model was constructed. Then, classification models were established and selected, and then, an optimal model to build bone density value prediction regression model was chosen.ResultsThe DSC value was 0.951 ± 0.030 in the testing dataset and 0.947 ± 0.060 in the external validation cohort. The multi-feature fusion model based on the lumbar 1 vertebra had the best performance in the diagnosis. The area under the curve (AUC) of diagnosing normal, osteopenia, and osteoporosis was 0.992, 0.973, and 0.989. The mean absolute errors (MAEs) of the bone density prediction regression model in the test set and external testing dataset are 8.20 mg/cm3 and 9.23 mg/cm3, respectively, and the root mean square errors (RMSEs) are 10.25 mg/cm3 and 11.91 mg/cm3, respectively. The R-squared values are 0.942 and 0.923, respectively. The Pearson correlation coefficients are 0.972 and 0.965.ConclusionThe multi-feature fusion DCNN model based on only the lumbar 1 vertebrae and clinical variables can perform bone density three-classification diagnosis and estimate volumetric bone mineral density. If confirmed in independent populations, this automated opportunistic chest CT evaluation can help clinical screening of large-sample populations to identify subjects at high risk of osteoporotic fracture.

Research on registration method for enface image using multi-feature fusion.

The purpose of this work is to accurately and quickly register the OCT projection (enface) images at adjacent time points, and to solve the problem of interference caused by CNV lesions on the registration features. In this work, a multi-feature registration strategy was proposed, in which a combined feature (com-feature) containing 3D information, intersection information and SURF feature was designed. Firstly, the coordinates of all feature points were extracted as combined features, and then these feature coordinates were added to the initial vascular coordinate set simplified by the Douglas-Peucker algorithm as the point set for registration. Finally, the Coherent Point Drift (CPD) registration algorithm was used to register the enface coordinate point sets of adjacent time series. The newly designed features significantly improve the success rate of global registration of vascular networks in enface images, while the simplification step greatly improves the registration speed on the basis of preserving vascular features. The MSE, DSC and time complexity of the proposed method are 0.07993, 0.9693 and 42.7016s, respectively. CNV is a serious retinal disease in ophthalmology. The registration of OCT enface images at adjacent time points can timely monitor the progress of the disease and assist doctors in making diagnoses. The proposed method not only improves the accuracy of OCT enface image registration, but also significantly reduces the time complexity. It has good registration results in clinical routine and provides a more efficient method for clinical diagnosis and treatment.

From Outside to Inside: The Subtle Probing of Globular Fruits and Solanaceous Vegetables Using Machine Vision and Near-Infrared Methods

Machine vision and near-infrared light technology are widely used in fruits and vegetable grading, as an important means of agricultural non-destructive testing. The characteristics of fruits and vegetables can easily be automatically distinguished by these two technologies, such as appearance, shape, color and texture. Nondestructive testing is reasonably used for image processing and pattern recognition, and can meet the identification and grading of single features and fusion features in production. Through the summary and analysis of the fruits and vegetable grading technology in the past five years, the results show that the accuracy of machine vision for fruits and vegetable size grading is 70–99.8%, the accuracy of external defect grading is 88–95%, and the accuracy of NIR and hyperspectral internal detection grading is 80.56–100%. Comprehensive research on multi-feature fusion technology in the future can provide comprehensive guidance for the construction of automatic integrated grading of fruits and vegetables, which is the main research direction of fruits and vegetable grading in the future.

Lightweight Multifeature Fusion Network for Finger Vein Recognition

Lightweight Multifeature Fusion Network for Finger Vein Recognition

Cyclic shift short-distance attention for defect detection of fine etching mesh

Abstract Based on the deficiency of the existing Swin Transformer in the detection of surface defects in metal etched grids, i.e. the isolation of information transmission between different windows, and the limitations of image matrix size and network structure,which make it not suitable for long sequence data processing and dense prediction scenarios, a defect detection method for metal etching nets based on Cyclic shift Long Short Distance Attention (C-LSDA) is proposed. In the proposed method, cross-scale features are used to capture long and short distance relationships,and enhance the feature transfer between windows. Tracking position bias (TPB) is also used to improve relative position bias (RPB), in order to help the model to better understand the spatial relationships in the input data. In addition, the image is downsampled at various scales, so that the proposed method can be suitable for long sequence data processing and dense prediction scenarios. In order to improve the detection accuracy of small targets. a multi-feature fusion pyramid network (MFFPN) for feature fusion is also proposed. The experimental results show that the proposed method is significantly superior to the traditional CNN recognition method and the transformer recognition method. The proposed methodhas good identification accuracy and low computational cost.

Multi-feature fusion and multi-attention deep network for enhancing road extraction in remote sensing images

ABSTRACT Road detection in remote sensing (RS) images plays a critical role in applications ranging from urban planning to autonomous navigation systems. However, accurate road extraction remains a challenging task due to the presence of textual-similar objects that can be visually confused with roads, and shadows that can obscure road features. For this regard, we present a novel end-to-end network that leverages multi-feature fusion and multi-attention. Multi-level dual residual blocks are introduced to capture multi-scale and multi-level road features. A channel attention feature fusion module fuses road features from the decoder while suppressing coarse-grain noises. Moreover, a difference channel feature fusion module filters out the interfering texture-similar features and irrelevant background features. Subsequently, a spatial channel feature enhancement module is designed to identify the mis-segmented regions and reclassify these pixels. We conducted extensive experiments on diverse datasets, demonstrating the effectiveness of our approach in improving road detection accuracy, especially in areas with shadows and textual-similar objects. The results indicate that our approach outperforms state-of-the-art methods in handling textual-similar objects and shadow-occluded roads, making it a valuable contribution to the field of road extraction in remote sensing images.

Fatigue Damage Monitoring of Composite Structures Based on Lamb Wave Propagation and Multi-Feature Fusion

To address the challenges associated with fatigue damage monitoring in load-bearing composite structures, we developed a method that utilizes Lamb wave propagation and partial least squares regression (PLSR) for effective monitoring. Initially, we extracted diverse characteristics from both the time and frequency domains of the Lamb wave signal to capture the essence of the damage. Subsequently, we constructed a PLSR model, leveraging Lamb wave multi-feature fusion, specifically tailored for in-service fatigue damage monitoring. The efficacy of our proposed approach in quantitatively monitoring fatigue damage was thoroughly validated through rigorous standard fatigue tests. In practical applications, our model effectively mitigated the impact of multicollinearity among feature variables on model accuracy. Furthermore, the PLSR model demonstrated superior accuracy compared to the PCR model, given an equal number of principal components. To strike a harmonious balance between efficiency and precision, we optimized the size of the feature variable. The results show that the optimized PLSR model achieved an R-squared value exceeding 97% in predicting the in-service damage area. This underscores the robustness and reliability of our method in accurately monitoring fatigue damage in load-bearing composite structures.

Multi-feature fusion for efficient inter prediction in versatile video coding

Multi-feature fusion for efficient inter prediction in versatile video coding

Leaf Moisture Content Detection Method Based on UHF RFID and Hyperdimensional Computing

Leaf moisture content (LMC) directly affects the life activities of plants and becomes a key factor to evaluate the growth status of plants. To explore a low-cost, real-time, rapid, and accurate method for LMC detection, this paper employs Ultra-High-Frequency Radio-Frequency Identification (UHF RFID) sensor technology. By reading the tag information attached to the back of leaves, the parameters of the RSSI, phase, and reading distance of the tags are collected. In this paper, we propose an enhanced Multi-Feature Fusion algorithm based on Hyperdimensional Computing (HDC) called MFFHDC. In our proposed method, the real-valued features are encoded into hypervectors and then combined with Multi-Linear Discriminant Analysis (MLDA) for the feature fusion of different features. Finally, a retraining method based on Cosine Annealing with Warm Restarts (CAWR) is proposed to improve the model and further enhance its accuracy. Tests conducted in the experimental forest show that the proposed mechanism can effectively predict the LMC. The model’s Mean Absolute Error (MAE), Root Mean Square Error (RMSE), and Coefficient of Determination (R2) reached 0.0195, 0.0255, and 0.9131, respectively. Additionally, comparisons with other methods demonstrate that the presented system performs excellently in most aspects. As a lightweight model, this study shows great practical application value, particularly for the limited data volume and low hardware costs.

Multi-Feature Fusion and RF-Based Fault Diagnosis of Ball Mill Rolling Bearings

Multi-Feature Fusion and RF-Based Fault Diagnosis of Ball Mill Rolling Bearings

Prediction of benign and malignant ground glass pulmonary nodules based on multi-feature fusion of attention mechanism.

The purpose of this study was to develop and validate a new feature fusion algorithm to improve the classification performance of benign and malignant ground-glass nodules (GGNs) based on deep learning. We retrospectively collected 385 cases of GGNs confirmed by surgical pathology from three hospitals. We utilized 239 GGNs from Hospital 1 as the training and internal validation set, and 115 and 31 GGNs from Hospital 2 and Hospital 3, respectively, as external test sets 1 and 2. Among these GGNs, 172 were benign and 203 were malignant. First, we evaluated clinical and morphological features of GGNs at baseline chest CT and simultaneously extracted whole-lung radiomics features. Then, deep convolutional neural networks (CNNs) and backpropagation neural networks (BPNNs) were applied to extract deep features from whole-lung CT images, clinical, morphological features, and whole-lung radiomics features separately. Finally, we integrated these four types of deep features using an attention mechanism. Multiple metrics were employed to evaluate the predictive performance of the model. The deep learning model integrating clinical, morphological, radiomics and whole lung CT image features with attention mechanism (CMRI-AM) achieved the best performance, with area under the curve (AUC) values of 0.941 (95% CI: 0.898-0.972), 0.861 (95% CI: 0.823-0.882), and 0.906 (95% CI: 0.878-0.932) on the internal validation set, external test set 1, and external test set 2, respectively. The AUC differences between the CMRI-AM model and other feature combination models were statistically significant in all three groups (all p<0.05). Our experimental results demonstrated that (1) applying attention mechanism to fuse whole-lung CT images, radiomics features, clinical, and morphological features is feasible, (2) clinical, morphological, and radiomics features provide supplementary information for the classification of benign and malignant GGNs based on CT images, and (3) utilizing baseline whole-lung CT features to predict the benign and malignant of GGNs is an effective method. Therefore, optimizing the fusion of baseline whole-lung CT features can effectively improve the classification performance of GGNs.

A Non-Invasive Fetal QRS Complex Detection Method Based on a Multi-Feature Fusion Neural Network

Fetal heart monitoring, as a crucial part of fetal monitoring, can accurately reflect the fetus’s health status in a timely manner. To address the issues of high computational cost, inability to observe fetal heart morphology, and insufficient accuracy associated with the traditional method of calculating the fetal heart rate using a four-channel maternal electrocardiogram (ECG), a method for extracting fetal QRS complexes from a single-channel non-invasive fetal ECG based on a multi-feature fusion neural network is proposed. Firstly, a signal entropy data quality detection algorithm based on the blind source separation method is designed to select maternal ECG signals that meet the quality requirements from all channel ECG data, followed by data preprocessing operations such as denoising and normalization on the signals. After being segmented by the sliding window method, the maternal ECG signals are calculated as data in four modes: time domain, frequency domain, time–frequency domain, and data eigenvalues. Finally, the deep neural network using three multi-feature fusion strategies—feature-level fusion, decision-level fusion, and model-level fusion—achieves the effect of quickly identifying fetal QRS complexes. Among the proposed networks, the one with the best performance has an accuracy of 95.85% and sensitivity of 97%.

Graph-based multi-Feature fusion method for speech emotion recognition

Graph-based multi-Feature fusion method for speech emotion recognition

A fine-grained image classification algorithm based on self-supervised learning and multi-feature fusion of blood cells

Leukemia is a prevalent and widespread blood disease, and its early diagnosis is crucial for effective patient treatment. Diagnosing leukemia types heavily relies on pathologists’ morphological examination of blood cell images. However, this process is tedious and time-consuming, and the diagnostic results are subjective, leading to potential misdiagnosis and underdiagnosis. This paper proposes a blood cell image classification method that combines MAE with an enhanced Vision Transformer to tackle these challenges. Initially, pre-training occurs on two datasets, TMAMD and Red4, using the MAE self-supervised learning algorithm. Subsequently, the pre-training weights are transferred to our improved model.This paper introduces feature fusion of the outputs from each layer of the Transformer encoder to maximize the utilization of features extracted from lower layers, such as color, contour, and texture of blood cells, along with deeper semantic features. Furthermore, the dynamic margins for the subcenter Arcface Loss function are employed to enhance the model’s fine-grained feature representation by achieving inter-class dispersion and intra-class aggregation. Models trained using our method achieved state-of-the-art results on both the TMAMD dataset and Red4 dataset, with classification accuracies of 93.51% and 81.41%, respectively. This achievement is expected to be a valuable reference for physicians in their clinical diagnoses.

An adaptive learning based aberrance repressed multi-feature integrated correlation filter for Visual Object Tracking (VOT)

Target tracking via Correlation Filter (CF) is a hot research area of computer vision domain, and offers various credible benefits. Existing CF algorithms face challenges when there are target appearance variations due to background noise, scale and illumination changes, occlusion, and fast motion, which severely degrades the overall tracker performance. To get maximum benefits, an object tracker should perform well with the less computational burden in the presence of real time challenging situations. To address this issue, a novel visual object trackeris proposed based on multi feature fusion and adaptive learning technique with aberrance suppression. At first, multiple features i.e., Histogram of gradient (HOG), Color Naming (CN), saliency, and gray level intensities are combined using feature fusion technique. Further, based on the evaluation of final fused response map using Peak-to-Sidelobe Ratio (PSR), an adaptive learning strategy is integrated to improve the learning phase of tracker. Tracking results show that the proposed strategy beats the other modern CF trackers with Distance Precision (DP) scores of 88.2%, 85.9%, and 74.1% and 64.7% over OTB2013, OTB2015, and TempleColor128 and UAV123 datasets respectively.

A Mechanical Fault Diagnosis Method for UCG-Type On-Load Tap Changers in Converter Transformers Based on Multi-Feature Fusion

The On-Load Tap Changer (OLTC) is the only movable mechanical component in a converter transformer. To ensure the reliable operation of the OLTC and to promptly detect mechanical faults in OLTCs to prevent them from developing into electrical faults, this paper proposes a fault diagnosis method for OLTCs based on a combination of Particle Swarm Optimization (PSO) algorithm and Least Squares Support Vector Machine (LSSVM) with multi-feature fusion. Firstly, a multi-feature extraction method based on time/frequency domain statistics, synchrosqueezed wavelet transform, singular value decomposition, and multi-scale modal decomposition is proposed. Meanwhile, the random forest algorithm is used to screen features to eliminate the influence of redundant features on the accuracy of fault diagnosis. Secondly, the PSO algorithm is introduced to optimize the hyperparameters of LSSVM to obtain optimal parameters, thereby constructing an optimal LSSVM fault diagnosis model. Finally, different types of feature combinations are utilized for fault diagnosis, and the impact of these feature combinations on the fault diagnosis results is compared. Experimental results indicate that features of different types can complement each other, making the OLTC state information carried by multi-dimensional features more comprehensive, which helps to improve the accuracy of fault diagnosis. Compared with four traditional fault diagnosis methods, the proposed method performs better in fault diagnosis accuracy, achieving the highest accuracy of 98.58%, which can help to detect mechanical faults in the OLTC early and reduce the system’s downtime.

A coupled multi-factor synergistic graph network model for traffic prediction

Abstract Since only the spatio-temporal structure itself is considered in the current traffic prediction process, and there is a lack of multi-factor information about the scene, which leads to problems such as lack of universality and authenticity in the spatio-temporal scene, we proposed a coupled multi-factor synergistic graph network (CM-SGN). For this network, this paper firstly adopts a fusion mechanism to fuse traffic features with coupled scene features, constructs a complex feature correlation matrix, and enhances the multi-feature fusion effect of spatio-temporal scenes; secondly, it introduces a spatio-temporal feature network constrained by an attention mechanism to ensure the spatio-temporal stability of the fused features; and lastly, it reduces the sensitivity of the scene-traffic interdependent targets by using the regression layer combinations of the loss function to improve the prediction generalization capability. Experiments were conducted on two real datasets. Experiments were conducted on two real datasets, and the results show that the model proposed in this paper meets the complex spatio-temporal scenarios in traffic prediction, effectively captures the intrinsic spatio-temporal dependencies, and has good stability and generalization ability.