Adaptive Modulation Research Articles

Fault diagnosis algorithm based on GADF-DFT and multi-kernel domain coordinated adaptive network

To address the problems of low detection accuracy of rolling bearings under different loads and the difficulty of effectively identifying the lack of labelled data, a rolling bearing fault diagnosis method combining GADF-DFT image coding and Multi-kernel domain coordinated adaptation network is proposed. Firstly, the vibration signal is converted into a two-dimensional image using GADF coding technology, and then the GADF image is converted into the frequency domain using discrete Fourier transform to extract deeper feature information. Combined with the multi-source domain adaptive method, the public feature extraction module is used to initially achieve feature mining of the image; the MK-MMD algorithm of the domain-specific adaptive module reduces the difference in feature distribution between the source and target domains; and the final classification difference minimization module reduces the problems caused by the classification errors that may be generated by the different domain classifiers due to the fact that the data samples are located near the category boundaries. The test uses the Case Western Reserve University dataset and divides the dataset with different operating conditions as the source and target domains, and the test results show that the proposed model demonstrates its effectiveness in responding to the complex operating condition changes in rolling bearing fault detection in multiple operating condition migration tasks, good adaptability and robustness, and is able to achieve accurate fault diagnosis under different operating conditions.

DM-GAN: CNN hybrid vits for training GANs under limited data

Generative adversarial network (GAN) training demands substantial data and computational resources. This paper aims to explore an economical approach for generating novel images with limited image data, addressing the challenge of data scarcity. Our contributions involve resolving the few-shot image generation challenge through the development of an unsupervised hybrid generative adversarial network named DM-GAN. We introduce a lightweight hybrid module (DC-Vit) comprising convolution and visual transformation, merging local and global features to enhance image perception, expressiveness, and ensure stable image generation. Additionally, a multi-scale adaptive skip connection module is incorporated to effectively mitigate the feature loss problem arising from inter-layer jumps, thereby producing more complete and regular images. To enhance the texture learning process and improve the quality and realism of synthesized images, we integrate the gray conjugate matrix into the loss function. Empirical evaluations are conducted on small sample datasets at various resolutions, including publicly accessible collections of art paintings, real-life photographs, and proprietary artifact image datasets. The experimental results unequivocally demonstrate the qualitative and quantitative superiority of our model over existing methods, underscoring its efficacy and robustness.

NUAM-Net: A Novel Underwater Image Enhancement Attention Mechanism Network

Vision-based underwater exploration is crucial for marine research. However, the degradation of underwater images due to light attenuation and scattering poses a significant challenge. This results in the poor visual quality of underwater images and impedes the development of vision-based underwater exploration systems. Recent popular learning-based Underwater Image Enhancement (UIE) methods address this challenge by training enhancement networks with annotated image pairs, where the label image is manually selected from the reference images of existing UIE methods since the groundtruth of underwater images do not exist. Nevertheless, these methods encounter uncertainty issues stemming from ambiguous multiple-candidate references. Moreover, they often suffer from local perception and color perception limitations, which hinder the effective mitigation of wide-range underwater degradation. This paper proposes a novel NUAM-Net (Novel Underwater Image Enhancement Attention Mechanism Network) that addresses these limitations. NUAM-Net leverages a probabilistic training framework, measuring enhancement uncertainty to learn the UIE mapping from a set of ambiguous reference images. By extracting features from both the RGB and LAB color spaces, our method fully exploits the fine-grained color degradation clues of underwater images. Additionally, we enhance underwater feature extraction by incorporating a novel Adaptive Underwater Image Enhancement Module (AUEM) that incorporates both local and long-range receptive fields. Experimental results on the well-known UIEBD benchmark demonstrate that our method significantly outperforms popular UIE methods in terms of PSNR while maintaining a favorable Mean Opinion Score. The ablation study also validates the effectiveness of our proposed method.

An Intelligent diagnosis method for rolling bearings based on Ghost module and adaptive weighting module

An Intelligent diagnosis method for rolling bearings based on Ghost module and adaptive weighting module

E-BDL: Enhanced Band-Dependent Learning Framework for Augmented Radar Sensing.

Radar sensors, leveraging the Doppler effect, enable the nonintrusive capture of kinetic and physiological motions while preserving privacy. Deep learning (DL) facilitates radar sensing for healthcare applications such as gait recognition and vital-sign measurement. However, band-dependent patterns, indicating variations in patterns and power scales associated with frequencies in time-frequency representation (TFR), challenge radar sensing applications using DL. Frequency-dependent characteristics and features with lower power scales may be overlooked during representation learning. This paper proposes an Enhanced Band-Dependent Learning framework (E-BDL) comprising an adaptive sub-band filtering module, a representation learning module, and a sub-view contrastive module to fully detect band-dependent features in sub-frequency bands and leverage them for classification. Experimental validation is conducted on two radar datasets, including gait abnormality recognition for Alzheimer's disease (AD) and AD-related dementia (ADRD) risk evaluation and vital-sign monitoring for hemodynamics scenario classification. For hemodynamics scenario classification, E-BDL-ResNet achieves competitive performance in overall accuracy and class-wise evaluations compared to recent methods. For ADRD risk evaluation, the results demonstrate E-BDL-ResNet's superior performance across all candidate models, highlighting its potential as a clinical tool. E-BDL effectively detects salient sub-bands in TFRs, enhancing representation learning and improving the performance and interpretability of DL-based models.

A Multi-Level Adaptive Lightweight Net for Damaged Road Marking Detection Based on Knowledge Distillation

To tackle the complexity and limited applicability of high-precision segmentation models for damaged road markings, this study proposes a Multi-level Adaptive Lightweight Network (MALNet) based on knowledge distillation. By incorporating multi-scale dilated convolution and adaptive spatial channel attention fusion modules, the MALNet model significantly enhances the precision, integrity, and robustness of its segmentation branch. Furthermore, it employs an intricate knowledge distillation strategy, channeling rich, layered insights from a teacher model to a student model, thus elevating the latter’s segmentation ability. Concurrently, it streamlines the student model by markedly reducing its parameter count and computational demands, culminating in a segmentation network that is both high-performing and pragmatic. Rigorous testing on three distinct data sets for damaged road marking detection—CDM_P (Collective Damaged road Marking—Public), CDM_H (Collective Damaged road Marking—Highways), and CDM_C (Collective Damaged road Marking—Cityroad)—underscores the MALNet model’s superior segmentation abilities across all damage types, outperforming competing models in accuracy and completeness. Notably, the MALNet model excels in parameter efficiency, computational economy, and throughput. After distillation, the student model’s parameters and computational load decrease to only 31.78% and 27.40% of the teacher model’s, respectively, while processing speeds increase to 1.9 times, demonstrating a significant improvement in lightweight design.

Correction Compensation and Adaptive Cost Aggregation for Deep Laparoscopic Stereo Matching

Perception of digitized depth is a prerequisite for enabling the intelligence of three-dimensional (3D) laparoscopic systems. In this context, stereo matching of laparoscopic stereoscopic images presents a promising solution. However, the current research in this field still faces challenges. First, the acquisition of accurate depth labels in a laparoscopic environment proves to be a difficult task. Second, errors in the correction of laparoscopic images are prevalent. Finally, laparoscopic image registration suffers from ill-posed regions such as specular highlights and textureless areas. In this paper, we make significant contributions by developing (1) a correction compensation module to overcome correction errors; (2) an adaptive cost aggregation module to improve prediction performance in ill-posed regions; (3) a novel self-supervised stereo matching framework based on these two modules. Specifically, our framework rectifies features and images based on learned pixel offsets, and performs differentiated aggregation on cost volumes based on their value. The experimental results demonstrate the effectiveness of the proposed modules. On the SCARED dataset, our model reduces the mean depth error by 12.6% compared to the baseline model and outperforms the state-of-the-art unsupervised methods and well-generalized models.

A multi-domain adversarial transfer network for cross domain fault diagnosis under imbalanced data

In the intelligent fault diagnosis of rolling bearings, transfer learning methods extend the applicability of models to diverse working scenarios. However, real-world scenarios often suffer from data imbalance, which reduces diagnostic accuracy. To address this issue, this paper proposes a multi-domain adversarial transfer (MDAT) framework to enhance cross-domain fault diagnosis accuracy for rolling bearings under imbalanced data conditions. First, an enhanced information generation method is introduced to produce realistic and useable synthetic data to mitigate data imbalance. Subsequently, an adversarial multi-domain adaptation module is designed to learn invariant features across multiple domains. Finally, a domain reweighting method is proposed to improve domain alignment and enhance domain confusion. The effectiveness of the proposed method was validated through two case studies on rolling bearing fault diagnosis. The results demonstrated that MDAT achieved cross-domain diagnosis accuracies of 89.2% and 99.0% under imbalanced data conditions, confirming the effectiveness and superiority of the MDAT framework.

BiDiCOS: Camouflaged object segmentation via bilateral diffusion model

The task of camouflaged object segmentation (COS) is to extract objects with camouflage characteristics that are difficult to detect in an image. The current mainstream COS method mainly relies on the general object segmentation framework using the encoder-decoder structure to predict the objects. However, the current COS framework suffers from over-reliance on the labeled ground truth and the output results. To this end, we propose a bilateral diffusion model for camouflaged object segmentation (BiDiCOS). The main innovation of BiDiCOS is that we design a new bilateral diffusion paradigm, transforming the segmentation and depth estimation tasks into denoising tasks. At the same time, the depth estimation branch can provide semantic information to the segmentation branch. Specifically, we design the adaptive feature fusion module for two branches to provide the required features adaptively. We design the bilateral feature fusion module to fuse the depth information with the mask information to reduce the semantic and logical errors during segmentation. Finally, we develop the specialized training strategy and inference strategy for BiDiCOS, which provide a solid foundation for realizing rational training and accurate prediction. Comprehensive experiments on four challenging COS datasets attest to the superior performance of BiDiCOS compared to the existing 20 COS methods. Our BiDiCOS achieves state-of-the-art with different sizes of backbones, where the MAE is reduced by 4.3 % on average. We have also performed comparative experiments on depth estimation. The experiments demonstrate that BiDiCOS can achieve a win–win situation for both tasks. The code will be available at https://github.com/jiangxinhao2020/BiDiCOS.

BFT‐Net: A transformer‐based boundary feedback network for kidney tumour segmentation

AbstractKidney tumours are among the top ten most common tumours, the automatic segmentation of medical images can help locate tumour locations. However, the segmentation of kidney tumour images still faces several challenges: firstly, there is a lack of renal tumour endoscopic datasets and no segmentation techniques for renal tumour endoscopic images; secondly, the intra‐class inconsistency of tumours caused by variations in size, location, and shape of renal tumours; thirdly, difficulty in semantic fusion during decoding; and finally, the issue of boundary blurring in the localization of lesions. To address the aforementioned issues, a new dataset called Re‐TMRS is proposed, and for this dataset, the transformer‐based boundary feedback network for kidney tumour segmentation (BFT‐Net) is proposed. This network incorporates an adaptive context extract module (ACE) to emphasize local contextual information, reduces the semantic gap through the mixed feature capture module (MFC), and ultimately improves boundary extraction capability through end‐to‐end optimization learning in the boundary assist module (BA). Through numerous experiments, it is demonstrated that the proposed model exhibits excellent segmentation ability and generalization performance. The mDice and mIoU on the Re‐TMRS dataset reach 91.1% and 91.8%, respectively.

A Robustness Study on Early Fire Image Recognitions

With the advancement of society and the rapid urbanization process, there is an escalating need for effective fire detection systems. This study endeavors to bolster the efficacy and dependability of fire detection systems in intricate settings by refining the existing You Only Look Once version 5 (YOLOv5) algorithm and introducing algorithms grounded on fire characteristics. Primarily, the Convolutional Block Attention Module (CBAM) attention mechanism is introduced to steer the model towards substantial features, thereby amplifying detection precision. Subsequently, a multi-scale feature fusion network, employing the Adaptive Spatial Feature Fusion Module (ASFF), is embraced to proficiently amalgamate feature information from various scales, thereby enhancing the model’s comprehension of image content and subsequently fortifying detection resilience. Moreover, refining the loss function and integrating a larger detection head further fortify the model’s capability to discern diminutive targets. Experimental findings illustrate that the refined YOLOv5 algorithm attains accuracy advancements of 8% and 8.2% on standard and small target datasets, respectively. To ascertain the practical viability of the refined YOLOv5 algorithm, this study introduces a temperature-based flame detection algorithm. By amalgamating and deploying both algorithms, the ultimate experimental outcomes reveal that the integrated algorithm not only elevates accuracy but also achieves a frame rate of 57 frames, aligning with the prerequisites for practical deployment.

T-distributed Stochastic Neighbor Network for unsupervised representation learning

Unsupervised representation learning (URL) is still lack of a reasonable operator (e.g. convolution kernel) for exploring meaningful structural information from generic data including vector, image and tabular data. In this paper, we propose a simple end-to-end T-distributed Stochastic Neighbor Network (TsNet) for URL with clustering downstream task. Concretely, our TsNet model has three major components: (1) an adaptive connectivity distribution learning module is presented to construct a pairwise graph for preserving the local structure of generic data; (2) a T-distributed stochastic neighbor embedding based loss function is designed to learn a transformation between embeddings and original data, which improves the discrimination of representations; (3) a nonlinear parametric mapping is learned via our TsNet on an unsupervised generalized manner, which can address the “out-of-sample” issue. By combining these components, our method is able to considerably outperform previous related unsupervised learning approaches on visualization and clustering of generic data. A simple deep neural network equipped on our model respectively achieves 74.90%, 76.56% ACC and NMI, which is 8% relative improvement over previous state-of-the-art on real single-cell RNA-sequencing (scRNA-seq) datasets clustering.

Adaptive optical third-harmonic generation microscopy for in vivo imaging of tissues.

Third-harmonic generation microscopy is a powerful label-free nonlinear imaging technique, providing essential information about structural characteristics of cells and tissues without requiring external labelling agents. In this work, we integrated a recently developed compact adaptive optics module into a third-harmonic generation microscope, to measure and correct for optical aberrations in complex tissues. Taking advantage of the high sensitivity of the third-harmonic generation process to material interfaces and thin membranes, along with the 1,300-nm excitation wavelength used here, our adaptive optical third-harmonic generation microscope enabled high-resolution in vivo imaging within highly scattering biological model systems. Examples include imaging of myelinated axons and vascular structures within the mouse spinal cord and deep cortical layers of the mouse brain, along with imaging of key anatomical features in the roots of the model plant Brachypodium distachyon. In all instances, aberration correction led to enhancements in image quality.

MSAug: Multi-Strategy Augmentation for rare classes in semantic segmentation of remote sensing images

Recently, remote sensing images have been widely used in many scenarios, gradually becoming the focus of social attention. Nevertheless, the limited annotation of scarce classes severely reduces segmentation performance. This phenomenon is more prominent in remote sensing image segmentation. Given this, we focus on image fusion and model feedback, proposing a multi-strategy method called MSAug to address the remote sensing imbalance problem. Firstly, we crop rare class images multiple times based on prior knowledge at the image patch level to provide more balanced samples. Secondly, we design an adaptive image enhancement module at the model feedback level to accurately classify rare classes at each stage and dynamically paste and mask different classes to further improve the model’s recognition capabilities. The MSAug method is highly flexible and can be plug-and-play. Experimental results on remote sensing image segmentation datasets show that adding MSAug to any remote sensing image semantic segmentation network can bring varying degrees of performance improvement.

Dehazing & Reasoning YOLO: Prior knowledge-guided network for object detection in foggy weather

Fast and accurate object detection in foggy weather is crucial for visual tasks such as autonomous driving and video surveillance. Existing methods typically preprocess images with enhancement techniques before the object detector, so that the real-time performance of object detection decreases to some extent. Meanwhile, many popular object detection models rely solely on visual features for localization and classification. When fog is present, visual features would be so adversely impacted that the detection accuracy sharply decreases. Therefore, we propose an end-to-end prior knowledge-guided network called DR-YOLO for object detection in foggy weather. DR-YOLO integrates the atmospheric scattering model and the co-occurrence relation graph as prior knowledge into the entire training process of the detector. Firstly, Restoration Subnet Module (RSM) is designed to employ the atmospheric scattering model to guide the learning direction of the detector for dehazing features. Specifically, it is only adopted during the training process and does not increase the time cost of detection process. Secondly, for guiding the detector to pay more attention to potential co-occurring objects in the same scene, we introduce Relation Reasoning Attention Module (RRAM) that utilizes the co-occurrence relation graph to supplement deficient visual features in foggy weather. In addition, DR-YOLO employs Adaptive Feature Fusion Module (AFFM) to effectively merge the key features from the backbone and neck for the needs of RRAM and RSM. Finally, we conduct experiments on clear, synthetic and real-world foggy datasets to demonstrate the effectiveness of DR-YOLO. The source code is available at https://github.com/wenxinss/DR-YOLO.

Detection of Cervical Lesion Cell/Clumps Based on Adaptive Feature Extraction.

Automated detection of cervical lesion cell/clumps in cervical cytological images is essential for computer-aided diagnosis. In this task, the shape and size of the lesion cell/clumps appeared to vary considerably, reducing the detection performance of cervical lesion cell/clumps. To address the issue, we propose an adaptive feature extraction network for cervical lesion cell/clumps detection, called AFE-Net. Specifically, we propose the adaptive module to acquire the features of cervical lesion cell/clumps, while introducing the global bias mechanism to acquire the global average information, aiming at combining the adaptive features with the global information to improve the representation of the target features in the model, and thus enhance the detection performance of the model. Furthermore, we analyze the results of the popular bounding box loss on the model and propose the new bounding box loss tendency-IoU (TIoU). Finally, the network achieves the mean Average Precision (mAP) of 64.8% on the CDetector dataset, with 30.7 million parameters. Compared with YOLOv7 of 62.6% and 34.8M, the model improved mAP by 2.2% and reduced the number of parameters by 11.8%.

Transformer-based cross-modality interaction guidance network for RGB-T salient object detection

Exploring more effective multimodal fusion strategies is still challenging for RGB-T salient object detection (SOD). Most RGB-T SOD methods tend to focus on the strategy of acquiring modal complementary features by utilizing foreground information while ignoring the importance of background information for salient object localization. In addition, feature fusion without information filtering may introduce more noise. To solve these problems, this paper proposes a new cross-modal interaction guidance network (CIGNet) for RGB-T saliency object detection. Specifically, we construct a transformer-based dual-stream encoder to extract multimodal features. In the decoder, we propose an attention mechanism-based modal information complementary module (MICM) for capturing cross-modal complementary information for global comparison and salient object localization. Based on the MICM features, we design a multi-scale adaptive fusion module (MAFM) to find the optimal salient region of the multi-scale fusion process and reduce redundant features. In order to enhance the completeness of salient features after multi-scale feature fusion, this paper proposes the saliency region mining module (SRMM), which corrects the features in the boundary neighborhood by exploiting the differences between foreground and background pixels and the boundary. Comparisons with other state-of-the-art methods on three RGB-T datasets and five RGB-D datasets, the experimental results demonstrate the superiority and extensiveness of the proposed CIGNet.

Research on the Generation of Professional Skill Modules for Talent Cultivation in the Landscape Architecture Profession for Industry-Education Integration of Small and Medium-Sized Enterprises

Due to industry characteristics or regional limitations, many students in certain majors tend to seek employment in small and medium-sized enterprises (SMEs). SMEs face certain challenges in implementing industry-education integration, and there is a lack of mature methods in specific implementation processes and talent cultivation plan generation. Taking the landscape architecture profession as an example, this paper conducts a correlation analysis and cross-analysis of the industry-required professional skills based on surveys of over 300 industry practitioners employed in SMEs. It provides professional skill cultivation modules based on market feedback. This research process and analysis method have certain reference significance for the rapid production of adaptive talent cultivation professional skill modules in other industries targeting SMEs.

HSAW: A Half-Face Self-Attention Weighted Approach for Facial Expression Recognition

Facial expression recognition plays an increasingly important role in daily life, and it is used in several areas of human–computer interaction, such as robotics, assisted driving, and intelligent tutoring systems. However, the current mainstream methods are based on the whole face, and do not consider the existence of expression asymmetry between the left and right half-face. Hence, the accuracy of facial expression recognition needs to be improved. In this paper, we propose a half-face self-attention weighted approach called HSAW. Using statistical analysis and computer vision techniques, we found that the left half-face contains richer expression features than the right half-face. Specifically, we employed a self-attention mechanism to assign different weights to the left and right halves of the face. These weights are combined with convolutional neural network features for improved facial expression recognition. Furthermore, to attack the presence of uncertain categories in the dataset, we introduce adaptive re-labeling module, which can improve the recognition accuracy. Extensive experiments conducted on the FER2013 and RAF datasets have verified the effectiveness of the proposed method, which utilizes fewer parameters.

Autonomous Thermal Modulator Based on Gold Film‐Coated Liquid Crystal Elastsomer

AbstractRadiative cooling has been recently intensively explored for thermal management and enhancing energy efficiency. Yet, traditional materials with singular emissivity fall short in dynamic thermal management, highlighting the need for materials that can adjust their thermal radiation in real time. Active modulation methods, requiring external stimuli such as mechanical stretch, electric potential, or humidity change, offer adaptability but can increase energy use and complexity. Passive approaches, using materials' inherent thermal‐responsive properties, face manufacturing and scalability challenges. Here, a scalable yet effective passive approach is introduced for adaptive thermal modulation based on gold (Au) and liquid crystal elastomer (LCE) with a reversible response to environmental temperature changes. This modulator enables a “low thermal resistance” state through actuation‐induced microcracks that expose a high‐emissivity polymer substrate, and a “high thermal resistance” state by closing these microcracks and forming a high thermal resistance air gap between the modulator and the target object. The flexible design and fixed external dimensions of the Au‐LCE thermal modulator make it adaptable to various surface geometries. Furthermore, by adjusting the LCE's chemical composition, the modulator's transition temperature can be tailored, broadening its applications from enhancing building energy efficiency to improving clothing thermal comfort.