Adaptive Modulation Research Articles

A single-layer dense convolutional reversible residual network for bearing fault diagnosis based on differential local adaptive

Abstract For the cross-domain fault diagnosis of industrial bearings under different working conditions and noise, most current domain adaptation methods in transfer learning only focus on either marginal distribution alignment or conditional distribution alignment. They fail to adequately combine discriminative and global distribution information. Furthermore, the majority of models have a very high parameter count and memory utilization, which makes it challenging to use them in real-world industrial situations. Therefore, a single-layer densely connected reversible residual network based on differential local adaptation is proposed. This network is more competitive in industrial applications than other fault diagnosis models since it not only uses less memory and has fewer parameters, but it also shows superior cross-domain fault diagnostic capacity in noisy situations. Additionally, to extract discriminative and global domain-invariant features, a domain adaptation module is created that takes into account local and global data distributions differently. Multiple transfer tasks and two distinct datasets are used to validate the model. Comparative tests reveal that the suggested model uses less memory and requires fewer parameters to attain good accuracy and transferability.

Open-Ethical AI: Advancements in Open-Source Human-Centric Neural Language Models

This survey summarizes the most recent methods for building and assessing helpful, honest, and harmless neural language models, considering small, medium, and large-size models. Pointers to open-source resources that help to align pre-trained models are given, including methods that use parameter-efficient techniques, specialized prompting frameworks, adapter modules, case-specific knowledge injection, and adversarially robust training techniques. Special care is given to evidencing recent progress on value alignment, commonsense reasoning, factuality enhancement, and abstract reasoning of language models. Most reviewed works in this survey publicly shared their code and related data and were accepted in world-leading Machine Learning venues. This work aims to help researchers and practitioners accelerate their entrance into the field of human-centric neural language models, which might be a cornerstone of the contemporary and near-future industrial and societal revolution.

Autonomous Extraction Technology for Aquaculture Ponds in Complex Geological Environments Based on Multispectral Feature Fusion of Medium-Resolution Remote Sensing Imagery

Coastal aquaculture plays a crucial role in global food security and the economic development of coastal regions, but it also causes environmental degradation in coastal ecosystems. Therefore, the automation, accurate extraction, and monitoring of coastal aquaculture areas are crucial for the scientific management of coastal ecological zones. This study proposes a novel deep learning- and attention-based median adaptive fusion U-Net (MAFU-Net) procedure aimed at precisely extracting individually separable aquaculture ponds (ISAPs) from medium-resolution remote sensing imagery. Initially, this study analyzes the spectral differences between aquaculture ponds and interfering objects such as saltwater fields in four typical aquaculture areas along the coast of Liaoning Province, China. It innovatively introduces a difference index for saltwater field aquaculture zones (DIAS) and integrates this index as a new band into remote sensing imagery to increase the expressiveness of features. A median augmented adaptive fusion module (MEA-FM), which adaptively selects channel receptive fields at various scales, integrates the information between channels, and captures multiscale spatial information to achieve improved extraction accuracy, is subsequently designed. Experimental and comparative results reveal that the proposed MAFU-Net method achieves an F1 score of 90.67% and an intersection over union (IoU) of 83.93% on the CHN-LN4-ISAPS-9 dataset, outperforming advanced methods such as U-Net, DeepLabV3+, SegNet, PSPNet, SKNet, UPS-Net, and SegFormer. This study’s results provide accurate data support for the scientific management of aquaculture areas, and the proposed MAFU-Net method provides an effective method for semantic segmentation tasks based on medium-resolution remote sensing images.

TEA-GCN: Transformer-Enhanced Adaptive Graph Convolutional Network for Traffic Flow Forecasting

Traffic flow forecasting is crucial for improving urban traffic management and reducing resource consumption. Accurate traffic conditions prediction requires capturing the complex spatial-temporal dependencies inherent in traffic data. Traditional spatial-temporal graph modeling methods often rely on fixed road network structures, failing to account for the dynamic spatial correlations that vary over time. To address this, we propose a Transformer-Enhanced Adaptive Graph Convolutional Network (TEA-GCN) that alternately learns temporal and spatial correlations in traffic data layer-by-layer. Specifically, we design an adaptive graph convolutional module to dynamically capture implicit road dependencies at different time levels and a local-global temporal attention module to simultaneously capture long-term and short-term temporal dependencies. Experimental results on two public traffic datasets demonstrate the effectiveness of the proposed model compared to other state-of-the-art traffic flow prediction methods.

AIFormer: Adaptive Interaction Transformer for 3D Point Cloud Understanding

Recently, significant advancements have been made in 3D point cloud analysis by leveraging transformer architecture in 3D space. However, it remains challenging to effectively implement local and global learning within irregular and sparse structures of 3D point clouds. This paper presents the Adaptive Interaction Transformer (AIFormer), a novel hierarchical transformer architecture designed to enhance 3D point cloud analysis by fusing local and global features through the adaptive interaction of features. Specifically, AIFormer mainly consists of several stacked AIFormer Blocks. Each AIFormer module employs the Local Relation Aggregation Module and the Global Context Aggregation Module, respectively, to extract local details of relationships within the reference point and long-range dependencies between reference points. Then, the local and global features are fused using the Adaptive Interaction Module for adaptive interaction to optimize the point representation. Additionally, the AIFormer Block further designs geometric relation functions and contextual relative semantic encoding to enhance local and global feature extraction capabilities, respectively. Extensive experiments on three popular 3D point cloud datasets verify that AIFormer achieves state-of-the-art or comparable performances. Our comprehensive ablation study further validates the effectiveness and soundness of the AIFormer design.

Polyamines: pleiotropic molecules regulating plant development and enhancing crop yield and quality.

Polyamines (PAs) are pleiotropic bioorganic molecules. Cellular PA contents are determined by a balance between PA synthesis and degradation. PAs have been extensively demonstrated to play vital roles in the modulation of plant developmental processes and adaptation to various environmental stresses. In this review, the latest advances on the diverse roles of PAs in a range of developmental processes, such as morphogenesis, organogenesis, growth and development, and fruit ripening, are summarized and discussed. Besides, the crosstalk between PAs and phytohormones or other signalling molecules, including H2O2 and NO, involved in these processes is dwelled on. In addition, the attempts made to improve the yield and quality of grain and vegetable crops through altering the PA catabolism are enumerated. Finally, several other vital questions that remain unanswered are proposed and discussed. These include the mechanisms underlying the cooperative regulation of developmental processes by PAs and their interplaying partners like phytohormones, H2O2 and NO; PA transport for maintaining homeostasis; and utilization of PA anabolism/catabolism for generating high-yield and good-quality crops. This review aims to gain new insights into the pleiotropic role of PAs in the modulation of plant growth and development, which provides an alternative approach for manipulating and engineering valuable crop varieties that can be used in the future.

Maximizing transmission capacity in optical communication systems utilizing a microresonator comb laser source with adaptive modulation and bandwidth allocation strategies

Traditional optical communication systems employ bulky laser arrays that lack coherence and are prone to severe frequency drift. Dissipative Kerr soliton microcombs offer numerous evenly spaced optical carriers with a high optical signal-to-noise ratio (OSNR) and coherence in chip-scale packages, potentially addressing the limitations of traditional wavelength division multiplexing (WDM) sources. However, soliton microcombs exhibit inhomogeneous OSNR and linewidth distributions across the spectra, leading to variable communication performance under uniform modulation schemes. Here, we demonstrate, for the first time, to our knowledge, the application of adaptive modulation and bandwidth allocation strategies in optical frequency comb (OFC) communication systems to optimize modulation schemes based on OSNR, linewidth, and channel bandwidth, thereby maximizing capacity. Experimental verification demonstrates that the method enhances spectral efficiency from 1.6 to 2.31 bit ⋅ s−1 ⋅ Hz−1, signifying a 44.58% augmentation. Using a single-soliton microcomb as the light source, we achieve a maximum communication capacity of 10.68 Tbps after 40 km of transmission in the C-band, with the maximum single-channel capacity reaching 432 Gbps. The projected combined transmission capacity for the C- and L-bands could surpass 20 Tbps. The proposed strategies demonstrate promising potential of utilizing soliton microcombs as future light sources in next-generation optical communication.

ERLNEIL-MDP: Evolutionary reinforcement learning with novelty-driven exploration for medical data processing

The rapid growth of medical data presents opportunities and challenges for healthcare professionals and researchers. To effectively process and analyze this complex and heterogeneous data, we propose evolutionary reinforcement learning with novelty-driven exploration and imitation learning for medical data processing (ERLNEIL-MDP) algorithm, including a novelty computation mechanism, an adaptive novelty-fitness selection strategy, an imitation-guided experience fusion mechanism, and an adaptive stability preservation module. The novelty computation mechanism quantifies the novelty of each policy based on its dissimilarity to the population and historical data, promoting exploration and diversity. The adaptive novelty-fitness selection strategy balances exploration and exploitation by considering policies' novelty and fitness during selection. The imitation-guided experience fusion mechanism incorporates expert knowledge and demonstrations into the learning process, accelerating the discovery of effective solutions. The adaptive stability preservation module ensures the stability and reliability of the learning process by dynamically adjusting the algorithm's hyperparameters and preserving elite policies across generations. These components work together to enhance the exploration, diversity, and stability of the learning process. The significance of this work lies in its potential to revolutionize medical data analysis, leading to more accurate diagnoses and personalized treatments. Experiments on MIMIC-III and n2c2 datasets demonstrate ERLNEIL-MDP's superior performance, achieving F1 scores of 0.933 and 0.928, respectively, representing 6.0 % and 6.7 % improvements over state-of-the-art methods. The algorithm exhibits strong convergence, high population diversity, and robustness to noise and missing data.

DAG-YOLO: A Context-Feature Adaptive fusion Rotating Detection Network in Remote Sensing Images

Object detection in remote sensing image (RSI) research has seen significant advancements, particularly with the advent of deep learning. However, challenges such as orientation, scale, aspect ratio variations, dense object distribution, and category imbalances remain. To address these challenges, we present DAG-YOLO, a one-stage context-feature adaptive weighted fusion network that incorporates through three innovative parts. First, we integrate 1D Gaussian Angle-coding with YOLOv5 to convert the angle regression task into a classification task, establishing a more robust rotating object detection baseline, GLR-YOLO. Second, we introduce the Dual Branch Context Adaptive Modeling module, which enhances feature extraction capabilities by capturing global context information. Third, we design an adaptive detect head with the Adaptive Global Feature Aggregation and Reweighting (AGFAR) module. AGFAR addresses feature inconsistency among different output layers of the Feature Pyramid Network, retaining useful semantic information and elevating detection accuracy. Extensive experiments on public datasets DOTA-v1.0, DOTA-v1.5, and UCAS-AOD showcase mAP scores of 77.75%, 73.79%, and 90.27%, respectively. Our proposed method has the best performance among the current mainstream SOTA methods, which proves its effectiveness in RSI object detection.

Deep Plug-and-Play Non-Iterative Cluster for 3D Global Feature Extraction

Efficient and accurate point cloud feature extraction is crucial for critical tasks such as 3D recognition and semantic segmentation. However, existing global feature extraction methods for 3D data often require designing different models for different input types (point clouds, voxels, and maps). This article proposes an efficient plug-and-play non-iterative clustering method (NICM) to establish a unified point cloud global feature extraction paradigm suitable for any input type to solve the above problems. The core idea of the NICM is to construct the connection between a single point and other global points based only on the cosine similarity between center points to achieve global feature extraction, which has linear complexity characteristics and can be combined with any existing feature extraction model. Additionally, to better integrate the features extracted by NICM and the original model, this article designs an adaptive feature fusion module is designed based on the gate unit, which retains similar features and effectively fuses dissimilar features based on their importance to downstream tasks. We have applied our method to downstream tasks such as point cloud recognition, part segmentation and scene segmentation. Sufficient experiments have proven that our method can provide comprehensive and robust features for the original model, and effectively improve the performance of downstream tasks.

The Impact of Varying Ratios of Light Quality Emitted by Light-Emitting Diodes (LEDs) on the Butter Lettuce

Light-emitting diodes (LEDs) are considered the optimal artificial light source for plant factories, yet further research is needed to understand the impact of LED light quality on plant growth. This experiment investigated the growth and development of butter lettuce under varying ratios of red and blue light provided by LEDs. The specific effects of different red and blue light quality ratios on butter lettuce growth were systematically tracked and recorded, with comprehensive measurements of growth parameters and photosynthetic characteristics. Empirical findings revealed that a higher red light component compared to blue light led to improved butter lettuce characteristics. These included increased leaf length and width, elevated plant height, higher relative chlorophyll content, and an increased net photosynthetic rate. The study also highlighted that the light quality requirements of lettuce fluctuate across different growth stages, allowing for adaptable modulation of lighting conditions to align with specific growth stage needs.Total fresh weight, total dry weight and dry matter content of lettuce reached the highest values in the R8B2 treatment with 80% red light and 20% blue light, and the percentage differences reached 29.2%, 23.1% and 13.9%, respectively. Additionally, the photosynthetic chlorophyll content and net photosynthetic rate exhibited maximum percentage differences of 22.22% and 14.6%, respectively. In conclusion, the experimental evidence supports that an R8B2 spectral composition (80% red and 20% blue light) in a controlled indoor setting represents the optimal light environment for the accelerated growth and superior quality of butter lettuce.

Integrating path signature and pen-tip trajectory features for online handwriting Yi text recognition

Recognizing online handwriting Yi text is crucial for recording and preserving Yi literature. However, the scarcity of online handwriting Yi text datasets has limited relevant research, impeding the process of Yi informatization. In this work, we use synthetic data to train models, and an Online Handwriting Yi Text Recognition Network (YTRN) is proposed, which extracts robust character features to address the gap between synthetic and real data. YTRN adeptly learns the spatial structure features from path signature feature maps and captures trajectory features from the pen-tip trajectories. Subsequently, an innovative adaptive feature fusion module integrates these two sets of features to yield more comprehensive and robust character representations. Experiments on our newly collected Yi-OLHWDB2.0 dataset demonstrate that our method outperforms previous approaches, achieving an impressive 95.67% accuracy. This highlights the model’s effectiveness in extracting comprehensive and robust features from path signature maps and pen-tip trajectories, significantly enhancing recognition accuracy and generalization.

Batch process soft sensing based on data-stacking multiscale adaptive graph neural network

Abstract Soft sensing technology has found extensive application in predicting key quality variables in batch processes. However, its application in batch process is limited by the uneven batch length, the correlation of data and the difficulty in extracting the dependencies between variables and within variables. To address these issues, we propose a data-stacking multiscale adaptive graph neural network (DSMAGNN) soft sensor model. Firstly, Mutual information (MI) is used to selected quality-related variables, the 3D batch data is converted into a time-delay sequence suitable for input to the soft sensor model through the data stacking strategy, and the underlying time correlation at different time scales is preserved by incorporating the multi-scale pyramid network. Secondly, the dependencies between variables are inferred by the adaptive graph learning module, while the dependencies both within and between variables are modeled by the multi-scale temporal graph neural network. Thirdly, collaborative work across different time scales is further facilitated by the scale fusion module. Finally, the feasibility and effectiveness of the model are verified through experiments in the industrial-scale penicillin fermentation process and hot rolling process. (DSMAGNN) soft sensor model. Firstly, MI is used to selected quality-related variables, and the data stacking strategy is employed to convert 3D batch data into a time-delay sequence suitable for input to the soft sensor model. A multiscale pyramid network is utilized to preserve the underlying time dependence across different time scales. Secondly, since the dependence relationship between variables may vary across different time scales, the adaptive graph learning modules deduce scale-specific variable dependencies without relying on predefined priors. Thirdly, given the multiscale feature representation and the inferred dependency relationships between scale-specific variables, we introduce a multiscale temporal graph neural network to jointly model dependencies within and between variables. Building upon this foundation, the scale fusion module is deployed to facilitate collaboration across different temporal scales and automatically capture the significance of contributing temporal patterns. We validate the feasibility and effectiveness of the proposed model through experiments conducted in industrial-scale penicillin fermentation and hot continuous rolling processes, the results show that the proposed model is superior to several compared models, thus confirming its validity.

Diffusion-driven Incomplete Multimodal Learning for Air Quality Prediction

Predicting air quality using multimodal data is crucial to comprehensively capture the diverse factors influencing atmospheric conditions. Therefore, this study introduces a multimodal learning framework that integrates outdoor images with traditional ground-based observations to improve the accuracy and reliability of air quality predictions. However, aligning and fusing these heterogeneous data sources pose a formidable challenge, further exacerbated by pervasive data incompleteness issues in practice. In this paper, we propose a novel incomplete multimodal learning approach (iMMAir) to recovery missing data for robust air quality prediction. Specifically, we first design a shallow feature extractor to capture modal-specific features within the latent representation space. Then we develop a conditional diffusion-driven recovery module to mitigate the distribution gap between the recovered and true data. This module further incorporates two conditional constraints of temporal correlation and semantic consistency for effective modal completion. Finally, we reconstruct incomplete modalities and fuse available data using a multimodal transformer network to predict the air quality. To alleviate the modality imbalance problem, we employ an adaptive gradient modulation strategy to adjust the optimization of each modality. Experimental results demonstrate that iMMAir significantly reduces prediction errors, outperforming baseline models by an average of 5.6% and 2.5% in air quality regression and classification tasks. Our source code and data are available at https://github.com/pestasu/IMMAir.

Adaptive-modulated fast fluctuation super-resolution microscopy

Fluorescence microscopy has significantly advanced biological imaging at the nanoscale, particularly with the advent of super-resolution microscopy (SRM), which transcends the Abbe diffraction limit. Most cutting-edge SR methods require high-precision optical setups, which constrain the widespread adoption of SRM. Fluorescence fluctuation-based SRM (FF-SRM) can break the diffraction limit without complex optical components, making it particularly well-suited for biological imaging. However, conventional FF-SRM methods, such as super-resolution optical fluctuation imaging (SOFI), still require specific fluorescent molecular blinking properties. Instead of enhancing the intrinsic blinking characteristics by finding specific fluorescent markers, employing optical methods such as spatial light modulation to adjust the excitation light field allows for easier and more flexible matching of the on-time ratio with the analysis of temporal stochastic intensity fluctuations. Nevertheless, the specific parameters of the modulation patterns have not been thoroughly explored, despite their crucial influence on the reconstruction quality. Herein, we propose adaptive-modulated fast fluctuation super-resolution microscopy. Our method demonstrates theoretically and experimentally that restricting the size of modulation units in a certain range ensures better image quality with fewer artifacts and signal losses. We find it still significantly effective when applied to other FF-SRM. Overall, the further development of the adaptive modulation technique has made it more stable in behavior and maintained high-quality imaging, presenting broader prospects for super resolution imaging based on statistical analysis.

Enhancing Multimodal Emotional Information Extraction in Film and Television through Adaptive Feature Fusion with DenseNe, Transformer, and 3D CNN Models

ABSTRACT The extraction of multimodal emotional information enables a more nuanced representation of the emotional subtleties embedded in film and television works. However, conventional approaches that independently extract features from images and text fail to capture the rich semantic interplay between these modalities, impeding the feature learning process within each modality. To address this, this paper presents an innovative model for extracting emotional information from multimodal film and television content. The model utilizes DenseNe for image feature extraction, enhancing network depth via the MSC module. Text feature extraction is achieved through a Transformer encoder, while video feature extraction employs a 3D CNN model. Refinements are made to the number and placement of convolutional layers, planar convolution size, and 3D convolution depth. Moreover, a multi-head scaled dot-product attention mechanism is incorporated into the interaction module to compute the similarity between each image block within the sequence and every word in the text sequence. Experimental evaluations on the CMU-MOSEI and CMU-MOSI datasets showcase superior performance compared to the baseline model, achieving accuracy and F1 scores of 0.708 and 0.698, respectively. Noteworthy is the proposed adaptive feature fusion module, which enriches the expressiveness of pivotal emotional features while eliminating redundant data.

Adversarial Unsupervised Domain Adaptation for 3D Semantic Segmentation with 2D Image Fusion of Dense Depth

AbstractUnsupervised domain adaptation (UDA) is increasingly used for 3D point cloud semantic segmentation tasks due to its ability to address the issue of missing labels for new domains. However, most existing unsupervised domain adaptation methods focus only on uni‐modal data and are rarely applied to multi‐modal data. Therefore, we propose a cross‐modal UDA on multi‐modal datasets that contain 3D point clouds and 2D images for 3D Semantic Segmentation. Specifically, we first propose a Dual discriminator‐based Domain Adaptation (Dd‐bDA) module to enhance the adaptability of different domains. Second, given that the robustness of depth information to domain shifts can provide more details for semantic segmentation, we further employ a Dense depth Feature Fusion (DdFF) module to extract image features with rich depth cues. We evaluate our model in four unsupervised domain adaptation scenarios, i.e., dataset‐to‐dataset (A2D2 → SemanticKITTI), Day‐to‐Night, country‐to‐country (USA → Singapore), and synthetic‐to‐real (VirtualKITTI → SemanticKITTI). In all settings, the experimental results achieve significant improvements and surpass state‐of‐the‐art models.

Adaptive Wireless Image Transmission Transformer Architecture for Image Transmission and Reconstruction

The advancement of 6G (6th Generation Mobile Networks) communication technology has posed challenges for traditional communication network architectures in meeting the demands for communication efficiency and quality. Semantic communication technology, characterized by its “understand before transmit” approach, has emerged as a pivotal technology driving the progress of 6G due to its ability to enhance communication efficiency and quality. The Wireless Image Transmission Transformer (WITT) model, which operates as a semantic communication system leveraging vision transformer technology for the transmission of semantic images, has shown efficacy in transmitting input images through processes of feature extraction and channel adaptation. This study introduces an advanced channel adaptive module that is informed by deep learning methodologies and the adaptive modulation principles of the Variational Information Bottleneck (VIB). This innovation enhances the original WITT model, resulting in the development of the Adaptive Wireless Image Transmission Transformer (ADWITT) architecture. Comprehensive experimental results have unequivocally shown that the transmission performance of the ADWITT architecture substantially surpasses that of the conventional WITT (Wavelet Image Transmission Technique) model, particularly in scenarios characterized by harsh and detrimental channel conditions. These findings underscore the robustness and adaptability of the ADWITT approach, which is poised to improve the field of image transmission by offering superior performance and resilience in environments where traditional methods falter.

YOLO-GE: An Attention Fusion Enhanced Underwater Object Detection Algorithm

Underwater object detection is a challenging task with profound implications for fields such as aquaculture, marine ecological protection, and maritime rescue operations. The presence of numerous small aquatic organisms in the underwater environment often leads to issues of missed detections and false positives. Additionally, factors such as the water quality result in weak target features, which adversely affect the extraction of target feature information. Furthermore, the lack of illumination underwater causes image blur and low contrast, thereby increasing the difficulty of the detection task. To address these issues, we propose a novel underwater object detection algorithm called YOLO-GE (GCNet-EMA). First, we introduce an image enhancement module to mitigate the impact of underwater image quality issues on the detection task. Second, a high-resolution feature layer is added into the network to improve the problems of missed detections and false positives for small targets. Third, we propose GEBlock, an attention-based fusion module that captures long-range contextual information and suppresses noise from lower-level feature layers. Finally, we combine an adaptive spatial fusion module with the detection head to filter out conflicting feature information from different feature layers. Experiments on the UTDAC2020, DUO and RUOD datasets show that the proposed method achieves an optimal detection accuracy.

A multi-scale feature extraction and fusion-based model for retinal vessel segmentation in fundus images.

In response to the challenge of low accuracy in retinal vessel segmentation attributed to the minute nature of the vessels, this paper proposes a retinal vessel segmentation model based on an improved U-Net, which combines multi-scale feature extraction and fusion techniques. An improved dilated residual module was first used to replace the original convolutional layer of U-Net, and this module, coupled with a dual attention mechanism and diverse expansion rates, facilitates the extraction of multi-scale vascular features. Moreover, an adaptive feature fusion module was added at the skip connections of the model to improve vessel connectivity. To further optimize network training, a hybrid loss function is employed to mitigate the class imbalance between vessels and the background. Experimental results on the DRIVE dataset and CHASE_DB1 dataset show that the proposed model has an accuracy of 96.27% and 96.96%, sensitivity of 81.32% and 82.59%, and AUC of 98.34% and 98.70%, respectively, demonstrating superior segmentation performance.