Learning Framework Research Articles

Machine-Learning-Assisted Screening of Nanocluster Electrocatalysts: Mapping and Reshaping the Activity Volcano for the Oxygen Reduction Reaction.

In computational heterogeneous catalysis, Sabatier's principle-based activity volcano plots provide an intuitive guide to catalyst design but impose a fundamental constraint on the maximum achievable catalytic performance. Recently, subnano clusters have emerged as an exciting platform, offering high noble metal utilization and superior performance for various reactions compared to extended surfaces, reflecting a complex structure-activity relationship in the non-scalable regime. However, understanding their non-monotonic catalytic activity, attributed to the large configurational space and their fluxional identity, poses a formidable challenge. Here, we present a machine learning (ML) framework that captures the non-monotonic trends in oxygen reduction reaction (ORR) activity at the subnanometer scale, attributed to their dynamic fluxional characteristics. We demonstrate a size-dependent shifting and reshaping of the ORR activity volcano, with Au replacing Pt at the peak. Leveraging only upon the non-ab initio geometric and electronic properties, our trained ML model accurately captures the site-specific adsorption energies of intermediates at the subnanometer regime. To account for the inconsistent trend in activity, we analyzed the correlation between electronic and geometric properties. Our findings reveal that the d-filling and coupling matrix of the neighboring metal atom significantly influences the intermediate adsorption on the local chemical environment compared to the d-band center. Following this analysis, we utilized ML to map the catalyst distribution in the activity volcano and identified the five best sub-nano electrocatalysts, demonstrating overpotential values lower than or comparable to the Pt(111) surface for the ORR. This study provides intuitive guidelines for the rational designing of highly efficient electrocatalysts for fuel cell applications while modifying the activity volcano plots for electrocatalysts at the subnanometer regime.

Data free knowledge distillation with feature synthesis and spatial consistency for image analysis.

Privacy and security concerns restrict access to original training datasets, posing significant challenges for model compression. Data-Free Knowledge Distillation (DFKD) emerges as a solution, aiming to transfer knowledge from teacher to student networks without accessing original data. Existing DFKD methods struggle to generate high-quality synthetic samples that capture the complexities of real-world data, leading to suboptimal knowledge transfer. Moreover, these approaches often fail to preserve the spatial attributes of the teacher network, resulting in shortcut learning and limited generalization.To address these issues, a novel DFKD strategy is proposed with three innovations: (1) an enhanced DCGAN generator with an attention module for synthesizing samples with improved micro-discriminative features; (2) a Multi-Scale Spatial Activation Region Consistency (MSARC) mechanism to accurately replicate the teacher's spatial attributes; and (3) an adversarial learning framework that creates a dynamic competitive environment between the generative and distillation phases. Rigorous evaluation of the method on several benchmark datasets, including CIFAR-10, CIFAR-100, Tiny-ImageNet, and medical imaging datasets such as PathMNIST, BloodMNIST, and PneumoniaMNIST, demonstrates superior performance compared to existing DFKD methods. Specifically, on CIFAR-100, the student network attains an accuracy of 77.85%, surpassing previous methods like CMI and SpaceshipNet. On BloodMNIST, the method achieves an accuracy of 80.50%, outperforming the next best method by over 5%.

Application of Nexus Learning framework for Personalized Medicine and Drug Development

Biological systems provide an enormous amount of knowledge on development and disease. The pharmaceutical industry is facing new possibilities and challenges with the rise of high-throughput methods to study disease and biology. The aim is to develop drugs based on acceptable therapeutic assumptions. Nexus Learning provides a variety of tools that help improve discovery and decision making using extensive, high-quality data and well-specified queries. Potential applications of NLF can be found across the whole drug development process. Clinical study target validation, prognostic biomarker discovery, and digital pathology data processing are a few examples. There has been a wide variety of applications in terms of technique and environment, with some methods producing reliable forecasts and insights. The primary problem with using NLF is that the findings provided by NL tend to be easy to understand or reproduce, which can limit their value. The collection of complete and methodical high-dimensional data remains an essential need across all domains. By addressing these challenges and increasing understanding about what is required to verify NLF methodologies, we can employ NLF to make data-driven decisions, which can speed up drug discovery and development and minimize failure rates.

Improving the Classification of Defect Levels in Main Electrical Equipment Through Advanced Prompting on a Large Language Model

The stable operation of the power system is closely related to the national economy and people’s livelihoods. Therefore, the timely detection, qualitative assessment, and handling of major equipment defects are crucial. The classification of defect levels in main electrical equipment is a fundamental task in this process, which is often manually completed, supplemented by knowledge bases or expert systems. However, this approach is time-consuming, labor-intensive, involves challenging human–machine interaction, and relies on expert experience. Conversational large language models, such as ChatGPT, ERNIE Bot, ChatGLM, have garnered widespread recognition in various domains. However, these models may have errors in the reasoning process, resulting in biased or even erroneous outputs, which is referred to as the “hallucinations”. The hallucinations’ problem of large language models poses challenges in specific fields. To mitigate the hallucinations in large language models, researchers often seek to incorporate domain-specific knowledge into these models through methods like fine-tuning or prompt learning. In order to enhance model performance while minimizing computational costs, this study adopts the prompt learning approach. Specifically, we propose a large language model prompt learning framework based on knowledge graphs, aiming to provide the large language model with reasoning support by leveraging specific information stored within the knowledge graph and receive explainable reasoning result. Experimental results demonstrate that our module achieved superior results on the power defect dataset compared to the non-prompt method.

Arts Integration in an Undergraduate General Education Course to Improve Engagement in Bioengineering

AbstractRapid advancements in bioengineering call for broad public literacy to help individuals better understand the changes these technologies bring to our lives. However, making bioengineering concepts accessible and relevant, especially to non-science majors, is often challenging. To address this challenge, we designed a general education course aimed at demystifying bioengineering through an inclusive, interdisciplinary approach. Grounded in STEAM (Science, Technology, Engineering, Arts, and Mathematics), sociocultural learning frameworks, and inquiry-based learning, the course integrates artistic perspectives with scientific instruction to encourage creativity and critical thinking. Students explore core bioengineering concepts, ethical considerations, and societal impacts through a combination of art, hands-on making, and collaborative learning. We observed high engagement and interdisciplinary connections in the classroom and the practical experiences shared here highlight the potential for such an approach to enhance scientific literacy and appreciation of bioengineering’s role in society.

AFF_CGE: Combined Attention-Aware Feature Fusion and Communication Graph Embedding Learning for Detecting Encrypted Malicious Traffic

While encryption enhances data security, it also presents significant challenges for network traffic analysis, especially in detecting malicious activities. To tackle this challenge, this paper introduces combined Attention-aware Feature Fusion and Communication Graph Embedding Learning (AFF_CGE), an advanced representation learning framework designed for detecting encrypted malicious traffic. By leveraging an attention mechanism and graph neural networks, AFF_CGE extracts rich semantic information from encrypted traffic and captures complex relations between communicating nodes. Experimental results reveal that AFF_CGE substantially outperforms traditional methods, improving F1-scores by 5.3% through 22.8%. The framework achieves F1-scores ranging from 0.903 to 0.929 across various classifiers, exceeding the performance of state-of-the-art techniques. These results underscore the effectiveness and robustness of AFF_CGE in detecting encrypted malicious traffic, demonstrating its superior performance.

Teacher Support and Student Engagement in the Conduct of Blended Learning Instruction for English as A Foreign Language

With the deep integration of information technology and education, blended learning has emerged as a new paradigm in higher education, combining the strengths of both online and offline learning environments. This approach allows English as Foreign Language (EFL) learners, particularly in the Chinese context, to engage in flexible and continuous learning beyond traditional classroom settings, thereby fostering greater student initiative and self-directed learning. Understanding the impact of teacher support on student engagement within this blended learning framework is crucial for optimizing educational outcomes. This study employed a quantitative descriptive comparative and correlational research design to examine the relationship between various forms of teacher support—instructional, emotional, feedback, and interpersonal—and student engagement among 307 Chinese EFL learners in a blended learning environment. The findings reveal that all forms of teacher support were perceived as high, with feedback provision ranking highest. Similarly, student engagement was also rated highly across behavioral, cognitive, emotional, and social domains. The Pearson correlation coefficient between teacher support and student engagement was found to be 0.75, indicating a significant positive relationship. Based on these findings, a program aimed at enhancing teacher support to further improve student engagement in blended learning environments was developed and recommended.

The ImmunoSkills Guide: Competencies for undergraduate immunology curricula.

Immune literacy garnered significant attention in recent years due to the threat posed by emerging infectious diseases. The pace of immunological discoveries and their relevance to society are substantial yet coordinated educational efforts have been rare. This motivated us to create a task force of educators to reflect on pedagogical approaches to teaching immunology and to draft, develop, and evaluate key competencies for undergraduate immunology education. The research questions addressed include: 1) Which competencies are considered important by educators? 2) Are the illustrative skills clear, accurate and well aligned with the core competencies listed in the Vision and Change report?; 3) What are the concerns of immunology educators about competencies and skills? We collected data on the draft competencies using surveys, focus groups, and interviews. The iterative revision phase followed the community review phase before finalizing the framework. Here, we report a hierarchical learning framework, with six core competencies, twenty illustrative skills, and companion immunology-specific example learning outcomes. Predominant themes from interviews and focus groups, which informed revisions of this framework are shared. With the growing need for immunology education across the sciences, the ImmunoSkills Guide and accompanying discussion can be used as a resource for educators, administrators and policymakers.

Capturing cell heterogeneity in representations of cell populations for image-based profiling using contrastive learning.

Image-based cell profiling is a powerful tool that compares perturbed cell populations by measuring thousands of single-cell features and summarizing them into profiles. Typically a sample is represented by averaging across cells, but this fails to capture the heterogeneity within cell populations. We introduce CytoSummaryNet: a Deep Sets-based approach that improves mechanism of action prediction by 30-68% in mean average precision compared to average profiling on a public dataset. CytoSummaryNet uses self-supervised contrastive learning in a multiple-instance learning framework, providing an easier-to-apply method for aggregating single-cell feature data than previously published strategies. Interpretability analysis suggests that the model achieves this improvement by downweighting small mitotic cells or those with debris and prioritizing large uncrowded cells. The approach requires only perturbation labels for training, which are readily available in all cell profiling datasets. CytoSummaryNet offers a straightforward post-processing step for single-cell profiles that can significantly boost retrieval performance on image-based profiling datasets.

Research trends in digital entrepreneurship education: A bibliometric analysis

Digital entrepreneurship learning is an essential approach to equipping students with knowledge and skills for entrepreneurial behaviour in a digital landscape. This study presents a comprehensive bibliometric analysis of the literature on digital entrepreneurship learning. A total of 359 articles were initially retrieved from the Scopus database, focusing on publications from 2018 to 2022, and 121 relevant articles were selected for in-depth analysis. References were organized using Mendeley, and VOSviewer software was employed for the classification and visualization of trends, key themes, and research networks within the field. This review serves as a foundational resource for future research, highlighting prevalent topics and gaps in digital entrepreneurship education. By mapping the evolution and focus areas of current studies, this paper provides valuable insights for educators, researchers, and policymakers to support the development of effective digital entrepreneurship learning frameworks. Keywords: Bibliometric analysis; digital; entrepreneurship.

Novelty Classification Model Use in Reinforcement Learning for Cervical Cancer

Purpose: Cervical cancer significantly impacts global health, where early detection is piv- otal for improving patient outcomes. This study aims to enhance the accuracy of cervical cancer diagnosis by addressing class imbalance through a novel hybrid deep learning model. Methods: The proposed model, RL-CancerNet, integrates EfficientNetV2 and Vision Transformers (ViTs) within a Reinforcement Learning (RL) framework. EfficientNetV2 extracts local features from cervical cytology images to capture fine-grained details, while ViTs analyze these features to recognize global dependencies across image patches. To address class imbalance, an RL agent dynamically adjusts the focus towards minority classes, thus reducing the common bias towards majority classes in medical image classification. Additionally, a Supporter Module incorporating Conv3D and BiLSTM layers with an attention mechanism enhances contextual learning. Results: RL-CancerNet was evaluated on the benchmark cervical cytology datasets Herlev and SipaKMeD, achieving an exceptional accuracy of 99.7%. This performance surpasses several state-of-the-art models, demonstrating the model’s effectiveness in identifying subtle diagnostic features in complex backgrounds. Conclusions: The integration of CNNs, ViTs, and RL into RL-CancerNet significantly improves the diagnostic accuracy of cervical cancer screenings. This model not only advances the field of automated medical screening but also provides a scalable framework adaptable to other medical imaging tasks, potentially enhancing diagnostic processes across various medical domains.

Heutagogical-based mobile social media space

This concise paper aims to propose a framework for enhancing intercultural communication competencies among Chinese as foreign language (CFL) learners using Heutagogical-based Mobile Social Media spaces. Integrating qualitative and quantitative data analysis with Activity Theory (AT) and the Design for Transformative Mobile Learning (DTML) framework, this study seeks to develop a potentially effective educational approach. By leveraging mobile social media, the envisioned framework intends to support autonomous learning and foster intercultural competencies among CFL learners.

(Re)defining Mobile Learning in the Post COVID-19 and GenAI Era

Mobile learning, thrust into the spotlight during the COVID-19 pandemic, has a rich 40-year history with a robust body of research predating 2020. This concise paper revisits mobile learning in light of the accelerated technological advancements and shifting educational practices post-pandemic. By examining the evolution of mobile learning frameworks and integrating recent advancements in AI and wearable technologies, we propose a contemporary redefinition that emphasises an accessible mobile ecology. We further explore the theoretical foundations and emerging scenarios in mobile learning, focusing on authentic learning experiences with current trends.

Replay-Based Incremental Learning Framework for Gesture Recognition Overcoming the Time-Varying Characteristics of sEMG Signals

Gesture recognition techniques based on surface electromyography (sEMG) signals face instability problems caused by electrode displacement and the time-varying characteristics of the signals in cross-time applications. This study proposes an incremental learning framework based on densely connected convolutional networks (DenseNet) to capture non-synchronous data features and overcome catastrophic forgetting by constructing replay datasets that store data with different time spans and jointly participate in model training. The results show that, after multiple increments, the framework achieves an average recognition rate of 96.5% from eight subjects, which is significantly better than that of cross-day analysis. The density-based spatial clustering of applications with noise (DBSCAN) algorithm is utilized to select representative samples to update the replayed dataset, achieving a 93.7% recognition rate with fewer samples, which is better than the other three conventional sample selection methods. In addition, a comparison of full dataset training with incremental learning training demonstrates that the framework improves the recognition rate by nearly 1%, exhibits better recognition performance, significantly shortens the training time, reduces the cost of model updating and iteration, and is more suitable for practical applications. This study also investigates the use of the incremental learning of action classes, achieving an average recognition rate of 88.6%, which facilitates the supplementation of action types according to the demand, and further improves the application value of the action pattern recognition technology based on sEMG signals.

Mamba-VNPS: A Visual Navigation and Positioning System with State-Selection Space

This study was designed to address the challenges of autonomous navigation facing UAVs in urban air mobility environments without GPS. Unlike traditional localization methods that rely heavily on GPS and pre-mapped routes, Mamba-VNPS leverages a self-supervised learning framework and advanced feature extraction techniques to achieve robust real-time localization without external signal dependence. The results show that Mamba-VNPS significantly outperforms traditional methods across multiple aspects, including localization error. These innovations provide a scalable and effective solution for UAV navigation, enhancing operational efficiency in complex spaces. This study highlights the urgent need for adaptive positioning systems in urban air mobility (UAM) and provides a methodology for future research on autonomous navigation technologies in both aerial and ground applications.

Pseudo Replay-based Class Continual Learning for Online New Category Anomaly Detection in Advanced Manufacturing

The incorporation of advanced sensors and machine learning techniques has enabled modern manufacturing enterprises to perform data-driven classification-based anomaly detection based on the sensor data collected in manufacturing processes. However, one critical challenge is that newly presented defect category may manifest as the manufacturing process continues, resulting in monitoring performance deterioration of previously trained machine learning models. Hence, there is an increasing need for empowering machine learning models to learn continually. Among all continual learning methods, memory-based continual learning has the best performance but faces the constraints of data storage capacity. To address this issue, this paper develops a novel pseudo replay-based continual learning framework by integrating class incremental learning and oversampling-based data generation. Without storing all the data, the developed framework could generate high-quality data representing previous classes to train machine learning model incrementally when new category anomaly occurs. In addition, it could even enhance the monitoring performance since it also effectively improves the data quality. The effectiveness of the proposed framework is validated in three cases studies, which leverages supervised classification problem for anomaly detection. The experimental results show that the developed method is very promising in detecting novel anomaly while maintaining a good performance on the previous task and brings up more flexibility in model architecture.

A hybrid local-global neural network for visual classification using raw EEG signals

EEG-based brain-computer interfaces (BCIs) have the potential to decode visual information. Recently, artificial neural networks (ANNs) have been used to classify EEG signals evoked by visual stimuli. However, methods using ANNs to extract features from raw signals still perform lower than traditional frequency-domain features, and the methods are typically evaluated on small-scale datasets at a low sample rate, which can hinder the capabilities of deep-learning models. To overcome these limitations, we propose a hybrid local-global neural network, which can be trained end-to-end from raw signals without handcrafted features. Specifically, we first propose a reweight module to learn channel weights adaptively. Then, a local feature extraction module is designed to capture basic EEG features. Next, a spatial integration module fuses information from each electrode, and a global feature extraction module integrates overall time-domain characteristics. Additionally, a feature fusion module is proposed to extract efficient features in high sampling rate settings. The proposed model achieves state-of-the-art results on two commonly used small-scale datasets and outperforms baseline methods on three under-studied large-scale datasets. Ablation experimental results demonstrate that the proposed modules have a stable performance improvement ability on multiple datasets across different sample rates, providing a robust end-to-end learning framework.

Comparison of Three Computational Tools for the Prediction of RNA Tertiary Structures

Understanding the structures of noncoding RNAs (ncRNAs) is important for the development of RNA-based therapeutics. There are inherent challenges in employing current experimental techniques to determine the tertiary (3D) structures of RNAs with high complexity and flexibility in folding, which makes computational methods indispensable. In this study, we compared the utilities of three advanced computational tools, namely RNAComposer, Rosetta FARFAR2, and the latest AlphaFold 3, to predict the 3D structures of various forms of RNAs, including the small interfering RNA drug, nedosiran, and the novel bioengineered RNA (BioRNA) molecule showing therapeutic potential. Our results showed that, while RNAComposer offered a malachite green aptamer 3D structure closer to its crystal structure, the performances of RNAComposer and Rosetta FARFAR2 largely depend upon the secondary structures inputted, and Rosetta FARFAR2 predictions might not even recapitulate the typical, inverted “L” shape tRNA 3D structure. Overall, AlphaFold 3, integrating molecular dynamics principles into its deep learning framework, directly predicted RNA 3D structures from RNA primary sequence inputs, even accepting several common post-transcriptional modifications, which closely aligned with the experimentally determined structures. However, there were significant discrepancies among three computational tools in predicting the distal loop of human pre-microRNA and larger BioRNA (tRNA fused pre-miRNA) molecules whose 3D structures have not been characterized experimentally. While computational predictions show considerable promise, their notable strengths and limitations emphasize the needs for experimental validation of predictions besides characterization of more RNA 3D structures.

FLSAD: Defending Backdoor Attacks in Federated Learning via Self-Attention Distillation

Federated Learning (FL), as a distributed machine learning framework, can effectively learn symmetric and asymmetric patterns from large-scale participants. However, FL is susceptible to malicious backdoor attacks through attackers injecting triggers into the backdoored model, resulting in backdoor samples being misclassified as target classes. Due to the stealthy nature of backdoor attacks in FL, it is difficult for users to discover the symmetric and asymmetric backdoor properties. Currently, backdoor defense methods in FL cause model performance degradation while reducing backdoors. In addition, some methods will assume the existence of clean samples, which does not match the realistic scenarios. To address such issues, we propose FLSAD, an effective backdoor defense method in FL via self-attention distillation. FLSAD can recover the triggers using an entropy maximization estimator. Based on the recovered triggers, we leverage the self-attention distillation to eliminate the backdoor. Compared with the baseline backdoor defense methods, FLSAD can reduce the success rates of different state-of-the-art backdoor attacks to 2% on four real-world datasets through extensive evaluation.

Precision-machine learning for the matrix element method

The matrix element method is the LHC inference method of choice for limited statistics. We present a dedicated machine learning framework, based on efficient phase-space integration, a learned acceptance and transfer function. It is based on a choice of INN and diffusion networks, and a transformer to solve jet combinatorics. We showcase this setup for the CP-phase of the top Yukawa coupling in associated Higgs and single-top production.