Local Learning Research Articles

Using computational fluid dynamics and deep learning for leak detection and localization in a smart water management system

Using computational fluid dynamics and deep learning for leak detection and localization in a smart water management system

Time-Series Forecasting and Sequence Learning Using Memristor-based Reservoir System

Pushing the frontiers of time-series information processing in the ever-growing domain of edge devices with stringent resources has been impeded by the systems’ ability to process information and learn locally on the device. Local processing and learning of time-series information typically demand intensive computations and massive storage as the process involves retrieving information and tuning hundreds of parameters back in time. In this work, we developed a memristor-based echo state network accelerator that features efficient temporal data processing and in-situ online learning. The proposed design is benchmarked using various datasets involving real-world tasks, such as forecasting the load energy consumption and weather conditions. The experimental results illustrate that the hardware model experiences a marginal degradation in performance as compared to the software counterpart. This is mainly attributed to the limited precision and dynamic range of network parameters when emulated using memristor devices. The proposed system is evaluated for lifespan, robustness, and energy-delay product. It is observed that the system demonstrates reasonable robustness for device failure below 10%, which may occur due to stuck-at faults. Furthermore, 247 × reduction in energy consumption is achieved when compared to a custom CMOS digital design implemented at the same technology node.

AIFormer: Adaptive Interaction Transformer for 3D Point Cloud Understanding

Recently, significant advancements have been made in 3D point cloud analysis by leveraging transformer architecture in 3D space. However, it remains challenging to effectively implement local and global learning within irregular and sparse structures of 3D point clouds. This paper presents the Adaptive Interaction Transformer (AIFormer), a novel hierarchical transformer architecture designed to enhance 3D point cloud analysis by fusing local and global features through the adaptive interaction of features. Specifically, AIFormer mainly consists of several stacked AIFormer Blocks. Each AIFormer module employs the Local Relation Aggregation Module and the Global Context Aggregation Module, respectively, to extract local details of relationships within the reference point and long-range dependencies between reference points. Then, the local and global features are fused using the Adaptive Interaction Module for adaptive interaction to optimize the point representation. Additionally, the AIFormer Block further designs geometric relation functions and contextual relative semantic encoding to enhance local and global feature extraction capabilities, respectively. Extensive experiments on three popular 3D point cloud datasets verify that AIFormer achieves state-of-the-art or comparable performances. Our comprehensive ablation study further validates the effectiveness and soundness of the AIFormer design.

Enhancing Chimp Optimization Algorithm Using Local Search Capabilities and Machine Learning for Real Engineering Problems

Enhancing Chimp Optimization Algorithm Using Local Search Capabilities and Machine Learning for Real Engineering Problems

Network Bottlenecks and Task Structure Control the Evolution of Interpretable Learning Rules in a Foraging Agent.

Developing reliable mechanisms for continuous local learning is a central challenge faced by biological and artificial systems. Yet, how the environmental factors and structural constraints on the learning network influence the optimal plasticity mechanisms remains obscure even for simple settings. To elucidate these dependencies, we study meta-learning via evolutionary optimization of simple reward-modulated plasticity rules in embodied agents solving a foraging task. We show that unconstrained meta-learning leads to the emergence of diverse plasticity rules. However, regularization and bottlenecks in the model help reduce this variability, resulting in interpretable rules. Our findings indicate that the meta-learning of plasticity rules is very sensitive to various parameters, with this sensitivity possibly reflected in the learning rules found in biological networks. When included in models, these dependencies can be used to discover potential objective functions and details of biological learning via comparisons with experimental observations.

Transfer learning for probabilistic localization of hidden cracks in concrete structures

AbstractThe utility of discriminative supervised learning models built using multiple training-data sources is investigated for hidden crack localization in concrete. Feed-forward neural network (FFNN) is chosen as the model architecture, and transfer learning is used to assimilate the information obtained from different sources (computational physics simulations and laboratory experiments). The labeled training data consists of values of a damage index and the known locations of hidden cracks. The classification models need to learn how the presence of damage (hidden cracks) affects the damage index at different sensors for different test conditions. To this end, diagnostic FFNN models are built by sequentially adding and training new hidden layers to assimilate labeled information from computer models (different model geometries, test conditions, crack lengths, crack locations) and laboratory experiments on a plain cement slab. These transfer learning-based models are then used to localize damage in concrete specimens that reflect real-world conditions (i.e., specimens with steel reinforcement and randomly distributed aggregate). The actual damage state in these specimens is determined by extracting cores and performing petrographic studies on the extracted cores. The damage probability estimated by transfer learning-based models is compared with the petrographic damage rating index (DRI) to identify the most suitable approach to train the diagnostic models. The transfer learning-based diagnostic methodology shows promise and could be used in various structural health monitoring applications, where sufficient labeled data are typically not available from a single data source.

Rasch model of teacher readiness instrument for implementing science learning based on Balinese local wisdom

Local culture has undergone significant shifts and alienations, leading to the neglect of societal values. This situation underscores the need for teachers to be well-prepared to incorporate local wisdom into science education, supporting Cultured-Based Learning. This study, conducted from January to June 2022, aimed to assess the relevance of items in a teacher readiness instrument for implementing local wisdom-based science learning in Bali. An ex post facto research design was employed to analyze the preparedness of 72 science teachers in Bali through a detailed questionnaire. The collected ordinal data were converted into an interval scale using the Method of Successive Interval (MSI) and analyzed using the Rasch Model with the Jamovi application to assess item relevance. The study's findings highlight the cognitive and emotional readiness of science teachers as being in the high category, while collegial support and instructional tools are in the low category. These results suggest that improving collegial features and instructional tools through lesson studies and workshops could enhance the integration of local wisdom into science education in Bali.

Global induced local network for infrared: dim small target detection

Abstract It is challenging to detect infrared dim targets submerged in complicated backgrounds due to their small size and faint intensity. The previous attention-based detection networks frequently require global long-range dependence. Significant calculations are required to determine the target's sparse but meaningful position. To prevent wasting calculations on the background, this paper offers a detection network guided by global context for local feature learning, named GILNet (Global Induced Local Network). It designs a global location module (GLM) and a local feature interaction module (LFIM) to capture the global position and features of targets, respectively. More specifically, using global context interaction, the GLM finds the region that might contain dim small targets, that is, the coarse location. In the coarsely located regions, the LFIM further acquires feature information about targets. Next, we also design an eight-directional attention operation to obtain the contour information of targets in the low feature map. It is fused with the high feature map in the multi-directional feature fusion module (MFFM), which retains more semantic and spatial information about targets. Finally, quantitative and qualitative analysis show that the GILNet performs better than eight comparison methods on two public datasets.

Contribution of Local Content Learning in Preserving Kajang Tribe Culture : Phenomenological Study

This research aims to accumulate the concept of formal education in encouraging and maintaining the existence of the Kajang tribe's cultural traditions. The research approach used is a qualitative with a phenomenological method. The informants in this study were the Kajang tribal leaders, the community, parents of students, and teachers of SDN 351 Kawasan Amma Toa. Data collection techniques used were through observation, interviews and documents. The data obtained were then analyzed through three stages, namely data reduction, data presentation and drawing conclusions. The results of the research show that "Pasang Ri Kajang" or noble values implemented in local content learning from the local wisdom of the Kajang tribal community are: 1) Love for God and the universe and its contents, 2) Responsibility, discipline and independence, 3) Honest, 4) Obey applicable rules and be polite, 5) Care about the environment, 6) Work hard in nature conservation, 7) Justice, 8) Be humble, 9) Love peace and unity. The integration of local wisdom values in learning will be in accordance with the existing environment experienced by students so that students will be more motivated in learning so that it will have an impact on preserving Kajang tribal culture.

Machine Learning for Localization of Premature Ventricular Contraction Origins: A Review.

Premature ventricular contraction (PVC) is one of the most common arrhythmias, originating from ectopic beats in the ventricles. Precision in localizing the origin of PVCs has long been a focal point in electrophysiology research. Machine learning (ML) has developed rapidly in the past two decades with increasingly widespread applications. With the increase of clinical data such as electrocardiograms (ECGs), computed tomography (CT), and magnetic resonance imaging (MRI), ML and its subfields, deep learning (DL), have become powerful analytical tools, playing an increasingly important role in electrophysiological research. In this review, we mainly provide an overview of the development of ML in the localization of PVC origins, including its applications, advantages, disadvantages, and future research directions. This information is intended to serve as a reference for clinicians and researchers, aiding them in better-utilizing ML techniques for the diagnosis and study of PVC origins.

Fast Global and Local Semi-Supervised Learning via Matrix Factorization

Fast Global and Local Semi-Supervised Learning via Matrix Factorization

FGTL: Federated Graph Transfer Learning for Node Classification

Unsupervised multi-source domain transfer in federated scenario has become an emerging research direction, which can help unlabeled target domain to obtain the adapted model through source domains under privacy-preserving. However, when local data is graph, the difference of domains (or data heterogeneity) mainly originate from the difference in node attributes and subgraph structures, leading to serious model drift, which is not considered by the existing related algorithms. Currently, there are two challenges in this scenario: (1) The node representations extracted directly through conventional GNNs lack inter-domain generalized and consistent information, making it difficult to apply existing federated learning algorithms. (2) The knowledge of source domains has quality differences, which may lead to negative transfer. To address these issues, we propose a novel two-phase Federated Graph Transfer Learning (FGTL) framework. In the generalization phase, FGTL utilizes local contrastive learning and global context embedding to force node representations to capture the inter-domain generalized and consistent information, lightly alleviating model drift. In the transfer phase, FGTL utilizes consensus knowledge to force the decision bound of classifier to adapt to the target client. In addition, FGTL+ exploits model grouping to make consensus knowledge generation more efficient, further enhancing the scalability of FGTL. Extensive experiments show that FGTL significantly outperforms state-of-the-art related methods, while FGTL+ further enhances privacy protection and reduces both communication and computation overhead.

Novel modified weights and cosine similarity based maximum marginal projection and its application in fault diagnosis

Abstract Facing the problem that the data generated in industrial processes have few labeled samples and the local manifold learning dimensionality reduction method ignores the local spatial structure of sample points and the distance relationship in constructing different weights. To solve the above problems, this paper presents a novel modified weights and cosine similarity based maximum marginal projection named MCMMP. In MCMMP, cosine similarity is used to consider the space feature of sample points, which enhances the performance of dimensionality reduction. The new modified weights are applied to measure the between-class and the within-class sample points, which enhance the divisibility of sample points. After MCMMP dimensionality reduction, the classifier is used to classify the dimensionality reduction sample points. Finally, the proposed new method is used in two cases Tennessee Eastman Process (TEP) and Three-phase Flow Facility (TFF) to test the fault diagnosis performance. The results of the simulation process indicated that the new fault diagnosis method based on MCMMP, compared with other related diagnosis methods, has good performance.

Efektivitas Pembelajaran Kitab Taisirul Kholaq Dalam Meningkatkan Akhlak Siswa

Juvenile delinquency is an act of violating norms and rules committed during adolescence or the transition from childhood to adulthood. Teenagers are an asset that every country has. This research aims to find out; 1) Local Content Learning of Kitab Taisirul Kholaq at An-Nur Al Anwar Junior High School Bululawang Malang, 2) Student morals at An-Nur Al Anwar Junior High School Bululawang Malang, 3) The Effect of Local Content Learning of Kitab Taisirul Kholaq on Student Morals at An-Nur Al Anwar Junior High School Bululawang Malang. This research was conducted with a quantitative approach using the type of correlation research, used to determine the correlation or relationship of local content learning Kitab Taisirul Kholaq on student morals. The sample used in this study was 15% of the population with a purposive sampling technique of 54 students. Data collection techniques using observation, questionnaires, and documentation. The results showed 1) it is known that the minimum value of the local content variable is 36, the maximum value is 62, the mean is 44.13, Std Deviation is 4.434, Variance is 19.662 from 54 respondents. 2) The minimum value of the student morals variable is 46, the maximum value is 83, the mean is 62.07, Std Deviation is 6.375, Variance is 40.636 from 54 respondents. 3) There is an influence of local content learning of the book of Taisirul Kholaq on student morals at An-Nur Al Anwar Junior High School with a moderate level of strength.

Data-driven inventory control for large product portfolios: A practical application of prescriptive analytics

Motivated by the real-world inventory management problem of a large network of pharmacies, this paper proposes and studies a practically relevant Prescriptive Analytics approach for data-driven dynamic inventory control of large portfolios of interrelated products. We extend existing research on weighted Sample Average Approximation by integrating a ‘global learning’ model that effectively exploits cross-learning opportunities within the product portfolio. The results of an extensive numerical evaluation on real-world data suggest that our approach outperforms relevant benchmarks—in particular, models that rely on ‘local learning’ strategies where weight functions are trained separately for each product. The numerical results also allow us to derive important practical and structural insights regarding the value of contextual information in our global learning framework.

RLocator: Reinforcement Learning for Bug Localization

RLocator: Reinforcement Learning for Bug Localization

Adaptive compressed learning boosts both efficiency and utility of differentially private federated learning

In the federated learning (FL) research field, current research is confronted with several pivotal challenges, e.g., data privacy, model utility and communication efficiency. Furthermore, these challenges are further amplified by statistical data heterogeneous in the FL system. Thus, a novel Communication-efficient and Utility-assured Gaussian differential privacy-based Personalized Federated Adaptive Compressed Learning method, called CUG-PFACL, is proposed. Specifically, an end-to-end local adaptive compressed learning strategy is designed, including three crucial modules, namely the measurement matrix, the personalized compressed data transformation and the local model. Especially, jointly training the measurement matrix module and the personalized compressed data transformation module can mitigate the inherent statistical heterogeneity while preserving all important characteristics of the compressed private data of each local client, and alleviate the additional heterogeneity induced by Gaussian differential privacy in each global communication round. Numerous experimental simulation and comparisons demonstrate that CUG-PFACL has three notable advantages: data privacy guarantee, enhanced personalized model utility and high-efficient communication.

Global and local combined contrastive learning for multi-view clustering

Global and local combined contrastive learning for multi-view clustering

Continuous Health Assessment of Bridges under Sudden Environmental Variability by Local Unsupervised Learning

Continuous Health Assessment of Bridges under Sudden Environmental Variability by Local Unsupervised Learning

Hierarchical Organ-Aware Total-Body Standard-Dose PET Reconstruction From Low-Dose PET and CT Images.

Positron emission tomography (PET) is an important functional imaging technology in early disease diagnosis. Generally, the gamma ray emitted by standard-dose tracer inevitably increases the exposure risk to patients. To reduce dosage, a lower dose tracer is often used and injected into patients. However, this often leads to low-quality PET images. In this article, we propose a learning-based method to reconstruct total-body standard-dose PET (SPET) images from low-dose PET (LPET) images and corresponding total-body computed tomography (CT) images. Different from previous works focusing only on a certain part of human body, our framework can hierarchically reconstruct total-body SPET images, considering varying shapes and intensity distributions of different body parts. Specifically, we first use one global total-body network to coarsely reconstruct total-body SPET images. Then, four local networks are designed to finely reconstruct head-neck, thorax, abdomen-pelvic, and leg parts of human body. Moreover, to enhance each local network learning for the respective local body part, we design an organ-aware network with a residual organ-aware dynamic convolution (RO-DC) module by dynamically adapting organ masks as additional inputs. Extensive experiments on 65 samples collected from uEXPLORER PET/CT system demonstrate that our hierarchical framework can consistently improve the performance of all body parts, especially for total-body PET images with PSNR of 30.6 dB, outperforming the state-of-the-art methods in SPET image reconstruction.