Generative Learning Model Research Articles

Lembar Kerja Peserta Didik Berdasarkan Model Pembelajaran Generatif untuk Materi Gelombang Cahaya Kelas XI SMA

This research aims to develop LKPD based on a generative learning model on light wave material for class XI SMA that is valid and practical. The generative learning model was chosen because it is able to encourage students to actively build their understanding through interaction, reflection and discussion. This model has proven effective in improving critical thinking and problem-solving skills in physics learning. The developed worksheet is designed following the syntax of the generative learning model: orientation, cognitive conflict, disclosure, construct, application, and reflection, to support in-depth learning and link theory with real application. This research uses the Research and Development (R&D) method with the 4D development model (define, design, develop, disseminate). The define stage includes needs analysis and problem identification. At the design stage, the LKPD was designed by taking into account the content, structure, and aesthetic components. The development stage involves validity testing by experts, well as practicality testing by teachers and students. The dissemination stage is planned for wider application. The results showed that this LKPD has a very high level of validity with a validation index value of 0.94 in the content aspect and 0.86 in the structure aspect, which means that this LKPD meets the eligibility standards of the Merdeka curriculum. The practicality test shows that the LKPD is very practical with a teacher assessment score of 95% and a student assessment of 87%, so it is feasible to use it in the real field because it has been declared valid and practical.

Deep learning generative model for crystal structure prediction

Deep learning generative model for crystal structure prediction

Condition Monitoring Using a Latent Space of Variational Autoencoder Trained Only on a Healthy Machine.

Machine learning generative models have opened up a new perspective for automated machine diagnostics. These methods improve decision-making by extracting features, classifying, and creating new observations using deep neural networks. Generative modeling aims to determine the joint distribution of input data. This contrasts traditional methods used in diagnostics based on discriminative models and the conditional probability distribution of the target variable at known feature values. In the variational autoencoder (VAE) algorithms trained by the authors, the parameters of diagnostic features are random variables, the distributions of which can be approximated based on data, and the identification of probability distributions is based on variational inference. Variational inference is a tool that deals with difficult statistical problems and is usually faster than classical methods. VAEs can detect anomalies, predict failures, and optimize processes. This paper proposes an unsupervised approach to fault diagnosis using only healthy data with automatic feature extraction from the continuous probabilistic latent subspace of the VAE encoder and reduction in PCA or t-SNE. The solution, verified in the example of simulation data, is a response to a common problem related to the lack or difficulty of obtaining marked data in defected states of devices and mechanical structures.

SVQ-MAE: an efficient speech pre-training framework with constrained computational resources

Self-supervised learning for speech pre-training models has achieved remarkable success in acquiring superior speech contextual representations by learning from unlabeled audio, excelling in numerous downstream speech tasks. However, the pre-training of these models necessitates significant computational resources and training duration, presenting a high barrier to entry into the realm of pre-training learning. In our efforts, by amalgamating the resource-efficient benefits of the generative learning model, Masked Auto Encoder, with the efficacy of the vector quantization method in discriminative learning, we introduce a novel pre-training framework: Speech Vector Quantization Masked Auto Encoder (SVQ-MAE). Distinct from the majority of SSL frameworks, which require simultaneous construction of speech contextual representations and mask reconstruction within an encoder-only module, we have exclusively designed a decoupled decoder for pre-training SVQ-MAE. This allows the additional decoupled decoder to undertake the mask reconstruction task solely, reducing the learning complexity of pretext tasks and enhancing the encoder’s efficiency in extracting speech contextual representations. Owing to this innovation, by using only 4 GPUs, SVQ-NAE can achieve high performance comparable to wav2vec 2.0, which requires 64 GPUs for training. In the Speech Processing Universal Performance Benchmark, SVQ-MAE surpasses wav2vec 2.0 in both keyword spotting and emotion recognition tasks. Furthermore, in cross-lingual ASR for Mandarin, upon fine-tuning on AISHELL-1, SVQ-MAE achieves a Character Error Rate of 4.09%, outperforming all supervised ASR models.

THE INFLUENCE OF A GENERATIVE LEARNING MODEL BASED ON WAVE MATERIAL COGNITIVE CONFLICT ON STUDENT LEARNING OUTCOMES AT SMAN 5 PAYAKUMBUH

Student learning outcomes in Physics subjects, especially in Wave material, are still low. This is caused by the learning model used in the Wave material not being being the process standards and characteristics of wave learning objectives. A generative learning model based on cognitive conflict is one approach to solving the aforementioned issue. The purpose of this study is to ascertain how student learning outcomes at SMAN 5 Payakumbuh are affected by the use of a generative learning model based on cognitive conflict in Wave content. The type of research is quasi-experimental research with a pretest-posttest Control Group Design. The participants in this study were all SMAN 5 Payakumbuh science class XI students. The information gathered reflects the attitudes, knowledge, and abilities of the pupils toward learning. Two averages are tested for equality as a data analysis technique. The study's findings demonstrate the notable distinctions between classrooms that employ the Problem-Based Learning model and those that employ the Generative learning model based on cognitive conflict. The average student learning outcome in classes that apply the Generative learning model is 83.14 and in classes that apply the Problem-Based Learning model is 77.26. The influence of the generative learning model based on cognitive conflict can be seen in the learning outcomes of students who have been analyzed and hypothesis tested. Based on the hypothesis test, the ttable is 2.006 and the tcount is 2.1. The condition for H0 to be rejected is if ttable < tcount. The tcount value is within the rejection of H0, so HI is accepted. Because all variables are controlled, except the learning model, it can be said that the application of the Generative learning model based on cognitive conflict in Wave material has a positive effect on student learning outcomes.

Integration of cognitive conflict in generative learning model to enhancing students’ creative thinking skills

In the complexity of the Fourth Industrial Revolution era, the importance of creative thinking is increasingly emphasized in the context of learning computing and algorithms. These skills are instrumental in inspiring innovative solutions, addressing complex challenges, and fostering the development of advanced technologies that characterize the transformative landscape of Industrial Revolution 4.0. This study aims to determine the effectiveness of the generative learning model based on cognitive conflict in improving the creative thinking skills (CTS) and learning outcomes of students in the computational physics and algorithms & programming courses. This research used mixed methods consisting of pretest-posttest control group design and snowballing technique. The research instruments consist of cognitive tests, psychomotor tests, affective tests, CTS tests, observation questionnaires, and interviews. The research sample consisted of 138 students taking computational physics and algorithms & programming courses. Quantitative data were analyzed using multivariate analysis of variance and qualitative data were analyzed using narrative analysis. The findings indicate that this model effectively improves students’ CTS and learning outcomes. Furthermore, the cognitive conflict aspect encourages students to be creative in analyzing and solving problems. This model has the potential to be used to optimize students’ potential in facing the demands of the fourth industrial revolution.

Continual Learning of Generative Models With Limited Data: From Wasserstein-1 Barycenter to Adaptive Coalescence.

Learning generative models is challenging for a network edge node with limited data and computing power. Since tasks in similar environments share a model similarity, it is plausible to leverage pretrained generative models from other edge nodes. Appealing to optimal transport theory tailored toward Wasserstein-1 generative adversarial networks (WGANs), this study aims to develop a framework that systematically optimizes continual learning of generative models using local data at the edge node while exploiting adaptive coalescence of pretrained generative models. Specifically, by treating the knowledge transfer from other nodes as Wasserstein balls centered around their pretrained models, continual learning of generative models is cast as a constrained optimization problem, which is further reduced to a Wasserstein-1 barycenter problem. A two-stage approach is devised accordingly: 1) the barycenters among the pretrained models are computed offline, where displacement interpolation is used as the theoretic foundation for finding adaptive barycenters via a "recursive" WGAN configuration and 2) the barycenter computed offline is used as metamodel initialization for continual learning, and then, fast adaptation is carried out to find the generative model using the local samples at the target edge node. Finally, a weight ternarization method, based on joint optimization of weights and threshold for quantization, is developed to compress the generative model further. Extensive experimental studies corroborate the effectiveness of the proposed framework.

A Novel Multimodal Generative Learning Model based on Basic Fuzzy Concepts

A Novel Multimodal Generative Learning Model based on Basic Fuzzy Concepts

NJmat: Data-Driven Machine Learning Interface to Accelerate Material Design.

Machine learning techniques have significantly transformed the way materials scientists conduct research. However, the widespread deployment of machine learning software in daily experimental and simulation research for materials and chemical design has been limited. This is partly due to the substantial time investment and learning curve associated with mastering the necessary codes and computational environments. In this paper, we introduce a user-friendly, data-driven machine learning interface featuring multiple "button-clicking" functionalities to streamline the design of materials and chemicals. This interface automates the processes of transforming materials and molecules, performing feature selection, constructing machine learning models, making virtual predictions, and visualizing results. Such automation accelerates materials prediction and analysis in the inverse design process, aligning with the time criteria outlined by the Materials Genome Initiative. With simple button clicks, researchers can build machine learning models and predict new materials once they have gathered experimental or simulation data. Beyond the ease of use, NJmat offers three additional features for data-driven materials design: (1) automatic feature generation for both inorganic materials (from chemical formulas) and organic molecules (from SMILES), (2) automatic generation of Shapley plots, and (3) automatic construction of "white-box" genetic models and decision trees to provide scientific insights. We present case studies on surface design for halide perovskite materials encompassing both inorganic and organic species. These case studies illustrate general machine learning models for virtual predictions as well as the automatic featurization and Shapley/genetic model construction capabilities. We anticipate that this software tool will expedite materials and molecular design within the scope of the Materials Genome Initiative, particularly benefiting experimentalists.

The impact of the generative learning methodology on teaching artistic Gymnastics Law to fourth-year Female Students

Evaluate the effectiveness of the generative learning model in teaching artistic gymnastics law to female fourth-stage students at the University of Babylon's College of Physical Education and Sports Sciences. To determine the variations in cognitive accomplishment between the control and experimental study groups after teaching the artistic gymnastics law. The research hypotheses are that fourth-stage female students at the College of Physical Education and Sports Sciences, University of Babylon, have significantly higher cognitive achievement of the artistic gymnastics law after post-testing. The researcher utilized an experimental approach. The fourth-year female students at the University of Babylon's College of Physical Education and Sports Sciences deliberated on the research community for the academic year 2022-2023. One of the reasons for this decision is that the topic (artistic gymnastics) is presented at this level. This is one of the subjects in the first semester. At present, there are 40 female students in the research sample, which was randomly divided into 20 students in the experimental group and 20 students in the control group. The researcher's conclusion was as follows: The strategy used, and the generative learning model, increased cognitive success when teaching artistic gymnastics law. In post-tests, the generative learning model beat the previously used strategy regarding cognitive accomplishment. The researcher recommended the following: 1. Implementing this concept to include additional sports activities in other cognitive and practical curricula.2. Instructing faculty members in the department to use this paradigm in general and practical curricula.3. Conducting scientific studies using current techniques or tactics and comparing results of this model to assess its efficacy in the educational process.

GPianoroll: a Deep Learning System with Human Feedback for Music Generation

We present a human-feedback-based evaluation pipeline for deep learning generative models, tested on music composition. Leveraging Bayesian Optimization and asking users to grade the generated songs, we efficiently find the point of a given model’s latent space that yields each volunteer’s favorite without retraining.

Efektivitas Model Pembelajaran Generatif: Pemahaman dan Keterlibatan Siswa dalam Pembelajaran Matematika

Enhancing the quality of mathematics education requires innovative and interactive teaching approaches. Generative Learning Model offers a framework that allows students to actively participate in the learning process, potentially improving their understanding of mathematical concepts. This research aims to conduct a systematic analysis of existing literature on the use of Generative Learning Model in mathematics education, focusing on effective strategies for developing interactive and effective learning tools. The research methodology involves developing a review protocol, conducting a comprehensive literature search through databases such as Google Scholar, and selecting studies using the PRISMA flowchart. The results of the analysis show that the Generative Learning Model can significantly improve mathematical concept understanding and student engagement. Effective strategies in developing learning tools based on the Generative Learning Model include the use of interactive tools and contextual approaches in teaching. The conclusions of this research confirm that the use of the Generative Learning Model contributes positively to the interactivity and effectiveness of mathematics learning, and provides recommendations for further research and practical application in educational contexts.

Efforts to Improve Mathematical Communication Skills in Mathematics Learning in Indonesia

This research aims to identify various models/methods/strategies and media that are effective in improving mathematical communication. This study uses the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) method with four stages, namely identification, scanning, eligibility, and inclusion. Harzing's Publish or Perish (PoP) is used to search for required research references. The research results found 30 publications regarding efforts to improve mathematical communication skills in schools and universities. Realistic Mathematic Education (RME), cooperative learning models, and the use of media are the methods most widely used in efforts to improve mathematical communication skills. Quantum learning models/methods, PBL, generative learning models, CBL, BBL, discovery, inquiry, and SSCS can also be chosen as alternatives in efforts to improve mathematical communication skills. Middle school level and geometry materials are most often used by researchers in efforts to improve mathematical communication. The results of this research can be a reference for teachers to choose the right model/method/strategy and media to improve mathematical communication skills in pupils and students.

The Effectiveness of the Generative Learning Model to Develop Audio Comprehension Skills and Language Thinking Skills among Primary School Students

The study aimed to verify the effectiveness of the generative learning model in developing audio comprehension skills and linguistic thinking; to achieve the objective of the study, the researcher used the semi-experimental approach, based on the design of the experimental and control groups, and the researcher also identified a list of audio comprehension skills and a list of linguistic thinking skills appropriate for sixth grade primary students, in the light of which an achievement test for audio comprehension skills and a linguistic thinking test were built, and two research materials were designed: The teacher's guide and the student's educational activities booklet; After the researcher verified the validity and stability of the two study tools, they were applied to the study sample consisting of (66) students. After processing the data statistically, the study found statistically significant differences at a level of significance less or equal to (0.05) between the average scores of the experimental group and the control group in the total dimensional test of audio comprehension skills and linguistic thinking, in favor of the experimental group, and the study also provided a number of recommendations and suggestions in light of the results of the study reached.

GenCoder: A Novel Convolutional Neural Network Based Autoencoder for Genomic Sequence Data Compression.

Revolutionary advances in DNA sequencing technologies fundamentally change the nature of genomics. Today's sequencing technologies have opened into an outburst in genomic data volume. These data can be used in various applications where long-term storage and analysis of genomic sequence data are required. Data-specific compression algorithms can effectively manage a large volume of data. In recent times, deep learning has achieved great success in many compression tools and is gradually being used in genomic sequence compression. Significantly, autoencoder has been applied in dimensionality reduction, compact representations of data, and generative model learning. It can use convolutional layers to learn essential features from input data, which is better for image and series data. Autoencoder reconstructs the input data with some loss of information. Since accuracy is critical in genomic data, compressed genomic data must be decompressed without any information loss. We introduce a new scheme to address the loss incurred in the decompressed data of the autoencoder. This paper proposes a novel algorithm called GenCoder for reference-free compression of genomic sequences using a convolutional autoencoder and regenerating the genomic sequences from a latent code produced by the autoencoder, and retrieving original data losslessly. Performance evaluation is conducted on various genomes and benchmarked datasets. The experimental results on the tested data demonstrate that the deep learning model used in the proposed compression algorithm generalizes well for genomic sequence data and achieves a compression gain of 27% over the best state-of-the-art method.

Generative Quantile Regression with Variability Penalty

Quantile regression and conditional density estimation can reveal structure that is missed by mean regression, such as multimodality and skewness. In this article, we introduce a deep learning generative model for joint quantile estimation called Penalized Generative Quantile Regression (PGQR). Our approach simultaneously generates samples from many random quantile levels, allowing us to infer the conditional distribution of a response variable given a set of covariates. Our method employs a novel variability penalty to avoid the problem of vanishing variability, or memorization, in deep generative models. Further, we introduce a new family of partial monotonic neural networks (PMNN) to circumvent the problem of crossing quantile curves. A major benefit of PGQR is that it can be fit using a single optimization, thus, bypassing the need to repeatedly train the model at multiple quantile levels or use computationally expensive cross-validation to tune the penalty parameter. We illustrate the efficacy of PGQR through extensive simulation studies and analysis of real datasets. Code to implement our method is available at https://github.com/shijiew97/PGQR.

Synthesising microstructures of a partially frozen salty sand using voxel-based 3D generative adversarial networks

Generating synthetic material microstructures is essential in the numerical modelling of geomaterials. The occurrence of permafrost and saline groundwater overlapping regions is crucial in a series of phenomena, such as carbon emissions and subgrade settlements. The microstructure of geomaterials in these regions is of particular complexity because of the multiphase nature with salty water and ice crystals. This complexity renders existing generative models ineffective in synthesising their microstructures. Traditional generative methods are limited in the sense that require prior knowledge of material descriptors. Recently, machine learning generative models achieved unprecedented levels of performance and realism, but still lack the means to assess posterior error. This work aims to bridge the gap between traditional methods and deep learning generative models by assessing posterior image quality in the latter. A 3D Generative Adversarial Network (GAN) model is trained with image samples from an X-ray CT of a partially frozen salty sand. The metrics retained to assess posterior quality are particle fabric (shape parameter and anisotropy) and homogenised elastic coefficients obtained with Finite Element Method (FEM) simulations. A hyperparametric study on batch size and latent dimension serves to select the best configuration based on particle fabric. FEM simulations determine the deviation in the generated images elastic coefficients being 7.55% on average with respect to real samples. With 803 voxels, generated images are the largest up-to-date in a three-phase material, allowing to reach REV criteria. Applications range from the generation of microscales in double-scale models to the calibration of image processing tools.

Mechanism for feature learning in neural networks and backpropagation-free machine learning models.

Understanding how neural networks learn features, or relevant patterns in data, for prediction is necessary for their reliable use in technological and scientific applications. In this work, we presented a unifying mathematical mechanism, known as average gradient outer product (AGOP), that characterized feature learning in neural networks. We provided empirical evidence that AGOP captured features learned by various neural network architectures, including transformer-based language models, convolutional networks, multilayer perceptrons, and recurrent neural networks. Moreover, we demonstrated that AGOP, which is backpropagation-free, enabled feature learning in machine learning models, such as kernel machines, that a priori could not identify task-specific features. Overall, we established a fundamental mechanism that captured feature learning in neural networks and enabled feature learning in general machine learning models.

Character-based physics learning module through generative learning model: Student conceptual understanding

One of the causes of students' low conceptual understanding is the lack of instructional materials with a composition that aids students in understanding concepts independently or during classroom learning. The aim of this research is to produce a character-based learning module, particularly emphasizing the virtues of honesty, valuing others' opinions, and caring, through a valid, practical, and effective generative learning model to enhance students' conceptual understanding. This study follows a research and development approach. The development design employs the ADDIE model, tested with 29 eleventh-grade science students at SMAN 6 Banjarmasin. Data collection involved validation sheets for the learning module, observations of lesson plan implementation, student response questionnaires, and learning outcome tests. The data were then analyzed qualitatively and quantitatively. The results show: (1) the developed character-based learning module with an average score of 2.9 is declared valid, (2) the module, assessed through lesson plan implementation and student response questionnaires, is considered practical, and (3) the developed character-based learning module is effective in improving students' conceptual understanding, yielding an N-gain of 0.65 categorized as moderate, with a noticeable difference in students' character achievement before and after the learning process. In conclusion, this study affirms that the character-based learning module with a generative learning model is deemed suitable for enhancing students' conceptual understanding.

Nonlinear system identification using modified variational autoencoders

This research proposes a methodology for identifying nonlinear systems using input/output data and deep learning generative models. Our framework integrates Variational Autoencoders (VAE) with Nonlinear Autoregressive with exogenous input (NARX) in a unified identification structure to address overfitting in nonlinear system identification using NARX structures. Specifically, we modify a variational autoencoder by replacing the decoder module with a NARX model using the latent space information captured from the VAE encoder module as one of the exogenous inputs. Following the training phase, the decoder module can be used as a nonlinear model of the system. We evaluate the efficacy of our approach by performing open-loop prediction tests on data from four nonlinear benchmark systems: Cascaded tanks, Gas furnace, Silverbox, and Wiener-Hammerstein. The proposed VAE-NARX method reported Root Mean Squared Error (RMSE) of 8.23×10−3, 16.69×10−3, 0.002×10−3 and 0.037×10−3 respectively. Our results demonstrate that our proposed method achieves similar and outperforms prediction performances to standard identification techniques and can enhance the performance of traditional nonlinear system identification methods based on multi-layer perceptron models.