Raw Input Data Research Articles

Modeling Student Management and Civic Education Strategies from an Interdisciplinary Perspective

Abstract This paper issues from an interdisciplinary perspective, combining computer technology, principles of management and other multi-disciplinary knowledge to build a model of student management and civic education strategy. Two modules are part of the student management model: student behavior analysis and prediction. In student behavior analysis, the fuzzy C-means clustering algorithm is improved, and the Gaussian density function is used to determine the initial clustering center. In student behavior prediction, the convolutional network is used to input raw data, and the extracted features are inputted into the CABLSTM model for training and prediction of student behavior. The Civic Education Strategy Model is built on the principle of feedback control and is constructed at the school, family, and individual levels. In the analysis of student management and Civic and Political Education practice, teaching practice was conducted at University C in Lanzhou City, Gansu Province, China. After the practice, the number of students who are very satisfied and satisfied with the overall student management is 2, 356, accounting for 65.81%, and the comprehensive quality of students is in the middle to high range. The students’ life values, family and national sentiment, and thought level dimensions in Civic and political literacy have significant differences (P<0.05), and the level of mastery of Civic and political knowledge is good.

Allele-specific binding (ASB) analyzer for annotation of allele-specific binding SNPs

BackgroundAllele-specific binding (ASB) events occur when transcription factors (TFs) bind more favorably to one of the two parental alleles at heterozygous single nucleotide polymorphisms (SNPs). Evidence suggests that ASB events could reveal the impact of sequence variations on TF binding and may have implications for the risk of diseases.ResultsHere we present ASB-analyzer, a software platform that enables the users to quickly and efficiently input raw sequencing data to generate individual reports containing the cytogenetic map of ASB SNPs and their associated phenotypes. This interactive tool thereby combines ASB SNP identification, biological annotation, motif analysis, phenotype associations and report summary in one pipeline. With this pipeline, we identified 3772 ASB SNPs from thirty GM12878 ChIP-seq datasets and demonstrated that the ASB SNPs were more likely to be enriched at important sites in TF-binding domains.ConclusionsASB-analyzer is a user-friendly tool that enables the detection, characterization and visualization of ASB SNPs. It is implemented in Python, R and bash shell and packaged in the Conda environment. It is available as an open-source tool on GitHub at https://github.com/Liying1996/ASBanalyzer.

Application of machine learning-based algorithms to predict the stress-strain curves of additively manufactured mild steel out of its microstructural characteristics

The study presents a Machine Learning (ML)-based framework designed to forecast the stress-strain relationship of arc-direct energy deposited mild steel. Based on microstructural characteristics previously extracted using microscopy and X-ray diffraction, approximately 1000 new parameter sets are generated by applying the Latin Hypercube Sampling Method (LHSM). For each parameter set, a Representative Volume Element (RVE) is synthetically created via Voronoi Tessellation. Input raw data for ML-based algorithms comprises these parameter sets or RVE-images, while output raw data includes their corresponding stress-strain relationships calculated after a Finite Element (FE) procedure. Input data undergoes preprocessing involving standardization, feature selection, and image resizing. Similarly, the stress-strain curves, initially unsuitable for training traditional ML algorithms, are preprocessed using cubic splines and occasionally Principal Component Analysis (PCA). The later part of the study focuses on employing multiple ML algorithms, utilizing two main models. The first model predicts stress-strain curves based on microstructural parameters, while the second model does so solely from RVE images. The most accurate prediction yields a Root Mean Squared Error of around 5 MPa, approximately 1% of the yield stress. This outcome suggests that ML models offer precise and efficient methods for characterizing dual-phase steels, establishing a framework for accurate results in material analysis.

Emotional Responses to Religious Conversion: Insights from Machine Learning

This study aims to understand the feelings of newly converted Muslims when they narrated their pre- and post-conversion using the Machine Learning model and qualitative approach. The data set analyzed in this paper comes from in-depth interviews with 12 mualaf/ newly converted Muslims from various backgrounds. All recorded interviews were transcribed and filtered to remove any unnecessary or misaligned data to ensure that the data was fully aligned with the interview questions. To analyze emotional changes, we utilize natural language processing (NLP) algorithms, which enable us to extract and interpret emotional content from textual data sources, such as personal narratives. The analysis was performed in Google Colab and utilizing XLM-EMO, a fine-tuned multilingual emotion detection model that detects joy, anger, fear, and sadness emotions from text. The model was chosen because it supports Bahasa, as our interview was conducted in Bahasa. Furthermore, the model also has the best accuracy amongst its competitors, namely LS-EMO and UJ-Combi. The model also has great performance, with the overall average Macro-F1s for XLM-RoBERTa-large, XLM-RoBERTa-base, and XLM-Twitter-base are .86, .81, and .84. Furthermore, two psychologists compared emotion detection results from the XLM-EMO model to the raw input data, and an inductive content analysis was performed. This approach allowed us to identify the reasoning behind the emotions deemed pertinent and intriguing for our investigation. This study showed that Sadness is the most dominant emotion, constituting 46.67% of the total emotions in the pre-conversion context. On the other hand, joy emerges as the most dominant, constituting a substantial proportion of 57.73% among the emotions analyzed from post-conversion emotions data. Understanding the positive impact of religious conversion on emotions may inform mental health interventions and incorporate spiritual or religious elements into therapeutic approaches for individuals struggling with emotional issues, guiding individuals undergoing religious conversion and emphasizing the potential emotional benefits.

A data-driven based method for damage detection of combining joints and elements of frame structures using noisy incomplete data

Most previous studies on damage detection in civil engineering structures have focused on either element damage detection or joint damage detection, separately. However, in practice, both elements and joints may be prone to damage, simultaneously. In addition, the development of effective numerical approaches to detect and quantify these damages in real time within structures is essential to ensure their integrity and reliable operation. Therefore, to deal with these problems, this study proposes an effective data-driven approach by using an attention based convolutional gated recurrent unit network (ACGRU) for real time damage detection of combining joint and element in frame structures using incomplete data. In the proposed approach, the convolutional layers in the network are utilized to extract critical features from the raw input data. Then, these extracted features are fed into the gated recurrent unit layers to learn to predict the desired output data. In addition, by introducing the attention mechanisms into the network, the important information can be effectively learned. The performance and applicability of the ACGRU are validated through two different numerical examples using incomplete data in both noise-free condition and noisy condition. Moreover, the effect of the numbers and placements of sensors on the damage detection results is also investigated. The damage detection results achieved by the proposed approach are compared with those of other state-of-the-art methods to inspect the reliability of the proposed approach.

Využití administrativních zdrojů dat při vymezení obyvatelstva ve sčítání lidu 2021 v Česku

The article presents the administrative data sources used in the 2021 population census in Czechia and describes the main steps in data processing leading from raw input data to the final census population. Special attention is paid to signs-of-life analysis, which deals with the issue of overcoverage in the population register. The article ties in with a previous article (published in 2022) that discussed the use of registers in European population censuses and explained the process of combining data sources in the previous 2011 Czech population census.

Symbolic Regression Approaches for the Direct Calculation of Pipe Diameter

This study provides novel and accurate symbolic regression-based solutions for the calculation of pipe diameter when flow rate and pressure drop (head loss) are known, together with the length of the pipe, absolute inner roughness of the pipe, and kinematic viscosity of the fluid. PySR and Eureqa, free and open-source symbolic regression tools, are used for discovering simple and accurate approximate formulas. Three approaches are used: (1) brute force of computing power, which provides results based on raw input data; (2) an improved method where input parameters are transformed through the Lambert W-function; (3) a method where the results are based on inputs and the Colebrook equation transformed through new suitable dimensionless groups. The discovered models were simplified by the WolframAlpha simplify tool and/or the equivalent Matlab Symbolic toolbox. Novel models make iterative calculus redundant; they are simple for computer coding while the relative error remains lower compared with the solution through nomograms. The symbolic-regression solutions discovered by brute force computing power discard the kinematic viscosity of the fluid as an input parameter, implying that it has the least influence.

Deep Cascade Gradient RBF Networks With Output-Relevant Feature Extraction and Adaptation for Nonlinear and Nonstationary Processes.

The main challenge for industrial predictive models is how to effectively deal with big data from high-dimensional processes with nonstationary characteristics. Although deep networks, such as the stacked autoencoder (SAE), can learn useful features from massive data with multilevel architecture, it is difficult to adapt them online to track fast time-varying process dynamics. To integrate feature learning and online adaptation, this article proposes a deep cascade gradient radial basis function (GRBF) network for online modeling and prediction of nonlinear and nonstationary processes. The proposed deep learning method consists of three modules. First, a preliminary prediction result is generated by a GRBF weak predictor, which is further combined with raw input data for feature extraction. By incorporating the prior weak prediction information, deep output-relevant features are extracted using a SAE. Online prediction is finally produced upon the extracted features with a GRBF predictor, whose weights and structure are updated online to capture fast time-varying process characteristics. Three real-world industrial case studies demonstrate that the proposed deep cascade GRBF network outperforms existing state-of-the-art online modeling approaches as well as deep networks, in terms of both online prediction accuracy and computational complexity.

DNN Surgery: Accelerating DNN Inference on the Edge Through Layer Partitioning

Recent advances in deep neural networks have substantially improved the accuracy and speed of various intelligent applications. Nevertheless, one obstacle is that DNN inference imposes a heavy computation burden on end devices, but offloading inference tasks to the cloud causes a large volume of data transmission. Motivated by the fact that the data size of some intermediate DNN layers is significantly smaller than that of raw input data, we designed the DNN surgery, which allows partitioned DNN to be processed at both the edge and cloud while limiting the data transmission. The challenge is twofold: (1) Network dynamics substantially influence the performance of DNN partition, and (2) State-of-the-art DNNs are characterized by a directed acyclic graph rather than a chain, so that partition is incredibly complicated. To solve the issues, We design a Dynamic Adaptive DNN Surgery(DADS) scheme, which optimally partitions the DNN under different network conditions. We also study the partition problem under the cost-constrained system, where the resource of the cloud for inference is limited. Then, a real-world prototype based on the selif-driving car video dataset is implemented, showing that compared with current approaches, DNN surgery can improve latency up to 6.45 times and improve throughput up to 8.31 times. We further evaluate DNN surgery through two case studies where we use DNN surgery to support an indoor intrusion detection application and a campus traffic monitor application, and DNN surgery shows consistently high throughput and low latency.

Wind field forecasting using a novel method based on convolutional neural networks and bidirectional LSTM

ABSTRACT This paper proposes a deep-learning-based wind speed forecasting model based on CNNs and BLSTM. After CNN layers there are BLSTM layers which take the high-level features from the CNN layer and capture the behaviour of data in time. Finally, the BLSTM layers are followed by a fully connected layer and loss function. The main advantage of the proposed method over previous methods is the two-level structure of the model. In this architecture, the CNN layers extract the high-level features from raw input data and feed them to the BLSTM layers which are very good at capturing the sequential pattern of the data. This feature of the network increases the accuracy and performance of the model significantly. The simulation results illustrate the accurate and reliable performance of the proposed method. Also, it is shown that the performance of the model in forecasting the U characteristics of the wind is relatively better than V characteristics.

An interpretable single-cell RNA sequencing data clustering method based on latent Dirichlet allocation.

Single-cell RNA sequencing (scRNA-seq) detects whole transcriptome signals for large amounts of individual cells and is powerful for determining cell-to-cell differences and investigating the functional characteristics of various cell types. scRNA-seq datasets are usually sparse and highly noisy. Many steps in the scRNA-seq analysis workflow, including reasonable gene selection, cell clustering and annotation, as well as discovering the underlying biological mechanisms from such datasets, are difficult. In this study, we proposed an scRNA-seq analysis method based on the latent Dirichlet allocation (LDA) model. The LDA model estimates a series of latent variables, i.e. putative functions (PFs), from the input raw cell-gene data. Thus, we incorporated the 'cell-function-gene' three-layer framework into scRNA-seq analysis, as this framework is capable of discovering latent and complex gene expression patterns via a built-in model approach and obtaining biologically meaningful results through a data-driven functional interpretation process. We compared our method with four classic methods on seven benchmark scRNA-seq datasets. The LDA-based method performed best in the cell clustering test in terms of both accuracy and purity. By analysing three complex public datasets, we demonstrated that our method could distinguish cell types with multiple levels of functional specialization, and precisely reconstruct cell development trajectories. Moreover, the LDA-based method accurately identified the representative PFs and the representative genes for the cell types/cell stages, enabling data-driven cell cluster annotation and functional interpretation. According to the literature, most of the previously reported marker/functionally relevant genes were recognized.

Hybrid classifier for sentiment analysis in Malayalam with modified TF-IDF features

Sentiment Analysis (SA) is a computational study that examines people’s opinions, attitudes, and opinions based on their written text. Keralites’ mother tongue, Malayalam, is the most often used language to express themselves on Twitter. As there is no automatic Sentiment Analyzer in Malayalam, the SA of Twitter messages is necessary. In this research work, a Malayalam sentiment analysis model is introduced. The input raw data in the form of reviews are fed for the pre-processing stage. The pre-processing module includes sentence tokenization via Sandi Splitting and parts of speech (POS) tagging. Subsequently, Bag of Word, the Proposed weightage-based Term Frequency-Inverse Document Frequency, Unigram with the dictionary and Unigram with dictionary including negation words have been considered for feature vector formation. Finally, the review classification is undergone via the proposed hybrid classifier, which is constructed by hybridizing the Long Short-Term Memory (LSTM) and Convolutional Neural Network (CNN), respectively. To enhance the classification performance, the weight of the CNN classifier will be fine-tuned via an Improved Bumble bee mating Optimization (IBBMO), which is an advanced version of standard BBMO. The performance of the proposed work is compared over other conventional models in terms of positive, negative, convergence, and other measures. The accuracy of the proposed method is 95.436, which is much better than the existing works like DBN[Formula: see text]86.25, NN[Formula: see text]87.080, SVM[Formula: see text]87.234, WOA+Hybrid Classifier[Formula: see text]88.440, LA+Hybrid Classifier[Formula: see text]89.35285, CSO+Hybrid Classifier[Formula: see text]92.021, BBMO+Hybrid Classifier[Formula: see text]93.4248, and ML techniques[Formula: see text]94.014, at the 90th training percentage.

Hybrid deep neural network with dimension attention for state-of-health estimation of Lithium-ion Batteries

Lithium-ion batteries (LIBs) are widely used and became the main energy storage medium for many devices. Accurate estimation of LIBs state-of-health (SOH) is crucial for safe and reliable operation of devices. This study designs an end-to-end multi-battery shared hybrid neural network (NN) prognostic framework that combines a convolutional neural network (CNN), a multi-layer variant long-short-term memory (VLSTM) NN and a dimensional attention mechanism (CNN-VLSTM-DA) to SOH estimation for LIBs. First, feature extraction and selection on the raw input data are performed by using a CNN. Second, a suitable VLSTM is designed. The network adds a “peephole connection” to the forget gate and output gate, respectively, which enhances the network’s ability to distinguish subtle features between input sequences. Besides, the forget gate and the input gate are coupled, so that, together, they determine the information that needs to be forgotten and the new data that needs to be added. Then, the output data of the CNN layer are fed into a multi-layer VLSTM NN to further capture the temporal correlation of these data. Finally, the attention mechanism is applied to the output of the VLSTM, to assign different weights to the features of each dimension and to give the prediction results. Several experiments are carried out on three datasets from NASA, CALCE and Oxford. These include full charge/discharge data, charge/discharge data in different SOC ranges, and non-fixed discharge current data. The results verify the effectiveness of the proposed method.

Distributed Improved Deep Prediction for Recommender System using an Ensemble Learning

If online businesses possess valuable interest for suggesting their items by scoring them, then digital advertising gains their profits depending on their promotions or marketing task. Web users cannot be certain that the products handled via big-data recommendation are either advanced or interesting to their needs. In recent decades, recommender system models have been widely used to analyses large quantities of information. Amongst, a Distributed Improved Prediction with Matrix Factorization (MF) and Random Forest (RF) called DIPMF model exploits individual’s desires, choices and social context together for predicting the ratings of a particular item. But, the RF scheme needs high computation power and time for learning process. Also, its outcome was influenced by the training parameters. Hence this article proposes a Distributed Improved Deep Prediction with MF and ensemble learning (DIDPMF) model is proposed to decrease the computational difficulty of RF learning and increasing the efficiency of rating prediction. In this DIDPMF, a forest attribute extractor is ensemble with the Deep Neural Network (fDNN) for extracting the sparse attribute correlations from an extremely large attribute space. So, incorporating RF over DNN has the ability to provide prediction outcomes from all its base trainers instead of a single estimated possibility rate. This fDNN encompasses forest module and DNN module. The forest module is employed as an attribute extractor to extract the sparse representations from the given raw input data with the supervision of learning outcomes. First, independent decision trees are constructed and then ensemble those trees to obtain the forest. After, this forest is fed to the DNN module which acts as a learner to predict the individual’s ratings with the aid of novel attribute representations. Finally, the experimental results reveal that the DIDPMF outperforms than the other conventional recommender systems.

PyInfinityFlow: optimized imputation and analysis of high-dimensional flow cytometry data for millions of cells.

While conventional flow cytometry is limited to dozens of markers, new experimental and computational strategies, such as Infinity Flow, allow for the generation and imputation of hundreds of cell surface protein markers in millions of cells. Here, we describe an end-to-end analysis workflow for Infinity Flow data in Python. pyInfinityFlow enables the efficient analysis of millions of cells, without down-sampling, through direct integration with well-established Python packages for single-cell genomics analysis. pyInfinityFlow accurately identifies both common and extremely rare cell populations which are challenging to define from single-cell genomics studies alone. We demonstrate that this workflow can nominate novel markers to design new flow cytometry gating strategies for predicted cell populations. pyInfinityFlow can be extended to diverse cell discovery analyses with flexibility to adapt to diverse Infinity Flow experimental designs. pyInfinityFlow is freely available in GitHub (https://github.com/KyleFerchen/pyInfinityFlow) and on PyPI (https://pypi.org/project/pyInfinityFlow/). Package documentation with tutorials on a test dataset is available by Read the Docs (pyinfinityflow.readthedocs.io). The scripts and data for reproducing the results are available at https://github.com/KyleFerchen/pyInfinityFlow/tree/main/analysis_scripts, along with the raw flow cytometry input data.

Routing Attack Detection Using Ensemble Deep Learning Model for IIoT

Smart cities, ITS, supply chains, and smart industries may all be developed with minimal human interaction thanks to the increasing prevalence of automation enabled by machine-type communication (MTC). Yet, MTC has substantial security difficulties because of diverse data, public network access, and an insufficient security mechanism. In this study, we develop a novel IIOT attack detection basis by joining the following four main steps: (a) data collection, (b) pre-processing, (c) attack detection, and (d) optimisation for high classification accuracy. At the initial stage of processing, known as "pre-processing," the collected raw data (input) is normalised. Attack detection requires the creation of an intelligent security architecture for IIoT networks. In this work, we present a learning model that can recognise previously unrecognised attacks on an IIoT network without the use of a labelled training set. An IoT network intrusion detection system-generated labelled dataset. The study also introduces a hybrid optimisation algorithm for pinpointing the optimal LSTM weight when it comes to intrusion detection. When trained on the labelled dataset provided by the proposed method, the improved LSTM outperforms the other models with a finding accuracy of 95%, as exposed in the research.

Human-Aware Collaborative Robots in the Wild: Coping with Uncertainty in Activity Recognition.

This study presents a novel approach to cope with the human behaviour uncertainty during Human-Robot Collaboration (HRC) in dynamic and unstructured environments, such as agriculture, forestry, and construction. These challenging tasks, which often require excessive time, labour and are hazardous for humans, provide ample room for improvement through collaboration with robots. However, the integration of humans in-the-loop raises open challenges due to the uncertainty that comes with the ambiguous nature of human behaviour. Such uncertainty makes it difficult to represent high-level human behaviour based on low-level sensory input data. The proposed Fuzzy State-Long Short-Term Memory (FS-LSTM) approach addresses this challenge by fuzzifying ambiguous sensory data and developing a combined activity recognition and sequence modelling system using state machines and the LSTM deep learning method. The evaluation process compares the traditional LSTM approach with raw sensory data inputs, a Fuzzy-LSTM approach with fuzzified inputs, and the proposed FS-LSTM approach. The results show that the use of fuzzified inputs significantly improves accuracy compared to traditional LSTM, and, while the fuzzy state machine approach provides similar results than the fuzzy one, it offers the added benefits of ensuring feasible transitions between activities with improved computational efficiency.

Production Efficiency of Raw Milk and Its Determinants: Application of Combining Data Envelopment Analysis and Stochastic Frontier Analysis

China’s raw milk production is confronted with problems such as high production costs, stringent environmental constraints, weak industrial interest linkages, etc. The extensive and inefficient operation mode seriously restricts the further development of China’s dairy industry. How to increase the production efficiency of raw milk and realize the transition from “a country with high milk production” to “a country with high-efficiency milk production” has become the key to further developing China’s dairy industry. In order to explore the upgrading path of the raw milk industry in China, this study used the DEA-Malmquist model to estimate the production efficiency of raw milk in China and analyze its spatial and temporal distribution characteristics based on raw milk production input and output data at four scales (i.e., free-range, small-scale, medium-scale, and large-scale) from 2004 to 2020. It then adopted the SFA model to explore the relationship between raw milk input and output factors and the driving factors of production efficiency. Finally, robustness was discussed according to the existing research differences. The study draws several valuable conclusions. First, the production efficiency of raw milk in China from 2004 to 2020 fluctuated upward and showed specific regular regional distribution characteristics, but the spatial–temporal differences were minor. Second, raw milk production efficiency is significantly influenced by various factors, including the proportion of concentrate to roughage consumption, medical and epidemic prevention investment, the price of raw milk, the wage level, and fixed assets. Third, the spatial–temporal distribution and driving factors of raw milk production efficiency are less robust, so efficiency analysis and improvement measures should fully consider analytical methods, scale heterogeneity, indicator systems, and temporal heterogeneity.

Exploring data merging methods for a distributed processing system

The ALICE experiment at the CERN LHC (Large Hadron Collider) is undertaking a major upgrade during the LHC Long Shutdown 2 in 2019-2021, which includes a new computing system called O2 (Online-Offline). The raw data input from the ALICE detectors will increase a hundredfold, up to 3.5 TB/s. By reconstructing the data online, it will be possible to compress the data stream down to 100 GB/s before storing it permanently.The O2 software is a message-passing system. It will run on approximately 500 computing nodes performing reconstruction, compression, calibration and quality control of the received data stream. As a direct consequence of having a distributed computing system, locally generated data might be incomplete and could require merging to obtain complete results.This paper presents the O2 Mergers, the software designed to match and combine partial data into complete objects synchronously to data taking. Based on a detailed study and results of extensive benchmarks, a qualitative and quantitative comparison of different merging strategies considered to reach the final design and implementation of the software is discussed.

Long-term wave energy potential estimation in the Aegean and Ionian seas using dynamic downscaling and wave modelling techniques.

The current work focuses on the use of dynamic downscaling methods based on 40 years ERA5 hindcast climatic data, for estimating the Wave energy potential for the Hellenic region. The main areas of interest are the Aegean and Ionian islands. The combination of local and reanalysis climatic data, has been used, as it is linking the mesoscale meteorology, with microclimatic weather phenomena. This way the driving geostrophic winds are effectively taken into account for the estimation of low altitude wind distribution. WRF is used to downscale the raw reanalysis ERA5 input data grid to a finer 3 × 3 Km results grid. This way, high computational accuracy can be achieved over the investigated regions, thus revealing finer wind scales phenomena. The downscaled climatic data are used as initial and boundary conditions for NOAA/NCEP's WAVEWATCH III to produce the required wave climate for the areas of interest over a finer grid. The computational results are compared with existing measurements and the significant wave height, wave period and direction distributions are used to assess in detail the potential wave energy distribution in specific areas of interest. The seasonal wave-climate variability and long-term periodicity are also investigated.