Review Of Machine Learning Methods Research Articles

A review of machine learning methods used for educational data

AbstractIntegrating machine learning (ML) methods in educational research has the potential to greatly impact upon research, teaching, learning and assessment by enabling personalised learning, adaptive assessment and providing insights into student performance, progress and learning patterns. To reveal more about this notion, we investigated ML approaches used for educational data analysis in the last decade and provided recommendations for further research. Using a systematic literature review (SLR), we examined 77 publications from two large and high-impact databases for educational research using bibliometric mapping and evaluative review analysis. Our results suggest that the top five most frequently used keywords were similar in both databases. The majority of the publications (88%) utilised supervised ML approaches for predicting students’ performances and finding learning patterns. These methods include decision trees, support vector machines, random forests, and logistic regression. Semi-supervised learning methods were less frequently used, but also demonstrated promising results in predicting students’ performance. Finally, we discuss the implications of these results for statisticians, researchers, and policymakers in education.

Review of Machine Learning Methods for River Flood Routing

River flood routing computes changes in the shape of a flood wave over time as it travels downstream along a river. Conventional flood routing models, especially hydrodynamic models, require a high quality and quantity of input data, such as measured hydrologic time series, geometric data, hydraulic structures, and hydrological parameters. Unlike physically based models, machine learning algorithms, which are data-driven models, do not require much knowledge about underlying physical processes and can identify complex nonlinearity between inputs and outputs. Due to their higher performance, lower complexity, and low computation cost, researchers introduced novel machine learning methods as a single application or hybrid application to achieve more accurate and efficient flood routing. This paper reviews the recent application of machine learning methods in river flood routing.

A review on machine learning methods for intrusion detection system

With the increasing access to the Internet and the development of information technology, concerns about computer security have been raised on a considerably large scale. Computer crimes contain various methods to undermine information privacy and system integrity, causing millions to trillions lose in the past few years. It is urgent to improve the security algorithms and models to perform as a thorough structure to prevent attacks. Among this prevention structure, an intrusion detection system (IDS) has played a vital role to monitor and detect malicious behaviours. However, due to the rapidly increasing variety of threats, the traditional algorithms are not sufficient, and new methods should be brought into IDS to improve the functionality. Deep learning (DL) and Machine learning (ML) are newly developed programs which can process data on a considerably large scale. They can also make decisions and predictions without specific programming, and these features are suitable to improve and enhance the IDS. This article mainly focuses on a review of ML methods used in IDS construction.

A Critical Review of Machine Learning Methods Used in Metal Powder Bed Fusion Process to Predict Part Properties

A Critical Review of Machine Learning Methods Used in Metal Powder Bed Fusion Process to Predict Part Properties

Interpretable Machine Learning for Assessing the Cumulative Damage of a Reinforced Concrete Frame Induced by Seismic Sequences

Recently developed Machine Learning (ML) interpretability techniques have the potential to explain how predictors influence the dependent variable in high-dimensional and non-linear problems. This study investigates the application of the above methods to damage prediction during a sequence of earthquakes, emphasizing the use of techniques such as SHapley Additive exPlanations (SHAP), Partial Dependence Plots (PDPs), Local Interpretable Model-agnostic Explanations (LIME), Accumulated Local Effects (ALE), permutation and impurity-based techniques. Following previous investigations that examine the interdependence between predictors and the cumulative damage caused by a seismic sequence using classic statistical methods, the present study deploy ML interpretation techniques to deal with this multi-parametric and complex problem. The research explores the cumulative damage during seismic sequences, aiming to identify critical predictors and assess their influence on the cumulative damage. Moreover, the predictors contribution with respect to the range of final damage is evaluated. Non-linear time history analyses are applied to extract the seismic response of an eight-story Reinforced Concrete (RC) frame. The regression problem’s input variables are divided into two distinct physical classes: pre-existing damage from the initial seismic event and seismic parameters representing the intensity of the subsequent earthquake, expressed by the Park and Ang damage index (DIPA) and Intensity Measures (IMs), respectively. In addition to the interpretability analysis, the study offers also a comprehensive review of ML methods, hyperparameter tuning, and ML method comparisons. A LightGBM model emerges as the most efficient, among 15 different ML methods examined. Among the 17 examined predictors, the initial damage, caused by the first shock, and the IMs of the subsequent shock—IFVF and SIH—emerged as the most important ones. The novel results of this study provide useful insights in seismic design and assessment taking into account the structural performance under multiple moderate to strong earthquake events.

A Review of Machine Learning Methods Recently Applied to FTIR Spectroscopy Data for the Analysis of Human Blood Cells.

Machine learning (ML) is a broad term encompassing several methods that allow us to learn from data. These methods may permit large real-world databases to be more rapidly translated to applications to inform patient-provider decision-making. This paper presents a review of articles that discuss the use of Fourier transform infrared (FTIR) spectroscopy and ML for human blood analysis between the years 2019-2023. The literature review was conducted to identify published research of employed ML linked with FTIR for distinction between pathological and healthy human blood cells. The articles' search strategy was implemented and studies meeting the eligibility criteria were evaluated. Relevant data related to the study design, statistical methods, and strengths and limitations were identified. A total of 39 publications in the last 5 years (2019-2023) were identified and evaluated for this review. Diverse methods, statistical packages, and approaches were used across the identified studies. The most common methods included support vector machine (SVM) and principal component analysis (PCA) approaches. Most studies applied internal validation and employed more than one algorithm, while only four studies applied one ML algorithm to the data. A wide variety of approaches, algorithms, statistical software, and validation strategies were employed in the application of ML methods. There is a need to ensure that multiple ML approaches are used, the model selection strategy is clearly defined, and both internal and external validation are necessary to be sure that the discrimination of human blood cells is being made with the highest efficient evidence.

A Systematic Literature Review of Unsupervised Fault Detection Approach for Complex Engineering System

Monitoring complex engineering systems is an important countermeasure in managing the risk of faulty events. Observing the response of each process flow will avoid further damages in the production cycle. Both fault-tolerant approach that bears with faulty events and scheduled maintenance that helps to reduce tool wearing are deeply involved in condition-based monitoring methods implemented in factories. Thus, identification of faulty equipment is need to avoid major breakdown in the production system. A classification framework shows good performance in classifying faulty events, but a labelled dataset is usually financially consuming. Machine learning (ML) techniques have become a prospective tool in the unsupervised fault detection (UFD) approach to prevent total failures in complex engineering system. However, the efficiency of UFD applications, on the other hand, is determined by the selected ML method. This paper presents a systematic literature review of ML methods applied for UFD, highlighting the methods explored in this field and the success of today's state-of-the-art machine learning techniques. This review focuses on the Scopus scientific database and provides a useful information on ML techniques, challenges and opportunities, and new research works in the UFD field.

Review of machine learning methods applied to enhanced geothermal systems

Review of machine learning methods applied to enhanced geothermal systems

Review of machine learning-based Mineral Resource estimation

Mineral Resources estimation plays a crucial role in the profitability of the future of mining operations. The conventional geostatistical methods used for grade estimation require expertise, understanding and knowledge of the spatial statistics, resource modelling, geology, mining engineering as well as clean validated data to build accurate block models. However, the geostatistical models are sensitive to changes in data and would have to be rebuilt on newly acquired data with different characteristics, which has proved to be a time-consuming process. Machine learning methods have in recent years been proposed as an alternative to the geostatistical methods to alleviate the problems these might suffer from in Mineral Resource estimation. In this paper, a systematic literature review of machine learning methods used in Mineral Resource estimation is presented. This has been conducted on such studies published during the period 1990 to 2019. The types, performances, and capabilities, of several machine learning methods have been evaluated and compared against each other, and against the conventional geostatistical methods. The results, based on 31 research studies, show that the machine learning-based methods have outperformed the conventional grade estimation modelling methods. The review also shows there is active research on applying machine learning to grade estimation from exploration through to exploitation. Further improvements can be expected if advanced machine learning techniques are to be used.

A Comprehensive Review of Machine Learning Methods in Stock Market

A Comprehensive Review of Machine Learning Methods in Stock Market

A brief review of machine learning methods for RNA methylation sites prediction.

Thanks to the tremendous advancement of deep sequencing and large-scale profiling, epitranscriptomics has become a rapidly growing field. As one of the most important parts of epitranscriptomics, ribonucleic acid (RNA) methylation has been focused on for years for its fundamental role in regulating the many aspects of RNA function. Thanks to the big data generated in sequencing, machine learning methods have been developed for efficiently identifying methylation sites. In this review, we comprehensively explore machine learning based approaches for predicting 10 types of methylation of RNA, which include m6A, m5C, m7G, 5hmC, m1A, m5U, m6Am, and so on. Firstly, we reviewed three main aspects of machine learning which are data, features and learning algorithms. Then, we summarized all the methods that have been used to predict the 10 types of methylation. Furthermore, the emergent methods which were designed to predict multiple types of methylation were also reviewed. Finally, we discussed the future perspectives for RNA methylation sites prediction.

Application of machine learning methods in photovoltaic output power prediction: A review

As the proportion of photovoltaic (PV) power generation rapidly increases, accurate PV output power prediction becomes more crucial to energy efficiency and renewable energy production. There are numerous approaches for PV output power prediction. Many researchers have previously summarized PV output power prediction from different angles. However, there are relatively few studies that use machine learning methods as a means to conduct a separate review of PV output power prediction. This review classifies machine learning methods from different perspectives and provides a systematic and critical review of machine learning methods for recent PV output power applications in terms of the temporal and spatial scales of prediction and finds that the artificial neural network and support vector machine are used much more frequently than other methods. In addition, this study examines the differences between the output power prediction of individual PV plants and regional PV stations and the benefits of regional PV plant prediction, while this paper presents some performance evaluation matrices commonly used for PV output power prediction. In addition, to further improve the accuracy of machine learning methods for PV output power prediction, some researchers suggest preprocessing the input data of the prediction models or considering hybrid machine learning methods. Furthermore, the potential advantages of machine model optimization for prediction performance improvement are discussed and explored in detail.

A systematic literature review of machine learning methods in predicting court decisions

<span>Envisaging legal cases’ outcomes can assist the judicial decision-making process. Prediction is possible in various cases, such as predicting the outcome of construction litigation, crime-related cases, parental rights, worker types, divorces, and tax law. The machine learning methods can function as support decision tools in the legal system with artificial intelligence’s advancement. This study aimed to impart a systematic literature review (SLR) of studies concerning the prediction of court decisions via machine learning methods. The review determines and analyses the machine learning methods used in predicting court decisions. This review utilised RepOrting Standards for Systematic Evidence Syntheses (ROSES) publication standard. Subsequently, 22 relevant studies that most commonly predicted the judgement results involving binary classification were chosen from significant databases: Scopus and Web of Sciences. According to the SLR’s outcomes, various machine learning methods can be used in predicting court decisions. Additionally, the performance is acceptable since most methods achieved more than 70% accuracy. Nevertheless, improvements can be made on the types of judicial decisions predicted using the existing machine learning methods.</span>

Review of machine learning methods for RNA secondary structure prediction.

Secondary structure plays an important role in determining the function of noncoding RNAs. Hence, identifying RNA secondary structures is of great value to research. Computational prediction is a mainstream approach for predicting RNA secondary structure. Unfortunately, even though new methods have been proposed over the past 40 years, the performance of computational prediction methods has stagnated in the last decade. Recently, with the increasing availability of RNA structure data, new methods based on machine learning (ML) technologies, especially deep learning, have alleviated the issue. In this review, we provide a comprehensive overview of RNA secondary structure prediction methods based on ML technologies and a tabularized summary of the most important methods in this field. The current pending challenges in the field of RNA secondary structure prediction and future trends are also discussed.

Review of Machine Learning Methods for the Prediction and Reconstruction of Metabolic Pathways

Prediction and reconstruction of metabolic pathways play significant roles in many fields such as genetic engineering, metabolic engineering, drug discovery, and are becoming the most active research topics in synthetic biology. With the increase of related data and with the development of machine learning techniques, there have many machine leaning based methods been proposed for prediction or reconstruction of metabolic pathways. Machine learning techniques are showing state-of-the-art performance to handle the rapidly increasing volume of data in synthetic biology. To support researchers in this field, we briefly review the research progress of metabolic pathway reconstruction and prediction based on machine learning. Some challenging issues in the reconstruction of metabolic pathways are also discussed in this paper.

Condition monitoring systems: a systematic literature review on machine-learning methods improving offshore-wind turbine operational management

ABSTRACT Information is key. Offshore wind farms are installed with supervisory control and data acquisition systems (SCADA) gathering valuable information. Determining the precise condition of an asset is essential on achieving the expected operational lifetime and efficiency. Equipment fault detection is necessary to achieve this. This paper presents a systematic literature review of machine learning methods applied to condition monitoring systems, using both vibration information and SCADA data together. Starting with conventional methods using vibration models, such as Fast-Fourier transforms to five prominent supervised learning regression models; Artificial neural network, support vector regression, Bayesian network, random forest and K-nearest neighbour. This review specifically looks at how conventional vibration data can be combined with SCADA data to determine the assets condition.

Review of machine learning methods in soft robotics.

Soft robots have been extensively researched due to their flexible, deformable, and adaptive characteristics. However, compared to rigid robots, soft robots have issues in modeling, calibration, and control in that the innate characteristics of the soft materials can cause complex behaviors due to non-linearity and hysteresis. To overcome these limitations, recent studies have applied various approaches based on machine learning. This paper presents existing machine learning techniques in the soft robotic fields and categorizes the implementation of machine learning approaches in different soft robotic applications, which include soft sensors, soft actuators, and applications such as soft wearable robots. An analysis of the trends of different machine learning approaches with respect to different types of soft robot applications is presented; in addition to the current limitations in the research field, followed by a summary of the existing machine learning methods for soft robots.

Systematic literature review of machine learning methods used in the analysis of real-world data for patient-provider decision making

BackgroundMachine learning is a broad term encompassing a number of methods that allow the investigator to learn from the data. These methods may permit large real-world databases to be more rapidly translated to applications to inform patient-provider decision making.MethodsThis systematic literature review was conducted to identify published observational research of employed machine learning to inform decision making at the patient-provider level. The search strategy was implemented and studies meeting eligibility criteria were evaluated by two independent reviewers. Relevant data related to study design, statistical methods and strengths and limitations were identified; study quality was assessed using a modified version of the Luo checklist.ResultsA total of 34 publications from January 2014 to September 2020 were identified and evaluated for this review. There were diverse methods, statistical packages and approaches used across identified studies. The most common methods included decision tree and random forest approaches. Most studies applied internal validation but only two conducted external validation. Most studies utilized one algorithm, and only eight studies applied multiple machine learning algorithms to the data. Seven items on the Luo checklist failed to be met by more than 50% of published studies.ConclusionsA wide variety of approaches, algorithms, statistical software, and validation strategies were employed in the application of machine learning methods to inform patient-provider decision making. There is a need to ensure that multiple machine learning approaches are used, the model selection strategy is clearly defined, and both internal and external validation are necessary to be sure that decisions for patient care are being made with the highest quality evidence. Future work should routinely employ ensemble methods incorporating multiple machine learning algorithms.

Review of machine learning methods for aerosol quantitative remote sensing

Review of machine learning methods for aerosol quantitative remote sensing

Machine Learning Techniques for the Diagnosis of Attention-Deficit/Hyperactivity Disorder from Magnetic Resonance Imaging: A Concise Review.

Attention-deficit/hyperactivity disorder (ADHD) is a neuro-developmental disease commonly seen in children and it is diagnosed via extensive interview procedures, behavioral studies, third-party observations, and comprehensive personal history. ADHD causes regional atrophy in brain regions and alters the pattern of functional brain connectivity networks. Automated/computerized methods based on magnetic resonance imaging (MRI) can replace subjective methods for the identification of ADHD. The aim of this study was to analyze various machine-learning algorithms for ADHD by feeding in vital input features extracted from functional brain connectivity and different existing methods and to review factors crucial for the diagnosis of ADHD. This paper is a concise review of machine learning methods for the diagnosis of ADHD from MRI. Techniques for feature extraction, dimensionality reduction/feature selection, and classification, employed in the computerized techniques for the diagnosis of ADHD from MRI and the accuracy of classification offered by the individual methods, are focussed on the review. Machine learning algorithms with features of functional brain connectivity networks as input, with hierarchical sparse feature elimination, exhibits the highest accuracy. Augmentation of the behavioral features does not contribute much to increased accuracy. The level of accuracy offered by the frameworks meant for the computer-aided diagnosis of ADHD, available in the literature, does not justify their feasibility in clinical practice. Computerized methods that exploit highly specific biomarkers of ADHD like brain iron concentration in Globus Pallidus, Putamen, Caudate nucleus, and thalamus as features are not available.