Compare Machine Learning Research Articles

Diagnosis and Prognosis of Lung Cancer & Lung Nodule using Machine Learning Techniques

Lung cancer is a serious and challenging cancer to diagnose. It frequently results in death in both men and women; thus, prompt, precise nodule analysis is crucial to the course of treatment. Early cancer detection has been accomplished through a variety of techniques. This research compares machine learning techniques for lung cancer nodule detection. To find anomalies, we used machine learning techniques such as principal component analysis, K-nearest neighbors, support vector machines, Naïve Bayes, decision trees, and artificial neural networks. We examined every technique with and without preprocessing. According to the experimental results, decision trees produce the most accurate results with 93,24% effectiveness without image processing while artificial neural networks produce the finest results with 82,43% effectiveness after image processing.

Evaluating and comparing machine learning approaches for effective decision making in renewable microgrid systems

This study addresses the critical issue of energy management in micro-grid (MG) systems incorporating renewable energy sources and hydrogen storage. The research introduces an innovative approach by conducting a comparative analysis of two machine learning methods, namely k-Nearest Neighbors (k-NN) and Random Forest (RF), to optimize micro-grid decision-making. The investigation reveals the consistent superiority of Random Forest, particularly in precision and F1-scores, across key micro-grid components such as the fuel cell relay, battery relay, super-capacitor relay, and grid system relay. The results demonstrate that the RF method consistently achieves high macro average precision factors (90%, 86%, 84%, 82%) and impressive macro average F1-scores (90%, 87%, 88%, 85%), surpassing the performance of k-NN, which yields notably lower precision factors (30%, 15%, 14%, 28%) and F1-scores (41%, 23%, 26%, 34%). This superior performance positions RF as a robust machine learning method for micro-grid decision-making, specifically in the realm of energy storage and renewable sources.The novelty of this work lies in establishing Random Forest as a reliable tool capable of handling the intricacies of micro-grid decision-making, thereby enhancing sustainable energy management processes. Additionally, the resilience of RF to imbalanced data adds to its effectiveness in diverse operational scenarios. This research sheds light on the potential of RF to contribute significantly to the advancement of sustainable energy solutions in micro-grid systems.

Comparing Machine Learning Algorithms for Estimating the Maize Crop Water Stress Index (CWSI) Using UAV-Acquired Remotely Sensed Data in Smallholder Croplands

Monitoring and mapping crop water stress and variability at a farm scale for cereals such as maize, one of the most common crops in developing countries with 200 million people around the world, is an important objective within precision agriculture. In this regard, unmanned aerial vehicle-obtained multispectral and thermal imagery has been adopted to estimate the crop water stress proxy (i.e., Crop Water Stress Index) in conjunction with algorithm machine learning techniques, namely, partial least squares (PLS), support vector machines (SVM), and random forest (RF), on a typical smallholder farm in southern Africa. This study addresses this objective by determining the change between foliar and ambient temperature (Tc-Ta) and vapor pressure deficit to determine the non-water stressed baseline for computing the maize Crop Water Stress Index. The findings revealed a significant relationship between vapor pressure deficit and Tc-Ta (R2 = 0.84) during the vegetative stage between 10:00 and 14:00 (South Africa Standard Time). Also, the findings revealed that the best model for predicting the Crop Water Stress Index was obtained using the random forest algorithm (R2 = 0.85, RMSE = 0.05, MAE = 0.04) using NDRE, MTCI, CCCI, GNDVI, TIR, Cl_Red Edge, MTVI2, Red, Blue, and Cl_Green as optimal variables, in order of importance. The results indicated that NIR, Red, Red Edge derivatives, and thermal band were some of the optimal predictor variables for the Crop Water Stress Index. Finally, using unmanned aerial vehicle data to predict maize crop water stress index on a southern African smallholder farm has shown encouraging results when evaluating its usefulness regarding the use of machine learning techniques. This underscores the urgent need for such technology to improve crop monitoring and water stress assessment, providing valuable insights for sustainable agricultural practices in food-insecure regions.

Application of machine learning algorithms to character interaction in single-player role-playing games

Character interaction in single-player role-playing games refers to the role interactions between the player character and the non-player characters (NPCs) in the game including dialogue, social interaction, cooperation, and competition, which are designed and implemented to achieve certain game goals and effects. This paper summarizes and compares machine learning algorithms applied to game development using a paper review and theoretical analysis, aiming to provide new solutions for optimizing and improving algorithms commonly used in game design. The ADEM algorithm can automate the evaluation of semantic relevance and logical coherence of character dialogues, but it is more costly in the pre-training phase and more difficult to perform domain adaptation for specific game content. The BERT algorithm can improve the speed of character dialogue generation through the training of unlabeled text, and then improve the flexibility of the dialogue through a small amount of labeled text for domain adaptation and fine-tuning, but it lacks in the generation of smooth and complex text and other aspects. The GAN algorithm can learn from a single or a small number of action sequences to achieve the transformation and mixing of character actions, thus generating multiple action gestures. However, its training process may suffer from problems such as pattern collapse leading to degradation in the quality of the generation, and it is also difficult to set a uniform objective criterion to determine the loss function.

The role of hyperparameters in machine learning models and how to tune them

Abstract Hyperparameters critically influence how well machine learning models perform on unseen, out-of-sample data. Systematically comparing the performance of different hyperparameter settings will often go a long way in building confidence about a model's performance. However, analyzing 64 machine learning related manuscripts published in three leading political science journals (APSR, PA, and PSRM) between 2016 and 2021, we find that only 13 publications (20.31 percent) report the hyperparameters and also how they tuned them in either the paper or the appendix. We illustrate the dangers of cursory attention to model and tuning transparency in comparing machine learning models’ capability to predict electoral violence from tweets. The tuning of hyperparameters and their documentation should become a standard component of robustness checks for machine learning models.

Comparing programming languages for data analytics: Accuracy of estimation in Python and R

AbstractSeveral open‐source programming languages, particularly R and Python, are utilized in industry and academia for statistical data analysis, data mining, and machine learning. While most commercial software programs and programming languages provide a single way to deliver a statistical procedure, open‐source programming languages have multiple libraries and packages offering many ways to complete the same analysis, often with varying results. Applying the same statistical method across these different libraries and packages can lead to entirely different solutions due to the differences in their implementations. Therefore, reliability and accuracy should be essential considerations when making library and package usage decisions while conducting statistical analysis using open source programming languages. Instead, most users take this for granted, assuming that their chosen libraries and packages produce accurate results for their statistical analysis. To this extent, this study assesses the estimation accuracy and reliability of Python and R's various libraries and packages by evaluating the univariate summary statistics, analysis of variance (ANOVA), and linear regression procedures using benchmarking data from the National Institutes of Standards and Technology (NIST). Further, experimental results are presented comparing machine learning methods for classification and regression. The libraries and packages assessed in this study include the stats package in R and Pandas, Statistics, NumPy, statsmodels, SciPy, statsmodels, scikit‐learn, and pingouin in Python. The results show that the stats package in R and statsmodels library in Python are reliable for univariate summary statistics. In contrast, Python's scikit‐learn library produces the most accurate results and is recommended for ANOVA. Among the libraries and packages assessed for linear regression, the results demonstrated that the stats package in R is more reliable, accurate, and flexible; thus, it is recommended for linear regression analysis. Further, we present results and recommendations for machine learning using R and Python.This article is categorized under: Algorithmic Development > Statistics Application Areas > Data Mining Software Tools

PDDGCN: A Parasitic Disease-Drug Association Predictor Based on Multi-view Fusion Graph Convolutional Network.

The precise identification of associations between diseases and drugs is paramount for comprehending the etiology and mechanisms underlying parasitic diseases. Computational approaches are highly effective in discovering and predicting disease-drug associations. However, the majority of these approaches primarily rely on link-based methodologies within distinct biomedical bipartite networks. In this study, we reorganized a fundamental dataset of parasitic disease-drug associations using the latest databases, and proposed a prediction model called PDDGCN, based on a multi-view graph convolutional network. To begin with, we fused similarity networks with binary networks to establish multi-view heterogeneous networks. We utilized neighborhood information aggregation layers to refine node embeddings within each view of the multi-view heterogeneous networks, leveraging inter- and intra-domain message passing to aggregate information from neighboring nodes. Subsequently, we integrated multiple embeddings from each view and fed them into the ultimate discriminator. The experimental results demonstrate that PDDGCN outperforms five state-of-the-art methods and four compared machine learning algorithms. Additionally, case studies have substantiated the effectiveness of PDDGCN in identifying associations between parasitic diseases and drugs. In summary, the PDDGCN model has the potential to facilitate the discovery of potential treatments for parasitic diseases and advance our comprehension of the etiology in this field. The source code is available at https://github.com/AhauBioinformatics/PDDGCN .

Machine learning to identify chronic cough from administrative claims data

Accurate identification of patient populations is an essential component of clinical research, especially for medical conditions such as chronic cough that are inconsistently defined and diagnosed. We aimed to develop and compare machine learning models to identify chronic cough from medical and pharmacy claims data. In this retrospective observational study, we compared 3 machine learning algorithms based on XG Boost, logistic regression, and neural network approaches using a large claims and electronic health record database. Of the 327,423 patients who met the study criteria, 4,818 had chronic cough based on linked claims–electronic health record data. The XG Boost model showed the best performance, achieving a Receiver-Operator Characteristic Area Under the Curve (ROC-AUC) of 0.916. We selected a cutoff that favors a high positive predictive value (PPV) to minimize false positives, resulting in a sensitivity, specificity, PPV, and negative predictive value of 18.0%, 99.6%, 38.7%, and 98.8%, respectively on the held-out testing set (n = 82,262). Logistic regression and neural network models achieved slightly lower ROC-AUCs of 0.907 and 0.838, respectively. The XG Boost and logistic regression models maintained their robust performance in subgroups of individuals with higher rates of chronic cough. Machine learning algorithms are one way of identifying conditions that are not coded in medical records, and can help identify individuals with chronic cough from claims data with a high degree of classification value.

Machine learning-based prediction of hip joint moment in healthy subjects, patients and post-operative subjects

The application of machine learning in the field of motion capture research is growing rapidly. The purpose of the study is to implement a long-short term memory (LSTM) model able to predict sagittal plane hip joint moment (HJM) across three distinct cohorts (healthy controls, patients and post-operative patients) starting from 3D motion capture and force data. Statistical parametric mapping with paired samples t-test was performed to compare machine learning and inverse dynamics HJM predicted values, with the latter used as gold standard. The results demonstrated favorable model performance on each of the three cohorts, showcasing its ability to successfully generalize predictions across diverse cohorts.

Multimodal imaging measures in the prediction of clinical response to deep brain stimulation for refractory depression: A machine learning approach

Objectives This study compared machine learning models using unimodal imaging measures and combined multi-modal imaging measures for deep brain stimulation (DBS) outcome prediction in treatment resistant depression (TRD). Methods Regional brain glucose metabolism (CMRGlu), cerebral blood flow (CBF), and grey matter volume (GMV) were measured at baseline using 18F-fluorodeoxy glucose (18F-FDG) positron emission tomography (PET), arterial spin labelling (ASL) magnetic resonance imaging (MRI), and T1-weighted MRI, respectively, in 19 patients with TRD receiving subcallosal cingulate (SCC)-DBS. Responders (n = 9) were defined by a 50% reduction in HAMD-17 at 6 months from the baseline. Using an atlas-based approach, values of each measure were determined for pre-selected brain regions. OneR feature selection algorithm and the naïve Bayes model was used for classification. Leave-out-one cross validation was used for classifier evaluation. Results The performance accuracy of the CMRGlu classification model (84%) was greater than CBF (74%) or GMV (74%) models. The classification model using the three image modalities together led to a similar accuracy (84%0 compared to the CMRGlu classification model. Conclusions CMRGlu imaging measures may be useful for the development of multivariate prediction models for SCC-DBS studies for TRD. The future of multivariate methods for multimodal imaging may rest on the selection of complementing features and the developing better models.Clinical Trial Registration: ClinicalTrials.gov (#NCT 01983904)

Ionic liquid-assisted preparation of Ag–Zn–In–S quaternary quantum dot thin films and luminescence performance optimized by machine learning

Machine learning-assisted synthesis of new materials has been an ongoing hot topic. Luminescent Ag–Zn–In–S quaternary semiconductor quantum dot thin films have great application potential in many fields because of their excellent photoelectric performance. In this study, an environmentally friendly ionic liquid-assisted approach was employed to prepare high-performance Ag–Zn–In–S luminescent thin films, and machine learning methods were applied to screen the optimal preparation conditions. The photoluminescence (PL) performance, crystal structure, and morphology of the thin films were also been studied. The initial data set was obtained by high-throughput experiments. By comparing machine learning algorithms of Xgboost, Random Forest, Bagging, SVM, Extra Tree, and Gradient Boosting, the Random Forest achieved the best accuracy (r = 0.84, R2 = 0.847) and was selected to predict the optimal preparation conditions of Ag–Zn–In–S quaternary quantum dot thin films. The machine learning predicted results are in great agreement with the subsequent experimental results, which verifies the accuracy and effectiveness of the machine learning model. This study offers a theoretical foundation for preparing optimal inorganic quantum dot luminescent materials using machine learning.

Improving urban water demand forecast using conformal prediction-based hybrid machine learning models

This paper presents a probabilistic forecasting method that predicts the future water consumption patterns, taking into account the inherent uncertainty in the system. The proposed method leverages statistical techniques to estimate the probability distribution of future water demand scenarios. The findings of this study will provide decision-makers with a range of possible alternatives that facilitate better planning and management of water resources. We developed a conformal prediction-based hybrid demand forecast model, which combines convolutional neural network (CNN) and bidirectional long short-term memory (BiLSTM) while comparing it with other machine learning models for probabilistic hourly water demand forecasting. Additionally, we address crucial considerations when implementing a probabilistic forecasting system, including selecting appropriate data and choosing model parameters. The performance of the proposed model is validated for probabilistic water demand forecasting in real-world settings. Results indicate noteworthy improvement in deterministic and probabilistic predictions by 10 % and 26.7 %, respectively. The findings underscore the potential benefits of this approach for improved decision-making and resource management. The results also demonstrate that the proposed hybrid model outperforms the compared machine learning models with better prediction performance and increased robustness for handling prediction uncertainties.

Comparing Machine Learning Techniques for Detecting Chronic Kidney Disease in Early Stage

In medical care, side effect trial and error processes are utilized for the discovery of hidden reasons for ailments and the determination of conditions. In our exploration, we used a crossbreed strategy to refine our optimal model, improving the Pearson relationship for highlight choice purposes. The underlying stage included the choice of ideal models through a careful survey of the current writing. Hence, our proposed half-and-half model incorporated a blend of these models. The base classifiers utilized included XGBoost, Arbitrary Woods, Strategic Relapse, AdaBoost, and the Crossover model classifiers, while the Meta classifier was the Irregular Timberland classifier. The essential target of this examination was to evaluate the best AI grouping techniques and decide the best classifier concerning accuracy. This approach resolved the issue of overfitting and accomplished the most elevated level of exactness. The essential focal point of the assessment was precision, and we introduced a far-reaching examination of the significant writing in even configuration. To carry out our methodology, we used four top-performing AI models and fostered another model named "half and half," utilizing the UCI Persistent Kidney Disappointment dataset for prescient purposes. In our experiment, we found out that the AI model XGBoost classifier gains almost 94% accuracy, a random forest gains 93% accuracy, Logistic Regression about 90% accuracy, AdaBoost gains 91% accuracy, and our proposed new model named hybrid gains the highest 95% accuracy, and performance of Hybrid model is best on this equivalent dataset. Various noticeable AI models have been utilized to foresee the event of persistent kidney disappointment (CKF). These models incorporate Naïve Bayes, Random Forest, Decision Tree, Support Vector Machine, K-nearest neighbor, LDA (Linear Discriminant Analysis), GB (Gradient Boosting), and neural networks. In our examination, we explicitly used XGBoost, AdaBoost, Logistic Regression, Random Forest, and Hybrid models with the equivalent dataset of highlights to analyze their accuracy scores.

Comparing Machine Learning and Advanced Methods with Traditional Methods to Generate Weights in Inverse Probability of Treatment Weighting: The INFORM Study.

Observational research provides valuable insights into treatments used in patient populations in real-world settings. However, confounding is likely to occur if there are differences in patient characteristics associated with both the exposure and outcome between the groups being evaluated. One approach to reduce confounding and facilitate unbiased comparisons is inverse probability of treatment weighting (IPTW) using propensity scores. Machine learning (ML) and entropy balancing can potentially be used in generating propensity scores for IPTW, but there is limited literature on this application. We aimed to assess the feasibility of applying these methods for reducing confounding in observational studies. These methods were assessed in a study comparing cardiovascular outcomes in adults with type 2 diabetes and established atherosclerotic cardiovascular disease taking once-weekly glucagon-like peptide-1 receptor agonists or dipeptidyl peptidase-4 inhibitors. We applied advanced methods to generate the propensity scores compared to the original logistic regression method in terms of covariate balance. After calculating weights, a weighted Cox proportional hazards model was used to calculate the sample average treatment effect. Support Vector Classification, Support Vector Regression, XGBoost, and LightGBM were the ML models used. Entropy balancing was also performed on features identified in the original cardiovascular outcomes study. Accuracy (range: 0.71 to 0.73), area under the curve (0.77 to 0.79), precision (0.53 to 0.60), recall (0.66 to 0.68), and F1 score (0.60 to 0.64) were similar between all of the advanced propensity score methods and traditional logistic regression. Among ML models, only XGBoost achieved balance in all measured baseline characteristics between the two treatment groups, closely approximating the performance of the original logistic regression. Entropy balancing weights provided the best performance among all models in balancing baseline characteristics, achieving near perfect balancing. Among the advanced methods examined, entropy balancing weights performed the best for optimizing balancing and can produce similar results compared to traditional logistic regression.

Metabolic profiling of murine radiation-induced lung injury with Raman spectroscopy and comparative machine learning.

Radiation-induced lung injury (RILI) is a dose-limiting toxicity for cancer patients receiving thoracic radiotherapy. As such, it is important to characterize metabolic associations with the early and late stages of RILI, namely pneumonitis and pulmonary fibrosis. Recently, Raman spectroscopy has shown utility for the differentiation of pneumonitic and fibrotic tissue states in a mouse model; however, the specific metabolite-disease associations remain relatively unexplored from a Raman perspective. This work harnesses Raman spectroscopy and supervised machine learning to investigate metabolic associations with radiation pneumonitis and pulmonary fibrosis in a mouse model. To this end, Raman spectra were collected from lung tissues of irradiated/non-irradiated C3H/HeJ and C57BL/6J mice and labelled as normal, pneumonitis, or fibrosis, based on histological assessment. Spectra were decomposed into metabolic scores via group and basis restricted non-negative matrix factorization, classified with random forest (GBR-NMF-RF), and metabolites predictive of RILI were identified. To provide comparative context, spectra were decomposed and classified via principal component analysis with random forest (PCA-RF), and full spectra were classified with a convolutional neural network (CNN), as well as logistic regression (LR). Through leave-one-mouse-out cross-validation, we observed that GBR-NMF-RF was comparable to other methods by measure of accuracy and log-loss (p > 0.10 by Mann-Whitney U test), and no methodology was dominant across all classification tasks by measure of area under the receiver operating characteristic curve. Moreover, GBR-NMF-RF results were directly interpretable and identified collagen and specific collagen precursors as top fibrosis predictors, while metabolites with immune and inflammatory functions, such as serine and histidine, were top pneumonitis predictors. Further support for GBR-NMF-RF and the identified metabolite associations with RILI was found as CNN interpretation heatmaps revealed spectral regions consistent with these metabolites.

Correlation-Based Comparative Machine Learning Analysis for the Classification of Metastatic Breast Cancer Using Blood Profile

Correlation-Based Comparative Machine Learning Analysis for the Classification of Metastatic Breast Cancer Using Blood Profile

Comparing Machine Learning Models to Determine the Effect of Speech Duration on Speaker Identification within Kazakh Speech Corpus

This paper conducts comparative analysis of speaker identification techniques, namely Gaussian Mixture Models (GMM), Bidirectional Long Short-Term Memory (BiLSTM) neural networks, and Recurrent Neural Networks (RNN), applied to the Kazakh Speech Corpus. The study's central objective is to explore the influence of speech duration on the efficacy of speaker identification. Our results indicate that all models exhibit enhanced accuracy with increased speech duration. Furthermore, the incorporation of delta and fundamental frequency (F0) as supplementary features bolsters the performance of these models. This research contributes to the understanding of how speech duration and additional features can optimize speaker identification techniques, providing valuable insights for future developments in the field.

Disseminating the Risk Factors With Enhancement in Precision Medicine Using Comparative Machine Learning Models for Healthcare Data

Disseminating the Risk Factors With Enhancement in Precision Medicine Using Comparative Machine Learning Models for Healthcare Data

Comparing machine learning approaches for estimating soil saturated hydraulic conductivity.

Characterization of near (field) saturated hydraulic conductivity (Kfs) of the soil environment is among the crucial components of hydrological modeling frameworks. Since the associated laboratory/field experiments are time-consuming and labor-intensive, pedotransfer functions (PTFs) that rely on statistical predictors are usually integrated with the existing measurements to predict Kfs in other areas of the field. In this study some of the most appropriate machine learning approaches, including variants of artificial neural networks (ANNs) were used for predicting Kfs by some easily measurable soil attributes. The analyses were performed using 100 measurements in Bajgah Agricultural Experimental Station. First, physico-chemical inputs as bulk density (BD), initial water content (Wi), saturated water content (Ws), mean weight diameter (MWD), and geometric mean diameter (GMD) of aggregates, pH, electrical conductivity (EC), and calcium carbonate equivalent (CCE) were measured. Then, radial basis functions (RBFNNs), multilayer perceptron (MLPNNs), hybrid genetic algorithm (GA-NNs), and particle swarm optimization (PSO-NNs) neural networks were utilized to develop PTFs and compared their accuracy with the traditional regression model (MLR) using statistical indices. The statistical assessment indicated that PSO-NNs with the lowest RMSE and MAPE as well as the highest correlation coefficient (R) value provided the most accurate and robust prediction of Kfs. The prediction models ranked as PSO-NNs (R = 0.958; RMSE = 0.343; MAPE = 9.47), GA-NNs (R = 0.949; RMSE = 0.404; MAPE = 11.83), MLPNNs (R = 0.933; RMSE = 0.426; MAPE = 12.13), RBFNNs (R = 0.926; RMSE = 0.452; MAPE = 14.30), and MLR (R = 0.675; RMSE = 0.685; MAPE = 22.54) in terms of their performances for the test data set. Results revealed that all NN models particularly PSO-NNs were efficient in prediction of Kfs. However, further evaluations may be recommended for other soil conditions and input variables to quantify their potential uncertainties and wider potential and versatility before they are used in other geographical locations/soil conditions.

Comparative Machine Learning Approaches to Analyzing the Illnesses of the Chronic Renal and Heart Diseases

The considerable increase in the risk of clinical events associated with chronic renal disease makes it a severe global public health issue. Chronic kidney disease (CKD) is a severe global public health issue, increasing the risk of clinical events and being associated with renal failure, cardiovascular disease, and early mortality. An accurate and timely diagnosis is essential. This research paper focuses on the global public health issue of chronic kidney disease (CKD) and its association with cardiovascular disease. It emphasizes the importance of accurate diagnosis and timely intervention for CKD, which poses significant risks to patients’ health. The study proposes a machine learning (ML) approach using deep neural networks and feature selection methods to diagnose CKD and heart attack disease. The ensemble learning algorithms used in this study are decision tree (DT), logistic regression (LR), Naive Bayes (NB), random forest (RF), support vector machine (SVM), and gradient boosted trees (GBT) classifier, as well as one deep learning technique called recurrent neural network (RNN). Feature selection techniques like correlation coefficient methods are used to identify critical characteristics. The evaluation of the proposed approach was conducted using accuracy, precision, recall, and F1 measure metrics. The study employed all features for grid search and testing in each approach.