Supervised Machine Learning Models Research Articles

A machine learning model based on CHAT-23 for early screening of autism in Chinese children.

Autism spectrum disorder (ASD) is a neurodevelopmental condition that significantly impacts the mental, emotional, and social development of children. Early screening for ASD typically involves the use of a series of questionnaires. With answers to these questionnaires, healthcare professionals can identify whether a child is at risk for developing ASD and refer them for further evaluation and diagnosis. CHAT-23 is an effective and widely used screening test in China for the early screening of ASD, which contains 23 different kinds of questions. We have collected clinical data from Wuxi, China. All the questions of CHAT-23 are regarded as different kinds of features for building machine learning models. We introduce machine learning methods into ASD screening, using the Max-Relevance and Min-Redundancy (mRMR) feature selection method to analyze the most important questions among all 23 from the collected CHAT-23 questionnaires. Seven mainstream supervised machine learning models were built and experiments were conducted. Among the seven supervised machine learning models evaluated, the best-performing model achieved a sensitivity of 0.909 and a specificity of 0.922 when the number of features was reduced to 9. This demonstrates the model's ability to accurately identify children for ASD with high precision, even with a more concise set of features. Our study focuses on the health of Chinese children, introducing machine learning methods to provide more accurate and effective early screening tests for autism. This approach not only enhances the early detection of ASD but also helps in refining the CHAT-23 questionnaire by identifying the most relevant questions for the diagnosis process.

Supervised machine learning for understanding and predicting the status of bistable eukaryotic plankton community in urbanized rivers

Understanding and predicting the ecological status of urbanized rivers is crucial for their restoration and management. However, the complex and nonlinear nature of ecological responses poses a challenge to the development of predictive models. Here, the study investigated and predicted the status of eukaryotic plankton communities in urbanized rivers by coupling environmental DNA metabarcoding, the alternative stable states theory, and supervised machine learning (SML) models. The results revealed two distinct states of eukaryotic plankton communities under similar environmental conditions: one state was characterized by the enrichment of a diverse phytoplankton population and the high relative abundance of protozoa, whereas the alternative state was characterized by abundant phytoplankton and fungi with an associated risk of algal blooms. Turbidity was identified as a key driver based on the SML model and Mantel test. Potential analysis demonstrated that the response pattern of eukaryotic plankton communities to turbidity was thresholds with hysteresis (Threshold1 = 17 NTU, Threshold2 = 24 NTU). A reduction in turbidity induced a regime shift in the eukaryotic plankton community toward an alternative state associated with a risk of algal blooms. In the prediction of ecological status, both SML models showed excellent performance (R2 > 0.80, RMSE < 0.1, Kappa > 0.70). Additionally, SHapley Additive exPlanations analysis identified turbidity, chlorophyll-a, chemical oxygen demand (COD), ammonia nitrogen and green algae's amplicon sequence variants as crucial features for prediction, with turbidity and COD showing a synergistic effect on ecological status. A framework was further proposed to enhance the understanding and prediction of ecological status in urbanized rivers. The obtained results of this study demonstrated the feasibility of using SML models to predict and explain the ecological status of urbanized rivers with alternative stable states. This provides valuable insights for the application of SML models in the restoration and management of urbanized rivers.

Analysis of 27 supervised machine learning models for the co-gasification assessment of peanut shell and spent tea residue in an open-core downdraft gasifier

The producer gas (PG) obtained through thermochemical processing of the various renewable biomass types contributes to Sustainable Development Goal-7 (SDG-7). Hence, this study examined 27 supervised and multiple-input single-output ML models in terms of performance metrics and accuracy to predict CO, H2, CH4, and CO2 compositions, as well as PG's HHV in the co-gasification of peanut shell (PS) and spent tea residue (STR). Multiple trial experiments were tested with various equivalence ratios (ERs) and mixing ratios (MRs) on a 90 m3/h gas-yield open-core, down-draft gasifier with air as the gasification medium. About 18 models were chosen after evaluating their performance metrics in estimating relevant parameters. The accuracy of those models is assessed based on 12 sample runs with varying ER and MR. The findings revealed that 16 models from the linear, neural network, support vector machine, Gaussian process, tree, and ensemble categories were reliable ML models. The chosen 16 models' R2 values for CO, H2, CH4, CO2, and HHVPG are above 0.931, 0.937, 0.962, 0.806, and 0.971, respectively, with the exception of TRE. Additionally, the models demonstrated a prediction accuracy of >95 % for all of the investigated parameters in the co-gasification of PS and STR when compared to random experimental runs.

Long-read RNA sequencing reveals allele-specific N6-methyladenosine modifications.

Long-read sequencing technology enables highly accurate detection of allele-specific RNA expression, providing insights into the effects of genetic variation on splicing and RNA abundance. Furthermore, the ability to directly sequence RNA promises the detection of RNA modifications in tandem with ascertaining the allelic origin of each molecule. Here, we leverage these advantages to determine allele-biased patterns of N6-methyladenosine (m6A) modifications in native mRNA. We utilized human and mouse cells with known genetic variants to assign allelic origin of each mRNA molecule combined with a supervised machine learning model to detect read-level m6A modification ratios. Our analyses revealed the importance of sequences adjacent to the DRACH-motif in determining m6A deposition, in addition to allelic differences that directly alter the motif. Moreover, we discovered allele-specific m6A modification (ASM) events with no genetic variants in close proximity to the differentially modified nucleotide, demonstrating the unique advantage of using long reads and surpassing the capabilities of antibody-based short-read approaches. This technological advancement promises to advance our understanding of the role of genetics in determining mRNA modifications.

Prediction of medical admissions after psychiatric inpatient hospitalization in bipolar disorder: a retrospective cohort study.

Bipolar Disorder (BD) is a severe mental illness associated with high rates of general medical comorbidity, reduced life expectancy, and premature mortality. Although BD has been associated with high medical hospitalization, the factors that contribute to this risk remain largely unexplored. We used baseline medical and psychiatric records to develop a supervised machine learning model to predict general medical admissions after discharge from psychiatric hospitalization. In this retrospective three-year cohort study of 71 patients diagnosed with BD (mean age=52.19 years, females=56.33%), lasso regression models combining medical and psychiatric records, as well as those using them separately, were fitted and their predictive power was estimated using a leave-one-out cross-validation procedure. The proportion of medical admissions in patients with BD was higher compared with age- and sex-matched hospitalizations in the same region (25.4% vs. 8.48%). The lasso model fairly accurately predicted the outcome (area under the curve [AUC]=69.5%, 95%C.I.=55-84.1; sensitivity=61.1%, specificity=75.5%, balanced accuracy=68.3%). Notably, pre-existing cardiovascular, neurological, or osteomuscular diseases collectively accounted for more than 90% of the influence on the model. The accuracy of the model based on medical records was slightly inferior (AUC=68.7%, 95%C.I. = 54.6-82.9), while that of the model based on psychiatric records only was below chance (AUC=61.8%, 95%C.I.=46.2-77.4). Our findings support the need to monitor medical comorbidities during clinical decision-making to tailor and implement effective preventive measures in people with BD. Further research with larger sample sizes and prospective cohorts is warranted to replicate these findings and validate the predictive model.

Development of machine learning models for fractional flow reserve prediction in angiographically intermediate coronary lesions.

Fractional flow reserve (FFR) represents the gold standard in guiding the decision to proceed or not with coronary revascularization of angiographically intermediate coronary lesion (AICL). Optical coherence tomography (OCT) allows to carefully characterize coronary plaque morphology and lumen dimensions. We sought to develop machine learning (ML) models based on clinical, angiographic and OCT variables for predicting FFR. Data from a multicenter, international, pooled analysis of individual patient's level data from published studies assessing FFR and OCT on the same target AICL were collected through a dedicated database to train (n = 351) and validate (n = 151) six two-class supervised ML models employing 25 clinical, angiographic and OCT variables. A total of 502 coronary lesions in 489 patients were included. The AUC of the six ML models ranged from 0.71 to 0.78, whereas the measured F1 score was from 0.70 to 0.75. The ML algorithms showed moderate sensitivity (range: 0.68-0.77) and specificity (range: 0.59-0.69) in detecting patients with a positive or negative FFR. In the sensitivity analysis, using 0.75 as FFR cut-off, we found a higher AUC (0.78-0.86) and a similar F1 score (range: 0.63-0.76). Specifically, the six ML models showed a higher specificity (0.71-0.84), with a similar sensitivity (0.58-0.80) with respect to 0.80 cut-off. ML algorithms derived from clinical, angiographic, and OCT parameters can identify patients with a positive or negative FFR.

Machine Learning–Based Prediction of Chronic Shunt-Dependent Hydrocephalus After Spontaneous Subarachnoid Hemorrhage

BackgroundChronic posthemorrhagic hydrocephalus often arises following spontaneous subarachnoid hemorrhage (SAH). Timely identification of patients predisposed to develop chronic shunt-dependent hydrocephalus may significantly enhance clinical outcomes. MethodsWe performed an analysis of 510 SAH-patients treated at our institution between 2013 and 2018. Clinical and radiological variables, including age, sex, Hunt & Hess grade, Fisher-Score, external ventricular drainage placement, central nervous system infection, aneurysm characteristics, and treatment modalities, were evaluated. Supervised machine learning models, trained and compared using Python and scikit-learn, were employed to predict chronic shunt-dependent hydrocephalus. Model performance was rigorously assessed through repeated cross-validation. To facilitate transparency and collaboration, we publicly released the dataset and code on GitHub (https://github.com/RISCSoftware/shuntclf) and developed an interactive web application (https://huggingface.co/spaces/risc42/shuntclf). ResultsAmong the evaluated machine learning models, logistic regression exhibited superior performance, with an AUC-ROC of 0.819 and an AUC-PR of 0.482, along with the highest F1 score of 0.473. Although the balanced accuracy scores of the models were generally proximate, ranging from 0.735 to 0.764, logistic regression consistently outperform others in key metrics such as AUC-ROC and AUC-PR. Conversely, female gender and absence of aneurysm within the anterior communicating artery were associated with reduced shunt requirement likelihood. ConclusionMachine learning models, including logistic regression, demonstrate strong predictive capability for early chronic shunt-dependent hydrocephalus following spontaneous SAH, which may potentially contribute to more timely shunt placement interventions. This predictive capability is supported by our web interface, which simplifies the application of these models, aiding clinicians in efficiently determining the need for shunt placement.

Optimizing Lung Cancer Diagnosis with Machine Learning and Feature Selection Methods

Lung cancer is a prevalent disease, with nearly 238,000 new cases diagnosed in 2023. This study utilizes clinical predictors from a Kaggle dataset containing 309 observations across 15 variables to aid in lung cancer diagnosis. The variables include swallowing difficulty, peer pressure, gender, allergy, yellow fingers, anxiety, wheezing, alcohol consumption, chronic disease, chest pain, coughing, fatigue, smoking, age, and shortness of breath. The research aims to develop and compare various supervised machine learning models for classifying and predicting lung cancer, while also identifying key clinical tests and parameters using unsupervised statistical models. The dataset was divided into training and test sets, balanced, and preprocessed for unbiased training. Feature selection and machine learning models were applied to identify crucial predictors. The study explored tree models, logistic regression, Naïve Bayes, support vector machine (SVM), ensemble, neural network, and kernel models. Among these, the linear SVM achieved the highest accuracy of 93.75% with 5-fold cross-validation. However, it showed overfitting, with a lower test accuracy of 82.55%. The Gaussian Naïve Bayes model emerged as the optimal choice, providing consistent performance between validation and test cases. It achieved the highest cross-validation classification accuracy of 82.81% using only 9 variables: swallowing difficulty, peer pressure, gender, allergy, yellow fingers, anxiety, wheezing, alcohol consumption, and chronic disease. This model allows for effective training with fewer predictors without compromising classification

Forecasting infectious diseases in Brazilian cities: Integrating socio-economic and geographic data from related cities through a machine learning approach

Supervised machine learning models and public surveillance data have been employed for infectious disease forecasting in many settings. These models leverage various data sources capturing drivers of disease spread, such as climate conditions or human behavior. However, few models have incorporated the organizational structure of different geographic locations for forecasting. Traveling waves of seasonal outbreaks have been reported for dengue, influenza, and other infectious diseases, and many of the drivers of infectious disease dynamics may be shared across different cities, either due to their geographic or socioeconomic proximity. In this study, we developed a machine learning model to predict case counts of four infectious diseases across Brazilian cities one week ahead by incorporating information from related cities. We compared selecting related cities using both geographic distance and GDP per capita. Incorporating information from geographically proximate cities improved predictive performance for two of the four diseases, specifically COVID-19 and Zika. We also discuss the impact on forecasts in the presence of anomalous contagion patterns and the limitations of the proposed methodology.

Machine learning approaches to detect hepatocyte chromatin alterations from iron oxide nanoparticle exposure

This study focuses on developing machine learning models to detect subtle alterations in hepatocyte chromatin organization due to Iron (II, III) oxide nanoparticle exposure, hypothesizing that exposure will significantly alter chromatin texture. A total of 2000 hepatocyte nuclear regions of interest (ROIs) from mouse liver tissue were analyzed, and for each ROI, 5 different parameters were calculated: Long Run Emphasis, Short Run Emphasis, Run Length Nonuniformity, and 2 wavelet coefficient energies obtained after the discrete wavelet transform. These parameters served as input for supervised machine learning models, specifically random forest and gradient boosting classifiers. The models demonstrated relatively robust performance in distinguishing hepatocyte chromatin structures belonging to the group exposed to IONPs from the controls. The study's findings suggest that iron oxide nanoparticles induce substantial changes in hepatocyte chromatin distribution and underscore the potential of AI techniques in advancing hepatocyte evaluation in physiological and pathological conditions.

A Machine Learning-Based Prediction of Malaria Occurrence in Kenya

For many years’ malaria has been a health public concern in Kenya as well as many parts of Africa and other parts of the world. The purpose of this study is to develop and evaluate a supervised machine learning model to predict malaria occurrence (final malaria test results) in Kenya. The study investigated twelve predictor variables on the outcome variable (malaria test results), where five machine learning models namely; k-nearest neighbors, support vector machines, random forest, tree bagging, and boosting, were estimated. During the model evaluation, random forest emerged as the best overall model in the classification and prediction of final malaria test results. The model attained a higher classification accuracy of 97.33%, sensitivity of 71.1%, specificity of 98.4%, balanced accuracy of 84.7% and an area under the curve of 98.3%. From the final model, the presence of plasmodium falciparum emerged most important feature, followed by region, endemic zone and anemic level. The feature with the least importance in predicting final malaria test results was having mosquito nets. In conclusion, employing Machine learning algorithms enhances early detection, optimizing resource allocation for interventions, and ultimately reducing the incidence and impact of malaria in the Kenya. The study recommends allocation of resources and funds to areas with the presence of plasmodium falciparum, region susceptible to malaria, endemic zones and anemic prone areas.

Middle ear-acquired cholesteatoma diagnosis based on CT scan image mining using supervised machine learning models

BackgroundDistinguishing between middle ear cholesteatoma and chronic suppurative otitis media (CSOM) is an ongoing challenge. While temporal bone computed tomography (CT) scan is highly accurate for diagnosing middle ear conditions, its specificity in discerning between cholesteatoma and CSOM is only moderate. To address this issue, we utilized trained machine learning models to enhance the specificity of temporal bone CT scan in diagnosing middle ear cholesteatoma. Our database consisted of temporal bone CT scan native images from 122 patients diagnosed with middle ear cholesteatoma and a control group of 115 patients diagnosed with CSOM, with both groups labeled based on surgical findings. We preprocessed the native images to isolate the region of interest and then utilized the Inception V3 convolutional neural network for image embedding into data vectors. Classification was performed using machine learning models including support vector machine (SVM), k-nearest neighbors (k-NN), random forest, and neural network. Statistical metrics employed to interpret the results included classification accuracy, precision, recall, F1 score, confusion matrix, area under the receiver operating characteristic curve (AUC), and FreeViz diagram.ResultsOur training dataset comprised 5390 images, and the testing dataset included 125 different images. The neural network, k-NN, and SVM models demonstrated significantly higher relevance in terms of classification accuracy, precision, and recall compared to the random forest model. For instance, the F1 scores were 0.974, 0.987, and 0.897, respectively, for the former three models, in contrast to 0.661 for the random forest model.ConclusionThe performance metrics of the presented trained machine learning models hold promising prospects as potentially clinically useful aids.

Immune-based Machine learning Prediction of Diagnosis and Illness State in Schizophrenia and Bipolar Disorder

BackgroundSchizophrenia and bipolar disorder frequently face significant delay in diagnosis, leading to being missed or misdiagnosed in early stages. Both disorders have also been associated with trait and state immune abnormalities. Recent machine learning-based studies have shown encouraging results using diagnostic biomarkers in predictive models, but few have focused on immune-based markers. Our main objective was to develop supervised machine learning models to predict diagnosis and illness state in schizophrenia and bipolar disorder using only a panel of peripheral kynurenine metabolites and cytokines. MethodsThe cross-sectional I-GIVE cohort included hospitalized acute bipolar patients (n = 205), stable bipolar outpatients (n = 116), hospitalized acute schizophrenia patients (n = 111), stable schizophrenia outpatients (n = 75) and healthy controls (n = 185). Serum kynurenine metabolites, namely tryptophan (TRP), kynurenine (KYN), kynurenic acid (KA), quinaldic acid (QUINA), xanthurenic acid (XA), quinolinic acid (QUINO) and picolinic acid (PICO) were quantified using liquid chromatography-tandem mass spectrometry (LC-MS/MS), while V-plex Human Cytokine Assays were used to measure cytokines (interleukin-6 (IL-6), IL-8, IL-17, IL-12/IL23-P40, tumor necrosis factor-alpha (TNF-ɑ), interferon-gamma (IFN-γ)). Supervised machine learning models were performed using JMP Pro 17.0.0. We compared a primary analysis using nested cross-validation to a split set as sensitivity analysis. Post-hoc, we re-ran the models using only the significant features to obtain the key markers. ResultsThe models yielded a good Area Under the Curve (AUC) (0.804, Positive Prediction Value (PPV) = 86.95; Negative Prediction Value (NPV) = 54.61) for distinguishing all patients from controls. This implies that a positive test is highly accurate in identifying the patients, but a negative test is inconclusive. Both schizophrenia patients and bipolar patients could each be separated from controls with a good accuracy (SCZ AUC 0.824; BD AUC 0.802). Overall, increased levels of IL-6, TNF-ɑ and PICO and decreased levels of IFN-γ and QUINO were predictive for an individual being classified as a patient. Classification of acute versus stable patients reached a fair AUC of 0.713. The differentiation between schizophrenia and bipolar disorder yielded a poor AUC of 0.627. ConclusionsThis study highlights the potential of using immune-based measures to build predictive classification models in schizophrenia and bipolar disorder, with IL-6, TNF-ɑ, IFN-γ, QUINO and PICO as key candidates. While machine learning models successfully distinguished schizophrenia and bipolar disorder from controls, the challenges in differentiating schizophrenic from bipolar patients likely reflect shared immunological pathways by the both disorders and confounding by a larger state-specific effect. Larger multi-centric studies and multi-domain models are needed to enhance reliability and translation into clinic.

Synthetic lidar point cloud generation using deep generative models for improved driving scene object recognition

The imbalanced distribution of different object categories poses a challenge for training accurate object recognition models in driving scenes. Supervised machine learning models trained on imbalanced data are biased and easily overfit the majority classes, such as vehicles and pedestrians, which appear more frequently in driving scenes. We propose a novel data augmentation approach for object recognition in lidar point cloud of driving scenes, which leverages probabilistic generative models to produce synthetic point clouds for the minority classes and complement the original imbalanced dataset. We evaluate five generative models based on different statistical principles, including Gaussian mixture model, variational autoencoder, generative adversarial network, adversarial autoencoder and the diffusion model. Experiments with a real-world autonomous driving dataset show that the synthetic point clouds generated for the minority classes by the Latent Generative Adversarial Network result in significant improvement of object recognition performance for both minority and majority classes. The codes are available at https://github.com/AAAALEX-XIANG/Synthetic-Lidar-Generation.

Supervised Machine Learning Models for Mechanical Properties Prediction in Additively Manufactured Composites

This paper analyses mechanical property prediction through Machine Learning for continuous fiber-reinforced polymer matrix composites printed using the novel Material Extrusion Additive Manufacturing technique. The composite is formed by a nylon-based matrix and continuous fiber (carbon, Kevlar, or fiberglass). From the literature, the elastic modulus and tensile strength were taken along with printing parameters like fiber content, fiber fill type, matrix lattice, matrix fill density, matrix deposition angle, and fiber deposition angle. Such data were fed to several supervised learning algorithms: Ridge Regression, Bayesian Ridge Regression, Lasso Regression, K-Nearest Neighbor Regression, CatBoost Regression, Decision Tree Regression, Random Forest Regression, and Support Vector Regression. The Machine Learning analysis confirmed that fiber content is the most influential parameter in elasticity (E) and strength (σ). The results show that the K-Nearest Neighbors and CatBoost provided the closest predictions for E and σ compared to the other models, and the tree-based model presented the narrowest error distribution. The computational metrics point to a size versus prediction time tradeoff between these two best predictors, and adopting the prediction time as the most relevant criterion leads to the conclusion that the CatBoost model can be considered, when compared to the others tested, the most appropriate solution to work as a predictor in the task at hand.

AI and mental health: evaluating supervised machine learning models trained on diagnostic classifications

AI and mental health: evaluating supervised machine learning models trained on diagnostic classifications

Intelligent Threat Detection And Response Systems For Safeguarding Cloud-Hosted Electronic Health Records From Cyber Attacks

As more people use cloud-based electronic health record (EHR) systems, they make healthcare better, but they also make it easier for cybercriminals to attack. This article describes a system that uses artificial intelligence (AI) and machine learning (ML) to intelligently watch cloud-hosted EHR environments for bad behaviour, find cyberattacks, and automatically take the right steps to stop them. Using supervised machine learning models that have been trained on known threat indicators, the suggested framework constantly looks at log and system data. As soon as an attack is found, established containment and mitigation steps are carried out naturally to lower the harm. The test results show that the framework can correctly identify common EHR attack methods like ransomware and data theft, as well as quickly and effectively protect private patient data

Combating Phishing in Kenya: A Supervised Learning Model for Enhanced Email Security in Kenyan Financial Institutions

Purpose: Phishing is a serious cybercrime problem that puts people and organizations at risk all around the world, especially in Republic of Kenya's financial institutions. Modern solutions are required because traditional security measures are being challenged by the growing sophistication of phishing attempts. The goal of this thesis is to use artificial intelligence (AI) to create a supervised machine learning model that will alleviate phishing email attacks in the Kenyan financial institutions. Attackers frequently use phishing emails as a means of obtaining unauthorized access to private information, including login credentials, financial information, and personal information. This can lead to identity theft, reputational harm, and monetary losses. Methodology: The suggested framework focuses on using supervised machine learning techniques to recognize and stop phishing emails with accuracy. Four primary parts make up the framework: response, email filtering, feature extraction, and categorization. Four primary steps are involved in developing the framework: gathering data, preparing the data, training the model, and deployment. A thorough dataset of phishing and non-phishing emails is compiled throughout the data collecting phase from a variety of sources, including as public databases, forums on the dark web, and emails from financial institutions staff. Cleaning, classifying, and preprocessing the gathered data are all part of the data preprocessing step, which makes sure the data is appropriate for training the model. Supervised machine learning methods are used in the model training phase to create a reliable detection model. Findings: The system is tested against a dataset of phishing and non-phishing emails particular to the Kenyan financial sectors. The framework's effectiveness is assessed using performance indicators such as accuracy, precision, recall, and the F1-score. The results reveal that the system can correctly detect new phishing emails that were not previously included in the training dataset, demonstrating its adaptability to emerging threats. Unique Contribution to Theory, Practice and Policy: By offering an effective mechanism for detecting and alleviating phishing email attacks, the proposed framework considerably minimizes the risk of data breaches and financial losses in the banking sector.

Enhance the Detection of DoS and Brute Force Attacks within the MQTT Environment Through Feature Engineering and Employing an Ensemble Technique

The rapid development of the Internet of Things (IoT) environment has introduced unprecedented levels of connectivity and automation. The Message Queuing Telemetry Transport (MQTT) protocol has become recognized in IoT applications due to its lightweight and efficient features; however, this simplicity also renders MQTT vulnerable to multiple attacks that can be launched against the protocol, including denial of service (DoS) and brute-force attacks. This study aims to improve the detection of intrusion DoS and bruteforce attacks in an MQTT traffic intrusion detection system (IDS). Our approach utilizes the MQTT dataset for model training by employing effective feature engineering and ensemble learning techniques. Following our analysis and comparison, we identified the top 10 features demonstrating the highest effectiveness, leading to improved model accuracy. We used supervised machine learning models, including Random Forest, Decision Trees, k-Nearest Neighbors, and XGBoost, in combination with ensemble classifiers. Stacking, voting, and bagging ensembles utilize these four supervised machinelearning methods to combine models. This study's results illustrate the proposed technique's efficacy in enhancing the accuracy of detecting DoS and brute-force attacks in MQTT traffic. Stacking and voting classifiers achieved the highest accuracy of 0.9538. Our approach outperforms the most recent study that utilized the same dataset.

Assessment of Published Papers on the Use of Machine Learning in Diagnosis and Treatment of Mastitis

The present study is an evaluation of published papers on machine learning as employed in mastitis research. The aim of this study was the quantitative evaluation of the scientific content and the bibliometric details of these papers. In total, 69 papers were found to combine machine learning in mastitis research and were considered in detail. There was a progressive yearly increase in published papers, which originated from 23 countries (mostly from China or the United States of America). Most original articles (n = 59) referred to work involving cattle, relevant to mastitis in individual animals. Most articles described work related to the development and diagnosis of the infection. Fewer articles described work on the antibiotic resistance of pathogens isolated from cases of mastitis and on the treatment of the infection. In most studies (98.5% of published papers), supervised machine learning models were employed. Most frequently, decision trees and support vector machines were employed in the studies described. ‘Machine learning’ and ‘mastitis’ were the most frequently used keywords. The papers were published in 39 journals, with most frequent publications in Computers and Electronics in Agriculture and Journal of Dairy Science. The median number of cited references in the papers was 39 (interquartile range: 31). There were 435 co-authors in the papers (mean: 6.2 per paper, median: 5, min.–max.: 1–93) and 356 individual authors. The median number of citations received by the papers was 4 (min.–max.: 0–70). Most papers (72.5%) were published in open-access mode. This study summarized the characteristics of papers on mastitis and artificial intelligence. Future studies could explore using these methodologies at farm level, and extending them to other animal species, while unsupervised learning techniques might also prove to be useful.