Machine Classifier Research Articles

Harmonizing the CBCL and SDQ ADHD scores by using linear equating, kernel equating, item response theory and machine learning methods.

A problem that applied researchers and practitioners often face is the fact that different institutions within research consortia use different scales to evaluate the same construct which makes comparison of the results and pooling challenging. In order to meaningfully pool and compare the scores, the scales should be harmonized. The aim of this paper is to use different test equating methods to harmonize the ADHD scores from Child Behavior Checklist (CBCL) and Strengths and Difficulties Questionnaire (SDQ) and to see which method leads to the result. Sample consists of 1551 parent reports of children aged 10-11.5 years from Raine study on both CBCL and SDQ (common persons design). We used linear equating, kernel equating, Item Response Theory (IRT), and the following machine learning methods: regression (linear and ordinal), random forest (regression and classification) and Support Vector Machine (regression and classification). Efficacy of the methods is operationalized in terms of the root-mean-square error (RMSE) of differences between predicted and observed scores in cross-validation. Results showed that with single group design, it is the best to use the methods that use item level information and that treat the outcome as interval measurement level (regression approach).

Residual Mulching Film Detection in Seed Cotton Using Line Laser Imaging

Due to the widespread use of mulching film in cotton planting in China, residual mulching film mixed with machine-picked cotton poses a significant hazard to cotton processing. Detecting residual mulching film in seed cotton has become particularly challenging due to the film’s semi-transparent nature. This study constructed an imaging system combining an area array camera and a line scan camera. A detection scheme was proposed that utilized features from both image types. To simulate online detection, samples were placed on a conveyor belt moving at 0.2 m/s, with line lasers at a wavelength of 650 nm as light sources. For area array images, feature extraction was performed to establish a partial least squares discriminant analysis (PLS-DA) model. For line scan images, texture feature analysis was used to build a support vector machine (SVM) classification model. Subsequently, image features from both cameras were merged to construct an SVM model. Experimental results indicated that detection methods based on area array and line scan images had accuracies of 75% and 79%, respectively, while the feature fusion method achieved an accuracy of 83%. This study demonstrated that the proposed method could effectively improve the accuracy of residual mulching film detection in seed cotton, providing a basis for reducing residual mulching film content during processing.

Varroa Mite Counting Based on Hyperspectral Imaging.

Varroa mite infestation poses a severe threat to honeybee colonies globally. This study investigates the feasibility of utilizing the HS-Cam and machine learning techniques for Varroa mite counting. The methodology involves image acquisition, dimensionality reduction through Principal Component Analysis (PCA), and machine learning-based segmentation and classification algorithms. Specifically, a k-Nearest Neighbors (kNNs) model distinguishes Varroa mites from other objects in the images, while a Support Vector Machine (SVM) classifier enhances shape detection. The final phase integrates a dedicated counting algorithm, leveraging outputs from the SVM classifier to quantify Varroa mite populations in hyperspectral images. The preliminary results demonstrate segmentation accuracy exceeding 99% and an average precision of 0.9983 and recall of 0.9947 across all the classes. The results obtained from our machine learning-based approach for Varroa mite counting were compared against ground-truth labels obtained through manual counting, demonstrating a high degree of agreement between the automated counting and manual ground truth. Despite working with a limited dataset, the HS-Cam showcases its potential for Varroa counting, delivering superior performance compared to traditional RGB images. Future research directions include validating the proposed hyperspectral imaging methodology with a more extensive and diverse dataset. Additionally, the effectiveness of using a near-infrared (NIR) excitation source for Varroa detection will be explored, along with assessing smartphone integration feasibility.

Quantum and classical machine learning investigation of synthesis–structure relationships in epitaxially grown wide band gap semiconductors

Quantum and classical machine learning investigation of synthesis–structure relationships in epitaxially grown wide band gap semiconductors

Systematic Analysis of Deep Learning Models vs. Machine Learning

Deep learning (DL) and classical machine learning (ML) models are compared and contrasted in this study, which offers a complete overview of the differences and technological improvements between the two types of models. Through an analysis of a diverse range of research publications, the study draws attention to the distinct advantages and uses of both techniques. Deep learning, which is characterized by its use of neural networks with several layers, is particularly effective at managing massive datasets that are not organized. It has also made great progress in the areas of image and audio recognition, natural language processing, and complicated pattern identification exercises. On the other hand, classic machine learning models, which are based on the extraction of features and simpler methods, continue to be quite successful in structured data situations such as classification, regression, and clustering challenges. By concentrating on aspects such as data quantity, computing resources, and unique application needs, the survey sheds light on the parameters that should be considered when selecting between deep learning and machine learning. In addition to this, it addresses the ever-changing environment of hybrid models, which combine methods from both deep learning and machine learning in order to capitalize on the advantages of both approaches. This study highlights the significance of contextual awareness in the fast-developing area of artificial intelligence by providing researchers and practitioners with useful insights that can be used to deploy the AI models that are the most appropriate for their particular requirements.

Classification machine learning to detect de facto reuse and cyanobacteria at a drinking water intake

Harmful algal blooms (HABs) or higher levels of de facto water reuse (DFR) can increase the levels of certain contaminants at drinking water intakes. Therefore, the goal of this study was to use multi-class supervised machine learning (SML) classification with data collected from six online instruments measuring fourteen total water quality parameters to detect cyanobacteria (corresponding to approximately 950 cells/mL, 2900 cells/mL, and 8600 cells/mL) or DFR (0.5, 1 and 2 % of wastewater effluent) events in the raw water entering an intake. Among 56 screened models from the caret package in R, four (mda, LogitBoost, bagFDAGCV, and xgbTree) were selected for optimization. mda had the greatest testing set accuracy, 98.09 %, after optimization with 7 false alerts. Some of the most important water parameters for the different models were phycocyanin-like fluorescence, UVA254, and pH. SML could detect algae blending events (estimated <9000 cells/mL) due in part to the phycocyanin-like fluorescence sensor. UVA254 helped identify higher concentrations of DFR. These results show that multi-class SML classification could be used at drinking water intakes in conjunction with online instrumentation to detect and differentiate HABs and DFR events. This could be used to create alert systems for the water utilities at the intake, rather than the finished water, so any adjustment to the treatment process could be implemented.

A comprehensive investigation of morphological features responsible for cerebral aneurysm rupture using machine learning

Cerebral aneurysms are a silent yet prevalent condition that affects a significant global population. Their development can be attributed to various factors, presentations, and treatment approaches. The importance of selecting the appropriate treatment becomes evident upon diagnosis, as the severity of the disease guides the course of action. Cerebral aneurysms are particularly vulnerable in the circle of Willis and pose a significant concern due to the potential for rupture, which can lead to irreversible consequences, including fatality. The primary objective of this study is to predict the rupture status of cerebral aneurysms. To achieve this, we leverage a comprehensive dataset that incorporates clinical and morphological data extracted from 3D real geometries of previous patients. The aim of this research is to provide valuable insights that can help make informed decisions during the treatment process and potentially save the lives of future patients. Diagnosing and predicting aneurysm rupture based solely on brain scans is a significant challenge with limited reliability, even for experienced physicians. However, by employing statistical methods and machine learning techniques, we can assist physicians in making more confident predictions regarding rupture likelihood and selecting appropriate treatment strategies. To achieve this, we used 5 classification machine learning algorithms and trained them on a substantial database comprising 708 cerebral aneurysms. The dataset comprised 3 clinical features and 35 morphological parameters, including 8 novel morphological features introduced for the first time in this study. Our models demonstrated exceptional performance in predicting cerebral aneurysm rupture, with accuracy ranging from 0.76 to 0.82 and precision score from 0.79 to 0.83 for the test dataset. As the data are sensitive and the condition is critical, recall is prioritized as the more crucial parameter over accuracy and precision, and our models achieved outstanding recall score ranging from 0.85 to 0.92. Overall, the best model was Support Vector Machin with an accuracy and precision of 0.82, recall of 0.92 for the testing dataset and the area under curve of 0.84. The ellipticity index, size ratio, and shape irregularity are pivotal features in predicting aneurysm rupture, respectively, contributing significantly to our understanding of this complex condition. Among the multitude of parameters under investigation, these are particularly important. In this study, the ideal roundness parameter was introduced as a novel consideration and ranked fifth among all 38 parameters. Neck circumference and outlet numbers from the new parameters were also deemed significant contributors.

Hyperparameter optimization of two-branch neural networks in multi-target prediction

As a result of the ever increasing complexity of configuring and fine-tuning machine learning models, the field of automated machine learning (AutoML) has emerged over the past decade. However, software implementations like Auto-WEKA and Auto-sklearn typically focus on classical machine learning (ML) tasks such as classification and regression. Our work can be seen as the first attempt at offering a single AutoML framework for most problem settings that fall under the umbrella of multi-target prediction, which includes popular ML settings such as multi-label classification, multivariate regression, multi-task learning, dyadic prediction, matrix completion, and zero-shot learning. Automated problem selection and model configuration are achieved by extending DeepMTP, a general deep learning framework for MTP problem settings, with popular hyperparameter optimization (HPO) methods. Our extensive benchmarking across different datasets and MTP problem settings identifies cases where specific HPO methods outperform others.

Random coordinate descent: A simple alternative for optimizing parameterized quantum circuits

Variational quantum algorithms rely on the optimization of parameterized quantum circuits in noisy settings. The commonly used back-propagation procedure in classical machine learning is not directly applicable in this setting due to the collapse of quantum states after measurements. Thus, gradient estimations constitute a significant overhead in a gradient-based optimization of such quantum circuits. This paper introduces a random coordinate descent algorithm as a practical and easy-to-implement alternative to the full gradient descent algorithm. This algorithm only requires one partial derivative at each iteration. Motivated by the behavior of measurement noise in the practical optimization of parameterized quantum circuits, this paper presents an optimization problem setting that is amenable to analysis. Under this setting, the random coordinate descent algorithm exhibits the same level of stochastic stability as the full gradient approach, making it as resilient to noise. The complexity of the random coordinate descent method is generally no worse than that of the gradient descent and can be much better for various quantum optimization problems with anisotropic Lipschitz constants. Theoretical analysis and extensive numerical experiments validate our findings. Published by the American Physical Society 2024

Quantum Support Vector Machine for Classification Task: A Review

Quantum computing has emerged as a promising technology capable of solving complex computational problems more efficiently than classical computers. Among the various quantum algorithms developed, the Quantum Support Vector Machine (QSVM) has gained significant attention for its potential to enhance machine learning tasks, particularly classification. This review paper explores the theoretical foundations, methodologies, and potential advantages of QSVM for classification tasks. We discuss the quantum computing principles underpinning QSVM, compare them with classical support vector machines, and review recent advancements and applications. Finally, we highlight the challenges and prospects of QSVM in the context of quantum machine learning.

Mixed effect estimation in deep compartment models: Variational methods outperform first-order approximations.

This work focusses on extending the deep compartment model (DCM) framework to the estimation of mixed-effects. By introducing random effects, model predictions can be personalized based on drug measurements, enabling the testing of different treatment schedules on an individual basis. The performance of classical first-order (FO and FOCE) and machine learning based variational inference (VI) algorithms were compared in a simulation study. In VI, posterior distributions of the random variables are approximated using variational distributions whose parameters can be directly optimized. We found that variational approximations estimated using the path derivative gradient estimator version of VI were highly accurate. Models fit on the simulated data set using the FO and VI objective functions gave similar results, with accurate predictions of both the population parameters and covariate effects. Contrastingly, models fit using FOCE depicted erratic behaviour during optimization, and resulting parameter estimates were inaccurate. Finally, we compared the performance of the methods on two real-world data sets of haemophilia A patients who received standard half-life factor VIII concentrates during prophylactic and perioperative settings. Again, models fit using FO and VI depicted similar results, although some models fit using FO presented divergent results. Again, models fit using FOCE were unstable. In conclusion, we show that mixed-effects estimation using the DCM is feasible. VI performs conditional estimation, which might lead to more accurate results in more complex models compared to the FO method.

Wavelet scattering and multiclass support vector machine (WS_MSVM) for effective fault classification in transformers: a real-time experimental approach

The dependable operation of the protective system is affected by residual magnetism and magnetic bias during the activation of the transformer. Challenges arise in distinguishing between inrush current and fault current when the transformer circuit breaker switching angle and remnant flux attain specific values. This situation can lead to a lack of sensitivity or failure in the operation of the transformer protection system. Thus, this paper proposes an effective approach for classifying different faults in transformers (internal and non-internal faults) using wavelet scattering and multiclass support vector machine (MSVM) technique (WS_MSVM). The wavelet scattering method begins by transmitting the data through a sequence of wavelet transforms, nonlinear operations, and averaging processes. This series of operations aims to generate low-variance representations of time series data. Wavelet time scattering produces signal representations that remain unaffected by shifts in the input signal, while still preserving the ability to distinguish between internal and non-internal faults. Internal faults are those occurring within the zones of the current transformer (CT) connected on both sides of the transformer. On the other hand, non-internal faults consist of magnetizing inrush current, sympathetic inrush current, and external faults (faults occurring outside the CT zones). The efficacy of the proposed WS_SVM is evaluated on the real-time experimental results obtained from the differential path of a laboratory transformer. The experimental data generated over one power frequency cycle under diverse operating conditions is employed in MATLAB to assess the effectiveness of the proposed WS_SVM algorithm.

O-221 An interpretable deep learning model for predicting the number of mature oocytes retrieved after ovarian hyperstimulation

Abstract Study question Can an interpretable deep learning model successfully predict the number of mature oocytes retrieved after ovarian hyperstimulation and provide the rationale for these predictions? Summary answer An interpretable deep learning model can successfully predict the number of mature oocytes retrieved and provide a rationale for these predictions. What is known already A number of recent studies have used classical machine learning models in order to predict the number of mature oocytes retrieved in IVF cycles, including XGBoost, RandomForests and even basic deep learning models such as feed forward networks. Although these studies predicted the number of mature oocytes with a relatively high performance, the employed methods lack insights into the rationale governing their predictions. This lack of interpretability poses an important limitation when applying these models in a clinical setting. Study design, size, duration This study was a retrospective analysis of a dataset of 6,430 ovarian stimulation cycles performed at a single center in the USA, aimed at building a deep learning based, interpretable model to predict the number of mature oocytes retrieved after ovarian hyperstimulation. Participants/materials, setting, methods An interpretable deep learning model was developed to predict the number of mature oocytes retrieved. The model was evaluated on an out-of-sample test set and compared to baseline models used in prior studies such as XGBoost and Linear Regression. Main results and the role of chance The model successfully predicted the retrieved oocyte count, with a mean absolute error (MAE) deviation of ± 3.14 oocytes from the ground truth. The model outperformed the performance of models used in previous studies such as XGBoost and Linear Regression which achieved a MAE of ± 3.16 and ±3.2 oocytes respectively on the test dataset. Parameter significance was measured by calculating how much parameters aided in the final prediction. The parameters found to be most significant in predicting the number of retrieved mature oocytes were (in order): total number of follicles, number of follicles size 12mm-15mm and number of follicles size 16-17mm. Parameters that were found to be of lower significance but still indicative were follicles larger than 18 mm and estradiol on trigger day. Surprisingly, age and basal FSH were of little significance. Most notably, the number of follicles in the 12mm -15mm bin were much more indicative than larger follicles of size 16-17mm and much more than follicles larger than 18mm. Furthermore, the model generates a transparent breakdown of the prediction for each patient, including a heat map and bar graph highlighting the factors influencing the decision making process at every step, creating a completely transparent prediction process. Limitations, reasons for caution The model was developed on training data from a single clinic, therefore requiring further data collection from diverse global locations to ensure the model’s ability to generalize. Wider implications of the findings This study demonstrates better oocyte prediction accuracy and transparency in the prediction process, surpassing previous models while also building trust. These advancements not only improve the safety of Artificial Intelligence tools for optimizing stimulation protocols but also contribute to reducing regulatory concerns surrounding their deployment in clinical settings. Trial registration number not applicable

Machine Learning-Based Feature Extraction and Classification of EMG Signals for Intuitive Prosthetic Control

Signals play a fundamental role in science, technology, and communication by conveying information through varying patterns, amplitudes, and frequencies. This paper introduces innovative methodologies for processing electromyographic (EMG) signals to develop artificial intelligence systems capable of decoding muscle activity for controlling arm movements. The study investigates advanced signal processing techniques and machine learning classification algorithms using the GRABMyo dataset, aiming to enhance prosthetic control systems and rehabilitation technologies. A comprehensive analysis was conducted on signal processing techniques, including signal filtering and discrete wavelet transform (DWT), alongside a composite feature set comprising Mean Absolute Value (MAV), Waveform Length (WL), Zero Crossing (ZC), Slope Sign Changes (SSC), Root Mean Square (RMS), Enhanced Waveform Length (EWL), and Enhanced Mean Absolute Value (EMAV). These features, refined through Linear Discriminant Analysis (LDA) for dimensionality reduction, were classified using Support Vector Machine (SVM) algorithms. Signal filtering and DWT improved signal quality, facilitating better feature extraction, while the diverse feature set enhanced classification accuracy. LDA further improved accuracy by isolating the most informative features, and the SVM achieved optimal performance in decoding complex EMG patterns. Machine learning models, including K-Nearest Neighbor (KNN), Naïve Bayes (NB), and the SVM, were evaluated, with the SVM outperforming the others. The significance of these results lies in their potential applications in prosthetic control systems and rehabilitation technologies. By accurately decoding muscle activity, the developed systems can facilitate more intuitive and responsive robotic arm movements, contributing to the advancement of innovative solutions for individuals requiring prosthetic devices or undergoing rehabilitation, hence improving the quality of life for users. This research marks a significant step forward in the integration of advanced signal processing and machine learning in the field of EMG analysis.

Comparison of deep learning architectures for predicting amyloid positivity in Alzheimer's disease, mild cognitive impairment, and healthy aging, from T1-weighted brain structural MRI.

Abnormal β-amyloid (Aβ) accumulation in the brain is an early indicator of Alzheimer's disease (AD) and is typically assessed through invasive procedures such as PET (positron emission tomography) or CSF (cerebrospinal fluid) assays. As new anti-Alzheimer's treatments can now successfully target amyloid pathology, there is a growing interest in predicting Aβ positivity (Aβ+) from less invasive, more widely available types of brain scans, such as T1-weighted (T1w) MRI. Here we compare multiple approaches to infer Aβ + from standard anatomical MRI: (1) classical machine learning algorithms, including logistic regression, XGBoost, and shallow artificial neural networks, (2) deep learning models based on 2D and 3D convolutional neural networks (CNNs), (3) a hybrid ANN-CNN, combining the strengths of shallow and deep neural networks, (4) transfer learning models based on CNNs, and (5) 3D Vision Transformers. All models were trained on paired MRI/PET data from 1,847 elderly participants (mean age: 75.1 yrs. ± 7.6SD; 863 females/984 males; 661 healthy controls, 889 with mild cognitive impairment (MCI), and 297 with Dementia), scanned as part of the Alzheimer's Disease Neuroimaging Initiative. We evaluated each model's balanced accuracy and F1 scores. While further tests on more diverse data are warranted, deep learning models trained on standard MRI showed promise for estimating Aβ + status, at least in people with MCI. This may offer a potential screening option before resorting to more invasive procedures.

CCNN-SVM: Automated Model for Emotion Recognition Based on Custom Convolutional Neural Networks with SVM

The expressions on human faces reveal the emotions we are experiencing internally. Emotion recognition based on facial expression is one of the subfields of social signal processing. It has several applications in different areas, specifically in the interaction between humans and computers. This study presents a simple CCNN-SVM automated model as a viable approach for FER. The model combines a Convolutional Neural Network for feature extraction, certain image preprocessing techniques, and Support Vector Machine (SVM) for classification. Firstly, the input image is preprocessed using face detection, histogram equalization, gamma correction, and resizing techniques. Secondly, the images go through custom single Deep Convolutional Neural Networks (CCNN) to extract deep features. Finally, SVM uses the generated features to perform the classification. The suggested model was trained and tested on four datasets, CK+, JAFFE, KDEF, and FER. These datasets consist of seven primary emotional categories, which encompass anger, disgust, fear, happiness, sadness, surprise, and neutrality for CK+, and include contempt for JAFFE. The model put forward demonstrates commendable performance in comparison to existing facial expression recognition techniques. It achieves an impressive accuracy of 99.3% on the CK+ dataset, 98.4% on the JAFFE dataset, 87.18% on the KDEF dataset, and 88.7% on the FER.

Improving support vector machine and backpropagation performance for diabetes mellitus classification

Diabetes mellitus (DM) is a glucose disorder disease in the human body that contributes significantly to the high mortality rate. Various studies on early detection and classification have been conducted as a DM prevention effort by applying a machine learning model. The problems that may occur are weak model performance and misclassification caused by imbalanced data. The existence of dominating (majority) data causes poor model performance in identifying minority data. This paper proposed handling the problem of imbalanced data by performing the synthetic minority oversampling technique (SMOTE) and observing its effect on the classification performance of the support vector machine (SVM) and Backpropagation artificial neural network (ANN) methods. The experiment showed that the SVM method and imbalanced data achieved 94.31% accuracy, and the Backpropagation ANN achieved 91.56% accuracy. At the same time, the SVM method and balanced data produced an accuracy of 98.85%, while the Backpropagation ANN method and balanced data produced an accuracy of 94.90%. The results show that oversampling techniques can improve the performance of the classification model for each data class.

Improving support vector machine and backpropagation performance for diabetes mellitus classification

Diabetes mellitus is a glucose disorder disease in the human body that contributes significantly to the high mortality rate. Various studies on early detection and classification have been conducted as a diabetes mellitus prevention effort by applying a machine learning model. The problems that may occur are weak model performance and misclassification caused by imbalanced data. The existence of dominating (majority) data causes poor model performance in identifying minority data. This paper proposed handling the problem of imbalanced data by performing the synthetic minority oversampling technique (SMOTE) and observing its effect on the classification performance of the support vector machine (SVM) and Backpropagation artificial neural network (ANN) methods. The experiment showed that the SVM method and imbalanced data achieved 94.31% accuracy, and the Backpropagation ANN achieved 91.56% accuracy. At the same time, the SVM method and balanced data produced an accuracy of 98.85%, while the Backpropagation ANN method and balanced data produced an accuracy of 94.90%. The results show that oversampling techniques can improve the performance of the classification model for each data class.

Combination of Lexical Resources and Support Vector Machine for Film Sentiment Analysis

Text data generated by internet users holds potentially valuable information that can be researched for new insights. One strategy for obtaining information from a text data set is to classify text into predetermined categories based on existing data. Text classification is an aspect of Text Mining. One of the popular approaches in Text Mining uses the Support Vector Machine (SVM) classification algorithm, which aims to classify text and separate data into different classes. However, in some cases, SVM classification algorithms may face difficulties in understanding the context of the text properly due to unclear wording, varying sentence structures, or a lack of understanding of interpretation. To address this problem, applying SVM classification using lexical resources can be an effective solution. In this research framework, the first step is to obtain data, which in this case is a film review dataset taken from the kaggle.com site. After obtaining the data, the next step is preprocessing. The results of the preprocessing are then divided into 80:20 percentages. The 80% training data is used to search for the form of polarization, and this training data lexicon is used for training the SVM model. Based on the modeling results, the overall model accuracy is around 85%, calculated using the confusion matrix. The precision value, which shows the proportion of correct positive predictions, reached 88%. The precision for negative predictions reached 80%, and for neutral predictions, it reached 0%. These results show that the Lexicon+SVM model has good performance, with an accuracy of 85%.

Predicting the Winner of a Twenty20 International Cricket Match: Classification and Explainable Machine Learning Approach

We present a supervised machine learning approach to predict the winner of a Twenty20 (T20) international match. The prediction dynamically changes as the match progresses. We also use explainable machine learning techniques (SHAP scores) to understand the importance of various features in making the decision at various stages of the T20 match. We present results on a dataset of 808 men's T20 international matches. The dynamic accuracy increases from about 55% in the initial stages of the T20 match to a maximum of about 85% in the final stages of the match (with an overall accuracy of about 63% in innings 1 and 74% in innings 2). SHAP scores reveal that team strength is an important feature in making the prediction in initial stages of the match; however, in the final stages, match situation plays the dominant role in the decision making process. Our work may help team coaches and captains to assess their chances of winning and/or chart a course towards winning in the ongoing T20 match, as well as be useful for sports analytics and gambling websites and apps.