Machine Learning Solutions Research Articles

A physics-informed machine learning solution for landslide susceptibility mapping based on three-dimensional slope stability evaluation

A physics-informed machine learning solution for landslide susceptibility mapping based on three-dimensional slope stability evaluation

Unsupervised and interpretable discrimination of lithium-bearing minerals with Raman spectroscopy imaging

As lithium-bearing minerals become critical raw materials for the field of energy storage and advanced technologies, the development of tools to accurately identify and differentiate these minerals is becoming essential for efficient resource exploration, mining, and processing. Conventional methods for identifying ore minerals often depend on the subjective observation skills of experts, which can lead to errors, or on expensive and time-consuming techniques such as Inductively Coupled Plasma Mass Spectrometry (ICP-MS) or Optical Emission Spectroscopy (ICP-OES). More recently, Raman Spectroscopy (RS) has emerged as a powerful tool for characterizing and identifying minerals due to its ability to provide detailed molecular information. This technique excels in scenarios where minerals have similar elemental content, such as petalite and spodumene, by offering distinct vibrational information that allows for clear differentiation between such minerals. Considering this case study and its particular relevance to the lithium-mining industry, this manuscript reports the development of an unsupervised methodology for lithium-mineral identification based on Raman Imaging. The deployed machine-learning solution provides accurate and interpretable results using the specific bands expected for each mineral. Furthermore, its robustness is tested with additional blind samples, providing insights into the unique spectral signatures and analytical features that enable reliable mineral identification.

[formula omitted]: A versatile approach for unsupervised segmentation of calcium imaging data

Recent advances in calcium imaging, including the development of fast and sensitive genetically encoded indicators, high-resolution camera chips for wide-field imaging, and resonant scanning mirrors in laser scanning microscopy, have notably improved the temporal and spatial resolution of functional imaging analysis. Nonetheless, the variability of imaging approaches and brain structures challenges the development of versatile and reliable segmentation methods. Standard techniques, such as manual selection of regions of interest or machine learning solutions, often fall short due to either user bias, non-transferability among systems, or computational demand. To overcome these issues, we developed CalciSeg, a data-driven and reproducible approach for unsupervised functional calcium imaging data segmentation. CalciSeg addresses the challenges associated with brain structure variability and user bias by offering a computationally efficient solution for automatic image segmentation based on two parameters: regions’ size limits and number of refinement iterations. We evaluated CalciSeg efficacy on datasets of varied complexity, different insect species (locusts, bees, and cockroaches), and imaging systems (wide-field, confocal, and multiphoton), showing the robustness and generality of our approach. Finally, the user-friendly nature and open-source availability of CalciSeg facilitate the integration of this algorithm into existing analysis pipelines.

Word frequency statistics based on MapReduce on serverless platforms

This paper investigates the application of serverless computing in conjunction with the MapReduce framework, particularly in machine learning (ML) tasks. The MapReduce programming model has been widely used to process large-scale datasets by simplifying parallel and distributed data processing. This study explores how the combination of these two technologies can provide more efficient and cost-effective ML solutions. Through a detailed analysis of serverless environments and the MapReduce framework, this paper shows how the combination can advance the fields of cloud computing and machine learning. The experimental part includes the implementation of Map-Reduce model on a serverless platform, exploring the impact of different parameter settings on performance and improving efficiency by optimizing the data processing flow. In addition, the paper analyzes the use of memory and CPU resources and derives the relationship between dataset size, memory consumption and processor configuration and execution time. Through these experiments and analyses, this paper provides an empirical basis and theoretical support for the optimization of cloud computing frameworks.

Comprehensive evaluation and systematic comparison of Gaussian process (GP) modelling applications in peptide quantitative structure-activity relationship

Peptide quantitative structure-activity relationship (pQSAR) is a specific extension of traditional QSARs from small-molecule drugs to bioactive peptides. Since peptides are linear biopolymers that are essentially different to small-molecule compounds in terms of their structural features such as ordering sequence, large size and intrinsic flexibility, the pQSAR methodology (including structural characterization and regression modelling) should be further exploited relative to traditional QSARs. Gaussian process (GP) serves as a pioneering Bayesian-based machine learning (ML) solution for tackling linear/nonlinear-hybrid regression issues in intricate domains. However, the applications of GP regression in QSAR and, particularly, the pQSAR still remain largely unexplored to date. In this work, we launched a comprehensive pQSAR study with GP regression modelling, aiming to the deep evaluation of GP performance based on different characterizations and also the systematic comparison of GP with other routine MLs. Here, we culled two distinct classes of peptide datasets, which separately comprise 12 panels of sophisticated benchmarks and 46 panels of extended samples, totally containing 8804 peptide samples and systematically resulting in 522 regression models. Our study indicated that the GP can generally provide an effective solution for many pQSAR problems with the potential to promote ML regression modelling in this area, which is comparable with or even better than those widely used methods on both the sophisticated benchmarks and extended samples. In addition, GP also has many advantages as compared to traditional MLs, such as hyperparameter self-consistency, overfitting resistance, interpretable output and estimable uncertainty.

ЕФЕКТИВНІ СХОВИЩА ДАНИХ ДЛЯ РІШЕНЬ МАШИННОГО НАВЧАННЯ

Awareness of the importance of using effective data warehouses to develop machine learning solutions in today's world is becoming increasingly relevant in connection with the growth of data volumes and the growing need for accurate and productive models. The article identifies major vital requirements for data storage systems to ensure effective data management in building machine learning solutions. The study underscores the practical implications of rapid data access and minimal latency, reliable storage systems with robust backup and recovery mechanisms, high-level security, flexibility in handling different data types, and cost-effectiveness. These factors are not just theoretical considerations but directly impact the efficiency and success of machine learning solutions. Together with describing the concepts of block storage and object storage, the article also compares major cloud platforms—AWS (Amazon Web Services), Microsoft Azure, and Google Cloud Platform (GCP)—each providing a comprehensive range of flexible and customizable storage, security, and data processing services. These platforms enable users to manage their information resources flexibly and efficiently, offering unique features that cater to the specific needs of machine learning applications. Understanding the nuances of each provider's offerings empowers engineers and researchers to make informed decisions that align with their unique requirements. The article provides a thorough overview of the key considerations and available options, guiding strategic decisions to support machine learning initiatives effectively. Also the importance of staying up to date with the evolution of major platforms offerings is emphasized. In conclusion, selecting the proper data storage solution is critical for enhancing the performance, security, and cost-efficiency of machine learning models.

Utilizing Multi-Class Classification Methods for Automated Sleep Disorder Prediction

Even from infancy, a human’s day-life alternates from a period of wakefulness to a period of sleep at night, during the 24-hour cycle. Sleep is a normal process necessary for human physical and mental health. A lack of sleep makes it difficult to control emotions and behaviour, reduces productivity at work, and can even increase stress or depression. In addition, poor sleep affects health; when sleep is insufficient, the chances of developing serious diseases greatly increase. Researchers in sleep medicine have identified an extensive list of sleep disorders, and thus leveraged Artificial Intelligence (AI) to automate their analysis and gain a deeper understanding of sleep patterns and related disorders. In this research, we seek a Machine Learning (ML) solution that will allow for efficient classification of unlabeled instances as being Sleep Apnea, Insomnia or Normal (subjects without a specific sleep disorder) by assessing the performance of two well-established strategies for multi-class classification tasks: the One-Vs-All (OVA) and One-Vs-One (OVO). In the context of the specific strategies, two well-known binary classification models were assumed, Logistic Regression (LR) and Support Vector Machines (SVMs). Both strategies’ validity was verified upon a dataset of diverse information related to the profiles (anthropometric data, sleep metrics, lifestyle and cardiovascular health factors) of potential patients or individuals not exhibiting any specific sleep disorder. Performance evaluation was carried out by comparing the weighted average results in all involved classes that represent these two specific sleep disorders and no-disorder occurrence; accuracy, kappa score, precision, recall, f-measure, and Area Under the ROC curve (AUC) were recorded and compared to identify an effective and robust model and strategy, both class-wise and on average. The experimental evaluation unveiled that after feature selection, 2-degree polynomial SVM under both strategies was the least complex and most efficient, recording an accuracy of 91.44%, a kappa score of 84.97%, precision, recall and f-measure equal to 0.914, and an AUC of 0.927.

Machine Learning Innovations for Precise Plant Disease Detection: A Review

The sustainable agriculture practices demands new innovations identifying plant diseases and instead of crop disease detection and precision and efficacy. An extensive review of the literature found through PubMed searches indicates a gap in the present approaches, which highlights the need for sophisticated machine learning solutions in the field of plant pathology. This study involves a comprehensive review of relevant publications collected via PubMed searches. The methodology involves the analysis of machine learning algorithms, datasets utilized and techniques applied for plant disease detection. Special attention is given to recent advancements in the field, focusing on the development and optimization of models tailored for precise and reliable disease identification. The study reveals compelling results, underscoring the transformative impact of machine learning innovations on plant disease detection accuracy. Specific algorithms exhibit superior performance, with implications for widespread applications in precision agriculture. These outcomes not only enhance current disease identification capabilities but also lay the groundwork for future advancements in automated and high-precision plant pathology diagnostics. The integration of machine learning emerges as a pivotal force in reshaping the landscape of plant disease detection.

Machine-learning-based particle identification with missing data

In this work, we introduce a novel method for Particle Identification (PID) within the scope of the ALICE experiment at the Large Hadron Collider at CERN. Identifying products of ultrarelativisitc collisions delivered by the LHC is one of the crucial objectives of ALICE. Typically employed PID methods rely on hand-crafted selections, which compare experimental data to theoretical simulations. To improve the performance of the baseline methods, novel approaches use machine learning models that learn the proper assignment in a classification task. However, because of the various detection techniques used by different subdetectors, as well as the limited detector efficiency and acceptance, produced particles do not always yield signals in all of the ALICE components. This results in data with missing values. Out of the box machine learning solutions cannot be trained with such examples without either modifying the training dataset or re-designing the model architecture. In this work, we propose the new method for PID that addresses these issues and can be trained with all of the available data examples, including incomplete ones. Our approach improves the PID purity and efficiency of the selected sample for all investigated particle species.

Multimodal Quanvolutional and Convolutional Neural Networks for Multi-Class Image Classification

By utilizing hybrid quantum–classical neural networks (HNNs), this research aims to enhance the efficiency of image classification tasks. HNNs allow us to utilize quantum computing to solve machine learning problems, which can be highly power-efficient and provide significant computation speedup compared to classical operations. This is particularly relevant in sustainable applications where reducing computational resources and energy consumption is crucial. This study explores the feasibility of a novel architecture by leveraging quantum devices as the first layer of the neural network, which proved to be useful for scaling HNNs’ training process. Understanding the role of quanvolutional operations and how they interact with classical neural networks can lead to optimized model architectures that are more efficient and effective for image classification tasks. This research investigates the performance of HNNs across different datasets, including CIFAR100 and Satellite Images of Hurricane Damage by evaluating the performance of HNNs on these datasets in comparison with the performance of reference classical models. By evaluating the scalability of HNNs on diverse datasets, the study provides insights into their applicability across various real-world scenarios, which is essential for building sustainable machine learning solutions that can adapt to different environments. Leveraging transfer learning techniques with pre-trained models such as ResNet, EfficientNet, and VGG16 demonstrates the potential for HNNs to benefit from existing knowledge in classical neural networks. This approach can significantly reduce the computational cost of training HNNs from scratch while still achieving competitive performance. The feasibility study conducted in this research assesses the practicality and viability of deploying HNNs for real-world image classification tasks. By comparing the performance of HNNs with classical reference models like ResNet, EfficientNet, and VGG-16, this study provides evidence of the potential advantages of HNNs in certain scenarios. Overall, the findings of this research contribute to advancing sustainable applications of machine learning by proposing novel techniques, optimizing model architectures, and demonstrating the feasibility of adopting HNNs for real-world image classification problems. These insights can inform the development of more efficient and environmentally friendly machine learning solutions.

An analytical survey of cyber‐physical systems in water treatment and distribution: Security challenges, intrusion detection, and future directions

AbstractSince the inception of the Industrial 4.0 revolution, industrial cyber‐physical systems (CPSs) have become integral to critical infrastructures and industrial sectors, including water treatment and distribution systems. Integrating physical and digital worlds has made communication systems within these plants—comprising actuators, sensors, and controllers—vulnerable to advanced cyber‐attacks. Safeguarding the nation's critical infrastructure has thus attracted significant interest from both academia and industry. This article thoroughly examines water treatment and distribution CPSs, detailing their architectural design, devices, applications, and security standards. It analyzes various cyber‐attacks and explores CPS security vulnerabilities and their detection and mitigation techniques. Additionally, it reviews the trends in machine learning (ML) and deep learning (DL) intrusion detection system (IDS) solutions, highlighting their advantages and disadvantages. The article evaluates current datasets and testbeds, identifying some of the best‐performing IDS algorithms tested on each dataset compared to previous research, which could serve as benchmarks in this field. Finally, it proposes data augmentation techniques to generate comprehensive datasets, identifies research gaps, and suggests potential improvements to enhance IDS performance.

Automation Bias and Complacency in Security Operation Centers

The volume and complexity of alerts that security operation center (SOC) analysts must manage necessitate automation. Increased automation in SOCs amplifies the risk of automation bias and complacency whereby security analysts become over-reliant on automation, failing to seek confirmatory or contradictory information. To identify automation characteristics that assist in the mitigation of automation bias and complacency, we investigated the current and proposed application areas of automation in SOCs and discussed its implications for security analysts. A scoping review of 599 articles from four databases was conducted. The final 48 articles were reviewed by two researchers for quality control and were imported into NVivo14. Thematic analysis was performed, and the use of automation throughout the incident response lifecycle was recognized, predominantly in the detection and response phases. Artificial intelligence and machine learning solutions are increasingly prominent in SOCs, yet support for the human-in-the-loop component is evident. The research culminates by contributing the SOC Automation Implementation Guidelines (SAIG), comprising functional and non-functional requirements for SOC automation tools that, if implemented, permit a mutually beneficial relationship between security analysts and intelligent machines. This is of practical value to human automation researchers and SOCs striving to optimize processes. Theoretically, a continued understanding of automation bias and its components is achieved.

Machine learning solutions for enhanced performance in plant-based microbial fuel cells

It is well known that numerous operational, material and design variables act upon the performance of a plant-based microbial fuel cell which is an emerging sustainable and versatile energy device like hydrogen fuel cells. However, due to the high complexity of these bioelectrochemical systems, new solutions are required to optimize performance and uncover hidden relationships between dominant fuel cell variables. For this purpose, a database of 229 observations was created for plant-based microbial fuel cells (PMFCs) with 159 descriptor variables and a target variable (maximum power density) based on experimental results from 51 recent publications. Then, some machine learning solutions like principal component analysis (PCA), classification trees and SHapley Additive exPlanations (SHAP) analysis were applied. The PCA indicated mainly two routes involving low and high chemical oxygen demand (COD) towards high maximum power density which consists of the plant family, wastewater type, support media, construction design, separator type, anode and cathode electrodes and light source. SHAP analysis revealed that the most important factors for high performance are operating temperature, natural light, soil support medium, and constructed wetland design. Finally, the classification tree successfully demonstrated nine routes towards high maximum power density which exclude the use of graphite plate cathode electrodes.

Deep Learning-Based Detection of Android Malware using Graph Convolutional Networks (GCN)

The study is centered around identifying Android malware using deep learning methods through Graph Neural Networks (GNNs) and Graph Convolutional Networks (GCNs). With Android being widely used worldwide ensuring the security of released applications poses a challenge. Conventional malware detection techniques, like dynamic analysis have limitations in recognizing new malware types leading to a shift towards machine learning and deep learning solutions. The research introduces a malware detection system that employs GNNs particularly focusing on GCNs to analyze the relationships within an applications code by transforming APK files into graph formats. The system follows stages including data gathering, feature extraction, graph construction, model training and implementation. By concentrating on function call graphs the system proves effective in identifying software surpassing traditional machine learning methods in terms of accuracy, precision, recall and F1 score. The GCN based model shows enhancements over approaches with an accuracy rate of 95% compared to 89%, for traditional machine learning models. This progress highlights the potential of learning techniques in bolstering Android security. The system excels not in identifying software but also proves versatile, for different uses like screening apps, in stores and functioning as a standalone antivirus program.

Innovative Machine Learning Solutions: Investigating Algorithms and Applications

This comprehensive review paper provides a thorough examination of the ever-evolving landscape of machine learning (ML), spanning from its historical origins to contemporary applications, challenges, and future prospects. It begins by elucidating the foundational concepts of machine learning, encompassing the diverse types, key terminology, and the intricate pipeline involved in the machine learning process. Delving into its historical perspective, the paper chronicles the development of machine learning, tracing its roots in artificial intelligence and highlighting key milestones and influential researchers who have shaped its trajectory. The core of this review explores an array of machine learning algorithms and techniques, spanning regression, classification, clustering, dimensionality reduction, deep learning, and ensemble methods. These algorithms are contextualized with real-world applications, ranging from healthcare to finance, natural language processing (NLP), computer vision, recommender systems, and robotics. Each application domain is buttressed with illustrative examples and case studies. In recognizing the challenges and open problems that confront machine learning, the review delves into issues pertaining to data quality, model interpretability, bias, ethics, generalization, and overfitting. Moreover, it identifies pressing research questions and areas where advancements are needed. Recent trends and developments in machine learning, including transfer learning, explainable AI, federated learning, reinforcement learning, and ethical considerations, are also highlighted to provide a glimpse into the evolving landscape. The paper culminates in a thought-provoking discussion on the future of machine learning, its potential societal impact, and its transformative role across industries. In summary, this review amalgamates key findings and insights, offering a comprehensive view of machine learning's multifaceted journey, from its inception to its promising future.

TransKinect: a computer vision and machine learning clinical decision support system for automatic independent wheelchair transfer technique assessment

Background Physical and occupational therapists provide routine care for manual wheelchair users and are responsible for training and assessing the quality of transfers. These transfers can produce large loads on the upper extremity joints if improper sitting-pivot-technique is used. Methods to assess quality of transfers include the Transfer Assessment Instrument, a clinically validated tool derived from quantitative biomechanical features; however, adoption of this tool is low due to the complex usage requirements and speed of typical transfers. Objective The objective of this study is to develop and validate a computer vison and machine learning solution to better implement the Transfer Assessment Instrument in clinical settings. Methods The prototype system, TransKinect, consists of an infrared depth sensor and a custom software application; usability testing was carried out with fifteen therapists who performed two transfer assessments with the TransKinect. Proficiency in using features, usability, acceptability and satisfaction were analysed with validated surveys and themes were extracted from the qualitative feedback. Results The therapists were able to successfully complete the transfer quality assessments with 86.7 ± 5.4% proficiency. Total scores for System Usability Scale (77.6 ± 14.7%) and Questionnaire for User Interface Satisfaction (83.5 ± 8.7%) indicated that the system was usable and satisfactory. Qualitative feedback indicated that TransKinect was user-friendly, easy to learn, and had high potential. Discussion The results support TransKinect as a potential clinical decision support system for therapists for the comprehensive assessment of independent transfer technique. Future research is needed to investigate the utility and acceptance of TransKinect in real clinical environments. Implications for Rehabilitation Machine learning and computer vision can be used to analyze transfer technique TransKinect is a usable and user-friendly means for therapists to automate analysis Summary reports and videos of transfers show high potential for clinical use Adoption of TransKinect can increase quality of care for manual wheelchair users

Innovating Healthcare Delivery: Enhancing Patient Engagement with Rule-Based Machine Learning Solutions

In contemporary healthcare, chatbots, driven by rule-based machine learning and sophisticated algorithms, are revolutionizing traditional models. This study explores their use in primary care triage, mental health support, chronic disease management, and telemedicine, highlighting their potential to enhance patient engagement, optimize clinical workflows, and improve care quality. Despite their promise, chatbots face challenges such as safeguarding patient privacy, mitigating biases, ensuring regulatory compliance, and maintaining ethical standards. The paper emphasizes the need for interoperability, scalability, and usability for seamless integration into healthcare systems. Future advancements include integrating advanced machine learning, evolving voice recognition, and personalized medicine approaches. By leveraging data analytics and predictive modelling, chatbots could proactively identify health risks, leading to a new era of preventive and personalized healthcare. Overall, this research highlights chatbots' profound impact on promoting patient-centred care, initiative-taking health management, and data-driven decision-making, fostering equitable access to high-quality healthcare services. Keywords— Rule-based chatbots, Machine Learning, Healthcare, Natural Language Processing, Patient Engagement, Clinical Support, Case Studies, Prospects.

Trends in forecasting groundwater ingresses into underground structures

Often, underground structures are faced with groundwater ingresses during their erection and even during their operation. To conceive the most suitable drainage or dewatering systems, and at the same time better guarantee the sustainability of these structures, these inflows should be accurately forecasted in advance. To this end, researchers have made considerable efforts and developed various solutions. This article put forwards the recent trends and progress related to the prediction of groundwater ingresses in underground structures. Pioneering solutions (analytical, semi-analytical, empirical and semi-empirical) as well as numerical, machine learning and other solutions are widely highlighted. Besides, the paper explains that the ideal solutions are still subject of current and future investigations. The need to continually opt for better schemes or strategies for accurate groundwater ingress prediction solutions is adequately expressed. Relevant inspirations can be drawn from this article for future accurate groundwater ingress forecasting solutions.

Multimodal deep learning for dementia classification using text and audio

Dementia is a progressive neurological disorder that affects the daily lives of older adults, impacting their verbal communication and cognitive function. Early diagnosis is important to enhance the lifespan and quality of life for affected individuals. Despite its importance, diagnosing dementia is a complex process. Automated machine learning solutions involving multiple types of data have the potential to improve the process of automated dementia screening. In this study, we build deep learning models to classify dementia cases from controls using the Pitt Cookie Theft dataset from DementiaBank, a database of short participant responses to the structured task of describing a picture of a cookie theft. We fine-tune Wav2vec and Word2vec baseline models to make binary predictions of dementia from audio recordings and text transcripts, respectively. We conduct experiments with four versions of the dataset: (1) the original data, (2) the data with short sentences removed, (3) text-based augmentation of the original data, and (4) text-based augmentation of the data with short sentences removed. Our results indicate that synonym-based text data augmentation generally enhances the performance of models that incorporate the text modality. Without data augmentation, models using the text modality achieve around 60% accuracy and 70% AUROC scores, and with data augmentation, the models achieve around 80% accuracy and 90% AUROC scores. We do not observe significant improvements in performance with the addition of audio or timestamp information into the model. We include a qualitative error analysis of the sentences that are misclassified under each study condition. This study provides preliminary insights into the effects of both text-based data augmentation and multimodal deep learning for automated dementia classification.

Pathways to chronic disease detection and prediction: Mapping the potential of machine learning to the pathophysiological processes while navigating ethical challenges

AbstractChronic diseases such as heart disease, cancer, and diabetes are leading drivers of mortality worldwide, underscoring the need for improved efforts around early detection and prediction. The pathophysiology and management of chronic diseases have benefitted from emerging fields in molecular biology like genomics, transcriptomics, proteomics, glycomics, and lipidomics. The complex biomarker and mechanistic data from these “omics” studies present analytical and interpretive challenges, especially for traditional statistical methods. Machine learning (ML) techniques offer considerable promise in unlocking new pathways for data‐driven chronic disease risk assessment and prognosis. This review provides a comprehensive overview of state‐of‐the‐art applications of ML algorithms for chronic disease detection and prediction across datasets, including medical imaging, genomics, wearables, and electronic health records. Specifically, we review and synthesize key studies leveraging major ML approaches ranging from traditional techniques such as logistic regression and random forests to modern deep learning neural network architectures. We consolidate existing literature to date around ML for chronic disease prediction to synthesize major trends and trajectories that may inform both future research and clinical translation efforts in this growing field. While highlighting the critical innovations and successes emerging in this space, we identify the key challenges and limitations that remain to be addressed. Finally, we discuss pathways forward toward scalable, equitable, and clinically implementable ML solutions for transforming chronic disease screening and prevention.