Traditional Machine Learning Models Research Articles

Hyperspectral Inversion of Soil Cu Content in Agricultural Land Based on Continuous Wavelet Transform and Stacking Ensemble Learning

Heavy metal pollution in agricultural land poses significant threats to both the ecological environment and human health. Therefore, the rapid and accurate prediction of heavy metal content in agricultural soil is crucial for environmental protection and soil remediation. Acknowledging the limitations of traditional single linear or nonlinear machine learning models in terms of prediction accuracy, this study developed an ensemble learning model that integrates multiple linear or nonlinear learning models with a random forest (RF) model to improve both the prediction accuracy and reliability. In this study, we selected a typical copper (Cu) polluted area in the Pearl River Delta of Guangdong Province as the research site and collected Cu content data and indoor soil reflectance spectral data from 269 surface soil samples. First, the soil spectral data were preprocessed using Savitzky–Golay (SG) smoothing, multiplicative scattering correction (MSC), and continuous wavelet transform (CWT) to reduce noise interference. Next, principal components analysis (PCA) was employed to reduce the dimensionality of the preprocessed spectral data, eliminating redundant features and lowering the computational complexity. Finally, based on the dimensionality-reduced data and Cu content, we established a stacked ensemble learning model, where the base models included SVR, PLSR, BPNN, and XGBoost, with RF serving as the meta-model to estimate the soil heavy metal content. To evaluate the performance of the stacking model, we compared its prediction accuracy with that of individual models. The results indicate that, compared to the traditional machine learning models, the prediction accuracy of the stacking model was superior (R2 = 0.77; RMSE = 7.65 mg/kg; RPD = 2.29). This suggests that the integrated algorithm demonstrates a greater robustness and generalization capability. This study presents a method to improve soil heavy metal content estimation using hyperspectral technology, ensuring a robust model that supports policymakers in making informed decisions about land use, agriculture, and environmental protection.

Enhancing water quality prediction with advanced machine learning techniques: An extreme gradient boosting model based on long short-term memory and autoencoder

Achieving carbon neutrality in the pulp and paper industry necessitates effectively recycling pulp and papermaking wastewater, where continuous monitoring of effluent quality indices is crucial. This study suggests a novel machine learning-based model named LSTMAE-XGBOOST that integrates the feature extraction capabilities of autoencoder, the sequential feature learning capabilities of LSTM, and the high prediction accuracy of XGBOOST. This model is capable of extracting the complex relationships, non-Gaussian characteristics, and time series features from the papermaking wastewater data, and it demonstrates superior predictive performance. Compared to traditional machine learning models, the proposed model exhibits higher prediction accuracy. Specifically, when contrasted with partial least squares regression, LSTMAE-XGBOOST achieves a 40% increase in R2 and a 35% reduction in RMSE. Further comparative assessments against other machine learning-based hybrid models with similar structures confirm the superiority of integrating LSTM and XGBOOST within the hybrid model approach. This study contributes a compelling methodology for modeling effluent quality indices, offering significant implications for environmental management in the pulp and paper industry.

Enhancing early detection of cognitive decline in the elderly: a comparative study utilizing large language models in clinical notes

BackgroundLarge language models (LLMs) have shown promising performance in various healthcare domains, but their effectiveness in identifying specific clinical conditions in real medical records is less explored. This study evaluates LLMs for detecting signs of cognitive decline in real electronic health record (EHR) clinical notes, comparing their error profiles with traditional models. The insights gained will inform strategies for performance enhancement. MethodsThis study, conducted at Mass General Brigham in Boston, MA, analysed clinical notes from the four years prior to a 2019 diagnosis of mild cognitive impairment in patients aged 50 and older. We developed prompts for two LLMs, Llama 2 and GPT-4, on Health Insurance Portability and Accountability Act (HIPAA)-compliant cloud-computing platforms using multiple approaches (e.g., hard prompting, retrieval augmented generation, and error analysis-based instructions) to select the optimal LLM-based method. Baseline models included a hierarchical attention-based neural network and XGBoost. Subsequently, we constructed an ensemble of the three models using a majority vote approach. Confusion-matrix-based scores were used for model evaluation. FindingsWe used a randomly annotated sample of 4,949 note sections from 1,969 patients (women: 1,046 [53.1%]; age: mean, 76.0 [SD, 13.3] years), filtered with keywords related to cognitive functions, for model development. For testing, a random annotated sample of 1,996 note sections from 1,161 patients (women: 619 [53.3%]; age: mean, 76.5 [SD, 10.2] years) without keyword filtering was utilised. GPT-4 demonstrated superior accuracy and efficiency compared to Llama 2, but did not outperform traditional models. The ensemble model outperformed the individual models in terms of all evaluation metrics with statistical significance (p<0.01), achieving a precision of 90.2% [95% CI: 81.9%-96.8%], a recall of 94.2% [95% CI: 87.9%-98.7%], and an F1-score of 92.1% [95% CI: 86.8%-96.4%]. Notably, the ensemble model showed a significant improvement in precision, increasing from a range of 70%-79% to above 90%, compared to the best-performing single model. Error analysis revealed that 63 samples were incorrectly predicted by at least one model; however, only 2 cases (3.2%) were mutual errors across all models, indicating diverse error profiles among them. InterpretationLLMs and traditional machine learning models trained using local EHR data exhibited diverse error profiles. The ensemble of these models was found to be complementary, enhancing diagnostic performance. Future research should investigate integrating LLMs with smaller, localised models and incorporating medical data and domain knowledge to enhance performance on specific tasks.

A Genetic Optimized Federated Learning Approach for Joint Consideration of End-to-End Delay and Data Privacy in Vehicular Networks

In 5G vehicular networks, two key challenges have become apparent, including end-to-end delay minimization and data privacy. Learning-based approaches have been used to alleviate these, either by predicting delay or protecting privacy. Traditional approaches train machine learning models on local devices or cloud servers, each with their own trade-offs. While pure-federated learning protects privacy, it sacrifices delay prediction performance. In contrast, centralized training improves delay prediction but violates privacy. Existing studies in the literature overlook the effect of training location on delay prediction and data privacy. To address both issues, we propose a novel genetic algorithm optimized federated learning (GAoFL) approach in which end-to-end delay prediction and data privacy are jointly considered to obtain an optimal solution. For this purpose, we analytically define a novel end-to-end delay formula and data privacy metrics. Accordingly, a novel fitness function is formulated to optimize both the location of training model and data privacy. In conclusion, according to the evaluation results, it can be advocated that the outcomes of the study highlight that training location significantly affects privacy and performance. Moreover, it can be claimed that the proposed GAoFL improves data privacy compared to centralized learning while achieving better delay prediction than other federated methods, offering a valuable solution for 5G vehicular computing.

Cleft Lip and Palate Classification Through Vision Transformers and Siamese Neural Networks

This study introduces a novel approach for the diagnosis of Cleft Lip and/or Palate (CL/P) by integrating Vision Transformers (ViTs) and Siamese Neural Networks. Our study is the first to employ this integration specifically for CL/P classification, leveraging the strengths of both models to handle complex, multimodal data and few-shot learning scenarios. Unlike previous studies that rely on single-modality data or traditional machine learning models, we uniquely fuse anatomical data from ultrasound images with functional data from speech spectrograms. This multimodal approach captures both structural and acoustic features critical for accurate CL/P classification. Employing Siamese Neural Networks enables effective learning from a small number of labeled examples, enhancing the model’s generalization capabilities in medical imaging contexts where data scarcity is a significant challenge. The models were tested on the UltraSuite CLEFT dataset, which includes ultrasound video sequences and synchronized speech data, across three cleft types: Bilateral, Unilateral, and Palate-only clefts. The two-stage model demonstrated superior performance in classification accuracy (82.76%), F1-score (80.00–86.00%), precision, and recall, particularly distinguishing Bilateral and Unilateral Cleft Lip and Palate with high efficacy. This research underscores the significant potential of advanced AI techniques in medical diagnostics, offering valuable insights into their application for improving clinical outcomes in patients with CL/P.

Innovative Sentiment Analysis and Prediction of Stock Price Using FinBERT, GPT-4 and Logistic Regression: A Data-Driven Approach

This study explores the comparative performance of cutting-edge AI models, i.e., Finaance Bidirectional Encoder representations from Transsformers (FinBERT), Generatice Pre-trained Transformer GPT-4, and Logistic Regression, for sentiment analysis and stock index prediction using financial news and the NGX All-Share Index data label. By leveraging advanced natural language processing models like GPT-4 and FinBERT, alongside a traditional machine learning model, Logistic Regression, we aim to classify market sentiment, generate sentiment scores, and predict market price movements. This research highlights global AI advancements in stock markets, showcasing how state-of-the-art language models can contribute to understanding complex financial data. The models were assessed using metrics such as accuracy, precision, recall, F1 score, and ROC AUC. Results indicate that Logistic Regression outperformed the more computationally intensive FinBERT and predefined approach of versatile GPT-4, with an accuracy of 81.83% and a ROC AUC of 89.76%. The GPT-4 predefined approach exhibited a lower accuracy of 54.19% but demonstrated strong potential in handling complex data. FinBERT, while offering more sophisticated analysis, was resource-demanding and yielded a moderate performance. Hyperparameter optimization using Optuna and cross-validation techniques ensured the robustness of the models. This study highlights the strengths and limitations of the practical applications of AI approaches in stock market prediction and presents Logistic Regression as the most efficient model for this task, with FinBERT and GPT-4 representing emerging tools with potential for future exploration and innovation in AI-driven financial analytics.

A hybrid transformer and attention based recurrent neural network for robust and interpretable sentiment analysis of tweets

Sentiment analysis is a pivotal tool in understanding public opinion, consumer behavior, and social trends, underpinning applications ranging from market research to political analysis. However, existing sentiment analysis models frequently encounter challenges related to linguistic diversity, model generalizability, explainability, and limited availability of labeled datasets. To address these shortcomings, we propose the Transformer and Attention-based Bidirectional LSTM for Sentiment Analysis (TRABSA) model, a novel hybrid sentiment analysis framework that integrates transformer-based architecture, attention mechanism, and recurrent neural networks like BiLSTM. The TRABSA model leverages the powerful RoBERTa-based transformer model for initial feature extraction, capturing complex linguistic nuances from a vast corpus of tweets. This is followed by an attention mechanism that highlights the most informative parts of the text, enhancing the model’s focus on critical sentiment-bearing elements. Finally, the BiLSTM networks process these refined features, capturing temporal dependencies and improving the overall sentiment classification into positive, neutral, and negative classes. Leveraging the latest RoBERTa-based transformer model trained on a vast corpus of 124M tweets, our research bridges existing gaps in sentiment analysis benchmarks, ensuring state-of-the-art accuracy and relevance. Furthermore, we contribute to data diversity by augmenting existing datasets with 411,885 tweets from 32 English-speaking countries and 7,500 tweets from various US states. This study also compares six word-embedding techniques, identifying the most robust preprocessing and embedding methodologies crucial for accurate sentiment analysis and model performance. We meticulously label tweets into positive, neutral, and negative classes using three distinct lexicon-based approaches and select the best one, ensuring optimal sentiment analysis outcomes and model efficacy. Here, we demonstrate that the TRABSA model outperforms the current seven traditional machine learning models, four stacking models, and four hybrid deep learning models, yielding notable gain in accuracy (94%) and effectiveness with a macro average precision of 94%, recall of 93%, and F1-score of 94%. Our further evaluation involves two extended and four external datasets, demonstrating the model’s consistent superiority, robustness, and generalizability across diverse contexts and datasets. Finally, by conducting a thorough study with SHAP and LIME explainable visualization approaches, we offer insights into the interpretability of the TRABSA model, improving comprehension and confidence in the model’s predictions. Our study results make it easier to analyze how citizens respond to resources and events during pandemics since they are integrated into a decision-support system. Applications of this system provide essential assistance for efficient pandemic management, such as resource planning, crowd control, policy formation, vaccination tactics, and quick reaction programs.

Generative artificial intelligence and optimisation framework for concrete mixture design with low cost and embodied carbon dioxide

This research presents a generative Artificial Intelligence (AI) and design framework that integrates machine learning (ML) and optimisation methodologies to discover new concrete mixture designs. Unlike traditional ML models that predict based on existing data, this framework innovatively generates new concrete mix designs that meet specific requirements such as strength, cost-efficiency, and reduced embodied CO2. To propose a powerful and reliable generative AI model, several advanced ML algorithms were considered, e.g., CatBoost, XGBoost, and LGBM. These models were trained on a unique dataset consisting of 4,936 data points collected from five different batching plants and have not been published yet. Bayesian Optimisation was employed to fine-tune model hyperparameters, resulting in the most effective models attaining R2 values of 0.94 and 0.89 for raw and grouped data, respectively. To verify the trained generative AI model, a case study was conducted, in which the model was requested to provide designs of a mix with pre-determined strength and optimised cost and embodied CO2. The mix designs generated by the framework were successfully validated through experimental tests, corroborating the predictive outcomes. The research culminated in the development of a web application, a tool crafted to streamline the concrete mixture design and optimisation process. This generative AI design framework can be applied to many other aspects of material design and engineering problems.

Predicting shear strength of corroded RC columns: A probabilistic model with enhanced Gaussian Process Regression

This study proposes a new probabilistic model for predicting the shear strength of corroded reinforced concrete (RC) columns. The probabilistic model addresses limitations of traditional methods by combining mechanical understanding with enhanced Gaussian Process Regression (GPR). A novel mean function for enhanced GPR is developed first based on the shear resistance mechanism of corroded RC columns. Then the hyper-parameters of both the mean function and kernel function for the enhanced GPR are optimized using the maximum likelihood estimation method. This leads to the establishment of the probabilistic model that is based on the enhanced GPR. Finally, the accuracy and effectiveness of the enhanced GPR probabilistic model are validated by comparing it with both traditional mechanical models and machine learning models. The results indicate that the proposed probabilistic model can not only describes the probabilistic characteristics for shear strength of corroded RC columns based on probability density functions, but also provides an efficient calibration method for traditional prediction models based on confidence intervals.

A study on hyperspectral soil total nitrogen inversion using a hybrid deep learning model CBiResNet-BiLSTM

Rapid, accurate and non-destructive acquisition of soil total nitrogen (TN) content in the black soil zone is significant for achieving precise fertilization. In this study, the soil types of corn and soybean fields in Jilin Agricultural University, China, were selected as the study area. A total of 162 soil samples were collected using a five-point mixed sampling method. Then, spectral data were obtained and the noisy edge were initially eliminated. Subsequently, the denoised spectral data underwent smoothing by using the Savitzky–Golay (SG) method. After performing the first-order difference (FD) and second-order difference (SD) transformations on the data, it was input to the model. In this study, a hybrid deep learning model, CBiResNet-BiLSTM, was designed for precise prediction of soil TN content. This model was optimized based on ResNet34, and its capabilities were enhanced by incorporating CBAM in the residual module to facilitate additional eigenvalue extraction. Also, Bidirectional Long Short-Term Memory (BiLSTM) was integrated to enhance model accuracy. Besides, partial least squares regression (PLSR), random forest regression (RFR), support vector machine regression (SVR), and back propagation neural network (BP), as well as ResNet(18, 34, 50, 101, 152) models were taken for comparative experiments. The results indicated that the traditional machine learning model PLSR achieved good performance, with R2 of 0.883, and the hybrid deep learning model CBiResNet-BiLSTM had the best inversion capability with R2 of 0.937, with the R2 being improved by 5.4%, compared with the PLSR model. On this basis, we present the LUCAS dataset to demonstrate the generalisability of the model. Therefore, the CBiResNet-BiLSTM model is a fast and feasible hyperspectral estimation method for soil TN content.Graphical abstract

User-wise perturbations for user identity protection in EEG-based BCIs.

An electroencephalogram (EEG)-based brain-computer interface (BCI) is a direct communication pathway between the human brain and a computer. Most research so far studied more accurate BCIs, but much less attention has been paid to the ethics of BCIs. Aside from task-specific information, EEG signals also contain rich private information, e.g., user identity, emotion, disorders, etc., which should be protected. We show for the first time that adding user-wise perturbations can make identity information in EEG unlearnable. We propose four types of user-wise privacy-preserving perturbations, i.e., random noise, synthetic noise, error minimization noise, and error maximization noise. After adding the proposed perturbations to EEG training data, the user identity information in the data becomes unlearnable, while the BCI task information remains unaffected. Experiments on six EEG datasets using three neural network classifiers and various traditional machine learning models demonstrated the robustness and practicability of the proposed perturbations. Our research shows the feasibility of hiding user identity information in EEG data without impacting the primary BCI task information.

Using interpretable machine learning to predict bloodstream infection and antimicrobial resistance in patients admitted to ICU: Early alert predictors based on EHR data to guide antimicrobial stewardship.

Nosocomial infections and Antimicrobial Resistance (AMR) stand as formidable healthcare challenges on a global scale. To address these issues, various infection control protocols and personalized treatment strategies, guided by laboratory tests, aim to detect bloodstream infections (BSI) and assess the potential for AMR. In this study, we introduce a machine learning (ML) approach based on Multi-Objective Symbolic Regression (MOSR), an evolutionary approach to create ML models in the form of readable mathematical equations in a multi-objective way to overcome the limitation of standard single-objective approaches. This method leverages readily available clinical data collected upon admission to intensive care units, with the goal of predicting the presence of BSI and AMR. We further assess its performance by comparing it to established ML algorithms using both naturally imbalanced real-world data and data that has been balanced through oversampling techniques. Our findings reveal that traditional ML models exhibit subpar performance across all training scenarios. In contrast, MOSR, specifically configured to minimize false negatives by optimizing also for the F1-Score, outperforms other ML algorithms and consistently delivers reliable results, irrespective of the training set balance with F1-Score.22 and.28 higher than any other alternative. This research signifies a promising path forward in enhancing Antimicrobial Stewardship (AMS) strategies. Notably, the MOSR approach can be readily implemented on a large scale, offering a new ML tool to find solutions to these critical healthcare issues affected by limited data availability.

Leveraging survival analysis in cost-aware deepnet for efficient hard drive failure prediction

AbstractMany real-world datasets, such as those used for failure and anomaly detection, are severely imbalanced, with a relatively small number of failed instances compared to the number of normal instances. To address these issues, this paper leverages the Backblaze hard disk drives (HDDs) data and makes several contributions to hard drive failure prediction. This research explores 1D convolutional neural networks (CNN) to utilize the sequential nature of hard drive sensor data. The performance of 1D CNN models is compared to traditional machine learning (ML) algorithms, such as the synthetic minority over-sampling technique (SMOTE) and weighted logistic regression (WLR), demonstrating superior results, suggesting the potential effectiveness of the proposed approaches. In addition to these efforts, this paper aims to provide a comprehensive understanding of hard drive longevity and the critical factors contributing to their eventual failure through survival analysis. The 1D CNN models employ weighted binary cross-entropy (WCE) loss and modified focal loss (MFL) functions to manage class imbalanced issues commonly observed in hard drive data. The findings suggest that 1D CNN models outperform traditional ML models, with regularization techniques like dropout and early stopping proving effective in controlling overfitting. Notably, the 1D CNN model with WCE loss demonstrated the best overall performance with a $$G_{mean}$$ G mean of 0.692, successfully maximizing the FDR without increasing the FAR. In parallel, the research also employs Cox regression to identify key SMART parameters influencing drive failure. The high concordance index (c-index) of the Cox model (0.958) adds confidence to the insights derived. The research thus sets a solid groundwork for data center management strategies, with a future focus on practical implementation and evaluation of these findings.

Predictive and experimental assessment of chloride ion permeation in concrete subjected to multi-factorial conditions using the XGBoost algorithm

Chloride ions infiltrate concrete structures, causing corrosion of the steel reinforcement, which creates concrete spalling and decreases load-bearing capacity, ultimately leading to structural failure. Thus, it is essential to comprehend the diffusion process of chloride ions in concrete. Current models used to predict the chloride ion diffusion in concrete are hindered by poor accuracy due to their simplistic consideration of variables and the complex interplay of environmental and material factors affecting key parameters such as surface chloride concentration (Cs) and the chloride diffusion coefficient (D). These influences are challenging to capture with simple linear or non-linear relationships, and traditional machine learning models often overfit training data and underperform with new data. To address these challenges, this study presents physical model experiments conducted to explore the diffusion process of chloride ions under multi-field coupling conditions, examining chloride ion concentrations across different concrete layers under varying environmental temperatures (T), humidities (h), erosion times (t), water-cement ratios (W/C), and volumes of coarse aggregates (v). This study reveals the distribution patterns of chloride ions within concrete layers. An XGBoost machine learning predictive model was developed using environmental temperature, humidity, erosion time, water-cement ratio, and coarse aggregate volume as input variables, with Cs and D as output variables. The results show that when the water-cement ratio reaches 0.5 in high humidity, the SHAP value rises to 0.015, enhancing chloride diffusion. As erosion time exceeds 200 days and temperature surpasses 38 °C, the SHAP value peaks at 0.02. Additionally, when coarse aggregate volume is between 0.45 and 0.60, temperature changes have little effect on Cs. Additionally, a graphical user interface was developed for modeling Cs and D to enhance practical usability.

AI-Generated Spam Review Detection Framework with Deep Learning Algorithms and Natural Language Processing

Spam reviews pose a significant challenge to the integrity of online platforms, misleading consumers and undermining the credibility of genuine feedback. This paper introduces an innovative AI-generated spam review detection framework that leverages Deep Learning algorithms and Natural Language Processing (NLP) techniques to identify and mitigate spam reviews effectively. Our framework utilizes multiple Deep Learning models, including Convolutional Neural Networks (CNNs), Long Short-Term Memory (LSTM) networks, Gated Recurrent Unit (GRU), and Bidirectional LSTM (BiLSTM), to capture intricate patterns in textual data. The system processes and analyzes large volumes of review content to detect deceptive patterns by utilizing advanced NLP and text embedding techniques such as One-Hot Encoding, Word2Vec, and Term Frequency-Inverse Document Frequency (TF-IDF). By combining three embedding techniques with four Deep Learning algorithms, a total of twelve exhaustive experiments were conducted to detect AI-generated spam reviews. The experimental results demonstrate that our approach outperforms the traditional machine learning models, offering a robust solution for ensuring the authenticity of online reviews. Among the models evaluated, those employing Word2Vec embeddings, particularly the BiLSTM_Word2Vec model, exhibited the strongest performance. The BiLSTM model with Word2Vec achieved the highest performance, with an exceptional accuracy of 98.46%, a precision of 0.98, a recall of 0.97, and an F1-score of 0.98, reflecting a near-perfect balance between precision and recall. Its high F2-score (0.9810) and F0.5-score (0.9857) further highlight its effectiveness in accurately detecting AI-generated spam while minimizing false positives, making it the most reliable option for this task. Similarly, the Word2Vec-based LSTM model also performed exceptionally well, with an accuracy of 97.58%, a precision of 0.97, a recall of 0.96, and an F1-score of 0.97. The CNN model with Word2Vec similarly delivered strong results, achieving an accuracy of 97.61%, a precision of 0.97, a recall of 0.96, and an F1-score of 0.97. This study is unique in its focus on detecting spam reviews specifically generated by AI-based tools rather than solely detecting spam reviews or AI-generated text. This research contributes to the field of spam detection by offering a scalable, efficient, and accurate framework that can be integrated into various online platforms, enhancing user trust and the decision-making processes.

Employing machine learning for advanced gap imputation in solar power generation databases

This research evaluates the application of advanced machine learning algorithms, specifically Random Forest and Gradient Boosting, for the imputation of missing data in solar energy generation databases and their impact on the size of green hydrogen production systems. The study demonstrates that the Random Forest model notably excels in harnessing solar data to optimize hydrogen production, achieving superior prediction accuracy with mean absolute error (MAE) of 0.0364, mean squared error (MSE) of 0.0097, root mean squared error (RMSE) of 0.0985, and a coefficient of determination (R2) of 0.9779. These metrics surpass those obtained from baseline models including linear regression and recurrent neural networks, highlighting the potential of accurate imputation to significantly enhance the efficiency and output of renewable energy systems. The findings advocate for the integration of robust data imputation methods in the design and operation of photovoltaic systems, contributing to the reliability and sustainability of energy resource management. Furthermore, this research makes significant contributions by showcasing the comparative performance of traditional machine learning models in handling data gaps, emphasizing the practical implications of data imputation on optimizing hydrogen production systems. By providing a detailed analysis and validation of the imputation models, this work offers valuable insights for future advancements in renewable energy technology.

Geographic traceability of Gastrodia elata Blum based on combination of NIRS and Chemometrics

The content of the active ingredient in G. elata Bl. is affected by the soil and climate of different regions, so geographical traceability is essential to ensure its quality, commercial value. This study used a combination of NIRS and various chemometric methods to establish an effective geotraceability method for G. elata Bl.. Firstly, a traditional machine learning model was built based on the SF dataset NIRS, and a ResNet model was built based on NIRS generated 2DCOS images and 3DCOS images. Secondly, the model performance was validated using the ZT dataset. The results show that the 3DCOS-ResNet model performs the best with 100.00 % and 95.45 % test set and EV accuracy, respectively. This study provides a theoretical basis for regulators to quickly ensure the authenticity of G. elata Bl. sources. However, more data and in-depth studies are needed in the future to validate and improve the applicability of the model.

Bayesian optimized deep Q-network for diagnosing mine ventilation systems windage alteration fault targeting imbalanced data

Fault diagnosis of mine ventilation system is of great significance for mine safety production. Traditional machine learning algorithms have been widely applied in the field of mine ventilation systems windage alteration faults (WAFs) diagnosis, but these algorithms have poor intelligence and weak generalization ability. Therefore, this research constructs a WAFs diagnosis model (WAFs-BODQN) based on Bayesian optimized (BO) deep Q-network (DQN). Meanwhile, in order to solve the problem of poor performance of intelligent models when the dataset is imbalanced, a reinforcement learning reward function (KMeans-SDF) was designed, which combines the KMeans++ algorithm and spatial distance function (SDF). The WAFs-BODQN model with KMeans-SDF reward function has fault location diagnosis accuracies of 98.75 %, 97.50 %, and 95.00 % for mild, moderate, and extreme imbalanced datasets UB1, UB2, and UB3, respectively. This effectively avoids the "eccentricity" phenomenon of the intelligent model on majority class and achieves accurate prediction of fault locations. The accuracy of fault location diagnosis using the WAFs-BODQN model in simulation experiments and on-site empirical applications is higher than 95 %, demonstrating the intelligence, generalization, and feasibility of WAFs-BODQN model in the field of WAFs diagnosis in mine ventilation systems. By comparing the results with traditional machine learning and deep learning fault diagnosis models, it has been proven that the WAFs-BODQN model has advantages in intelligence and generalization ability. It is expected to establish a universal architecture for diagnosing WAFs, providing theoretical guidance and technical support for achieving intelligent mine ventilation.

Artificial intelligence for parking forecasting: an extensive survey of machine learning techniques

To address the parking challenges, this survey delves into the significant impact of machine learning (ML) on parking availability (PA) predictions. With swelling urban populations, efficient parking management has become paramount. PA prediction offers accurate, context-sensitive solutions for dynamic on-street and off-road parking scenarios, thereby promoting urban mobility and parking efficiency. However, traditional ML models, while contributory, struggled to capture complex contextual nuances and dependencies for effective predictions. The rapid advancements of deep learning offer promising avenues for sophisticated prediction models. This survey covers a wide spectrum, from PA definitions and relevant datasets to ML modules, features considered, and evaluation metrics. Additionally, the current limitations and future directions are also explored. This comprehensive review underscores the present contributions of ML in parking predictions and paves the way for refining and devising future developments to tackle the persistent parking issues.

Compatibility analysis of waste polymer recycling in asphalt binder using molecular descriptor and graph neural network

Recycling of waste polymers for valuable use is important for circular economy and environmental sustainability. This study introduces a novel approach to evaluating the compatibility between waste polymers and asphalt binders using advanced molecular representation models. The solubility parameters of waste polymers were predicted using traditional machine learning (ML) models and geometry-enhanced graph neural network (GeoGNN), respectively. The compatibility index was then calculated based on the absolute difference between the solubility parameters of polymers and asphalt. Results indicate that GeoGNN outperforms traditional ML and other GNN models due to its superior ability to capture complex spatial structures. The study also identifies key molecular descriptors that significantly influence solubility parameters of waste polymers. Given the variability in asphalt binder composition, the most compatible waste polymers differ across binders, making the data-driven approach especially valuable. The GeoGNN model greatly enhances the ability to assess compatibility in the polymer-asphalt system. This complements experimental techniques by integrating geometric information to analyze molecular features uncovering the structure-property relationship of material.