Hybrid Ensemble Model Research Articles

A new hybrid ensemble approach for the prediction of effluent total nitrogen from a full-scale wastewater treatment plant using a combined trickling filter-activated sludge system.

In this study, different K-nearest neighbors (KNN), support vector regression (SVR), decision tree (DT), and random forest (RF) algorithms integrated with the Bayesian optimization algorithm (BOP) have been applied as novel hybrid modeling/optimization tools to predict the total nitrogen in treated wastewater of Southern Tehran Wastewater Treatment Plant (STWWTP). In order to enhance the outcomes of hybrid models, the chosen sub-models (the best and least correlated hybrid models) were used to generate voting average and stacked regression ensemble models. Throughout the preprocessing step, two alternative scenarios were used to handle missing values from the samples, including elimination versus estimation via linear interpolation. The results of this research demonstrated that ensemble models were better than individual hybrid models, although not all ensemble models were superior to single models. The results also revealed that the stacking regression ensemble model using KNN-BOP and SVR-BOP as sub-models was the most superior model among the developed models, with the coefficient of determination (R2) = 0.640, root mean squared error (RMSE) = 2.378, and mean absolute error (MAE) = 1.838 on the test data. The best hybrid ensemble model that can accurately predict the concentration of total nitrogen (TN) in the effluent can give people a heads-up about water pollution caused by eutrophication before it gets bad.

Improved hybrid resampling and ensemble model for imbalance learning and credit evaluation

A clustering-based undersampling (CUS) and distance-based near-miss method are widely used in current imbalanced learning algorithms, but this method has certain drawbacks. In particular, the CUS does not consider the influence of the distance factor on the majority of instances, and the near-miss method omits the inter-class(es) within the majority of samples. To overcome these drawbacks, this study proposes an undersampling method combining distance measurement and majority class clustering. Resampling methods are used to develop an ensemble-based imbalanced-learning algorithm called the clustering and distance-based imbalance learning model (CDEILM). This algorithm combines distance-based undersampling, feature selection, and ensemble learning. In addition, a cluster size-based resampling (CSBR) method is proposed for preserving the original distribution of the majority class, and a hybrid imbalanced learning framework is constructed by fusing various types of resampling methods. The combination of CDEILM and CSBR can be considered as a specific case of this hybrid framework. The experimental results show that the CDEILM and CSBR methods can achieve better performance than the benchmark methods, and that the hybrid model provides the best results under most circumstances. Therefore, the proposed model can be used as an alternative imbalanced learning method under specific circumstances, e.g., for providing a solution to credit evaluation problems in financial applications.

Identifying Land-Use Related Potential Disaster Risk Drivers in the Ayeyarwady Delta (Myanmar) during the Last 50 Years (1974–2021) Using a Hybrid Ensemble Learning Model

Land-use and land-cover change (LULCC) dynamics significantly impact deltas, which are among the world’s most valuable but also vulnerable habitats. Non-risk-oriented LULCCs can act as disaster risk drivers by increasing levels of exposure and vulnerability or by reducing capacity. Making thematically detailed long-term LULCC data available is crucial to improving understanding of those dynamics interlinked at different spatiotemporal scales. For the Ayeyarwady Delta, one of the least studied mega-deltas, such comprehensive information is still lacking. This study used 50 Landsat and Sentinel-1A images spanning five decades from 1974 to 2021 in five-year intervals. A hybrid ensemble model consisting of six machine-learning classifiers was employed to generate land-cover maps from the images, achieving accuracies of about 90%. The major identified potential risk-relevant LULCC dynamics include urban growth towards low-lying areas, mangrove deforestation, and the expansion of irrigated agricultural areas and cultivated aquatic surfaces. The novel area-wide LULCC products achieved through the analyses provide a basis to support future risk-sensitive development decisions and can be used for regionally adapted disaster risk management plans and models. Developed with freely available data and open-source software, they hold great potential to increase research activity in the Ayeyarwady Delta and will be shared upon request.

Artificial Intelligence-Enabled Social Media Analysis for Pharmacovigilance of COVID-19 Vaccinations in the United Kingdom: Observational Study.

Background The rollout of vaccines for COVID-19 in the United Kingdom started in December 2020. Uptake has been high, and there has been a subsequent reduction in infections, hospitalizations, and deaths among vaccinated individuals. However, vaccine hesitancy remains a concern, in particular relating to adverse effects following immunization (AEFIs). Social media analysis has the potential to inform policy makers about AEFIs being discussed by the public as well as public attitudes toward the national immunization campaign.Objective We sought to assess the frequency and nature of AEFI-related mentions on social media in the United Kingdom and to provide insights on public sentiments toward COVID-19 vaccines.Methods We extracted and analyzed over 121,406 relevant Twitter and Facebook posts, from December 8, 2020, to April 30, 2021. These were thematically filtered using a 2-step approach, initially using COVID-19–related keywords and then using vaccine- and manufacturer-related keywords. We identified AEFI-related keywords and modeled their word frequency to monitor their trends over 2-week periods. We also adapted and utilized our recently developed hybrid ensemble model, which combines state-of-the-art lexicon rule–based and deep learning–based approaches, to analyze sentiment trends relating to the main vaccines available in the United Kingdom.Results Our COVID-19 AEFI search strategy identified 46,762 unique Facebook posts by 14,346 users and 74,644 tweets (excluding retweets) by 36,446 users over the 4-month period. We identified an increasing trend in the number of mentions for each AEFI on social media over the study period. The most frequent AEFI mentions were found to be symptoms related to appetite (n=79,132, 14%), allergy (n=53,924, 9%), injection site (n=56,152, 10%), and clots (n=43,907, 8%). We also found some rarely reported AEFIs such as Bell palsy (n=11,909, 2%) and Guillain-Barre syndrome (n=9576, 2%) being discussed as frequently as more well-known side effects like headache (n=10,641, 2%), fever (n=12,707, 2%), and diarrhea (n=16,559, 3%). Overall, we found public sentiment toward vaccines and their manufacturers to be largely positive (58%), with a near equal split between negative (22%) and neutral (19%) sentiments. The sentiment trend was relatively steady over time and had minor variations, likely based on political and regulatory announcements and debates.Conclusions The most frequently discussed COVID-19 AEFIs on social media were found to be broadly consistent with those reported in the literature and by government pharmacovigilance. We also detected potential safety signals from our analysis that have been detected elsewhere and are currently being investigated. As such, we believe our findings support the use of social media analysis to provide a complementary data source to conventional knowledge sources being used for pharmacovigilance purposes.

A Hybrid Analytic Model for the Effective Prediction of Different Stages in Chronic Kidney Ailments

Chronic kidney disease (CKD) is a gradual loss of kidney function over the period of time and it is irrevocable once functionality reaches the critical state. Detecting the various stages of CKD helps to reduce the progression of the disease. Accurate prediction of CKD stages is one of the urgent needs in the medical industry and it can be effectively done by adopting machine learning (ML) techniques. The primary objective of the present research is to develop an effective classification model for the accurate prediction of CKD stages based on the patient’s health profile as well as the clinical test reports. Here, a hybrid ML strategy is employed that integrates random forest (RF) and AdaBoost (AB) techniques through a voting classifier (VC). The standard CKD dataset with 400 tuples and 25 parameters is used for the proposed investigation. The modification of diet in renal disease (MDRD) equation is used to extract an additional feature known as “estimated Glomerular Filtration Rate (eGFR)” for the prediction of the CKD stage. Pre-processing is carried out on the CKD dataset to fill the missing values by considering the skewness of the parameters and the issue of data leakage is also well addressed. Medically important features are considered and Correlation analysis is carried out to select the appropriate features for the model building process. The proposed Hybrid Ensemble Model (HEM) aids in lowering the bias and variance. HEM model efficiency is assessed using the performance metrics such as cross validation score (CVS), accuracy, precision, recall, F1 measure, Mean Squared Error (MSE), bias and variance and it is compared with the state-of-the-art classification schemes. The outcomes of the analysis reveal that the proposed HEM ensures that the CKD stage prediction is more accurate with 99.16%, 100%, 100% in reduced feature set I, set II, set III and with cross validation score of 97.85%, 99.28%, and 99.64% with reduced features set I, set II and set III respectively.

A Multi-Classification Model for Predicting the Invasiveness of Lung Adenocarcinoma Presenting as Pure Ground-Glass Nodules.

ObjectivesTo establish a multi-classification model for precisely predicting the invasiveness (pre-invasive adenocarcinoma, PIA; minimally invasive adenocarcinoma, MIA; invasive adenocarcinoma, IAC) of lung adenocarcinoma manifesting as pure ground-glass nodules (pGGNs).MethodsBy the inclusion and exclusion criteria, this retrospective study enrolled 346 patients (female, 297, and male, 49; age, 55.79 ± 10.53 (24-83)) presenting as pGGNs from 1292 consecutive patients with pathologically confirmed lung adenocarcinoma. A total of 27 clinical were collected and 1409 radiomics features were extracted by PyRadiomics package on python. After feature selection with L2,1-norm minimization, logistic regression (LR), extra w(ET) and gradient boosting decision tree (GBDT) were used to construct the three-classification model. Then, an ensemble model of the three algorithms based on model ensemble strategy was established to further improve the classification performance.ResultsAfter feature selection, a hybrid of 166 features consisting of 1 clinical (short-axis diameter, ranked 27th) and 165 radiomics (4 shape, 71 intensity and 90 texture) features were selected. The three most important features are wavelet-HLL_firstorder_Minimum, wavelet-HLL_ngtdm_Busyness and square_firstorder_Kurtosis. The hybrid-ensemble model based on hybrid clinical-radiomics features and the ensemble strategy showed more accurate predictive performance than other models (hybrid-LR, hybrid-ET, hybrid-GBDT, clinical-ensemble and radiomics-ensemble). On the training set and test set, the model can obtain the accuracy values of 0.918 ± 0.022 and 0.841, and its F1-scores respectively were 0.917 ± 0.024 and 0.824.ConclusionThe multi-classification of invasive pGGNs can be precisely predicted by our proposed hybrid-ensemble model to assist patients in the early diagnosis of lung adenocarcinoma and prognosis.

TSRNet: Diagnosis of COVID-19 based on self-supervised learning and hybrid ensemble model

BackgroundAs of Feb 27, 2022, coronavirus (COVID-19) has caused 434,888,591 infections and 5,958,849 deaths worldwide, dealing a severe blow to the economies and cultures of most countries around the world. As the virus has mutated, its infectious capacity has further increased. Effective diagnosis of suspected cases is an important tool to stop the spread of the pandemic. Therefore, we intended to develop a computer-aided diagnosis system for the diagnosis of suspected cases. MethodsTo address the shortcomings of commonly used pre-training methods and exploit the information in unlabeled images, we proposed a new pre-training method based on transfer learning with self-supervised learning (TS). After that, a new convolutional neural network based on attention mechanism and deep residual network (RANet) was proposed to extract features. Based on this, a hybrid ensemble model (TSRNet) was proposed for classifying lung CT images of suspected patients as COVID-19 and normal. ResultsCompared with the existing five models in terms of accuracy (DarkCOVIDNet: 98.08%; Deep-COVID: 97.58%; NAGNN: 97.86%; COVID-ResNet: 97.78%; Patch-based CNN: 88.90%), TSRNet has the highest accuracy of 99.80%. In addition, the recall, f1-score, and AUC of the model reached 99.59%, 99.78%, and 1, respectively. ConclusionTSRNet can effectively diagnose suspected COVID-19 cases with the help of the information in unlabeled and labeled images, thus helping physicians to adopt early treatment plans for confirmed cases.

A Hybrid Machine Learning Model to Predict Heart Disease Accurately

Objective: To propose the most effective machine learning algorithm for predicting cardiac problems. Methods: The dataset used for this study is “heart” which was taken from www.kaggle.com. The heart dataset contains 13 features and a target variable. It is divided into 70 percent training set and 30 percent testing set. K-Fold cross-validation is used in this study for model evaluation and model selection. The K value chosen is ten. A Hybrid Ensemble machine learning model is built using a heterogeneous collection of weak learners in this work. To construct a hybrid ensemble model, weak learners such as “Logistic Regression”, “Decision Tree”, “Support Vector Machine”, “KNearest Neighbor”, and “Naive Bayes” are used. Normally, in an ensemble model, a homogeneous group of weak learners is utilized, however in this study, a heterogeneous group of weak learners is used. The parameter used in this study is accuracy. Accuracy of all the weak learners is found and compared with the hybrid ensemble model. Findings: Weak machine learning models are combined to create an ensemble model. The ”Hybrid Ensemble model” has a 98 percent accuracy rate and outperforms all weak learners such as “Logistic Regression”, “Decision Tree”, “Support Vector Machine”, “K-Nearest Neighbor”, and “Naive Bayes”. Novelty and applications : For the prediction of heart problems, the hybrid ensemble model is recommended since it extracts more accurate and valuable data from huge amounts of data, making prediction easier for physicians. Keywords: Machine Learning; Ensemble Model; Weak Learners; Homogeneous; Heterogeneous

A novel hybrid ensemble model for hourly PM2.5 concentration forecasting

A novel hybrid ensemble model for hourly PM2.5 concentration forecasting

Detection of Credit Card Fraud using a Hybrid Ensemble Model

The rising number of credit card frauds presents a significant challenge for the banking industry. Many businesses and financial institutions suffer huge losses because card users are reluctant to use their cards. A primary goal of fraud detection is to identify prior transaction patterns to detect future fraud. In this paper, a hybrid ensemble model is proposed to combine bagging and boosting techniques to distinguish between fraudulent and legitimate transactions. During the experimentation two datasets are used; the European credit card dataset and the credit card stimulation dataset which are highly imbalanced. The oversampling method is used to balance both datasets. To overcome the problem of unbalanced data oversampling method is used. The model is trained to predict output results by combining random forest with Adaboost. The proposed model provides 98.27 % area under curve score on the European credit cards dataset and the stimulation credit card dataset gives 99.3 % area under curve score.

Study of Various Classification Approaches including Deep Learning in Heart Disease Prediction

During the last couple of decades, apart from other diseases, heart disease has proved to be a major cause of human death. This refers to a wide variety of heart conditions which include diseased vessels, structural problems and blood clots. This paper is aimed to make an effective prediction about the vulnerability to heart disease of a person depending on the given health parameters at a very early stage & to reduce premature death, with an improved accuracy and reliability compared to other traditional models. Our proposed prediction model has proved to be reliable in this connection and has yielded a maximum accuracy of 99.0% using Random Forest, Support vector machine and Decision trees and K-nearest neighbour algorithms. Using Cross Validation, we have also prepared the model (with the highest accuracy level of 98.6%) to work efficiently, taking the correct pattern of the dataset. Further, the proposed model has outperformed other traditional models in terms of accuracy using some other algorithms (Hybrid Ensemble model, Extreme Gradient Boosting with Random Forest and Stochastic Gradient Descent with accuracies of 94.2%, 87%, 78% respectively). Moreover, TensorFlow has also been used in order to get reliable prediction of heart disease with an approximate accuracy of 83.44%. The novelty of our proposed model lies in showcasing better results compared to those obtained by the traditional models and this model can easily be applied in medical science to provide better diagnosis.

Federated learning for intrusion detection in IoT security: a hybrid ensemble approach

Critical role of Internet of Things (IoT) in various domains like smart city, healthcare, supply chain and transportation has made them the target of malicious attacks. Past works in this area focused on centralized Intrusion Detection System (IDS), assuming the existence of a central entity to perform data analysis and identify threats. However, such IDS may not always be feasible, mainly due to spread of data across multiple sources and gathering at central node can be costly. Also, the earlier works primarily focused on improving True Positive Rate (TPR) and ignored the False Positive Rate (FPR), which is also essential to avoid unnecessary downtime of the systems. In this paper, we first present an architecture for IDS based on hybrid ensemble model, named PHEC, which gives improved performance compared to state-of-the-art architectures. We then adapt this model to a federated learning framework that performs local training and aggregates only the model parameters. Next, we propose Noise-Tolerant PHEC in centralized and federated settings to address the label-noise problem. The proposed idea uses classifiers using weighted convex surrogate loss functions. Natural robustness of KNN classifier towards noisy data is also used in the proposed architecture. Experimental results on four benchmark datasets drawn from various security attacks show that our model achieves high TPR while keeping FPR low on noisy and clean data. Further, they also demonstrate that the hybrid ensemble models achieve performance in federated settings close to that of the centralized settings.

Hybrid ensemble soft computing approach for predicting penetration rate of tunnel boring machine in a rock environment

This study implements a hybrid ensemble machine learning method for forecasting the rate of penetration (ROP) of tunnel boring machine (TBM), which is becoming a prerequisite for reliable cost assessment and project scheduling in tunnelling and underground projects in a rock environment. For this purpose, a sum of 185 datasets was collected from the literature and used to predict the ROP of TBM. Initially, the main dataset was utilised to construct and validate four conventional soft computing (CSC) models, i.e. minimax probability machine regression, relevance vector machine, extreme learning machine, and functional network. Consequently, the estimated outputs of CSC models were united and trained using an artificial neural network (ANN) to construct a hybrid ensemble model (HENSM). The outcomes of the proposed HENSM are superior to other CSC models employed in this study. Based on the experimental results (training RMSE = 0.0283 and testing RMSE = 0.0418), the newly proposed HENSM is potential to assist engineers in predicting ROP of TBM in the design phase of tunnelling and underground projects. • Amalgamation of four conventional soft computing models and ANN. • Construction of hybrid ensemble model using MPMR, RVM, ELM and FN. • Implementation of accuracy matrix for visual interpretation of results. • Determination of best performing model using uncertainty analysis.

Improving Sentiment Analysis for Social Media Applications Using an Ensemble Deep Learning Language Model.

As data grow rapidly on social media by users’ contributions, specially with the recent coronavirus pandemic, the need to acquire knowledge of their behaviors is in high demand. The opinions behind posts on the pandemic are the scope of the tested dataset in this study. Finding the most suitable classification algorithms for this kind of data is challenging. Within this context, models of deep learning for sentiment analysis can introduce detailed representation capabilities and enhanced performance compared to existing feature-based techniques. In this paper, we focus on enhancing the performance of sentiment classification using a customized deep learning model with an advanced word embedding technique and create a long short-term memory (LSTM) network. Furthermore, we propose an ensemble model that combines our baseline classifier with other state-of-the-art classifiers used for sentiment analysis. The contributions of this paper are twofold. (1) We establish a robust framework based on word embedding and an LSTM network that learns the contextual relations among words and understands unseen or rare words in relatively emerging situations such as the coronavirus pandemic by recognizing suffixes and prefixes from training data. (2) We capture and utilize the significant differences in state-of-the-art methods by proposing a hybrid ensemble model for sentiment analysis. We conduct several experiments using our own Twitter coronavirus hashtag dataset as well as public review datasets from Amazon and Yelp. For concluding results, a statistical study is carried out indicating that the performance of these proposed models surpasses other models in terms of classification accuracy.

Ensemble modeling with machine learning and deep learning to provide interpretable generalized rules for classifying CNS drugs with high prediction power.

The trade-off between a machine learning (ML) and deep learning (DL) model’s predictability and its interpretability has been a rising concern in central nervous system-related quantitative structure–activity relationship (CNS-QSAR) analysis. Many state-of-the-art predictive modeling failed to provide structural insights due to their black box-like nature. Lack of interpretability and further to provide easy simple rules would be challenging for CNS-QSAR models. To address these issues, we develop a protocol to combine the power of ML and DL to generate a set of simple rules that are easy to interpret with high prediction power. A data set of 940 market drugs (315 CNS-active, 625 CNS-inactive) with support vector machine and graph convolutional network algorithms were used. Individual ML/DL modeling methods were also constructed for comparison. The performance of these models was evaluated using an additional external dataset of 117 market drugs (42 CNS-active, 75 CNS-inactive). Fingerprint-split validation was adopted to ensure model stringency and generalizability. The resulting novel hybrid ensemble model outperformed other constituent traditional QSAR models with an accuracy of 0.96 and an F1 score of 0.95. With the power of the interpretability provided with this protocol, our model laid down a set of simple physicochemical rules to determine whether a compound can be a CNS drug using six sub-structural features. These rules displayed higher classification ability than classical guidelines, with higher specificity and more mechanistic insights than just for blood–brain barrier permeability. This hybrid protocol can potentially be used for other drug property predictions.

PSO Based Optimized Ensemble Learning and Feature Selection Approach for Efficient Energy Forecast

Swarm intelligence techniques with incredible success rates are broadly used for various irregular and interdisciplinary topics. However, their impact on ensemble models is considerably unexplored. This study proposes an optimized-ensemble model integrated for smart home energy consumption management based on ensemble learning and particle swarm optimization (PSO). The proposed model exploits PSO in two distinct ways; first, PSO-based feature selection is performed to select the essential features from the raw dataset. Secondly, with larger datasets and comprehensive range problems, it can become a cumbersome task to tune hyper-parameters in a trial-and-error manner manually. Therefore, PSO was used as an optimization technique to fine-tune hyper-parameters of the selected ensemble model. A hybrid ensemble model is built by using combinations of five different baseline models. Hyper-parameters of each combination model were optimized using PSO followed by training on different random samples. We compared our proposed model with our previously proposed ANN-PSO model and a few other state-of-the-art models. The results show that optimized-ensemble learning models outperform individual models and the ANN-PSO model by minimizing RMSE to 6.05 from 9.63 and increasing the prediction accuracy by 95.6%. Moreover, our results show that random sampling can help improve prediction results compared to the ANN-PSO model from 92.3% to around 96%.

Credit Card Fraud Detection by Modelling Behaviour Pattern using Hybrid Ensemble Model

Credit Card Fraud Detection by Modelling Behaviour Pattern using Hybrid Ensemble Model

Enhanced Evolutionary Feature Selection and Ensemble Method for Cardiovascular Disease Prediction.

Cardiovascular Disease (CVD) is one among the main factors for the increase in mortality rate worldwide. The analysis and prediction of this disease is yet a highly formidable task in medical data analysis. Recent advancements in technology such as Big Data, Artificial Intelligence and the need for automated models have paved the way for developing a more reliable and efficient model for predicting heart disease. Several researches have been carried out in predicting heart diseases but the focus on choosing the important attributes that play a significant role in predicting CVD is inadequate. Hence the choice of right features for the classification and the diagnosis of the heart disease is important. The core aim of this work is to identify and select the important features and machine learning methodologies that can enhance the prediction capability of the classification models for accurately predicting CVD. The results show that the proposed enhanced evolutionary feature selection with the hybrid ensemble model outperforms the existing approaches in terms of precision, recall and accuracy. The experimental outcomes show that the proposed approach attains the maximum classification accuracy of 93.65% for statlog dataset, 82.81% for SPECTF dataset and 84.95% for coronary heart disease dataset. The proposed classification model performance is demonstrated using ROC curve against state-of-the-art methods in machine learning.

A hybrid ensemble modelling framework for the prediction of breakup ice jams on Northern Canadian Rivers

The forecasting of river ice jams faces challenges relating to both the availability of data and the complexity of river ice dynamics, resulting in difficulties in model formulation. In this study, a hybrid ensemble modelling framework is developed to address the data scarcity issue and leverage advanced machine learning techniques for the prediction of ice jams with a one-day lead time. The proposed methodology utilises data easily monitored in advance of any ice jam events and maintains a realistic balance between ice jam and non-ice jam events. A combination of both single model algorithms, including classification trees, logistic regression, k-nearest neighbors, support vector machines, and artificial neural networks, and ensemble model algorithms, including random forest, adaptive boosting, gradient boosting, variance penalizing adaptive boosting, logistic boosting, class switching, and adaptive resampling and combining, are considered for both the member models of the first layer of the hybrid ensemble and for the ensemble combiner of the second layer. The final selection of both variables and member models for the hybrid ensemble is detailed, with a focus on the reduction of false negatives, the prediction of no ice jam on a day when one occurs. The proposed method is applied to the St. John River in New Brunswick, Canada, in a location particularly prone to ice jam flooding. Using the proposed methodology, a final model combining 6 different member models using a support vector machine as the ensemble combiner was produced, with a balanced prediction accuracy of 86%. This hybrid ensemble model outperformed the other tested ensemble models, as well as a series of generalized models produced using all available input variables and member models. The model also performed well against other ensemble techniques and against the individual member models. These results demonstrate the viability of the proposed methodology in constructing a hybrid ensemble model for the forecasting of ice jams on Northern Canadian Rivers. The techniques utilised can be adapted to other locations to facilitate ice jam forecasting, requiring data that is easily available and monitored in advance of any potential flooding events.

Predicting concrete compressive strength using hybrid ensembling of surrogate machine learning models

This study aims to implement a hybrid ensemble surrogate machine learning technique in predicting the compressive strength (CS) of concrete, an important parameter used for durability design and service life prediction of concrete structures in civil engineering projects. For this purpose, an experimental database consisting of 1030 records has been compiled from the machine learning repository of the University of California, Irvine. The database was used to train and validate four conventional machine learning (CML) models, namely Artificial Neural Network (ANN), Linear and Non-Linear Multivariate Adaptive Regression Splines (MARS-L and MARS-C), Gaussian Process Regression (GPR), and Minimax Probability Machine Regression (MPMR). Subsequently, the predicted outputs of CML models were combined and trained using ANN to construct the Hybrid Ensemble Model (HENSM). It is observed that the proposed HENSM produces higher predictive accuracy compared to the CML models used in the present study. The predictive performance of all models for CS prediction was compared using the testing dataset and it is found that the HENSM model attained the highest predictive accuracy in both phases. Based on the experimental results, the newly constructed HENSM model is very potential to be a new alternative in handling the overfitting issues of CML models and hence, can be used to predict the concrete CS, including the design of less polluting and more sustainable concrete constructions.