Traditional Machine Learning Methods Research Articles

Analyzing electroencephalograph signals for early Alzheimer’s disease detection: deep learning vs. traditional machine learning approaches

Alzheimer’s disease (AD) stands as a progressive neurodegenerative disorder with a significant global public health impact. It is imperative to establish early and accurate diagnoses of AD to facilitate effective interventions and treatments. Recent years have witnessed the emergence of machine learning (ML) and deep learning (DL) techniques, displaying promise in various medical domains, including AD diagnosis. This study undertakes a comprehensive contrast between conventional machine learning methods and advanced deep learning strategies for early AD diagnosis. Conventional ML algorithms like support vector machines, decision trees, and K nearest neighbor have been extensively employed for AD diagnosis through relevant feature extraction from heterogeneous data sources. Conversely, deep learning techniques such as multilayer perceptron (MLP) and convolutional neural networks (CNNs) have demonstrated exceptional aptitude in autonomously uncovering intricate patterns and representations from unprocessed data like EEG data. The findings reveal that while traditional ML methods may perform adequately with limited data, deep learning techniques excel when ample data is available, showcasing their potential for early and precise AD diagnosis. In conclusion, this research paper contributes to the ongoing discourse surrounding the choice of appropriate methodologies for early Alzheimer’s disease diagnosis.

Classification of Dermoscopic Images Using CNN-SVM

Traditional machine learning methods like GLCM and ABCD rules have long been employed for image classification tasks. However, they come with inherent limitations, primarily the need for manual feature extraction. This manual feature extraction process is time-consuming and relies on expert domain knowledge, making it challenging for non-experts to use effectively. Deep learning methods, specifically Convolutional Neural Networks (CNN), have revolutionized image classification by automating the feature extraction. CNNs can learn hierarchical features directly from the raw pixel values, eliminating the need for manual feature engineering. Despite their powerful capabilities, CNNs have limitations, mainly when working with small image datasets. They may overfit the data or struggle to generalize effectively. In light of these considerations, this study adopts a hybrid approach that leverages the strengths of both deep learning and traditional machine learning. CNNs are automatic feature extractors, allowing the model to capture meaningful image patterns. These extracted features are then fed into a Support Vector Machine (SVM) classifier, known for its efficiency and effectiveness in handling small datasets. The results of this study are encouraging, with an accuracy of 0.94 and an AUC score of 0.94. Notably, these metrics outperform Abbas' previous research by a significant margin, underscoring the effectiveness of the hybrid CNN-SVM approach. This research reinforces that SVM classifiers are well-suited for tasks involving limited image data, yielding improved classification accuracy and highlighting the potential for broader applications in image analysis.

Deep learning algorithm-enabled sediment characterization techniques to determination of water saturation for tight gas carbonate reservoirs in Bohai Bay Basin, China

Understanding water saturation levels in tight gas carbonate reservoirs is vital for optimizing hydrocarbon production and mitigating challenges such as reduced permeability due to water saturation (Sw) and pore throat blockages, given its critical role in managing capillary pressure in water drive mechanisms reservoirs. Traditional sediment characterization methods such as core analysis, are often costly, invasive, and lack comprehensive spatial information. In recent years, several classical machine learning models have been developed to address these shortcomings. Traditional machine learning methods utilized in reservoir characterization encounter various challenges, including the ability to capture intricate relationships, potential overfitting, and handling extensive, multi-dimensional datasets. Moreover, these methods often face difficulties in dealing with temporal dependencies and subtle patterns within geological formations, particularly evident in heterogeneous carbonate reservoirs. Consequently, despite technological advancements, enhancing the reliability, interpretability, and applicability of predictive models remains imperative for effectively characterizing tight gas carbonate reservoirs. This study employs a novel data-driven strategy to prediction of water saturation in tight gas reservoir powered by three recurrent neural network type deep/shallow learning algorithms—Gated Recurrent Unit (GRU), Recurrent Neural Networks (RNN), Long Short-Term Memory (LSTM), Support Vector Machine (SVM), K-nearest neighbor (KNN) and Decision tree (DT)—customized to accurately forecast sequential sedimentary structure data. These models, optimized using Adam's optimizer algorithm, demonstrated impressive performance in predicting water saturation levels using conventional petrophysical data. Particularly, the GRU model stood out, achieving remarkable accuracy (an R-squared value of 0.9973) with minimal errors (RMSE of 0.0198) compared to LSTM, RNN, SVM, KNN and, DT algorithms, thus showcasing its proficiency in processing extensive datasets and effectively identifying patterns. By achieving unprecedented accuracy levels, this study not only enhances the understanding of sediment properties and fluid saturation dynamics but also offers practical implications for reservoir management and hydrocarbon exploration in complex geological settings. These insights pave the way for more reliable and efficient decision-making processes, thereby advancing the forefront of reservoir engineering and petroleum geoscience.

Explainable AI for myocardial infarction using the vectorcardiogram

Abstract Background and purpose Myocardial infarction (MI), a widespread cardiovascular ailment, often lacks immediate patient awareness being early and accurate MI diagnosis crucial for lifesaving interventions. In artificial intelligence studies, ECG signals are extensively explored, while fewer examine the potential of vectorcardiogram (VCG) which offers a three-dimensional cardiac dipole representation. Traditional Machine Learning methods manually extract features; some studies advocate VCG features. Deep Learning, especially Convolutional Neural Networks (CNN), automates feature extraction. Although ECG contains redundant information from the VCG's 12 projections, no studies directly apply CNNs to VCG, nor assess the impact of redundancy on predictive ability. This study aims to bridge this gap by investigating CNNs' diagnostic capabilities with VCG inputs, specifically focusing on improving MI classification. Methods The PTB-XL database was used for this study, containing 10-seconds ECG data from various pathologies, including MI. The database encompasses 9,481 records from healthy patients and 4,129 records from patients with MI. Data was divided into 80% for training and 20% for testing. Consequently, the dataset was expanded to have 52% representing MI and 48% representing healthy cases. We designed a 1D-CNN classifier (Figure 1.A) with three convolutional layers. The network was trained using both ECG and VCG reconstruction through the Inverse Dower Transform. Results The trained model achieved accuracy values of 0.895 and 0.914 for the test set when utilizing ECG and VCG, respectively. These results underscore how the information condensation in the VCG contributes to an enhanced predictive capacity of the model. In a qualitative analysis, activation maps extracted from the CNN illustrate heightened activation in the QRS complex when the disease is present, contrasting with diminished activation in its absence. These maps depict the weight assigned to each signal segment, enabling the classification of signals into healthy and diseased categories. The presented figure exemplifies a notable activation in the QRS loop in the case of myocardial infarction (MI), aligning with the observed alteration in the cardiac signal associated with this pathology (Figure 1.B). Conclusion In this study, an interpretable CNN has been designed for MI detection, with the VCG yielding better results than the ECG for this task due to information compression. This provides a new insight for enhancing classification capability in Deep Learning models, allowing for advancements in the MI detection.

Comparative analysis of heat transfer prediction for falling film evaporation on the horizontal tube based on machine learning methods

Precise prediction of heat transfer for falling film evaporation is necessary for the horizontal tube falling film evaporator design. In this study, models to predict the heat transfer are compared, which are developed by traditional Least Square method (LSM) and Machine Learning (ML) methods, including Support Vector Regression (SVR), Artificial Neural Network (ANN) and Random Forest Regression (RFR). The training data is obtained by a series of experiments, containing 510 experimental data of fresh water and seawater of salinities from 30 to 60 g/kg. The experiments were conducted with the test tube diameter of 19, 25.4 and 38 mm and with the heat flux of 7.7–12 kW/m2. All ML models behave better performances than the LSM model and the SVR model is suggested as the best model to predict the heat transfer, considering the prediction accuracy and generalization ability comprehensively. SHapley Additive exPlanations (SHAP) is used to explain the relationships between Nusselt number and input variables, which also helps to resolve controversial issues about the effects of spray density and tube diameter on the heat transfer. The importance of variables is ranked, in which the tube pitch and seawater salinity are regarded as the most influential variables. Besides, the limitations and performance of models are analyzed in terms of both dataset and algorithms.

A survey on wind power forecasting with machine learning approaches

AbstractWind power forecasting techniques have been well developed over the last half-century. There has been a large number of research literature as well as review analyses. Over the past 5 decades, considerable advancements have been achieved in wind power forecasting. A large body of research literature has been produced, including review articles that have addressed various aspects of the subject. However, these reviews have predominantly utilized horizontal comparisons and have not conducted a comprehensive analysis of the research that has been undertaken. This survey aims to provide a systematic and analytical review of the technical progress made in wind power forecasting. To accomplish this goal, we conducted a knowledge map analysis of the wind power forecasting literature published in the Web of Science database over the last 2 decades. We examined the collaboration network and development context, analyzed publication volume, citation frequency, journal of publication, author, and institutional influence, and studied co-occurring and bursting keywords to reveal changing research hotspots. These hotspots aim to indicate the progress and challenges of current forecasting technologies, which is of great significance for promoting the development of forecasting technology. Based on our findings, we analyzed commonly used traditional machine learning and advanced deep learning methods in this field, such as classical neural networks, and recent Transformers, and discussed emerging technologies like large language models. We also provide quantitative analysis of the advantages, disadvantages, forecasting accuracy, and computational costs of these methods. Finally, some open research questions and trends related to this topic were discussed, which can help improve the understanding of various power forecasting methods. This survey paper provides valuable insights for wind power engineers.

A Novel Fault Diagnosis Method of High-Speed Train Based on Few-Shot Learning.

Ensuring the safe and stable operation of high-speed trains necessitates real-time monitoring and diagnostics of their suspension systems. While machine learning technology is widely employed for industrial equipment fault diagnosis, its effective application relies on the availability of a large dataset with annotated fault data for model training. However, in practice, the availability of informational data samples is often insufficient, with most of them being unlabeled. The challenge arises when traditional machine learning methods encounter a scarcity of training data, leading to overfitting due to limited information. To address this issue, this paper proposes a novel few-shot learning method for high-speed train fault diagnosis, incorporating sensor-perturbation injection and meta-confidence learning to improve detection accuracy. Experimental results demonstrate the superior performance of the proposed method, which introduces perturbations, compared to existing methods. The impact of perturbation effects and class numbers on fault detection is analyzed, confirming the effectiveness of our learning strategy.

Fault diagnosis of drone motors driven by current signal data with few samples

Multi rotor unmanned aerial vehicles (UAVs) are extensively utilized across various domains, and the motor constitutes a pivotal element in the UAV power system. The majority of UAV failures and crashes stem from motor malfunctions, underscoring the imperative need for comprehensive research on fault diagnosis in UAV motors to ensure the stable and reliable execution of flight tasks. This study focuses on quadrotor UAVs as the research subject and devises targeted fault simulation experiments based on the structural features and operational characteristics of the DC brushless motor used in quadrotor UAVs, specifically examining the stator, rotor, and bearings. To address challenges related to the UAV’s own loads, limited space for redundant parts, and the high cost and difficulty associated with installing sensors for traditional fault diagnostic signals such as vibration and temperature, this study opts to use current signals as a substitute. This approach resolves the issue of challenging data collection for UAVs and investigates a current signal based fault diagnosis method for UAV motors. Lastly, in response to the limited training samples available for fault data due to the UAV’s highly sensitive characteristics regarding the health status of its components and flight stability, traditional machine learning and deep learning methods encounter difficulties in identifying representative features with a small number of training samples, leading to the risk of overfitting and reduced model accuracy in fault diagnosis. To overcome this challenge, we propose a hybrid neural network fault diagnosis model that incorporates a width learning system and a convolutional neural network (CNN). The width learning system eliminates temporal characteristics from the original current signal, capturing more comprehensive and representative sample features in the width feature space. Subsequently, the CNN is employed for feature extraction and classification tasks. In empirical small sample fault diagnosis experiments using current signal data for UAV motors, our proposed model outperforms other models used for comparison.

Predictive Modelling of Traffic Flow with Deep Learning Techniques

This project delves into predictive modeling for traffic flow using deep learning techniques, focusing on the Metro Interstate dataset. Traffic Flow Prediction (TFP) is crucial for Intelligent Transport Systems (ITS), optimizing vehicle movement, reducing congestion, and improving route efficiency. Leveraging advancements in Artificial Intelligence (AI), Machine Learning (ML), Deep Learning (DL), and Big Data, our study explores various techniques and models for TFP. We highlight DL models' advantages over traditional ML methods, propelled by the wealth of real-time traffic data fostered by smart cities, presenting opportunities to craft robust predictive models. The core of our project revolves around developing a multi-step Recurrent Neural Network (RNN) with Long Short-Term Memory (LSTM) architecture. Our model forecasts traffic volume between Minneapolis and St. Paul, Minnesota, predicting volume two hours into the future based on a six-hour historical window. We explore DL algorithms' efficacy, including LSTM and Gated Recurrent Unit (GRU), in mitigating challenges like the vanishing gradient problem common in RNNs. Our analysis compares various NN models, emphasizing the importance of data availability for training and fine-tuning ML/DL models, with the Metro Interstate dataset serving as a crucial asset for comprehensive traffic flow analysis and model development.

Predicting compressor mass flow rate using various machine learning approaches

Abstract A major focus of the present study is to construct high-fidelity models for predicting corrected mass flow rates based on the collected compressor map data. Both traditional machine learning research and modern deep learning techniques have been employed to obtain well-fitted regression models of compressor mass flow rate. As traditional machine learning methods, Multiple Linear Regression and Random Forest, are conducted on compressor maps for prediction of corrected mass flow rate. The time series-based deep learning models are able to capture the overall trend of a given input for specific map data. Therefore, a time series-based deep learning technique, namely Gated Recurrent Unit has been employed to improve regression results. Besides, the prediction capabilities of the models, results also show that the proposed models can be used for the development of dynamic aero-thermal mathematical models of gas turbine engines and mass flow rate models created for dynamic compressors in other disciplines.

Approach to Detecting Malicious Bots in the Vkontakte Social Network and Assessing Their Parameters

The emergence of new varieties of bots in social networks and the improvement of their capabilities to imitate the natural behavior of real users represent a significant problem in the field of protection of social networks and online communities. This paper proposes a new approach to detecting and assessing the parameters of bots within the social network «VKontakte». The basis of the proposed approach is the creation of datasets using the method of «controlled purchase» of bots, which allows one to assess bots’ characteristics such as price, quality, and speed of action of bots, and using the Turing Test to assess how much users trust bots. In combination with traditional machine learning methods and features extracted from interaction graphs, text messages, and statistical distributions, it becomes possible to not only detect bots accurately but also predict their characteristics. This paper demonstrates that the trained machine learning model, based on the proposed approach, is robust to imbalanced data and can identify most types of bots as it has only a minor correlation with their main characteristics. The proposed approach can be used within the choice of countermeasures for the protection of social networks and for historical analysis, which allows not only to confirm the presence of bots but also to characterize the specifics of the attack.

Classification of Malware Images Using Fine-Tunned ViT

Malware detection and classification have become critical tasks in ensuring the security and integrity of computer systems and networks. Traditional methods of malware analysis often rely on signature-based approaches, which struggle to cope with the ever-evolving landscape of malware variants. In recent years, deep learning techniques have shown promising results in automating the process of malware classification. This paper presents a novel approach to malware image classification using the Vision Transformer (ViT) architecture. In this work, we adapt the ViT model to the domain of malware analysis by representing malware images as input tokens to the ViT architecture. To evaluate the effectiveness of the proposed approach, we used a comprehensive dataset comprising 14,226 malware samples across 26 families. We compare the performance of our ViT-based classifier with traditional machine learning methods and other deep learning architectures. Our experimental results showcase the potential of the ViT in handling malware images, achieving a classification accuracy of 98.80%. The presented approach establishes a strong foundation for further research in utilizing state-of-the-art deep learning architectures for enhanced malware analysis and detection techniques.

Comprehensive Validation on Reweighting Samples for Bias Mitigation via AIF360

Fairness Artificial Intelligence (AI) aims to identify and mitigate bias throughout the AI development process, spanning data collection, modeling, assessment, and deployment—a critical facet of establishing trustworthy AI systems. Tackling data bias through techniques like reweighting samples proves effective for promoting fairness. This paper undertakes a systematic exploration of reweighting samples for conventional Machine-Learning (ML) models, utilizing five models for binary classification on datasets such as Adult Income and COMPAS, incorporating various protected attributes. In particular, AI Fairness 360 (AIF360) from IBM, a versatile open-source library aimed at identifying and mitigating bias in machine-learning models throughout the entire AI application lifecycle, is employed as the foundation for conducting this systematic exploration. The evaluation of prediction outcomes employs five fairness metrics from AIF360, elucidating the nuanced and model-specific efficacy of reweighting samples in fostering fairness within traditional ML frameworks. Experimental results illustrate that reweighting samples effectively reduces bias in traditional ML methods for classification tasks. For instance, after reweighting samples, the balanced accuracy of Decision Tree (DT) improves to 100%, and its bias, as measured by fairness metrics such as Average Odds Difference (AOD), Equal Opportunity Difference (EOD), and Theil Index (TI), is mitigated to 0. However, reweighting samples does not effectively enhance the fairness performance of K Nearest Neighbor (KNN). This sheds light on the intricate dynamics of bias, underscoring the complexity involved in achieving fairness across different models and scenarios.

Automatic Maize Leaf Disease Recognition Using Deep Learning

Maize leaf diseases exhibit visible symptoms and are currently diagnosed by expert pathologists through personal observation, but the slow manual detection methods and pathologist's skill influence make it challenging to identify diseases in maize leaves. Therefore, computer-aided diagnostic systems offer a promising solution for disease detection issues. While traditional machine learning methods require perfect manual feature extraction for image classification, deep learning networks extract image features autonomously and function without pre-processing. This study proposes using the EfficientNet deep learning model for the classification of maize leaf diseases and compares it with another established deep learning model. The maize leaf disease dataset was used to train all models, with 4188 images for the original dataset and 6176 images for the augmented dataset. The EfficientNet B6 model achieved 98.10% accuracy on the original dataset, while the EfficientNet B3 model achieved the highest accuracy of 99.66% on the augmented dataset.

Analyse the Enhancement of Sentiment Analysis in Arabic by doing a Comparative Study of Several Machine Learning Techniques

Abstract: Sentiment analysis is a crucial component of natural language processing that seeks to determine the emotional sentiment expressed in a given text. This study investigates sentiment analysis in the Arabic language through a comprehensive approach that integrates traditional machine learning methods with sophisticated deep learning models. We examine the efficacy of conventional algorithms such as Support Vector Machines (SVM) and Naive Bayes, as well as sophisticated neural network architectures such as Convolutional Neural Networks (CNNs), Long Short-Term Memory networks (LSTMs), and the Arabic variant of Bidirectional Encoder Representations from Transformers (BERT). The primary novelty of our approach is in the ensemble method, which combines many approaches to enhance the precision of sentiment categorization in Arabic text. To address the particular challenges presented by Arabic sentiment analysis, such as the intricate structure of the language and the diverse regional variations, we utilize a tailored preprocessing pipeline to effectively handle the nuances of Arabic text. Our comprehensive analysis of various datasets demonstrates that the ensemble technique outperforms individual model benchmarks and offers novel insights into the interplay between different machine learning paradigms in Arabic NLP. The results emphasize the ability of hybrid approaches to improve Arabic sentiment analysis, providing a solid basis for future research and practical applications in understanding the sentiments of Arabic consumers. This study is a significant addition to the expanding domain of Arabic Natural Language Processing (NLP). This resource offers a comprehensive and advanced methodology for utilizing machine learning and deep learning methods to comprehend and analyse the intricate aspects of sentiment in the Arabic language

Interpretable machine learning for creditor recovery rates

Machine learning methods have achieved great success in modeling complex patterns in finance such as asset pricing and credit risk that enable them to outperform statistical models. In addition to the predictive accuracy of machine learning methods, the ability to interpret what a model has learned is crucial in the finance industry. We address this challenge by adapting interpretable machine learning to the context of corporate bond recovery rate modeling. In addition to the best performance, we show the value of interpretable machine learning by finding drivers of recovery rates and their relationship that cannot be discovered by the use of traditional machine learning methods. Our findings are financially meaningful and consistent with the findings in the existing credit risk literature.

Bidirectional machine learning-assisted sensitivity-based stochastic searching approach for groundwater DNAPL source characterization.

In this study, we designed a machine learning-based parallel global searching method using the Bayesian inversion framework for efficient identification of dense non-aqueous phase liquid (DNAPL) source characteristics and contaminant transport parameters in groundwater. Swarm intelligence organized hybrid-kernel extreme learning machine (SIO-HKELM) was proposed to approximate the forward and inverse input-output correlation with a high accuracy using the DNAPL transport numerical simulation model. An adaptive inverse-HKELM was established for preliminary estimation of the source characteristics and contaminant transport parameters to correct prior information and generate high-quality initial starting points of parallel searching. A local accurate forward-HKELM surrogate of the numerical model was embedded in the searching system for avoiding repetitive CPU-demanding likelihood evaluations. A sensitivity-based Metropolis criterion (MC), incorporating the dynamic particle swarm optimization (SD-PSO) algorithm, was developed for improving the search ergodicity and realizing precise inversion of all the unknown variables with drastic variations in sensitivity to the likelihood function. Results showed that the generalization capability and robustness of SIO-HKELM were superior to those of the traditional machine learning methods, including KELM and support vector regression (SVR), and it sufficiently approximated the forward and inverse input-output mapping of the numerical model with testing determination coefficients of 0.9944 and 0.6440, respectively. With high-quality prior information and initial starting points generated by the adaptive inverse-HKELM feed approach, the uncertainty in the inversion outputs was reduced, and the searching process rapidly converged to reasonable posterior distributions in around 60 iterations. Compared with the widely used multichain Markov chain Monte Carlo (MCMC) approach, the parallel searching lines generated by SD-PSO-MC adequately covered the searching space, and the "equifinality" effect was more effectively restrained by reducing the relative errors of all the point estimations to less than 8%. Therefore, the real source information reflected by the statistical characteristics of the SD-PSO-MC inversion outputs was more precise than that obtained using the multichain MCMC approach.

PBAC: A pathway-based attention convolution neural network for predicting clinical drug treatment responses.

Precise and personalized drug application is crucial in the clinical treatment of complex diseases. Although neural networks offer a new approach to improving drug strategies, their internal structure is difficult to interpret. Here, we propose PBAC (Pathway-Based Attention Convolution neural network), which integrates a deep learning framework and attention mechanism to address the complex biological pathway information, thereby provide a biology function-based robust drug responsiveness prediction model. PBAC has four layers: gene-pathway layer, attention layer, convolution layer and fully connected layer. PBAC improves the performance of predicting drug responsiveness by focusing on important pathways, helping us understand the mechanism of drug action in diseases. We validated the PBAC model using data from four chemotherapy drugs (Bortezomib, Cisplatin, Docetaxel and Paclitaxel) and 11 immunotherapy datasets. In the majority of datasets, PBAC exhibits superior performance compared to traditional machine learning methods and other research approaches (area under curve = 0.81, the area under the precision-recall curve = 0.73). Using PBAC attention layer output, we identified some pathways as potential core cancer regulators, providing good interpretability for drug treatment prediction. In summary, we presented PBAC, a powerful tool to predict drug responsiveness based on the biology pathway information and explore the potential cancer-driving pathways.

Exhaustive Study into Machine Learning and Deep Learning Methods for Multilingual Cyberbullying Detection in Bangla and Chittagonian Texts

Cyberbullying is a serious problem in online communication. It is important to find effective ways to detect cyberbullying content to make online environments safer. In this paper, we investigated the identification of cyberbullying contents from the Bangla and Chittagonian languages, which are both low-resource languages, with the latter being an extremely low-resource language. In the study, we used both traditional baseline machine learning methods, as well as a wide suite of deep learning methods especially focusing on hybrid networks and transformer-based multilingual models. For the data, we collected over 5000 both Bangla and Chittagonian text samples from social media. Krippendorff’s alpha and Cohen’s kappa were used to measure the reliability of the dataset annotations. Traditional machine learning methods used in this research achieved accuracies ranging from 0.63 to 0.711, with SVM emerging as the top performer. Furthermore, employing ensemble models such as Bagging with 0.70 accuracy, Boosting with 0.69 accuracy, and Voting with 0.72 accuracy yielded promising results. In contrast, deep learning models, notably CNN, achieved accuracies ranging from 0.69 to 0.811, thus outperforming traditional ML approaches, with CNN exhibiting the highest accuracy. We also proposed a series of hybrid network-based models, including BiLSTM+GRU with an accuracy of 0.799, CNN+LSTM with 0.801 accuracy, CNN+BiLSTM with 0.78 accuracy, and CNN+GRU with 0.804 accuracy. Notably, the most complex model, (CNN+LSTM)+BiLSTM, attained an accuracy of 0.82, thus showcasing the efficacy of hybrid architectures. Furthermore, we explored transformer-based models, such as XLM-Roberta with 0.841 accuracy, Bangla BERT with 0.822 accuracy, Multilingual BERT with 0.821 accuracy, BERT with 0.82 accuracy, and Bangla ELECTRA with 0.785 accuracy, which showed significantly enhanced accuracy levels. Our analysis demonstrates that deep learning methods can be highly effective in addressing the pervasive issue of cyberbullying in several different linguistic contexts. We show that transformer models can efficiently circumvent the language dependence problem that plagues conventional transfer learning methods. Our findings suggest that hybrid approaches and transformer-based embeddings can effectively tackle the problem of cyberbullying across online platforms.

Building recognition and classification using deep learning in civil engineering projects

The recognition and regulation of buildings are essential aspects of urban management to prevent illegal constructions and maintain public safety and resources. Traditional machine learning methods for building recognition often suffer from low accuracy and weak generalization capabilities due to their reliance on manually designed features. Traditional machine learning methods for building recognition often suffer from low accuracy and weak generalization capabilities due to their reliance on manually designed features. Therefore, the study of automatic, accurate building identification method is very necessary. Based on this, Introducing advanced algorithms like Faster R-CNN and DRNet signifies a significant step towards automating accurate building identification. The utilization of Faster R-CNN as a basic training model combined with DRNet demonstrates promising results in accurately recognizing buildings. The experimental analysis highlights the potential of the proposed method, achieving an impressive 82.1% mean Average Precision (mAP) for landmark buildings. Accurate prediction of building coordinates further strengthens the effectiveness of the proposed approach. Comparative analysis showcases the superiority of the proposed model in recognizing buildings not only in normal images but also in complex environmental settings. The successful implementation of advanced algorithms in building recognition contributes to more efficient urban management and development. Continued research in automatic building identification methods is crucial for addressing challenges in urban planning and management, ensuring sustainable city development.