Defect Prediction Models Research Articles

Enhancing software defect prediction models using metaheuristics with a learning to rank approach

Enhancing software defect prediction models using metaheuristics with a learning to rank approach

Relationships Between Chemical Compounds and Sensory Properties of Virgin Olive Oil in the US and Israel: Development of a Prediction Model for Defects.

Virgin olive oil (VOO) quality is defined by both chemical and sensory parameters. While the chemical parameters are objective and measured using instrument-based methods, sensory quality evaluation is based upon human panels, which can be subjective, have less repeatability, suffer from fatigue, and require long and costly training. Tasting biases could be minimized by a trained panel, but using humans as a testing instrument is inevitably prone to various psychological biases, stimulus-related factors, and carry-over effects. The objectives of this study were to evaluate instrumental methodologies that will assist the existing human panel in assessing the sensory characteristics of VOO and to develop chemistry-based predicting models for sensory properties in the oil using VOO samples originating from the US and Israel. Our results indicated that oil rancidity highly correlated with the contents of chemical components contents; 1-penten-3-one, 3-hexen-1-ol, (E)-2-pentanal, and 1-octen-3-ol are the major volatiles associated with rancidity defects (low concentrations of these compounds). Positive sensory attributes, such as fruitiness, correlated with 1- acetoxypinoresinol and hexanal, while bitterness correlated with pinoresinol, the aldehydic form of oleuropein aglycones, and the dialdehydic form of oleuropein aglycone. The random forest model suggested that luteolin, (E)-2-hexenal, 1-penten-3-one, and C18:0 are the most useful measurements in predicting the occurrence of sensory defects in the olive oil samples included. In other words, when these compounds are below or above a certain threshold, a defect, such as rancidity, is more likely to be found by the sensory panel.

Intelligent Monitoring of Thermodynamic Parameters in Compressor Operations and Development of a Fault Prediction Model Using Deep Learning

Intelligent Monitoring of Thermodynamic Parameters in Compressor Operations and Development of a Fault Prediction Model Using Deep Learning

Hardware automatic test scheme and intelligent analyze application based on machine learning model

Abstract Hardware testing has always been the core of hardware development, and improving the performance and efficiency of hardware testing is very important for hardware development. Because hardware quality management is insufficient, many large hardware tools were developed using manual workshop technology in the past and could hardly be maintained. This can lead to the cancellation of the project, causing major personnel and property losses. Improving hardware quality and ensuring security are very complex problems. Hardware testing is usually conducted through manual and automatic testing, and the limitations of manual testing are increasingly obvious. So hardware automatic testing technology has attracted people’s attention in recent years. It has become an important research direction in the field hardware testing and can overcome many problems of traditional testing methods. Strict test rules, based on standards and scores, provide a fully automated test process. With the continuous improvement of network technology, the functions and scope of hardware are constantly enriched and expanded. With the acceleration of hardware updates and development, this has brought a heavy burden to the previous hardware testing work. The purpose of this article was to study the application of machine learning technology in the field of hardware automatic testing and provide an appropriate theoretical basis for optimizing testing methods. This article introduced the research methods of hardware automatic testing technology, introduced three automatic testing framework models, and summarized the application of machine learning in hardware testing. It included hardware security and reliability analysis, hardware defect prediction, and source-based research. Then, this article studied the defect prediction model and machine learning algorithm and constructed a hardware defect prediction model based on machine learning based on the theory. First, the data were preprocessed, and then, the Stacking method was used to build a comprehensive prediction model, and four prediction results evaluation indicators were established. In the experiment part, the defect prediction results of the hardware automatic test model were studied. The results showed that the hardware defect prediction model based on machine learning had higher accuracy, recall rate, F_measure and area under curve. Compared with other models, the average accuracy of the hardware defect prediction model in this article was 0.092 higher, which was more suitable for automatic hardware testing and analysis.

Power equipment defect prediction based on time series knowledge graph

With the increasing scale of power facilities, the operation monitoring of power equipment has become an important part of power system management. Defect prediction of power equipment is a key step in power system operation monitoring. In order to solve the problem of defect prediction of power equipment in large-scale power systems, this paper proposes a power equipment defect prediction model based on time series knowledge graph in combination with artificial intelligence technology. Multimodal information is fused through the attention mechanism, and then the time series representation of entities and relations is obtained by using the relationship-aware graph neural network and recurrent neural network. Finally, the defects of power equipment are predicted based on the time series representation. The method proposed in this paper can make full use of multimodal information and improve the accuracy of power equipment defect prediction. Experiments show that the performance of the model proposed in this paper is better than that of the baseline model.

An Empirical Study of the Impact of Class Overlap on the Performance and Interpretability of Cross-Version Defect Prediction

The class overlap problem refers to instances from different categories heavily overlapping in the feature space. This issue is one of the challenges in improving the performance of software defect prediction (SDP). Currently, the studies on the impact of class overlap on SDP mainly focused on within-project defect prediction and cross-project defect prediction. Moreover, the existing class overlap instances cleaning methods are not suitable for cross-version defect prediction. In this paper, we propose a class overlap instances cleaning method based on the Ratio of K-nearest neighbors with the Same Label (RKSL). This method removes instances with the abnormal neighbor ratio in the training set. Based on the RKSL method, we investigate the impact of class overlap on the performance and interpretability of the cross-version defect prediction model. The experiment results show that class overlap can affect the performance of cross-version defect prediction models significantly. The RKSL method can handle the class overlap problem in defect datasets, but it may impact the interpretability of models. Through the analysis of feature changes, we consider that class overlap instances cleaning can assist models in identifying more important features.

A hybrid‐ensemble model for software defect prediction for balanced and imbalanced datasets using AI‐based techniques with feature preservation: SMERKP‐XGB

AbstractMaintaining software quality is a significant challenge as the complexity of software is increasing with the rise of the software industry. Software defects are a primary concern in complex modules, and predicting them in the early stages of the software development life cycle (SDLC) is difficult. Previous techniques to address this issue have not been very promising. We have proposed “A hybrid ensemble model for software defect prediction using AI‐based techniques with feature preservation” to overcome this problem. We have used the National Aeronautics and Space Administration (NASA) dataset from the PROMISE repository for testing and validation. By applying exploratory data analysis (EDA), feature engineering, scaling, and standardization, we found that the dataset is imbalanced, which can negatively affect the model's performance. To address this, we have used the Synthetic Minority Oversampling (SMOTE) technique and the edited nearest neighbor (ENN) (SMOTE‐ENN). We have also used recursive feature elimination cross‐validation (RFE‐CV) with a pipeline to prevent data leaking in CV and kernel‐based principal component analysis (K‐PCA) to minimize dimensionality and selectively relevant features. The reduced dimensional data is then given to the eXtreme Gradient Boosting (XGBoost) for classification, resulting in the hybrid‐ensemble (SMERKP‐XGB) model. The proposed SMERKP‐XGB model is better than previously developed models in terms of accuracy (CM1: 97.53%, PC1: 92.05%, and PC2: 97.45%, KC1:95.65%), and area under the receiver operating characteristic curve values (CM1:96.30%, PC1:98.30%, and PC2:99.30%: KC1: 93.54) and other evaluation criteria mentioned in the literature.

Pantograph fault prediction of urban rail transit vehicles based on edge feature extraction and detection

Nowadays, as an indispensable part of urban infrastructure, urban rail transit (URT) vehicles have also developed rapidly. A large amount of manpower, material resources, and financial resources need to be invested in the construction process of URT. For URT vehicles, research on more accurate fault prediction methods can save a lot of maintenance costs and improve the reliability of URT construction. As an important electrical equipment for urban rail transit vehicles to obtain electric energy from the catenary, the operation of rail transit vehicles puts forward higher performance requirements for the pantograph. For solving the problems of low accuracy of fault prediction, over reliance on practical experience and high cost of fault prediction in the application of traditional URT vehicle pantograph fault prediction model. Combining sensor network and artificial intelligence algorithm, this paper analyzed the traditional rail transit vehicle pantograph fault prediction model, and verified it through comparative experiments. Through the comparative analysis of the experimental results, this paper can draw a conclusion that compared with the traditional rail transit vehicle pantograph fault prediction model, the rail transit vehicle pantograph fault prediction model has higher fault prediction accuracy, less model response time, lower risk of pantograph failure, higher model application satisfaction, and the accuracy of fault prediction increased by about 6.6%. The rail transit vehicle pantograph fault prediction model can effectively improve the accuracy of vehicle pantograph fault prediction, which can greatly promote the safety of URT and promote the intelligent process of URT.

Research on Fault Prediction and Diagnosis of Mechanical and Electrical Equipment in Construction Machinery based on Big Data Technology

This article aims to explore how to use big data technology for fault prediction and diagnosis of mechanical and electrical equipment in construction machinery. Through steps such as data collection and storage, data feature extraction and selection, and data analysis and processing, a fault prediction and diagnosis model is constructed to achieve real-time monitoring and early warning. The accuracy and efficiency of fault prediction are improved through decision feedback and algorithm optimization.

A holistic approach to software fault prediction with dynamic classification

Software Fault Prediction is a critical domain in machine learning aimed at pre-emptively identifying and mitigating software faults. This study addresses challenges related to imbalanced datasets and feature selection, significantly enhancing the effectiveness of fault prediction models. We mitigate class imbalance in the Unified Dataset using the Random-Over Sampling technique, resulting in superior accuracy for minority-class predictions. Additionally, we employ the innovative Ant-Colony Optimization algorithm (ACO) for feature selection, extracting pertinent features to amplify model performance. Recognizing the limitations of individual machine learning models, we introduce the Dynamic Classifier, a ground-breaking ensemble that combines predictions from multiple algorithms, elevating fault prediction precision. Model parameters are fine-tuned using the Grid-Search Method, achieving an accuracy of 94.129% and superior overall performance compared to random forest, decision tree and other standard machine learning algorithms. The core contribution of this study lies in the comparative analysis, pitting our Dynamic Classifier against Standard Algorithms using diverse performance metrics. The results unequivocally establish the Dynamic Classifier as a frontrunner, highlighting its prowess in fault prediction. In conclusion, this research introduces a comprehensive and innovative approach to software fault prediction. It pioneers the resolution of class imbalance, employs cutting-edge feature selection, and introduces dynamic ensemble classifiers. The proposed methodology, showcasing a significant advancement in performance over existing methods, illuminates the path toward developing more accurate and efficient fault prediction models.

Fault diagnosis and intelligent maintenance of industry 4.0 power system based on internet of things technology and thermal energy optimization

The application of Internet of Things technology provides a new opportunity for the fault diagnosis and maintenance of power system. This study aims to explore how to improve the fault diagnosis ability of power system through Internet of Things technology, and realize the efficient utilization of heat energy, so as to achieve the goal of intelligent maintenance. Based on the analysis of current power system operation status, this paper determines the key role of thermal energy management in improving system operation efficiency and reducing energy consumption. It then uses iot sensors and data analytics to monitor heat flow and loss in the power system in real time, identifying potential points of failure through big data. In order to realize intelligent maintenance, this paper designs a fault prediction model based on thermal energy optimization, combined with machine learning algorithm, to further improve the accuracy of fault diagnosis. The experimental results show that the fault diagnosis method combined with the Internet of Things technology can significantly reduce the fault incidence and optimize the efficiency of heat energy use. By applying this model, the overall operating cost of the power system is reduced and the maintenance efficiency is improved.

Review of imbalanced fault diagnosis technology based on generative adversarial networks

Abstract In the field of industrial production, machine failures not only negatively affect productivity and product quality, but also lead to safety accidents, so it is crucial to accurately diagnose machine failures in time and take appropriate measures. However, machines cannot operate with faults for extended periods, and the diversity of fault modes results in limited data collection, posing challenges to building accurate fault prediction models. Despite recent advancements, intelligent fault diagnosis methods based on traditional sampling and machine learning have shown notable progress. Nonetheless, these methods heavily rely on human expertise, making it challenging to extract comprehensive feature information. To address these challenges, numerous imbalance fault diagnosis methods based on generative adversarial networks (GANs) have emerged, GANs can generate realistic samples that conform to the distribution of the original data, showing promising results in diagnosing imbalances in critical components such as bearings and gears, despite their great potential, GAN methods also face challenges, including difficulties in training and generating abnormal samples. However, whether it is GAN-based resampling technology or traditional sampling technology, there are fewer reviews on noise-containing imbalance, intra- and inter-class dual imbalance, multi-class imbalance, time series imbalance and other problems in small samples, and there is a lack of a more comprehensive summary of the solutions to the above imbalance problems. Therefore, the purpose of this paper is to deeply explore the imbalance problems under various failure modes, and review and analyze the research methods and results based on GANs on this basis. By suggesting future research directions, this paper aims to provide guidance and reference for research in the field of industrial production maintenance.

A Formal Explainer for Just-In-Time Defect Predictions

Just-in-Tim e (JIT) defect prediction has been proposed to help teams prioritize the limited resources on the most risky commits (or pull requests), yet it remains largely a black box, whose predictions are not explainable or actionable to practitioners. Thus, prior studies have applied various model-agnostic techniques to explain the predictions of JIT models. Yet, explanations generated from existing model-agnostic techniques are still not formally sound, robust, and actionable. In this article, we propose FoX , a Fo rmal e X plainer for JIT Defect Prediction, which builds on formal reasoning about the behavior of JIT defect prediction models and hence is able to provide provably correct explanations, which are additionally guaranteed to be minimal. Our experimental results show that FoX is able to efficiently generate provably correct, robust, and actionable explanations, while existing model-agnostic techniques cannot. Our survey study with 54 software practitioners provides valuable insights into the usefulness and trustworthiness of our FoX approach; 86% of participants agreed that our approach is useful, while 74% of participants found it trustworthy. Thus, this article serves as an important stepping stone towards trustable explanations for JIT models to help domain experts and practitioners better understand why a commit is predicted as defective and what to do to mitigate the risk.

Improving Software Defect Prediction With a Combination of Feature Selection Based On Ant Colony Optimization and Ensemble Technique

Software defect prediction plays a vital role in enhancing software quality and minimizing maintenance costs. This study aims to improve software defect prediction by employing a combination of Ant Colony Optimization (ACO) for feature selection and ensemble techniques, particularly Gradient Boosting. The research utilizes three NASA MDP datasets: MC1, KC1, and PC2, to evaluate the performance of four machine learning algorithms: Random Forest, Support Vector Machine (SVM), Decision Tree, and Naïve Bayes. Data preprocessing involved handling class imbalances using the SMOTE technique and transforming categorical data into numerical representations. The results indicate that the integration of ACO and Gradient Boosting significantly enhances the accuracy of all four algorithms. Notably, the Random Forest algorithm achieved the highest accuracy of 99% on the MC1 dataset. The findings suggest that combining ACO-based feature selection with ensemble techniques can effectively boost the performance of software defect prediction models, offering a robust approach for early detection of potential softwaredefects and contributing to improved software reliability and efficiency.

Defect monitoring method for Al-CFRTP UFSW based on BWO–VMD–HHT and ResNet

Underwater friction stir welding (UFSW) achieves reliable joining between dissimilar materials and meets the welding demand for function and properties in lightweight structures of modern engineering. A defect monitoring method based on Variational Mode Decomposition optimized by Beluga Whale Optimization and Hilbert–Huang Transform (BWO–VMD–HHT) is proposed to solve the unclear feature of AE signal in UFSW due to the aqueous medium. UFSW experiments on Al alloy and carbon fiber reinforced thermoplastic (CFRTP) are carried out with AE signals measured. The time–frequency domain features of AE signals are extracted by BWO–VMD–HHT. The experimental results show that the main frequency of the AE signal is 22.5 kHz, and surface crack defects, shallow hole defects, and deep hole defects are accompanied by the transfer phenomena of different frequency components. Then, the feature vectors are built by frequency components in the BWO–VMD–HHT spectrum and reduced by principal component analysis, including 22.5 kHz, 24 kHz, 20.6 kHz, 18.4 kHz, 17.3 kHz, and 15.6 kHz. The feature vectors are divided into the train and test sets, and the welding defect prediction model (ResNet18-attention) is built by ResNet18 and trained by feature vectors. In the test set, the ResNet18-attention is compared with the BP, SVM, and RBF. Test results show that the precision of models has improved by at least 10%, which are trained by BWO–VMD–HHT features vector. Also, ResNet18-attention has achieved an average precision of 0.906 and recognizes the category of weld defect accurately, and this method can be applied to the defect monitoring of UFSW.

CfExplainer: Explainable just-in-time defect prediction based on counterfactuals

Just-in-time (JIT) defect prediction helps rationally allocate testing resources and reduce testing costs. However, most JIT defect prediction models lack explainability, which significantly affects their credibility. Recently, the local interpretable model-agnostic explanations (LIME) method has been used widely in model-explainable research, and many improved LIME-based methods have been proposed. However, problems with respect to explanation effectiveness and reliability remain, which seriously affects the practical use of LIME. To address this problem, CfExplainer, a local rule-based model-agnostic approach, is proposed. The approach first applies counterfactuals to generate synthetic instances. It then mines weighted class association rules based on synthetic instances, and it optimises the process of generating, ranking, pruning, and predicting the class association rules. Next, it employs the rules with the highest priority to explain the prediction results of the model. Experiments were conducted using the public datasets employed in related studies. Compared to other state-of-the-art methods, in terms of explanation effectiveness, CfExplainer's instance similarity improves by 26.5 %-31.2 %, and local model fittness improves by 2.0 %-3.5 %, 2.3 %-3 %, and 0.7 %-7.5 % on the AUC, F1-score, and Popt metrics, respectively. In terms of the reliability of the explanation, explanations that are 2.6 %-4.7 % more unique and 2.5 %-5.9 % more consistent with the actual characteristics of defect-introducing commits than other state-of-the-art methods. Thus, the explanations of the proposed approach can enhance the model credibility and help guide developers in fixing defects and reducing the risk of introducing them.

Unveiling the impact of unchanged modules across versions on the evaluation of within‐project defect prediction models

Unveiling the impact of unchanged modules across versions on the evaluation of within‐project defect prediction models

Implementation of Chernobyl optimization algorithm based feature selection approach to predict software defects

Background Software defects can have catastrophic consequences. Therefore, fixing these defects is crucial for the evolution of software. Software Defect Prediction (SDP) enables developers to investigate unscramble faults in the inaugural parts of the software progression mechanism. However, SDP faces many challenges, including the high magnitude of attributes in the datasets, which can degrade the prognostic performance of a defect forecasting model. Feature selection (FS), a compelling instrument for overcoming high dimensionality, selects only the relevant and best features while carefully discarding others. Over the years, several meta-heuristic algorithms such as the Genetic Algorithm (GA), Particle Swarm Optimization (PSO), Differential Evolution (DE), and Ant Colony Optimization (ACO) have been used to develop defect prediction models. However, these models suffer from several drawbacks, such as high cost, local optima trap, lower convergence rate, and higher parameter tuning. To overcome the above shortcomings, this study aims to develop an innovative FS technique, namely, the Chernobyl Optimization Algorithm (FSCOA), to unwrap the most informative features that can produce a precise prediction model while minimizing errors. Methods The proposed FSCOA approach mimicked the process of nuclear radiation while attacking humans after an explosion. The proposed FSCOA approach was combined with four widely used classifiers, namely Decision Tree (DT), K-nearest neighbor (KNN), Naive Bayes (NB), and Quantitative Discriminant Analysis (QDA), to determine the finest attributes from the SDP datasets. Furthermore, the accuracy of the recommended FSCOA method is correlated with existing FS techniques, such as FSDE, FSPSO, FSACO, and FSGA. The statistical merit of the proposed measure was verified using Friedman and Holm tests. Results The experimental findings showed that the proposed FSCOA approach yielded the best accuracy in most cases and achieved an average rank of 1.75, followed by the other studied FS approaches. Furthermore, the Holm test showed that the p-value was lower than or equivalent to the value of α/(A-i), except for the FSCOA and FSGA and FSCOA and FSACO models. Conclusion The experimental findings showed that the prospective FSCOA procedure eclipsed alternative FS techniques with higher accuracy in almost all cases while selecting optimal features.

FSBOA: feature selection using bat optimization algorithm for software fault detection

Feature selection (FS) plays a crucial role in software fault prediction (SFP), aiming to identify a subset of relevant and discriminative features from a large pool of software metrics. It serves as a critical preprocessing step in building accurate fault prediction models, enabling the identification of potential software faults early in the development life cycle and facilitating effective resource allocation for testing and maintenance activities. The study's objective is to determine how well the bat optimization algorithm (BOA) can extract the features that are most important for correctly predicting software flaws, improve the accuracy of fault prediction, reduce the dimensionality of the feature space, and mitigate the risk of overfitting, thereby enabling more effective resource utilization and better allocation of testing efforts. The forecasting models underwent testing and training utilizing a collection of software metrics, with the datasets undergoing evaluation using several different FS algorithms. An assessment was conducted by contrasting the effectiveness of multiple optimization algorithms, including evolutionary methods such as FS employing genetic algorithm (FSGA), FS employing differential evolution (FSDE), and swarm-based techniques such as FS employing ant colony optimization (FSACO), FS employing particle swarm optimization (FSPSO), FS employing firefly algorithm (FSFA), and FS employing binary grey wolf optimization algorithm (FSBGWO) in relation to FS employing bat optimization algorithm (FSBAO). The results obtained from FSBAO approach demonstrate the effectiveness in solving FS optimization problems with at most accuracy of 98.92%. Furthermore, the experimental results have been statistically validated for the greater efficiency of the proposed FSBAO algorithm. This study's findings have crucial implications for developing a software failure prediction models that is more accurate and efficient.

Semantic and traditional feature fusion for software defect prediction using hybrid deep learning model

Software defect prediction aims to find a reliable method for predicting defects in a particular software project and assisting software engineers in allocating limited resources to release high-quality software products. While most earlier research has concentrated on employing traditional features, current methodologies are increasingly directed toward extracting semantic features from source code. Traditional features often fall short in identifying semantic differences within programs, differences that are essential for the development of reliable and effective prediction models. In contrast, semantic features cannot present statistical metrics about the source code, such as the code size and complexity. Thus, using only one kind of feature negatively affects prediction performance. To bridge the gap between the traditional and semantic features, we propose a novel defect prediction model that integrates traditional and semantic features using a hybrid deep learning approach to address this limitation. Specifically, our model employs a hybrid CNN-MLP classifier: the convolutional neural network (CNN) processes semantic features extracted from projects’ abstract syntax trees (ASTs) using Word2vec. In contrast, the traditional features extracted from the dataset repository are processed by a multilayer perceptron (MLP). Outputs of CNN and MLP are then integrated and fed into a fully connected layer for defect prediction. Extensive experiments are conducted on various open-source projects to validate CNN-MLP’s effectiveness. Experimental results indicate that CNN-MLP can significantly enhance defect prediction performance. Furthermore, CNN-MLP’s improvements outperform existing methods in non-effort-aware and effort-aware cases.