Software Reliability Growth Models Research Articles

Understanding the Impact of Changes in Application Characteristics on SRGM

Due to the increasing reliance on technology in nearly every industry over the past three decades, it has become necessary to evaluate the performance of a software product prior to its formal release in the market. The properties of a software application, such as its complexity and lines of code, are subject to change over time as a result of factors namely the testing environment, allocation of resources, testing efficiency, and testing team’s expertise. The assumption of constant Fault Detection Rate (FDR) may not accurately anticipate the potential number of bugs correctly. Keeping all these considerations in mind, a framework is developed to incorporate change point in the development of a testing effort-based Software Reliability Growth Model (SRGM) that takes into account the effect of application characteristics under both perfect and imperfect debugging settings. In addition, these outcomes are compared to the model without a change point. The proposed model is validated on two real-life software fault datasets. The results demonstrate that the proposed model performs better than the model without a change point.

A Method of Reliability Assessment Based on Trend Analysis for Open Source Software

Software reliability growth model (SRGM) is used as one of the reliability assessment methods to assess the software reliability. In SRGM, the degree of reliability growth may fluctuate greatly according to change in the internal state of the software. It is called the change point (CP). Several researchers proposed the SRGM considering CP. In the open source software (OSS), there are many projects that continue development even after the software is released. Therefore, major updates with breaking changes may occur in it. The major updates can be a factor that causes a CP because it greatly changes the internal state of the OSS. This paper focuses on the relationship between CP and software updates. We collect OSS fault data from a bug tracking system. Moreover, we examine the behavior of SRGM before and after software updates. Furthermore, we discuss the applicability of SRGM for CP in OSS. Also, we compare the proposed model based on CP with the model without CP. As a result, we have confirmed that the SRGM can evaluate the reliability in the environment with major updates. Moreover, the proposed method performs better than without considering CP model. Especially, the exponential model’s mean value function is the suitable method to assess the OSS reliability for the proposed method.

Developing an innovative Imperfect Debugging Software Reliability Growth Model with enhanced Testing Coverage strategies

Developing an innovative Imperfect Debugging Software Reliability Growth Model with enhanced Testing Coverage strategies

Optimizing software reliability growth models through simulated annealing algorithm: parameters estimation and performance analysis

Optimizing software reliability growth models through simulated annealing algorithm: parameters estimation and performance analysis

An Approach to Study Bugs Infusion-Based Modeling and Optimal Release Time for Open-Source Software

The Concept of bugs’ infusion has been a very prominent area of research concerning Software Reliability Growth Modeling. The literature is evidence of some very useful proposals concerning this domain in terms of dealing with these issues based on error generation. However, whenever this topic is touched, researchers have considered a constant rate of error generation. In this work, authors have utilized two forms of bug infusions in the code. Furthermore, by using an MCDM technique of MAUT, the release time of the software under consideration has been determined. Results provide a satisfactory orientation for using the proposed models based on the infusion of bugs/errors and obtaining optimal release time.

An updated software reliability model using the shanker model and failure data

AbstractSoftware developers' goal is to develop reliable and superior software. Due to the fact that software errors frequently generate large societal or financial losses, software reliability is essential. Software reliability growth models are a widely used technique for software reliability assessment. This study examines various nonhomogeneous Poisson process models with the newly developed software reliability distribution and evaluates the unknown model parameters based on frequentist and Bayesian methods of estimation. Finally, we conduct evaluations on real datasets using a variety of evaluation criteria to compare the results of previous software reliability growth models and show how the proposed model may be applied under both approaches in a practical setting. According to this study, the innovative model's mean square error, R2, , bias, predicted relative variation, Theil statistic, and mean error of prediction values show the lowest values under the Bayesian approach for data sets II to IV, and both approaches perform well for data set I. These implementation findings demonstrate the effectiveness of our specific approach based on our examination of failure data.

Software testing and release decision at different statistical confidence levels with consideration of debuggers’ learning and negligent factors

This research delves into the software testing process and its environmental factors to uncover the core elements influencing software reliability. Specifically, it focuses on the learning and negligent aspects of the software reliability growth model. The learning factor accelerates reliability growth, leading to an S-shaped curve in the mean value function, while the negligent factor highlights the occurrence of imperfect debugging. The study also uses Brownian motion and stochastic differential equations to establish statistical confidence intervals for reliability and costs. These intervals aid software managers in assessing potential release risks at various confidence levels, allowing them to make informed decisions considering resource constraints and desired system reliability levels across different scenarios.

OSS Sustainability Assessment Based on the Deep Learning Considering Effort Wiener Process Data

This paper focuses on the sustainability based on the effort by using the fault big data of open source software (OSS). The fault detection phenomenon depends on the maintenance effort, because the number of software fault is influenced by the effort expenditure. Actually, the software reliability growth models with testing-effort have been proposed in the past. In this paper, we apply the deep learning approach to the OSS fault big data. Also, we propose the reliability assessment measure of sustainability. Then, we show several sustainability assessment measure based on the deep learning. Moreover, several numerical illustrations based on the proposed deep learning model are shown in this paper.

A Software Testing Workflow Analysis Tool Based on the ADCV Method

Based on two progressive aspects of the modeling problems in business process management (BPM), (1) in order to address the increasing complexity of user requirements on workflows underlying various BPM application scenarios, a more verifiable fundamental modeling method must be invented; (2) to address the diversification of software testing processes, more formalized advanced modeling technology must also be applied based on the fundamental modeling method. Aiming to address these modeling problems, this paper first proposes an ADCV (acquisition, decomposition, combination, and verification) method that runs through the core management links of four types of business processes (mining, decomposition, recombination, and verification) and then describes the compositional structure of the ADCV method and the design of corresponding algorithms. Then, the software testing workflow is managed and monitored using the method, and the corresponding analysis tool is implemented based on Petri nets. At the same time, the tool is applied to the case processing of the software testing workflow. Specifically, the workflow models are established successively through ADCV during the process of business iteration. Then, the analysis tool developed with the ADCV method, the model–view–controller (MVC) design pattern, and Java Swing technology are applied to instances of the software testing workflow to realize the modeling and management of the testing processes. Thus, the analysis tool can guarantee the accuracy of the parameter estimations of related software reliability growth models (SRGMs) and ultimately improve the quality of software products.

Change point software belief reliability growth model considering epistemic uncertainties

Various software reliability growth models (SRGMs) have been developed to evaluate software reliability. Since software faults are caused by bugs in the logic of the code, which are introduced due to human errors, software faults embody lots of epistemic uncertainties. Under the framework of uncertainty theory, a software belief reliability growth model (SBRGM) was proposed. Actually, during software testing fault detection rate function may show multiple phases due to changes of testing strategies and resources allocation. Thus, fault detection rate function may be discontinuous at some time known as the change point. Noting that the previous SBRGM did not consider the change point, this paper construct a new SBRGM incorporating change point, named CPSBRGM. Based on the new proposed model, reliability for software is evaluated under the framework of belief reliability theory. Method to estimate unknown parameters in the proposed model is also provided. The new proposed model is validated on three datasets and compared with the previous SBRGM. Results show that the new proposed model can clearly distinguish the change point during software testing, and is more in line with the actual software test situation than previous model without considering change points.

Imperfect Debugging-Based Generalized Exponential Testing Effort Estimation for Software Fault Detection and Removal

In the current technological era, the reliability growth model depicts the failure in software that is employed for estimating the reliability of software. Conventional software reliability growth model (SRGMs) usually presume that faults in software are immediately corrected once a software fault is found and no new faults are introduced. This consideration can be impractical. However, introduction of several new faults is possible throughout debugging, which is called imperfect debugging. During such a process of debugging and introduction of new faults, consumption of testing effort also plays an important role. Hence, in this paper, two models are proposed that incorporate testing effort along with imperfect debugging during fault correction. Additionally, the combined testing effort is the addition of two efforts, specifically detection effort as well as correction effort. The formulated models are validated for real data set and contrasted with additional famous SRGMs. These inferences indicate that Model 2 performs best in terms of fitting and prediction capability.

Software Reliability Growth Model for N-Version Fault Tolerant Software with Common and Independent Faults

Research and development teams have become increasingly focused on developing highly reliable software for safety-critical systems. It is a major challenge for real-time control systems to achieve high reliability software to meet safety standards. A reliability evaluation focuses primarily on analytical and modeling techniques for fault prediction. In safety-critical systems like nuclear plant controls, aircraft controls and railroad signalization systems, N-version programming (NVP) is an effective technique for raising software’s reliability, particularly in areas with high-risk ratios because small errors can result in hazardous incidents. It allows the software to be fault-tolerant, aiding it to produce accurate results even when the software has faults. We present an analytical method for assessing the reliability of N-version software systems. Analysis of the system’s reliability and other performance metrics is provided with closed-form expressions. As an additional extension, we conduct numerical analyses of two cases, the 2VP system and 3VP system, in which suitable parameters are used. We conduct numerical simulations using MATLAB to generate the analytical results and compare the analytical results by using numerical results and neuro-fuzzy results using fuzzy interference systems.

변환점을 가진 소프트웨어 신뢰성 성장모형의 비용 함수에 대한 민감도 분석

변환점을 가진 소프트웨어 신뢰성 성장모형의 비용 함수에 대한 민감도 분석

Study of a New Software Reliability Growth Model under Uncertain Operating Environments and Dependent Failures

The coronavirus disease (COVID-19) outbreak has prompted various industries to embark on digital transformation efforts, with software playing a critical role. Ensuring the reliability of software is of the utmost importance given its widespread use across multiple industries. For example, software has extensive applications in areas such as transportation, aviation, and military systems, where reliability problems can result in personal injuries and significant financial losses. Numerous studies have focused on software reliability. In particular, the software reliability growth model has served as a prominent tool for measuring software reliability. Previous studies have often assumed that the testing environment is representative of the operating environment and that software failures occur independently. However, the testing and operating environments can differ, and software failures can sometimes occur dependently. In this study, we propose a new model that assumes uncertain operating environments and dependent failures. In other words, the model proposed in this study takes into account a wider range of environments. The numerical examples in this study demonstrate that the goodness of fit of the new model is significantly better than that of the existing SRGM. Additionally, we show the utilization of the sequential probability ratio test (SPRT) based on the new model to assess the reliability of the dataset.

Software for "A Study on Optimal Release Schedule for Multiversion Software"

Research on software reliability growth models (SRGMs) has been extensively conducted for decades, and the models were often developed based on two assumptions: (1) once the errors are detected, they can be completely removed instantly, and (2) errors can be removed eternally, and the debugging tasks will not produce any new errors. How-ever, both assumptions are unrealistic. This study proposes an SRGM that ignores these restricted assumptions by introducing a detection process that may remove an error after a period of time once it has been detected and by considering imperfect debugging, which indicates that new errors may emerge through corresponding debugging tasks. In addi-tion, because software can be upgraded to respond on a timely basis to constantly changing consumer expectations and thus extend product life in the market, the proposed SRGM also considers software upgrades for the multiversion software, and a dynamic program-ming approach is used to effectively obtain the optimal release schedule with consideration of the constraint of budget. Real data sets are used to examine the effectiveness of the pro-posed model, and the fitting results show that the proposed model outperforms other existing models. The results of numerical validation indicate that the proposed dynamic programming method with information updating outperforms the sequential solution method in determining the optimal release time for each version. Moreover, decision makers should carefully evaluate the parameters because overestimating the parameters of the mean value functions will cause serious software risk due to excessively shortening the testing time.

A Study on Optimal Release Schedule for Multiversion Software

Research on software reliability growth models (SRGMs) has been extensively conducted for decades, and the models were often developed based on two assumptions: (1) once the errors are detected, they can be completely removed instantly, and (2) errors can be removed eternally, and the debugging tasks will not produce any new errors. However, both assumptions are unrealistic. This study proposes an SRGM that ignores these restricted assumptions by introducing a detection process that may remove an error after a period of time once it has been detected and by considering imperfect debugging, which indicates that new errors may emerge through corresponding debugging tasks. In addition, because software can be upgraded to respond on a timely basis to constantly changing consumer expectations and thus extend product life in the market, the proposed SRGM also considers software upgrades for the multiversion software, and a dynamic programming approach is used to effectively obtain the optimal release schedule with consideration of the constraint of budget. Real data sets are used to examine the effectiveness of the proposed model, and the fitting results show that the proposed model outperforms other existing models. The results of numerical validation indicate that the proposed dynamic programming method with information updating outperforms the sequential solution method in determining the optimal release time for each version. Moreover, decision makers should carefully evaluate the parameters because overestimating the parameters of the mean value functions will cause serious software risk due to excessively shortening the testing time. History: Accepted by Pascal Van Hentenryck, Area Editor for Computational Modeling: Methods & Analysis. Supplemental Material: The software that supports the findings of this study is available within the paper and its Supplemental Information ( https://pubsonline.informs.org/doi/suppl/10.1287/ijoc.2021.0141 ) as well as from the IJOC GitHub software repository ( https://github.com/INFORMSJoC/2021.0141 ). The complete IJOC Software and Data Repository is available at https://informsjoc.github.io/ .

Quality Analysis of Software Applications using Software Reliability Growth Models and Deep Learning Models

Finding the faults in the software is a very tedious task. Many software companies are trying to develop high-quality software which is having no faults. It is very important to analyze the errors, faults, and bugs in software development. Software reliability growth models (SRGM's) are used to help the software industries to create quality software products. Quality is the software metric that is used to analyze the performance of the software product. The software product which is having no errors or faults is considered the best software product. SRGM is also utilized to analyze the software quality based on the programming language. Deep Learning (DL) is a sub-domain in machine learning to solve several complex issues in software development. Finding accurate patterns from software faults is a very tedious task. DL algorithm performs better in integrating the SRGM with the DL approaches giving better results based on software fault detection. Many software faults real-time datasets are available to analyze the DL approaches. The performances of the various integrated models are analyzed by showing the quality metrics.

Modeling Software Reliability with Learning and Fatigue

Software reliability growth models (SRGMs) based on the non-homogeneous Poisson process have played a significant role in predicting the number of remaining errors in software, enhancing software reliability. Software errors are commonly attributed to the mental errors of software developers, which necessitate timely detection and resolution. However, it has been observed that the human error-making mechanism is influenced by factors such as learning and fatigue. In this paper, we address the issue of integrating the fatigue factor of software testers into the learning process during debugging, leading to the development of more realistic SRGMs. The first model represents the software tester’s learning phenomenon using the tangent hyperbolic function, while the second model utilizes an exponential function. An exponential decay function models fatigue. We investigate the behavior of our proposed models by comparing them with similar SRGMs, including two corresponding models in which the fatigue factor is removed. Through analysis, we assess our models’ quality of fit, predictive power, and accuracy. The experimental results demonstrate that the model of tangent hyperbolic learning with fatigue outperforms the existing ones regarding fit, predictive power, or accuracy. By incorporating the fatigue factor, the models provide a more comprehensive and realistic depiction of software reliability.

Reliability of Self-Driving Cars: When Can We Remove the Safety Driver?

Self-driving cars and other vehicles are being increasingly demonstrated, released, and deployed on roads. Yet only a handful of special-case vehicles have obtained a permit to go fully driverless, and our passenger cars still require drivers at the steering wheel to correct the car if something goes wrong. Safety drivers, which operate autonomous vehicles in testing phases, upon occasions were unable to correct the faulty behavior of their vehicles, inducing accidents and, unfortunately, casualties. This article proposes a method to analyze the reliability of autonomous vehicles applying the classical reliability theory and software reliability growth models (SRGMs). This method is then applied to real-world data to get some predictions on what is really needed to safely remove the driver and go fully driverless.

Modeling the Role of Testing Coverage in the Software Reliability Assessment

To assure the reliability and quality of the final product, testing is an essential and crucial part in the software development cycle. During this process, fault correction/detection activities are carried out to increase the reliability of the software. The non-homogeneous Poisson Process (NHPP) is the basis of the investigated software reliability growth models (SRGMs), which are based on the supposition that the number of faults found is affected by the amount of code covered during testing and that the amount of code covered during testing depends on the testing effort expended. This research takes into consideration several testing coverage functions: exponential, delayed S-shaped and logistic distributions, to propose three SRGMs that are based on testing efforts. For testing effort expenditure Weibull distribution has been employed. Two real failure datasets have been utilised to validate the proposed models, and their performance is evaluated using four goodness-of-fit metrics, including predictive ratio risk (PRR), coefficient of determination (R^2 ), predictive power (PP) and mean square error (MSE). Sensitivity analysis of cost requirement-based release time of software for exponential function has been done by using a genetic algorithm, which minimized the overall cost of the software subject to the requirement for reliability.