Test Execution Time Research Articles

Impact of Critical Success Factors on Productivity Gain during Automation Testing

Software testing, a linchpin of quality assurance in software development, encompasses both manual and automation approaches. While manual testing ensures meticulous scrutiny, automation accelerates efficiency, reducing time and costs in dynamic landscape of software development. This research investigates the impact of critical success factors on productivity gain in software testing, with a focus on automation, within CMMI Level 5 companies. Drawing from a dataset comprising thirty real-time projects spanning banking, retail, and industrial applications, study explores dynamics of software development under agile and waterfall models. Interviews with developers and testers reveal insights into key aspects influencing productivity, including skills, experiences, and training. Emphasizing the need for strategic automation in projects subject to changes and maintenance, the research analyzes over thirty projects, scrutinizing variables such as manually designed test cases, execution time, and subsequent automation of test cases. Strategic selection of test cases for automation emerges as a cost-efficient practice. Results highlight a correlation between manual and automated test cases, indicating productivity gains. Research introduces a productivity gain metric, showcasing a break-even point where automation significantly reduces testing time. Overall, the findings offer a comprehensive understanding of software testing within CMMI Level 5, guiding organizations toward efficient automation practices and improved productivity.

CIPerf: a benchmark for continuous integration services performance and cost analysis

Continuous Integration is a crucial practice in modern software development, enabling teams to automate the process of building, testing, and merging code increments to ensure continuous delivery of high-quality software. Despite its growing adoption, the cost and performance of Continuous Integration services often go unexamined in sufficient detail. This paper presents CIPerf, a comprehensive benchmark designed to analyze both the performance and cost of cloud-based and self-hosted Continuous Integration services. The study centers on a comparison between two specific services: Bitbucket Pipelines, a cloud-based offering by Atlassian, and Hetzner, a self-hosted solution. By focusing on these platforms, the research aims to provide practical insights into the real-world costs and execution performance of Continuous Integration services. To achieve this, CIPerf conducted automated tests on an hourly basis over a two-month period, measuring critical timeframes such as resource provisioning, environment setup, and the actual test execution times. The results showed significant differences in both the cost efficiency and the consistency of performance between the two services. For instance, Bitbucket Pipelines, while convenient in its cloud-based offering, demonstrated higher variability in provisioning times compared to the stable, predictable performance of Hetzner’s self-hosted environment. The analysis also explored how these performance metrics influence key software development metrics, including deployment frequency and developer productivity. CIPerf provides a clear methodology for developers and organizations to objectively assess their Continuous Integration service options, ultimately helping them optimize their workflows. Moreover, this benchmark can serve as an ongoing tool to monitor service performance over time, identifying potential degradations or improvements in service quality, thus offering longterm value for teams that rely on Continuous Integration for their development processes.

Assessment of lower limb proprioception after fibula free flap harvest: A pilot study.

After undergoing fibula-free flap harvest, patients may experience complications such as ankle instability. It remains unclear whether these patients have deficits of proprioception, and the recovery process is also uncertain. This study aimed to objectively evaluate proprioception on the donor and normal side of surgical patients during long-term follow-up using the Pro-kin system. This study enrolled 36 patients who underwent reconstruction of the head and neck using osseous free flaps harvested from the fibula. Each patient underwent pre-operative evaluations and was subsequently evaluated at postoperative months 1, 3, 6, and 12. The study assessed the proprioceptive evaluation of the lower limbs, muscle function, range of motion of the ankle, and donor side complications. On the donor side, the average trace error (ATE) at postoperative month 1 was significantly higher than pre-operation, postoperative months 6 and 12 (P< 0.05). The test execution time (TTE) at postoperative month 1 was significantly increased by 9.875s compared to the pre-operative levels (P= 0.012, 95% confidence interval [CI] 4: 1.877-17.873) and by 11.583s compared to postoperative month 12 (P= 0.007, 95% CI: 2.858-20.309). The reduction in range of motion of ankle dorsiflexion was most pronounced at postoperative month 1, exhibiting an 11.25∘ decrease compared to pre-operative levels (P< 0.001, 95% CI: 6.304-16.16). Although the range of motion of ankle dorsiflexion gradually improved over time at postoperative months 3, 6, and 12, it remained lower than pre-operative levels (P< 0.05). The study revealed that the patients exhibited proprioceptive disturbances in both lower limbs at postoperative month 1. The proprioceptive function gradually improved over time, with a gradual decrease in donor site complications.

E2E test execution optimization for web application based on state reuse

AbstractEnd‐to‐end (E2E) testing is a commonly used technique for web application testing. Unlike traditional unit tests, E2E tests focus on test scenarios that target the entire business, which integrate and collaborate of various components and services to make the whole application work. As a result, one drawback of E2E tests is their longer execution time, seriously affecting testing efficiency of web applications. In order to speed up the execution of E2E tests for web applications, this paper proposes a test execution optimization approach based page state reuse. Through analyzing the common operations of E2E tests, a common prefix trees is constructed to organize the same operations among test scripts in a test suite of web applications. Under the guidance of the prefix tree, the optimal reusable state is identified and duplicated to maximize the utilization of page states triggered by the same operations, thereby reducing the overall execution time of the test suite. Besides, to realize page state reuse automatically, we design a browser process replication strategy, which implement querying the active page and duplicating the web page. To verify the effectiveness of our method, experiments and evaluations were conducted on 347 E2E tests from eight open‐source web applications, and the results showed that our approach reduced the E2E testing execution time for web applications by 52%–68%.

The Computerized Developmental Eye Movement (DEM) Test: Normative Data for School-Aged Children.

The aim of the study was to determine the normative data of the computerized DEM test for school-age children in Latvia. The study analyzed data on the performance (test execution time, duration, number of fixations, and number of errors) of 291 children while completing the computerized DEM test. Eye movement fixations were recorded with a Tobii Pro Fusion video-oculograph (250 Hz). According to the results of the study, the performance of the computerized DEM test is 77 %. For the study, 1 SD (one standard deviation) was chosen as a criterion for determining test norms. In the study, the norms of the computerized DEM test in Latvia were developed in class groups-from 1st to 6th grade (aged 7 to 12 years), the results were summarized in a table as the minimum performance values of the computerized DEM test.

Investigation of crypto-algorithms for Stability Assessment

Performance evaluation plays a vital role in the field of cryptography. It is essential to assess the security, efficiency, and suitability of different algorithms in various applications. By evaluating the performance of cryptography algorithms, we can identify vulnerabilities, weaknesses, and strengths, which are crucial for ensuring the integrity and confidentiality of sensitive data. Moreover, performance evaluation allows for benchmarking, algorithm selection, and continuous improvement in the field, driving advancements in cryptography techniques and enhancing the overall security of systems that rely on cryptography. This paper implements a test algorithm that can evaluate the performance of different parameters for a range of cryptography algorithms. The performance of input is evaluated using parameters such as the Avalanche effect, Correlation coefficient, Bit independence test, Frequency test, Encryption and decryption execution time, Throughput, Brute Force attack, and Information entropy. By comparing results obtained from the performance tests, we can gain valuable insights into the relative strengths and weaknesses of the algorithms. This aids in making informed decisions regarding algorithm selection and improvement, ultimately contributing to the advancement of secure communication and data protection.

The Influence of Personality Type D and Coping Strategies on Cognitive Functioning in Students.

Academic and emotional challenges faced by medical students can affect their psychological well-being and health. Personal characteristics may also predispose one to the manifestation of distress reactions. Individuals with type D personality have an increased tendency to develop depressive reactions and somatic diseases, including the presence of cognitive dysfunction. In students, the presence of cognitive dysfunction may additionally adversely affect academic and psycho-emotional problems. The purpose of this study was to examine the influence of type D personality and coping strategies on cognitive functioning in medical students. A cross-sectional study included 258 medical students (age 19 ± 1.2 years, 79 men). All participants completed psychological questionnaires (DS-14 to identify type D personality, and The Coping Strategy Indication, CSI-to determine coping strategies), as well as extensive neuropsychological testing of cognitive functions. Among the medical students examined, the frequency of identification of type D personality was 44%. In persons with personality type D, according to psychometric testing, a decrease in the level of functional mobility of nervous processes (FMNP) was noted, which was manifested in an increase in the test completion time (p < 0.001) and an increase in the number of errors (p < 0.001) during the FMNP test, and an increase in the test completion time in the attention concentration test. In addition, in type D participants, an increase in the test execution time during the attention test was noted (p = 0.007). Personality type D was an independent risk factor for cognitive decline in students in multiple linear regression analysis, when type D was analyzed as a dichotomous construct. Assessing personal characteristics and identifying personality type D is advisable for medical students, to develop subsequent programs to increase their resistance to academic challenges, improve cognitive function, and also to prepare for future stress loads during professional activities in the field of healthcare.

A novel test for hyposalivation using a sugar cube.

Hyposalivation is a highly prevalent condition in old persons. The aim of this study was to assess a novel tool for the diagnosis of hyposalivation using a sugar cube and to compare its reliability to other validated test methods. Five tests were performed: unstimulated salivary flow test by draining method (USFT), oral moisture device Mucus® (MCS), sugar cube test (SCT), stimulated salivary flow test by chewing gum (CG) and Saxon test (SX). The sugar cube test consisted in measuring the time needed to disintegrate a standard-sized sugar cube N°4 (5.6 g) placed beneath the tongue. Bivariate correlation analyses were performed. ROC curve analysis and the Youden Index were used to determine the cut-off value. Sensitivity and specificity were calculated according to the determined cut-off point. A total of 121 participants were recruited, with an average age of 49.8 ± 18.2 years. The USFT was best correlated with the SCT. No correlation was found between SCT and the stimulated saliva tests (CG, SX) as well as the MCS test. According to the Youden index, 140 s is appropriate to diagnose hyposalivation. Sensitivity of .64 and specificity of .91 were found for SCT using USFT as gold standard. The mean subjective evaluation score of the SCT was 3.1 ± 1, significantly higher than USFT 2.6 ± 1.1 (p < .05). The sugar cube test proved to be a useful method for assessing unstimulated salivation, reducing test execution time and causing less participant discomfort than the gold standard unstimulated salivary flow test.

Italian Fast Speech Reception Threshold Test: A New Method to Investigate Adult Auditory Impairment in Noise

Introduction: Purpose of our study was to compare two competing methods of performing bisyllabic word speech audiometry for the detection of the 50% speech reception threshold in noise (SRT50). Methods: Classic method is performed submitting multiple word lists at a fixed signal-to-noise ratio. A newer Fast method – Italian Fast Speech Reception Threshold 50 (IFastSRT50) – is performed by means of program software with a single list of bisyllabic words and noise intensity shifting. Results: Means comparison between SRT50 Classic and IFastSRT50 shows a slight significant correlation (r = 0.263; p = 0.044) and a wide significant difference: SRT50 Classic = −2.763 dB (SD = 4.1) and IFastSRT50 = −7.803 dB (SD = 2.1) (p < 0.0001). There is a high difference between the test execution time means (SRT50 Classic = 11 min, IFastSRT50 = 2 min; p < 0.0001). The correlation between test results and execution times was higher for SRT50 Classic than IFastSRT50. Conclusion: IFastSRT50 test is a reliable method to quickly investigate signal-to-noise ratio needed to obtain 50% of recognition scores with bisyllabic words; it allows less execution time than SRT50 Classic method and can avoid patient fatigue and other limitations of different speech discrimination tests in noise as sentences based ones.

Practical Improvement in the Implementation of Two Avalanche Tests to Measure Statistical Independence in Stream Ciphers

This study describes the implementation of two algorithms in a parallel environment. These algorithms correspond to two statistical tests based on the bit’s independence criterion and the strict avalanche criterion. They are utilized to measure avalanche properties in stream ciphers. These criteria allow for the statistical independence between the outputs and the internal state of a bit-level cipher to be determined. Both tests require extensive input parameters to assess the performance of current stream ciphers, leading to longer execution times. The presented implementation significantly reduces the execution time of both tests, making them suitable for evaluating ciphers in practical applications. The evaluation results compare the performance of the RC4 and HC256 stream ciphers in both sequential and parallel environments.

Regression Test Suite Study Using Classic Statistical Methods and Machine Learning

This work is interdisciplinary in nature. This work tries to apply latest discoveries in Artificial Intel-ligence to classic testing methodologies. Machine Learning which is the field of Artificial Intelligence is explored in this work. The work demonstrates that provided the test team maintains the required data, Machine Learning Algorithms can aid in deciphering patterns from the test data. Patterns of interest are the relation between testers experience in the project and bugs uncovered, relations between the testers experience and the efficiency of test case with respect to code coverage and test execution time. Relation between testers experience and efficiency of test case with respect to code coverage and execution time, relation between testers experience and bugs uncovered are explored using classic statistical techniques and clustering Machine Learning Algorithms. This clustering can be of immense help in test selection, prioritization, pruning and Regression test execution time reduction.

Quantification of Regression Test Suite Execution Time in Parallel Execution Setup with Weighted Test Suite Split Algorithm

Regression test suite execution time study focus is essentially on two aspects. They are execution time reduction and making effective use of available hardware resources and manpower. This paper investigates how the regression test suite can be split into subsets to make use of parallel execution across several machines with identical execution speeds and asymmetrical execution speeds. In the symmetrical execution speed setup, long test execution time test cases are evenly distributed across all the hardware machines. However, in asymmetrical execution speed machines, more test cases are distributed to speed machines to make efficient use of hardware resources. In all the situations where there is automation tool to execute the individual test cases of test suite this approach can be employed to make effective use of hardware resources and to keep the execution time within bounds. The Algorithms can also be used in situations where there are queues involved and serial, fixed time service takes place for each of the entity being served.

Quantification of Regression Test Suite Execution Time in Parallel Execution Setup with Weighted Test Suite Split Algorithm

Regression test suite execution time study focus is essentially on two aspects. They are execution time reduction and making effective use of available hardware resources and manpower. This paper investigates how the regression test suite can be split into subsets to make use of parallel execution across several machines with identical execution speeds and asymmetrical execution speeds. In the symmetrical execution speed setup, long test execution time test cases are evenly distributed across all the hardware machines. However, in asymmetrical execution speed machines, more test cases are distributed to speed machines to make efficient use of hardware resources. In all the situations where there is automation tool to execute the individual test cases of test suite this approach can be employed to make effective use of hardware resources and to keep the execution time within bounds. The Algorithms can also be used in situations where there are queues involved and serial, fixed time service takes place for each of the entity being served.

Mutation testing optimisations using the Clang front‐end

AbstractMutation testing is the state‐of‐the‐art technique for assessing the fault detection capacity of a test suite. Unfortunately, a full mutation analysis is often prohibitively expensive. The CppCheck project for instance, demands a build time of 5.8 min and a test execution time of 17 s on our desktop computer. An unoptimised mutation analysis, for 55,000 generated mutants took 11.8 days in total, of which 4.3 days is spent on (re)compiling the project. In this paper, we present a feasibility study, investigating how a number of optimisation strategies can be implemented based on the Clang front‐end. These optimisation strategies allow to eliminate the compilation and execution overhead in order to support efficient mutation testing for the C language family. We provide a proof‐of‐concept tool that achieves a speedup of between 2 and 30 . We make a detailed analysis of the speedup induced by the optimisations, elaborate on the lessons learned and point out avenues for further improvements.

Comparative analysis of selected tools for test automation of web applications

The paper concerns a comparison of selected tools for conducting automated unit tests of web applications. It focuses on the testing of server and client parts. The aim of the paper is to answer the questions: which tools work best in creating automatic tests of server and client applications. In the context of the server part, unittest and pytest – libraries based on the Python language – are compared. The comparison of the client part tools is carried out in the context of testing applications programmed with the Angular framework and pairs Jasmine and Jest together. The research is based on the results of test execution times of the prepared test applications. Analogous tests were programmed with each tool and repeated several times to obtain reliable results. The research showed that among the tools for testing server applications, unittest is the more efficient, while in the case of tools for testing client applications, Jasmine shows higher performance.

A-306 Standardization of Automated Methodology for Qualitative Molecular Detection of HIV-1 in Dried Blood Spots (DBS)

Abstract Background Human Immunodeficiency Virus (HIV) is the etiological agent of acquired immunodeficiency syndrome (AIDS) with more than 35 million people infected worldwide. Typically, after seroconversion, individuals enter a clinically stable and relatively asymptomatic phase that can last for years. Without antiretroviral treatment, individuals usually progress to AIDS, which is characterized by a decrease in CD4+ cells in the immune system, which increases the susceptibility to opportunistic infections and eventual death. Historically, HIV tests have relied on the antibody response that patients produce due to the virus infection. Although these antibodies are ineffective in combating the virus, they have been found in most chronically infected patients. In newborns, nucleic acid amplification tests can diagnose HIV infection during the first 18 months of a baby's life, while their blood still contains maternal antibodies and can result in a false-positive interpretation of serological tests. the availability of a diagnostic test capable of detecting HIV infection that offers flexibility, stability and ease of collection is of great importance. In this sense, the detection of HIV-1 in dried blood spots (DBS) represent a good strategy, with simple collection of sample and provides evidence of current infection using nucleic acid amplification technologies such as polymerase chain reaction (PCR). In this way, this work aimed to evaluate a qualitative test for detetion of HIV 1 in DBS. Methods Were selected 103 whole blood samples. The samples were tested from the qualitative HIV test (PCR In house) from the Pardini Group's Genetics sector. With the aid of a pipette, approximately 70 µl of blood from each sample were dispensed in duplicate, within the circle outlined on the DBS filter paper. DBS was previously identified with the sample data. The DBS with the sample was placed in a tray on a flat surface at room temperature (between 18 and 25°C) for at least 4 hours protected from direct light to dry. After drying, the pre-extraction of the sample was performed and later the samples were placed in the equipment on the cobas® 4800, using the COBAS HIV 1 kit (Roche diagnostics), (qualitative test) for extraction. After the extraction step was complete, the plate was transferred to the cobas z 480 analyzer for detection. All steps were performed according to the manufacturer's instructions. At the end of the tests, the results were compared between the in-house methodology and the cobas® HIV-1 qualitative test. Results The test cobas® HIV-1 qualitative test showed 100% agreement with the in-house methodology for 90/90 negative and 13/13 positive samples. When comparing the test matrix (whole blood or DBS), no significant differences were observed in relation to test sensitivity and specificity. In addition, test automation provided a substantial reduction in test execution time. Conclusion The availability of tests that use DBS as a matrix offer important advantages, especially for children and the elderly, due to greater stability, ease of sample collection and transport. The qualitative cobas® HIV-1 test in DBS has been shown to be a good choice for detecting HIV-1 in infected patients.

A Novel YOLOv5 Deep Learning Model for Handwriting Detection and Recognition

Computer Vision (CV) has become an essential field in Artificial Intelligence applications. Object detection and recognition (ODR) is one of the fundamental tasks of computer vision implementations. However, developing an efficient ODR model is still a significant problem. The model’s execution time and speed are the most critical features during the inference or detection and recognition process, which need to be improved using the latest object detection architectures. In this paper, the handwritten detection and recognition (HDR) model is developed based on previously known algorithms with their efficiency, such as Faster R-CNN and YOLOv4 in the first hand. On the other hand, two new models capable of detecting and recognizing handwritten digits using the latest ODR algorithm are proposed, one based on the latest YOLO family architecture (YOLOv5-HDR) with high speed and accuracy and the other using the transformers architecture (DETR). To the best of our knowledge, this is the first study to achieve a details comparison between YOLOv5 and transformers-based models in handwritten digit detection. Finally, the detailed performance analysis achieved by the paper proves that the YOLOv4-based model achieved the testing inference 13% faster than Faster R-CNN. However, the proposed YOLOv5-based model outperformed the YOLOv4 and the transformers-based one as it increased the testing execution time 25% faster than the YOLOv4, three times faster than the DETR model. A further adversarial attack test has been conducted to ensure the robust performance of the proposed model. Furthermore, numerical experiment results and their analyses demonstrate the robustness and effectiveness of the proposed YOLOv5-based model being the most stable for handwritten digit detection and recognition tasks.

Analisis Dan Implementasi Algoritma Rivest Code-5 Pada Keamanan Data

The RC-5 algorithm is an algorithm with the encryption method using the symmetric method and processing in the form of a cipher block, the same keywords are used for the encryption and decryption processes. The testing and analysis phase consists of a). Testing the execution time of the key generation process (set up key) b). Testing the success of the encryption and decryption process on the client-server integration method c). Testing the success of the encryption and decryption process using the file operation method d). Comparison of overhead/file size before and after passing through the system. The testing phase and execution time analysis are carried out when using the file operation method where the test will be divided into 3 parts, namely the execution time for the key setup process, the encryption process, and the decryption process. Testing the success of the encryption and decryption process on the client-server integration method is divided into 2 parts, namely testing the encryption process and the decryption process. In testing the encryption process, the characters that will be sent to the server will be encrypted first with a key to becoming a ciphertext in the form of integer data. The test results obtained are 1). The execution time for key generation (set up key) is very fast, around 9-10 ns. 2). In the encryption and decryption process, the execution time depends on the size of the plaintext file. The larger the plaintext file size, the longer the execution time. Where for a file with a size of 1 kb requires an execution time of 50.6 ms in the encryption process. 3). There is no difference between the size of the file before entering encryption and after decryption. Where for files with a size of 500 bytes before entering the encryption process, a file of 500 bytes will be generated from the decryption process.

IoT-Based Banknotes Saving Automation System

Many problems occur with traditional savings, such as users not knowing the nominal amount that has been saved later, and the authenticity of the money saved. To overcome this problem, the "Savings Storage Automation System with IoT-Based Banknotes" tool was created, this tool aims to help users save money easily and safely. The system design is based on Arduino Mega. The inputs on the Arduino Mega consist of a GY-33 TCS34725 as a color sensor and a keypad to perform functions. The output produced is in the form of nominal data of banknotes that can be seen by the user through an LCD and sent to a database, checking the authenticity of the money is done manually by using ultraviolet. The method used to identify the nominal banknotes is based on the reading of each RGB value and color temperature on each nominal banknote. The average accuracy of reading currency values on real banknotes reaches 88%, while in testing counterfeit banknotes it is 14%. Testing execution time when entering money into savings is 3.57 seconds and data to the database is 6.57 seconds.

Cost-effective test case generation with the hyper-heuristic for software product line testing

Implementation of optimization algorithm for test case generation in Model-Based Testing (MBT) for Software Product Line (SPL) has been increasing, due to the demand for optimal test case results with a balanced trade-off between cost and effectiveness measure. This paper proposed a hyper-heuristic test cases generation approach in MBT for SPL called Improvement Selection Rules-Modified Choice Function (ISR-MCF). ISR-MCF is implemented with three search operators which are Non-Dominated Sorting Genetic Algorithm II with low-level heuristic (NSGA-II-LLH), Strength Pareto Evolutionary with Low-Level Heuristic (SPEA 2-LLH) and Particle Swarm Optimization with Low-Level Heuristic (PSO-LLH). The approach was evaluated with a test model and the result shows that the proposed ISR-MCF with NSGA-II-LLH outperforms other existing rules for minimization measure (size of a test suite and execution time and maximization measure (coverage criteria).