Performance Test Generation Research Articles

An automated model‐based approach for unit‐level performance test generation of mobile applications

AbstractMobile devices have limited resources, including memory and processing speed. The performance of mobile applications is an important concern. There are a large number of mobile platforms available with varying operating systems and hardware. Native applications are usually developed and maintained separately for these platforms. The overall performance of native applications may significantly vary across platforms. The current industrial practice is to manually test the performance for each variant, which is not a scalable or efficient approach. We tackled the problem of generating native application variants in our previous work. This paper proposes an automated model‐based approach for performance test generation for native application variants at unit level. We propose a performance profile that allows modeling of domain‐specific performance parameters on UML models, which are used for automated performance test generation for each native variant. The results of applying the approach on two real‐world applications show that the approach evaluates the performance of application variants for two different versions of Android successfully and have potential to reduce the effort and time. A questionnaire‐based study is conducted to evaluate the usefulness of the approach.

Fast Identification of Undetectable Transition Faults under Functional Broadside Tests

This paper describes a fast procedure for identifying undetectable transition faults under functional broadside tests. By using reachable states as scan-in states, functional broadside tests avoid overtesting that may occur when scan-based tests are used for detecting delay faults. The proposed procedure is based only on logic simulation, and does not perform test generation of any type. In one of its variations, the procedure uses logic simulation of fully unspecified primary input vectors starting from a known initial state in order to identify a superset of broadside tests that covers all the functional broadside tests. It then uses this superset to identify undetectable transition faults. The procedure identifies large numbers of undetectable transition faults in certain benchmark circuits.

Geração de Testes de Desempenho e Estresse a partir de Testes Funcionais

Despite the fact that the software testing is related to quality assurance, in order to save time and resources, it is not performed in part of software projects. In the organizations where testing is performed it can be seen that functional testing is getting more common and that the stress and 1 UFPI/DIE, Teresina-PI, {ismayle,pasn}@ufpi.edu.br 2 UFMG/DCC, Belo Horizonte-MG, rodolfo@dcc.ufmg.br Geracao de Testes de Desempenho e Estresse a partir de Testes Funcionais RITA • Volume 17 • Numero 2 • 2010 175 performance tests are scarcely performed despite the increment of web-based systems where the latter are considered essential. In this article it is proposed a method and its supporting tool for stress and performance test generation of web based systems, in order to facilitate the execution of non-functional testing. The stress and performance test generation takes advantage of functional tests. Experimental studies are also presented showing that the method and the tool can generate overall effort reduction for these tests

Approach of Degenerate Test Set Generation Based on Secure State Transition

在总结前人工作的基础上,结合安全操作系统对测试的特殊需求,提出了简并测试集(degenerate test set,简称DTS)的概念,设计了一种使用模型检测的基于安全状态转移的高效测试集生成方法.该方法以状态转移为化简对象,在利用模型检测技术生成测试用例的同时,归并相同的状态转移并化简需求集中的冗余属性,从而最终达到化简测试集的目的.在此基础上,探讨了单个用例失败时用例集的有效性问题,并对DTS 生成算法进行了改进.实验结果表明,该方法可以有效地对测试集中的冗余进行化简.

Incorporating Performance Testing in Test-Driven Development

Our performance-testing approach required manually inspecting the performance logs. During the project's development, JUnit-based performance testing tools, such as JUnitPerf, weren't available. Such tools provide better visibility of performance problems than manual inspection of performance logs. Although we believe manual inspection of performance trends is necessary, specifying the bottom-line performance in assert-based test cases can complement the use of performance log files, making the TFP testing results more visible to the developers. We're investigating the design of assert-based performance testing to improve the TFP process. Another direction of future work is automatic performance test generation. In this project, we relied on the performance architect's experience to identify the execution paths and measurement points for performance testing. We can derive this crucial information for performance testing from the performance requirements and system design. We plan to find guidelines for specifications of performance requirements and system design to make the automation possible

On the Acceleration of Test Generation Algorithms

In order to accelerate an algorithm for test generation, it is necessary to reduce the number of backtracks in the algorithm and to shorten the process time between backtracks. In this paper, we consider several techniques to accelerate test generation and present a new test generation algorithm called FAN (fan-out-oriented test generation algorithm). It is shown that the FAN algorithm is faster and more efficient than the PODEM algorithm reported by Goel. We also present an automatic test generation system composed of the FAN algorithm and the concurrent fault simulation. Experimental results on large combinational circuits of up to 3000 gates demonstrate that the system performs test generation very fast and effectively.