Software Functional Testing Research Articles

Implementation Approach of Unit and Integration Testing Method Based on Recent Advancements in Functional Software Testing

Implementation Approach of Unit and Integration Testing Method Based on Recent Advancements in Functional Software Testing

Integration testing for robotic systems

Conventional approaches for the validation of robotic systems include simulations and functional software testing. Although these approaches are interesting, they do not offer coverage information to guide the testing activity. In this sense, the introduction of coverage testing to the validation of mobile robotic systems seems to promise. This paper proposes a integration testing approach for robotic systems in a simulation environment. The approach is composed of test scenarios, constructed based on functional testing, and structural testing towards revealing defects and providing a better systematization of the testing activity in this application domain. The proposed approach focuses on systems developed in ROS, the robot operating system, in which communication can be established through a publish/subscribe interaction schema. The paper provides an example of the way the integration testing approach can be applied to robotic systems. An experimental study conducted with developers of mobile robotic systems evaluated the gains and proved the applicability of the approach to the industry. The results confirmed its advantages for the integration testing of mobile robotic systems. It can check functional behavior (test scenarios), or reach a high structural coverage (coverage criteria), and reveal common defects in mobile robotic systems.

Design and Application of a Test System for Ship Platform

Aiming at the problems of single function, poor integration and low expansion performance of the traditional test and test tools for ship platforms, an integrated test and test system based on an integrated and distributed architecture is designed and studied. Through the index system construction, system (equipment) test evaluation, data modeling and simulation, we develop an integrated simulation test platform, support the software and hardware functional test and test of ship platform system equipment, support the generation of test data, and comprehensive evaluation of equipment capabilities.

Integration and Verification Approach of ISTSat-1 CubeSat

Large-scale space projects rely on a thorough Assembly, Integration, and Verification (AIV) process to provide the upmost reliability to spacecraft. While this has not traditionally been the case with CubeSats, their increasing role in space science and technology has led to new verification approaches, including in educational CubeSats. This work describes the integration and verification approach for ISTSat-1, which is an educational CubeSat from the Instituto Superior Técnico in Portugal that partially discards the typical stage-gate approach to spacecraft development in favor of a more iterative approach, allowing for the system-level verification of unfinished prototypes. Early verification included software functional testing on a flatsat model, thermal vacuum and vibration testing on a battery model, ionizing radiation testing on the on-board computer, and non-ionizing radiation (EMC) testing on all subsystems. The testing of functional prototypes at an early development stage led to uncovering system-level errors that would typically require hardware redesign at a later project stage. The team considers the approach to be useful for educational projects that employ a small, co-located team with low non-recurring engineering costs.

Automatic localisation method for VLSI topology errors at the stage of functional control

The paper substantiates the urgency of the task of increasing the level of automation of functional testing of integrated structures that implement ultra-large integrated circuits (VLSI). To solve this task, there is proposed an original route designing and testing VLSI. This route for the first time implements the idea of automatically localising erroneous places in the topology of the integra structure. It is shown that the reasons for which up to now it was not possible to avoid developer intervention in the chain of operations of the algorithm-topology of cycle is to repeatedly convert formats and convert tests leading to the loss of debug information. The reasons for the loss of this information are analysed in detail and methods are proposed for restoring, more precisely, preventing informational disconnection between the mathematical and topological model of VLSI. To solve the problem of localisation of erroneous places in the VLSI topology, the paper presents a software and hardware complex based on the original software Functional Test Studio (FT Studio). FT Studio allows you to automate the verification of almost all types of VLSI, the composition of which is determined by the current standard OST B 11.073.012-87 Integrated Circuits. Special general technical conditions, including qualification and VLSI test tests. Software FT Studio leads the route of functional control of microcircuits to a new, higher level of automation. At this route the connection of the mathematical and topological model of VLSI is preserved within of the unified information environment. The latter relies on a powerful apparatus of the original object- and hardware oriented language Smirnov Test Electrical Exposition Language (STeeL), which supports the multiplatform nature of technological equipment. For the implementation and maintenance of the communication between an algorithm and topology VLSI, there are using language of interoperative exchange RSTL and system for analysing the results of measurements Lorenz, which perform automatic conversion and correct inter-unit information transfer from stage to stage.

A controlled experiment on time pressure and confirmation bias in functional software testing

ContextConfirmation bias is a person’s tendency to look for evidence that strengthens his/her prior beliefs rather than refutes them. Manifestation of confirmation bias in software testing may have adverse effects on software quality. Psychology research suggests that time pressure could trigger confirmation bias.ObjectiveIn the software industry, this phenomenon may deteriorate software quality. In this study, we investigate whether testers manifest confirmation bias and how it is affected by time pressure in functional software testing.MethodWe performed a controlled experiment with 42 graduate students to assess manifestation of confirmation bias in terms of the conformity of their designed test cases to the provided requirements specification. We employed a one factor with two treatments between-subjects experimental design.ResultsWe observed, overall, participants designed significantly more confirmatory test cases as compared to disconfirmatory ones, which is in line with previous research. However, we did not observe time pressure as an antecedent to an increased rate of confirmatory testing behaviour.ConclusionPeople tend to design confirmatory test cases regardless of time pressure. For practice, we find it necessary that testers develop self-awareness of confirmation bias and counter its potential adverse effects with a disconfirmatory attitude. We recommend further replications to investigate the effect of time pressure as a potential contributor to the manifestation of confirmation bias.

Functional Software Testing for Web Applications in the Context of Industry

Functional Software Testing for Web Applications in the Context of Industry

A Review of Random Test Case Generation using Genetic Algorithm

Background/Objectives: This research paper presents how Genetic algorithm is efficiently used in random test case generation during functional software testing. Methods/Statistical Analysis: Different hybridized Genetic Algorithms are used to generate test data automatically and optimized those test cases to solve many complex problem related to software testing. Findings: Genetic Algorithms are successfully used in software testing with increasing number of test case generation and provides a means of an automatic test case generator. Applications/Improvements: This study gives us a brief idea to implement Genetic Algorithms in software testing for optimum results and also it can be used with the neural networks and fuzzy systems for different types of testing to improve the performance.

Estimation Models for Software Functional Test Effort

The International Software Benchmarking and Standards Group (ISBSG) data-base was used to build estimation models for estimating software functional test effort. The analysis of the data revealed three test productivity patterns representing economies or diseconomies of scale and these patterns served as a basis for investigating the characteristics of the corresponding projects. Three groups of projects related to the three different productivity patterns, characterized by domain, team size, elapsed time and rigor of verification and validation carried out during development, were found to be statistically significant. Within each project group, the variations in test effort can be explained, in addition to functional size, by 1) the processes executed during development, and 2) the processes adopted for testing. Portfolios of estimation models were built using combinations of the three independent variables. Performance of the estimation models built using the function point method innovated by the Common Software Measurement International Consortium (COSMIC) known as COSMIC Function Points, and the one advocated by the International Function Point Users Group (IFPUG) known as IFPUG Function Points, were compared to evaluate the impact of these respective sizing methods on test effort estimation.

Achievement of minimized combinatorial test suite for configuration-aware software functional testing using the Cuckoo Search algorithm

ContextSoftware has become an innovative solution nowadays for many applications and methods in science and engineering. Ensuring the quality and correctness of software is challenging because each program has different configurations and input domains. To ensure the quality of software, all possible configurations and input combinations need to be evaluated against their expected outputs. However, this exhaustive test is impractical because of time and resource constraints due to the large domain of input and configurations. Thus, different sampling techniques have been used to sample these input domains and configurations. ObjectiveCombinatorial testing can be used to effectively detect faults in software-under-test. This technique uses combinatorial optimization concepts to systematically minimize the number of test cases by considering the combinations of inputs. This paper proposes a new strategy to generate combinatorial test suite by using Cuckoo Search concepts. MethodCuckoo Search is used in the design and implementation of a strategy to construct optimized combinatorial sets. The strategy consists of different algorithms for construction. These algorithms are combined to serve the Cuckoo Search. ResultsThe efficiency and performance of the new technique were proven through different experiment sets. The effectiveness of the strategy is assessed by applying the generated test suites on a real-world case study for the purpose of functional testing. ConclusionResults show that the generated test suites can detect faults effectively. In addition, the strategy also opens a new direction for the application of Cuckoo Search in the context of software engineering.

Modelo formal de pruebas funcionales de software para alcanzar el Nivel de Madurez Integrado 2

<span>Las aplicaciones de software son cada vez más importantes para las organizaciones debido a que permiten llevar <span>a cabo efiientemente sus tareas primordiales; por ello es mandatorio realizar las pruebas de calidad de software. <span>Esta investigación se enfocó en diseñar un modelo formal para desarrollar pruebas funcionales de software que <span>permitan alcanzar el nivel de calidad 2 del Modelo de Madurez de Pruebas Integrado (TMMI). El proceso se <span>inició con un diagnóstico situacional, aplicando la norma ISO-9001-2000; luego, se evaluaron diversos modelos <span>de prueba de calidad de software, como el ISO/IEC 9126, el TMM, el TMMI, el Proceso de Mejoramiento de <span>Pruebas (TPI) y el Enfoque de Gestión de Pruebas (TMAP), realizando una comparación bajo algunos criterios <span>como año de publicación, licenciamiento, niveles, factorías y riesgos. Con esta información se diseñó el modelo <span>propuesto, que es independiente del proceso de desarrollo de software. Concretamente, se fundamentó en el ciclo <span>de prueba, y se compone de cuatro fases: Especifiación, Planifiación, Ejecución y Evaluación, en el que se <span>contrasta en forma real el comportamiento esperado del software. Como caso de estudio y validación se aplicó <span>este modelo a una PYME; los resultados mostraron la efiiencia del modelo y revelaron que es preciso desarrollar <span>una cultura de calidad organizacional en esta empresa.</span></span></span></span></span></span></span></span></span></span></span></span><br /><br class="Apple-interchange-newline" /></span>

실사용 인터페이스를 이용한 열차제어 소프트웨어 테스팅 도구의 구조

열차제어시스템은 최근의 컴퓨터 기술의 발달에 따른 자동화 및 지능화에 따라 소프트웨어에의 의존성이 더욱 증가하고 있으며, 동시에 소프트웨어의 오류 내재 가능성이 높아지고 실제 장애발생으로 인한 위험비용도 증가하고 있다. 이에 따라 열차제어시스템 소프트웨어의 무결성 검증이 매우 중요한 이슈가 되고 있으며, 이 중에서 열차제어 소프트웨어 기능안전성 검증을 위한 블랙박스 테스팅 도구의 필요성이 제기되고 있으나, 기존 상용도구들은 사용하기 어렵고 복잡하여 실제 현장에서 적용이 거의 되지 않고 있다. 본 논문에서는 이러한 분석을 바탕으로 열차제어시스템 소프트웨어 기능안전성 검증을 위한 실제 사용하고 있은 인터페이스를 통한 새로운 개념의 블랙박스 테스팅 도구를 제안하였다. 현재 제안한 도구의 설계 및 프로토타입이 개발되어 열차제어시스템 소프트웨어 테스팅에 시범적용 중에 있다. Many railway signalling functions have increasingly depended on computer software with recent development in computing technology, leading to evolution into more flexible and intelligent railway signalling system. Meanwhile, software programs are likely to have many errors and the cost incurred by such errors has increased. Especially, if fatal software error occurs during railway operation, it may result in loss of lives. So the software verification and validation have become more important. It is needed for software functional safety tool to support these, but most commercial tools depend on direct access to the system's memory, resulting in many difficulties in application. Owing to such difficulties and complexity, they are rarely used in railway signalling system software validation. In this study, a new testing tool for software functional testing through an external interface that can be easily used in functional testing of software was developed. Such testing tool allows development and analysis of test cases for black-box testing through analysis of actually used interface protocols, leading to increased user convenience.

Test Purpose Oriented I/O Conformance Test Selection with Colored Petri Nets

This paper proposes an input-output conformance (IOCO) test selection method directed by test purpose model specified with colored Petri nets (CPN). Based on conformance testing oriented CPN models for specifying software functional behaviors and specific test purposes, respectively, feasible test cases are generated, guided by the CPN based IOCO relation, using synchronized model simulation with the proof of the soundness of test generation and the coverage towards test purposes. This test selection method integrates the merits the IOCO testing theory and the CPN modeling synergistically and is applied as a novel and applicable test selection method for actual testing practice of large-scale software systems. As the synchronized model simulation with two CPN models is irrespective of their model scale, the effectiveness and practicability of our test selection method are enhanced with scalability.

MSMAM: Testing resources allocation, obtaining non-functional indexes based on functional testing results, and evaluating security

Security testing is a key technology for software security. The testing results can reflect the relationship between software testing and software security, and they can help program designers for evaluating and improving software security. However, it is difficult to describe by mathematics the relationship between the results of software functional testing and software nonfunctional security indexes. In this paper, we propose a mathematics model (MSMAM) based on principal component analysis and multiattribute utility theory. This model can get nonfunctional security indexes by analyzing quantized results of functional tests. It can also evaluate software security and guide the effective allocation of testing resources in the process of software testing. The feasibility and effectiveness of MSMAM is verified by experiments.

범용 개발 보드를 이용한 차량용 소프트웨어 테스트 시스템 개발

Recently automotive software has been more complex and needs to be reduced its development time. Software testing of its functionalities and performance should be conducted in an early development phase to reduce time to market and the development cost. Software functional testing can be performed through simulating the hardware, but it is not guaranteed that evaluation of real-time performance using simulation has enough accuracy. Real-time performance can be precisely evaluated with hardware-in-the-loop simulation, but it costs time and effort to set up hardware for testing. In this paper, we suggest a testing system that can evaluate functional requirements and real time properties with a general-purpose development board in the early development phase. In addition, we improve reusability of the testing system through modularized and layered architecture. With the proposed testing system we can contribute to building reliable testing system at low cost without difficulty.

Application of Project-Driven Teaching Model on Software Functional Testing

in order to efficient and rapid training student mastery the all aspects application skills of software test, it was adopted project-driven teaching method to teach based on the characteristic of software test theory knowledge and operation requirements of job. This essay is main introduced that study and application of function testing teaching of software testing by project-driven teaching method. It is proved the method obtained good teaching results in fact teaching.

Composing software components: a software-testing perspective

Software components and component-based software development (CBSD) are acknowledged as the best approach for constructing quality software at reasonable cost. Composing Software Components: A Software-testing Perspective describes a 10-year investigation into the underlying principles of CBSD. By restricting attention to the simplest cases, startling results are obtained: Components are tested using only executable code. Their behavior is recorded and presented graphically. Functional and non-functional behavior of systems synthesized from components are calculated from component tests alone. No access to components themselves is required. Fast, accurate tools support every aspect of CBSD from design through debugging. Case studies of CBSD also illuminate software testing in general, particularly an expanded role for unit testing and the treatment of non-functional software properties. This unique book: Contains more than a dozen case studies of fully worked-out component synthesis, with revealing insights into fundamental testing issues. Presents an original, fundamental theory of component composition that includes persistent state and concurrency, based on functional software testing rather than proof-of-programs. Comes with free supporting software with tutorial examples and data for replication of examples. The Perl software has been tested on Linux, Macintosh, and Windows platforms. Full documentation is provided. Includes anecdotes and insights from the authors 50-year career in computing as systems programmer, manager, researcher, and teacher. Composing Software Components: A Software-testing Perspective will help software researchers and practitioners to understand the underlying principles of component testing. Advanced students in computer science, engineering, and mathematics can also benefit from the book as a supplemental text and reference.

Software Functional Testing from the Perspective of Business Practice

Industrial firms build their respective value chains by purchasing and tailoring core software to their specific business scenarios. Software functional testing is an indispensible element in the software implementation cycle. To achieve the two major aims of the functional testing, namely effectiveness and economics, business specialist, requirements analysts and the testing team should work together closely. To perform the functional testing, business requirements must be extracted and a number of recommended black-box testing methodologies should be used. Successful testing activities should enlist the support from test plans and test tools.

Distribution-based statistical sampling: An approach to software functional test

Software testing uses both structural and functional strategies to ensure the delivery of quality products. Structural testing checks the implementation of the software design, whereas functional testing validates the correct implementation of the specified software requirements. Exhaustive functional testing for software of any reasonable complexity is recognized as being impractical; therefore, sampling strategies must be introduced to prioritize and optimize the requirements validation. Recent work with statistically based sampling techniques shows a potential for the systematic validation of requirements with the use of representative inputs from the software's planned operating environments. This article discusses the need for sampling strategies in functional testing, the characteristics of and experience with a statistical sampling approach, and the impact of a statistical approach on the functional test process.

A survey of software functional testing methods

Functional testing is used to find disagreement between the specifications and the actual implementation of the software systems. The method of representing the specification can help to detect inconsistency and incompleteness in it. The various specification representation schemes are outlined in the paper. The basic technique of functional testing of software systems is the black box technique. This technique generates the test data using the information contained in the program's specification, independent of the implemented program's code. Black box testing cannot discover errors contained in the functions which are not mentioned explicitly in the specification. Therefore, a program dependent testing is necessary to discover this type of errors. The paper surveys the different methods of generating test data for both techniques; the black box and the program dependent techniques.