A Test Harness for Networked Mobile Applications and Middleware

Abstract

Ensuring that mobile device applications are free from bugs is difficult. The difficulty stems, in part, from the unpredictability inherent in the use of multiple mobile networks. Testers typically design and run tests to discover bugs, modify the software and then re-run the test to demonstrate the bug's absence. However, when using wireless networks, it is difficult to recreate the original operating conditions to re-run the test. Other challenges associated with testing software for mobile applications include determining the effects of adding concurrent devices to a system, and the need to manage user interaction during testing. In this paper, we introduce the Odin Test Harness, which is a tool that facilitates a simulated and controlled execution environment for testing middleware and application software involving mobile devices. In particular, the tool provides for fine-grained control over network characteristics including bandwidth, packet loss rates, latency and network interface availability. Moreover the test harness allows mobile apps to be programmatically manipulated, simulating user input, during test execution. Furthermore, the test harness enables testers to simulate load on the system and to help determine its scalability. We have evaluated the test harness' on our middleware platform for hosting mobile services and a healthcare monitoring application. The test harness has been found to be useful in finding bugs that would otherwise remain elusive. In particular, the tool's support for repeatable tests, tests that involve multiple devices, and tests that require user interaction has readied the healthcare application for use in a clinical trial.