Evaluating Mobile Applications in Virtual Environments

Abstract

Context plays a central role in mobile applications but is very difficult to control, and therefore, the evaluation of context-aware applications can be challenging. Traditionally, researchers had to choose either field-based or lab-based studies but recently, virtual environments have been proposed as a middle-ground between those two methods. In this paper, the authors review previous work on using virtual environments to evaluate mobile applications. the authors identify and classify different approaches to simulate specific aspects of the real world, and analyse their relative properties with respect to evaluating different facets of context-aware mobile applications. Based on this analysis, the authors derive criteria and selection strategies that can help researchers in picking specific evaluation approaches. The authors also point out a number of research challenges in this area as well as a number of promising areas for future research.