Using the case survey method to explore engineering practices in software start-ups

Abstract

Software start-ups are a new and relatively unexplored field for software engineering researchers. However, conducting empirical studies with start-ups is difficult. Start-ups produce very little hard evidence, thus data collection methods are limited to interviews and surveys. These methods come with their limitations, namely interview studies are not scalable to a large number of companies, and surveys are not generally applicable for exploratory studies. In this paper we present of a hybrid research method aimed to provide a compromise between breadth of a survey and depth of an interview study. The case survey method enables both qualitative and quantitative analysis of studied cases. We adapt the case survey method for use in primary studies and report experience with its application. The case survey method was successfully applied to design and launch a large scale study into engineering aspects of start-ups. We conclude that the case survey method is a promising research method to launch exploratory studies into large samples of start-up companies.