A Pilot Study: A Statistical Analysis for the Crowdsourced Design Evaluation Results based on the cDesign Framework

Abstract

In recent years, the “power of the crowd” has been repeatedly demonstrated and various Internet platforms have been used to applied collaborative intelligence to areas that range from open innovation to conceptual design. However, crowdsourcing applications in the fields of design research and creative innovation have been much slower to emerge. Although reported work has been suggested that designs can be improved by applying the crowdsourced design methodology, such as Crowdsourced Design Framework, its evaluation process is still required to be analyzed. In this paper, the statistical analysis methods, normal probability plots, are used to validate the crowdsourced design evaluation results in the crowdsourced design case study of living room layout design task. The discussion about the ranking distributions and results suggested that in the living room layout design task, standard distribution trendlines and $\mathbf{r}^{2}$ results proves the effects of the ranking evaluation method used in the case study. The distribution determines that the evaluation process and results matched a normal distribution. As the contribution to knowledge, this paper applies the statistical analysis method to measure and approve the crowdsourced design evaluation method and its results.